2024-09-16T09:26:00.846 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-16T09:26:00.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T09:26:00.968 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053 branch: wip-athakkar-testing-2024-09-12-1857 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: athakkar@redhat.com first_in_suite: false job_id: '7907053' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-athakkar-testing-2024-09-12-1857 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 66e33d6af1496291b0602ee0a859e68145f17dad ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 66e33d6af1496291b0602ee0a859e68145f17dad kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-12-1857 sha1: 66e33d6af1496291b0602ee0a859e68145f17dad owner: scheduled_avan@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 4787 sha1: 66e33d6af1496291b0602ee0a859e68145f17dad sleep_before_teardown: 0 subset: 1/20 suite: orch:cephadm suite_branch: wip-athakkar-testing-2024-09-12-1857 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_66e33d6af1496291b0602ee0a859e68145f17dad/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 66e33d6af1496291b0602ee0a859e68145f17dad targets: smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFx/gfw78LG3K29ayYgocKohIU9i+2H7zknVyG5ikojXwUiqN7iZa6eyQmtuGmrwArF8KJK0butX+iLZNA22d70= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNLzo8D6prqdUroGhGll/fESM9PWS3EMjhUcZnliu9chIVRuUnRclHt9w2qDNNo9vNqHOHjp8vGKr/jiK3d91s= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-16_08:23:53 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: avan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-16T09:26:00.968 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_66e33d6af1496291b0602ee0a859e68145f17dad/qa; will attempt to use it 2024-09-16T09:26:00.969 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_66e33d6af1496291b0602ee0a859e68145f17dad/qa/tasks 2024-09-16T09:26:00.969 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-16T09:26:00.971 INFO:teuthology.task.internal:Checking packages... 2024-09-16T09:26:00.992 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '66e33d6af1496291b0602ee0a859e68145f17dad' 2024-09-16T09:26:00.993 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:26:00.993 INFO:teuthology.packaging:ref: None 2024-09-16T09:26:00.993 INFO:teuthology.packaging:tag: None 2024-09-16T09:26:00.993 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-12-1857 2024-09-16T09:26:00.993 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:26:00.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-athakkar-testing-2024-09-12-1857 2024-09-16T09:26:01.133 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4882.g66e33d6a 2024-09-16T09:26:01.135 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-16T09:26:01.142 INFO:teuthology.task.internal:no buildpackages task found 2024-09-16T09:26:01.142 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-16T09:26:01.209 INFO:teuthology.task.internal:Saving configuration 2024-09-16T09:26:01.229 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-16T09:26:01.240 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-16T09:26:01.264 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 09:20:32.903267', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFx/gfw78LG3K29ayYgocKohIU9i+2H7zknVyG5ikojXwUiqN7iZa6eyQmtuGmrwArF8KJK0butX+iLZNA22d70='} 2024-09-16T09:26:01.286 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-16 09:20:32.902029', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLNLzo8D6prqdUroGhGll/fESM9PWS3EMjhUcZnliu9chIVRuUnRclHt9w2qDNNo9vNqHOHjp8vGKr/jiK3d91s='} 2024-09-16T09:26:01.286 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-16T09:26:01.295 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-16T09:26:01.295 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-16T09:26:01.295 INFO:teuthology.run_tasks:Running task console_log... 2024-09-16T09:26:01.363 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcd1e653ac0>, signals=[15]) 2024-09-16T09:26:01.363 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-16T09:26:01.370 INFO:teuthology.task.internal:Opening connections... 2024-09-16T09:26:01.370 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:26:01.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:26:01.448 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T09:26:01.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:26:01.524 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-16T09:26:01.531 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-09-16T09:26:01.550 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-09-16T09:26:01.550 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-09-16T09:26:01.607 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-09-16T09:26:01.607 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="9" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="9" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el9" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:LOGO="fedora-logo-icon" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T09:26:01.608 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T09:26:01.609 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-09-16T09:26:01.627 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-09-16T09:26:01.646 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-09-16T09:26:01.646 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-09-16T09:26:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-09-16T09:26:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="9" 2024-09-16T09:26:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-09-16T09:26:01.703 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="9" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el9" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:LOGO="fedora-logo-icon" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-16T09:26:01.704 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-16T09:26:01.704 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-09-16T09:26:01.727 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-16T09:26:01.735 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-16T09:26:01.742 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-16T09:26:01.743 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-09-16T09:26:01.745 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-09-16T09:26:01.761 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-16T09:26:01.768 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-16T09:26:01.768 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-09-16T09:26:01.802 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-09-16T09:26:01.898 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-16T09:26:01.957 INFO:teuthology.run_tasks:Running task kernel... 2024-09-16T09:26:01.971 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-16T09:26:01.971 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-16T09:26:01.971 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T09:26:01.972 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-16T09:26:01.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T09:26:01.989 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-16T09:26:01.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T09:26:01.990 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-16T09:26:02.049 INFO:teuthology.orchestra.run.smithi111.stdout:5.14.0-503.el9.x86_64 2024-09-16T09:26:02.049 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.14.0-503.el9.x86_64 2024-09-16T09:26:02.049 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum install -y kernel 2024-09-16T09:26:02.050 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-503.el9.x86_64 2024-09-16T09:26:02.050 INFO:teuthology.task.kernel:Running kernel on smithi114: 5.14.0-503.el9.x86_64 2024-09-16T09:26:02.050 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2024-09-16T09:26:04.654 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.2 MB 00:00 2024-09-16T09:26:08.357 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 1.8 MB/s | 8.2 MB 00:04 2024-09-16T09:26:10.042 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 35 MB/s | 20 MB 00:00 2024-09-16T09:26:11.595 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 3.5 MB/s | 20 MB 00:05 2024-09-16T09:26:14.334 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-16T09:26:15.776 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 76 kB/s | 19 kB 00:00 2024-09-16T09:26:16.613 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-16T09:26:17.879 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-16T09:26:21.988 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 6.5 kB/s | 19 kB 00:02 2024-09-16T09:26:22.036 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-09-16T09:26:22.791 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-16T09:26:24.068 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T09:26:24.068 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T09:26:24.161 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:26:24.166 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:26:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-09-16T09:26:24.167 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:26:24.167 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:26:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T09:26:24.167 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:26:24.167 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T09:26:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T09:26:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T09:26:24.168 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:26:24.168 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:26:24.168 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:26:24.168 INFO:teuthology.orchestra.run.smithi114.stdout:Install 4 Packages 2024-09-16T09:26:24.169 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:26:24.170 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 79 M 2024-09-16T09:26:24.170 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 126 M 2024-09-16T09:26:24.170 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:26:25.746 INFO:teuthology.orchestra.run.smithi114.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 15 kB/s | 23 kB 00:01 2024-09-16T09:26:28.071 INFO:teuthology.orchestra.run.smithi114.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 4.0 MB/s | 16 MB 00:03 2024-09-16T09:26:28.297 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-16T09:26:29.629 INFO:teuthology.orchestra.run.smithi114.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 6.3 MB/s | 35 MB 00:05 2024-09-16T09:26:30.270 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-16T09:26:30.270 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-16T09:26:30.366 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:26:30.377 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:26:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-16T09:26:30.377 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:26:30.377 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:26:30.377 INFO:teuthology.orchestra.run.smithi111.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-16T09:26:30.378 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:26:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-16T09:26:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-16T09:26:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-16T09:26:30.378 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:26:30.378 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:26:30.379 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:26:30.379 INFO:teuthology.orchestra.run.smithi111.stdout:Install 4 Packages 2024-09-16T09:26:30.379 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:26:30.380 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 79 M 2024-09-16T09:26:30.380 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 126 M 2024-09-16T09:26:30.380 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:26:30.532 INFO:teuthology.orchestra.run.smithi111.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 210 kB/s | 23 kB 00:00 2024-09-16T09:26:31.066 INFO:teuthology.orchestra.run.smithi111.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 54 MB/s | 29 MB 00:00 2024-09-16T09:26:31.179 INFO:teuthology.orchestra.run.smithi114.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 5.3 MB/s | 29 MB 00:05 2024-09-16T09:26:31.179 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:26:31.180 INFO:teuthology.orchestra.run.smithi114.stdout:Total 11 MB/s | 79 MB 00:07 2024-09-16T09:26:31.724 INFO:teuthology.orchestra.run.smithi111.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 27 MB/s | 35 MB 00:01 2024-09-16T09:26:31.864 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:26:31.883 INFO:teuthology.orchestra.run.smithi111.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-16T09:26:31.883 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:26:31.883 INFO:teuthology.orchestra.run.smithi111.stdout:Total 52 MB/s | 79 MB 00:01 2024-09-16T09:26:32.219 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:26:32.219 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:26:32.566 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:26:32.920 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:26:32.920 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:26:33.188 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:26:33.189 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:26:33.859 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:26:33.860 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:26:35.656 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:26:36.330 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:26:36.389 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T09:26:36.479 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T09:26:36.998 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-16T09:26:37.100 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T09:26:39.299 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T09:26:39.431 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T09:26:39.913 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T09:26:40.044 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T09:26:44.310 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T09:26:44.423 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:26:44.878 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T09:26:45.003 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:26:49.325 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:26:49.825 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:27.192 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:27.233 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:27.582 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:27.583 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T09:27:27.583 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T09:27:27.583 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T09:27:28.247 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:28.292 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:28.502 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:27:28.503 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:27:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-16T09:27:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-16T09:27:28.611 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-16T09:27:28.839 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T09:27:28.929 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T09:27:28.930 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T09:27:28.930 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T09:27:28.930 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T09:27:28.930 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T09:27:28.931 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-16T09:27:28.931 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T09:27:28.931 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T09:27:28.989 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T09:27:28.990 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T09:27:28.990 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2024-09-16T09:27:29.021 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.06 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 82.el9 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Group : Unspecified 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 8274670 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T09:27:29.022 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : builder@centos.org 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T09:27:29.023 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2024-09-16T09:27:29.024 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:27:29.024 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T09:27:29.024 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T09:27:29.025 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 5.14.0-505.el9.x86_64 2024-09-16T09:27:29.025 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T09:27:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-16T09:27:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:27:29.480 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:27:29.480 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-16T09:27:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-16T09:27:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-16T09:27:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-16T09:27:29.481 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:27:29.481 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:27:29.694 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-09-16T09:27:29.833 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T09:27:29.913 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T09:27:29.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T09:27:29.913 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-16T09:27:29.913 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-16T09:27:29.913 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-16T09:27:29.914 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-16T09:27:29.914 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-09-16T09:27:29.914 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2024-09-16T09:27:29.972 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-16T09:27:29.973 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-16T09:27:29.973 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -qi grub2-tools 2024-09-16T09:27:30.004 INFO:teuthology.orchestra.run.smithi111.stdout:Name : grub2-tools 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Epoch : 1 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Version : 2.06 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Release : 82.el9 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: x86_64 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Group : Unspecified 2024-09-16T09:27:30.005 INFO:teuthology.orchestra.run.smithi111.stdout:Size : 8274670 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:License : GPLv3+ 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Packager : builder@centos.org 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:Vendor : CentOS 2024-09-16T09:27:30.006 INFO:teuthology.orchestra.run.smithi111.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-16T09:27:30.007 INFO:teuthology.orchestra.run.smithi111.stdout:Summary : Support tools for GRUB. 2024-09-16T09:27:30.007 INFO:teuthology.orchestra.run.smithi111.stdout:Description : 2024-09-16T09:27:30.007 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:27:30.007 INFO:teuthology.orchestra.run.smithi111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-16T09:27:30.007 INFO:teuthology.orchestra.run.smithi111.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-16T09:27:30.007 INFO:teuthology.orchestra.run.smithi111.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-16T09:27:30.008 INFO:teuthology.orchestra.run.smithi111.stdout:hardware devices. 2024-09-16T09:27:30.008 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:27:30.008 INFO:teuthology.orchestra.run.smithi111.stdout:This subpackage provides tools for support of all platforms. 2024-09-16T09:27:30.009 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-16T09:27:30.010 INFO:teuthology.task.kernel:Updating grub on smithi111 to boot 5.14.0-505.el9.x86_64 2024-09-16T09:27:30.010 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-16T09:27:30.733 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-09-16T09:27:31.033 INFO:teuthology.orchestra.run.smithi114.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T09:27:31.063 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-09-16T09:27:31.065 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-09-16T09:27:31.081 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.copYmh9wkc 2024-09-16T09:27:31.081 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.copYmh9wkc 2024-09-16T09:27:31.156 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.copYmh9wkc 2024-09-16T09:27:31.290 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.copYmh9wkc is 6KB 2024-09-16T09:27:31.338 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.copYmh9wkc 2024-09-16T09:27:31.354 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T09:27:31.423 INFO:teuthology.orchestra.run.smithi114.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T09:27:31.423 INFO:teuthology.orchestra.run.smithi114.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T09:27:31.423 INFO:teuthology.orchestra.run.smithi114.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T09:27:31.424 INFO:teuthology.orchestra.run.smithi114.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T09:27:31.425 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T09:27:31.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-09-16T09:27:32.088 INFO:teuthology.orchestra.run.smithi111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-16T09:27:32.125 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-09-16T09:27:32.127 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-09-16T09:27:32.144 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.CFenwLvKTT 2024-09-16T09:27:32.144 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.CFenwLvKTT 2024-09-16T09:27:32.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.CFenwLvKTT 2024-09-16T09:27:32.357 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.CFenwLvKTT is 6KB 2024-09-16T09:27:32.407 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.CFenwLvKTT 2024-09-16T09:27:32.422 DEBUG:teuthology.orchestra.run.smithi111:> sudo /bin/ls /boot/loader/entries || true 2024-09-16T09:27:32.485 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-16T09:27:32.485 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-16T09:27:32.485 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-16T09:27:32.485 INFO:teuthology.orchestra.run.smithi111.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-16T09:27:32.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-16T09:27:32.631 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-09-16T09:28:01.617 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-16T09:28:01.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:28:01.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:28:02.635 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-16T09:28:02.636 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:28:02.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:28:20.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-16T09:28:21.053 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-16T09:28:29.037 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:28:29.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:28:30.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:28:30.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:28:32.097 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-16T09:28:33.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-16T09:28:44.108 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:28:44.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:28:45.118 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:28:45.119 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:28:48.189 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-16T09:29:02.525 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-09-16T09:29:03.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:29:03.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:29:17.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:29:17.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:29:17.872 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-16T09:29:18.482 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:29:18.482 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-16T09:29:18.483 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-09-16T09:29:18.497 INFO:teuthology.orchestra.run.smithi114.stdout:5.14.0-505.el9.x86_64 2024-09-16T09:29:18.497 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T09:29:18.497 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T09:29:18.497 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T09:29:19.498 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-16T09:29:19.498 DEBUG:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T09:29:19.566 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2024-09-16T09:29:19.597 DEBUG:teuthology.parallel:result is None 2024-09-16T09:29:21.729 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-09-16T09:29:39.730 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:29:39.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:29:40.030 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-16T09:29:40.389 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:29:40.389 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-16T09:29:40.389 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-09-16T09:29:40.405 INFO:teuthology.orchestra.run.smithi111.stdout:5.14.0-505.el9.x86_64 2024-09-16T09:29:40.406 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-16T09:29:40.406 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-16T09:29:40.406 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-16T09:29:41.407 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-16T09:29:41.407 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-16T09:29:41.469 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-09-16T09:29:41.493 DEBUG:teuthology.parallel:result is None 2024-09-16T09:29:41.493 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-16T09:29:41.501 INFO:teuthology.task.internal:Creating test directory... 2024-09-16T09:29:41.501 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T09:29:41.504 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-16T09:29:41.523 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-16T09:29:41.529 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-16T09:29:41.539 INFO:teuthology.task.internal:Creating archive directory... 2024-09-16T09:29:41.539 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T09:29:41.561 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-16T09:29:41.631 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-16T09:29:41.638 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-16T09:29:41.638 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T09:29:41.641 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-16T09:29:41.671 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T09:29:41.677 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T09:29:41.683 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T09:29:41.688 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-16T09:29:41.690 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-16T09:29:41.697 INFO:teuthology.task.internal:Configuring sudo... 2024-09-16T09:29:41.697 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T09:29:41.729 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-16T09:29:41.758 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-16T09:29:41.767 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-16T09:29:41.768 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T09:29:41.797 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-16T09:29:41.815 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T09:29:41.897 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T09:29:41.942 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T09:29:42.022 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T09:29:42.066 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:29:42.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T09:29:42.132 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T09:29:42.178 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-16T09:29:42.242 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T09:29:42.286 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-16T09:29:42.328 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:29:42.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-16T09:29:42.394 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-09-16T09:29:42.397 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-09-16T09:29:42.455 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T09:29:42.481 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T09:29:42.920 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-16T09:29:42.928 INFO:teuthology.task.internal:Starting timer... 2024-09-16T09:29:42.928 INFO:teuthology.run_tasks:Running task pcp... 2024-09-16T09:29:42.939 INFO:teuthology.run_tasks:Running task selinux... 2024-09-16T09:29:42.947 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-16T09:29:42.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2024-09-16T09:29:43.000 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2024-09-16T09:29:43.002 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-09-16T09:29:43.067 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-09-16T09:29:43.069 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-16T09:29:43.069 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2024-09-16T09:29:43.088 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2024-09-16T09:29:43.088 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-09-16T09:29:43.125 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-09-16T09:29:43.125 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi111.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi114.front.sepia.ceph.com': 'permissive'} 2024-09-16T09:29:43.126 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-16T09:29:43.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T09:29:43.155 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-16T09:29:43.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T09:29:43.192 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-16T09:29:43.192 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2024-09-16T09:29:43.243 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-09-16T09:29:43.274 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-16T09:29:43.283 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-16T09:29:43.290 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-16T09:29:43.404 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-16T09:29:43.419 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-16T09:29:43.421 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi111.front.sepia.ceph.com,smithi114.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-16T09:33:29.193 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com')] 2024-09-16T09:33:29.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:33:29.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:33:29.279 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-09-16T09:33:29.356 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-09-16T09:33:29.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:33:29.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-16T09:33:29.433 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-09-16T09:33:29.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-09-16T09:33:29.517 INFO:teuthology.run_tasks:Running task clock... 2024-09-16T09:33:29.529 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-16T09:33:29.529 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T09:33:29.529 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T09:33:29.532 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-16T09:33:29.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T09:33:29.560 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T09:33:29.574 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T09:33:29.587 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-16T09:33:29.601 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2024-09-16T09:33:29.602 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-16T09:33:29.609 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2024-09-16T09:33:29.623 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T09:33:29.627 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-09-16T09:33:29.637 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T09:33:29.639 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-09-16T09:33:29.655 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-16T09:33:29.667 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-16T09:33:29.697 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-09-16T09:33:29.700 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T09:33:29.700 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-09-16T09:33:29.700 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.700 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.700 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.701 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.726 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-09-16T09:33:29.730 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T09:33:29.730 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-09-16T09:33:29.730 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.730 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.730 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.730 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T09:33:29.731 INFO:teuthology.run_tasks:Running task install... 2024-09-16T09:33:29.741 DEBUG:teuthology.task.install:project ceph 2024-09-16T09:33:29.741 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '66e33d6af1496291b0602ee0a859e68145f17dad'}} 2024-09-16T09:33:29.741 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '66e33d6af1496291b0602ee0a859e68145f17dad'} 2024-09-16T09:33:29.742 INFO:teuthology.task.install:Using flavor: default 2024-09-16T09:33:29.753 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-16T09:33:29.754 INFO:teuthology.task.install:extra packages: [] 2024-09-16T09:33:29.754 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '66e33d6af1496291b0602ee0a859e68145f17dad', 'tag': None, 'wait_for_package': False} 2024-09-16T09:33:29.755 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:33:29.755 INFO:teuthology.packaging:ref: None 2024-09-16T09:33:29.755 INFO:teuthology.packaging:tag: None 2024-09-16T09:33:29.755 INFO:teuthology.packaging:branch: squid 2024-09-16T09:33:29.755 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:33:29.756 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T09:33:29.759 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '66e33d6af1496291b0602ee0a859e68145f17dad', 'tag': None, 'wait_for_package': False} 2024-09-16T09:33:29.759 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:33:29.759 INFO:teuthology.packaging:ref: None 2024-09-16T09:33:29.759 INFO:teuthology.packaging:tag: None 2024-09-16T09:33:29.760 INFO:teuthology.packaging:branch: squid 2024-09-16T09:33:29.760 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:33:29.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T09:33:29.996 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/ 2024-09-16T09:33:29.996 INFO:teuthology.task.install.rpm:Package version is 19.1.1-328.gad35db06 2024-09-16T09:33:30.000 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/ 2024-09-16T09:33:30.001 INFO:teuthology.task.install.rpm:Package version is 19.1.1-328.gad35db06 2024-09-16T09:33:30.110 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T09:33:30.110 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:33:30.110 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T09:33:30.115 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-16T09:33:30.115 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:33:30.115 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-16T09:33:30.137 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T09:33:30.137 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:33:30.137 INFO:teuthology.packaging:ref: None 2024-09-16T09:33:30.137 INFO:teuthology.packaging:tag: None 2024-09-16T09:33:30.137 INFO:teuthology.packaging:branch: squid 2024-09-16T09:33:30.137 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:33:30.138 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T09:33:30.141 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-16T09:33:30.142 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:33:30.142 INFO:teuthology.packaging:ref: None 2024-09-16T09:33:30.142 INFO:teuthology.packaging:tag: None 2024-09-16T09:33:30.142 INFO:teuthology.packaging:branch: squid 2024-09-16T09:33:30.142 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:33:30.142 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-16T09:33:30.204 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T09:33:30.207 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-16T09:33:30.280 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T09:33:30.284 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-16T09:33:30.344 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2024-09-16T09:33:30.346 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2024-09-16T09:33:30.348 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-09-16T09:33:30.349 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-09-16T09:33:30.569 INFO:teuthology.orchestra.run.smithi111.stdout:45 files removed 2024-09-16T09:33:30.594 INFO:teuthology.orchestra.run.smithi114.stdout:45 files removed 2024-09-16T09:33:30.596 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw 2024-09-16T09:33:30.622 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw 2024-09-16T09:33:31.159 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-16T09:33:31.176 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-16T09:33:31.443 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-16T09:33:31.444 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 52 kB/s | 12 kB 00:00 2024-09-16T09:33:31.711 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-16T09:33:31.719 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-16T09:33:32.327 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-16T09:33:32.877 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - BaseOS 7.3 MB/s | 8.2 MB 00:01 2024-09-16T09:33:36.095 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 20 MB 00:02 2024-09-16T09:33:41.770 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-16T09:33:44.554 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - CRB 1.4 MB/s | 6.5 MB 00:04 2024-09-16T09:33:46.071 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-16T09:33:46.154 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-16T09:33:46.825 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 36 MB/s | 23 MB 00:00 2024-09-16T09:33:47.855 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-16T09:33:48.601 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 37 MB/s | 23 MB 00:00 2024-09-16T09:33:52.323 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-16T09:33:54.057 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-16T09:33:54.674 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:33:54.691 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:33:54.691 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:33:54.691 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:19.1.1-328.gad35db06.el9 ceph 11 M 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:19.1.1-328.gad35db06.el9 ceph 3.4 M 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:19.1.1-328.gad35db06.el9 ceph 3.2 M 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:19.1.1-328.gad35db06.el9 ceph 5.4 M 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:19.1.1-328.gad35db06.el9 ceph 21 M 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:19.1.1-328.gad35db06.el9 ceph 25 k 2024-09-16T09:33:54.692 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:19.1.1-328.gad35db06.el9 ceph 751 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:19.1.1-328.gad35db06.el9 ceph 506 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:19.1.1-328.gad35db06.el9 ceph 5.3 M 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T09:33:54.693 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:19.1.1-328.gad35db06.el9 ceph 45 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:19.1.1-328.gad35db06.el9 ceph 136 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:19.1.1-328.gad35db06.el9 ceph 162 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:19.1.1-328.gad35db06.el9 ceph 320 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:19.1.1-328.gad35db06.el9 ceph 301 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:19.1.1-328.gad35db06.el9 ceph 99 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout:Installing weak dependencies: 2024-09-16T09:33:54.694 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout:Install 30 Packages 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 2 Packages 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:33:54.695 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 60 M 2024-09-16T09:33:54.696 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:33:55.441 INFO:teuthology.orchestra.run.smithi111.stdout:(1/32): ceph-base-19.1.1-328.gad35db06.el9.x86_ 10 MB/s | 5.4 MB 00:00 2024-09-16T09:33:55.499 INFO:teuthology.orchestra.run.smithi111.stdout:(2/32): ceph-selinux-19.1.1-328.gad35db06.el9.x 430 kB/s | 25 kB 00:00 2024-09-16T09:33:55.617 INFO:teuthology.orchestra.run.smithi111.stdout:(3/32): ceph-radosgw-19.1.1-328.gad35db06.el9.x 15 MB/s | 11 MB 00:00 2024-09-16T09:33:55.658 INFO:teuthology.orchestra.run.smithi111.stdout:(4/32): libcephfs2-19.1.1-328.gad35db06.el9.x86 4.6 MB/s | 751 kB 00:00 2024-09-16T09:33:55.684 INFO:teuthology.orchestra.run.smithi111.stdout:(5/32): libradosstriper1-19.1.1-328.gad35db06.e 7.4 MB/s | 506 kB 00:00 2024-09-16T09:33:55.742 INFO:teuthology.orchestra.run.smithi111.stdout:(6/32): python3-ceph-argparse-19.1.1-328.gad35d 771 kB/s | 45 kB 00:00 2024-09-16T09:33:55.834 INFO:teuthology.orchestra.run.smithi111.stdout:(7/32): python3-ceph-common-19.1.1-328.gad35db0 1.5 MB/s | 136 kB 00:00 2024-09-16T09:33:55.909 INFO:teuthology.orchestra.run.smithi111.stdout:(8/32): librgw2-19.1.1-328.gad35db06.el9.x86_64 21 MB/s | 5.3 MB 00:00 2024-09-16T09:33:55.935 INFO:teuthology.orchestra.run.smithi111.stdout:(9/32): python3-cephfs-19.1.1-328.gad35db06.el9 1.6 MB/s | 162 kB 00:00 2024-09-16T09:33:55.960 INFO:teuthology.orchestra.run.smithi111.stdout:(10/32): python3-rados-19.1.1-328.gad35db06.el9 6.2 MB/s | 320 kB 00:00 2024-09-16T09:33:55.985 INFO:teuthology.orchestra.run.smithi111.stdout:(11/32): python3-rbd-19.1.1-328.gad35db06.el9.x 5.9 MB/s | 301 kB 00:00 2024-09-16T09:33:56.011 INFO:teuthology.orchestra.run.smithi111.stdout:(12/32): python3-rgw-19.1.1-328.gad35db06.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-16T09:33:56.244 INFO:teuthology.orchestra.run.smithi111.stdout:(13/32): ceph-common-19.1.1-328.gad35db06.el9.x 16 MB/s | 21 MB 00:01 2024-09-16T09:33:56.483 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:19.1.1-328.gad35db06.el9 ceph 11 M 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:19.1.1-328.gad35db06.el9 ceph 3.4 M 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:19.1.1-328.gad35db06.el9 ceph 3.2 M 2024-09-16T09:33:56.487 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:19.1.1-328.gad35db06.el9 ceph 5.4 M 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:19.1.1-328.gad35db06.el9 ceph 21 M 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:19.1.1-328.gad35db06.el9 ceph 25 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:19.1.1-328.gad35db06.el9 ceph 751 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-16T09:33:56.488 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:19.1.1-328.gad35db06.el9 ceph 506 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:19.1.1-328.gad35db06.el9 ceph 5.3 M 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:19.1.1-328.gad35db06.el9 ceph 45 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:19.1.1-328.gad35db06.el9 ceph 136 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:19.1.1-328.gad35db06.el9 ceph 162 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:19.1.1-328.gad35db06.el9 ceph 320 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:19.1.1-328.gad35db06.el9 ceph 301 k 2024-09-16T09:33:56.489 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:19.1.1-328.gad35db06.el9 ceph 99 k 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:Installing weak dependencies: 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:Install 30 Packages 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 2 Packages 2024-09-16T09:33:56.490 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:33:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 60 M 2024-09-16T09:33:56.491 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:33:56.619 INFO:teuthology.orchestra.run.smithi111.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 169 kB/s | 107 kB 00:00 2024-09-16T09:33:56.636 INFO:teuthology.orchestra.run.smithi111.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 115 kB/s | 45 kB 00:00 2024-09-16T09:33:56.703 INFO:teuthology.orchestra.run.smithi111.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 231 kB/s | 160 kB 00:00 2024-09-16T09:33:56.812 INFO:teuthology.orchestra.run.smithi111.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 390 kB/s | 42 kB 00:00 2024-09-16T09:33:57.012 INFO:teuthology.orchestra.run.smithi111.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 779 kB/s | 292 kB 00:00 2024-09-16T09:33:57.104 INFO:teuthology.orchestra.run.smithi111.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.3 MB/s | 662 kB 00:00 2024-09-16T09:33:57.146 INFO:teuthology.orchestra.run.smithi111.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 661 kB/s | 221 kB 00:00 2024-09-16T09:33:57.171 INFO:teuthology.orchestra.run.smithi111.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 226 kB/s | 36 kB 00:00 2024-09-16T09:33:57.222 INFO:teuthology.orchestra.run.smithi111.stdout:(22/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.0 MB/s | 308 kB 00:00 2024-09-16T09:33:57.225 INFO:teuthology.orchestra.run.smithi114.stdout:(1/32): ceph-base-19.1.1-328.gad35db06.el9.x86_ 9.4 MB/s | 5.4 MB 00:00 2024-09-16T09:33:57.247 INFO:teuthology.orchestra.run.smithi111.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-16T09:33:57.272 INFO:teuthology.orchestra.run.smithi111.stdout:(24/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 377 kB/s | 47 kB 00:00 2024-09-16T09:33:57.283 INFO:teuthology.orchestra.run.smithi114.stdout:(2/32): ceph-selinux-19.1.1-328.gad35db06.el9.x 433 kB/s | 25 kB 00:00 2024-09-16T09:33:57.297 INFO:teuthology.orchestra.run.smithi111.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-16T09:33:57.356 INFO:teuthology.orchestra.run.smithi111.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-16T09:33:57.417 INFO:teuthology.orchestra.run.smithi114.stdout:(3/32): ceph-radosgw-19.1.1-328.gad35db06.el9.x 14 MB/s | 11 MB 00:00 2024-09-16T09:33:57.429 INFO:teuthology.orchestra.run.smithi111.stdout:(27/32): libunwind-1.6.2-1.el9.x86_64.rpm 431 kB/s | 67 kB 00:00 2024-09-16T09:33:57.459 INFO:teuthology.orchestra.run.smithi114.stdout:(4/32): libcephfs2-19.1.1-328.gad35db06.el9.x86 4.2 MB/s | 751 kB 00:00 2024-09-16T09:33:57.481 INFO:teuthology.orchestra.run.smithi111.stdout:(28/32): re2-20211101-20.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-16T09:33:57.484 INFO:teuthology.orchestra.run.smithi114.stdout:(5/32): libradosstriper1-19.1.1-328.gad35db06.e 7.4 MB/s | 506 kB 00:00 2024-09-16T09:33:57.559 INFO:teuthology.orchestra.run.smithi114.stdout:(6/32): python3-ceph-argparse-19.1.1-328.gad35d 601 kB/s | 45 kB 00:00 2024-09-16T09:33:57.573 INFO:teuthology.orchestra.run.smithi111.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-16T09:33:57.615 INFO:teuthology.orchestra.run.smithi111.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 8.5 MB/s | 1.6 MB 00:00 2024-09-16T09:33:57.651 INFO:teuthology.orchestra.run.smithi114.stdout:(7/32): python3-ceph-common-19.1.1-328.gad35db0 1.5 MB/s | 136 kB 00:00 2024-09-16T09:33:57.815 INFO:teuthology.orchestra.run.smithi111.stdout:(31/32): librados2-19.1.1-328.gad35db06.el9.x86 10 MB/s | 3.4 MB 00:00 2024-09-16T09:33:57.868 INFO:teuthology.orchestra.run.smithi114.stdout:(8/32): ceph-common-19.1.1-328.gad35db06.el9.x8 17 MB/s | 21 MB 00:01 2024-09-16T09:33:57.890 INFO:teuthology.orchestra.run.smithi111.stdout:(32/32): librbd1-19.1.1-328.gad35db06.el9.x86_6 10 MB/s | 3.2 MB 00:00 2024-09-16T09:33:57.893 INFO:teuthology.orchestra.run.smithi114.stdout:(9/32): python3-cephfs-19.1.1-328.gad35db06.el9 669 kB/s | 162 kB 00:00 2024-09-16T09:33:57.896 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:33:57.896 INFO:teuthology.orchestra.run.smithi111.stdout:Total 19 MB/s | 60 MB 00:03 2024-09-16T09:33:57.918 INFO:teuthology.orchestra.run.smithi114.stdout:(10/32): python3-rados-19.1.1-328.gad35db06.el9 6.3 MB/s | 320 kB 00:00 2024-09-16T09:33:58.002 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:33:58.003 INFO:teuthology.orchestra.run.smithi114.stdout:(11/32): librgw2-19.1.1-328.gad35db06.el9.x86_6 9.8 MB/s | 5.3 MB 00:00 2024-09-16T09:33:58.028 INFO:teuthology.orchestra.run.smithi114.stdout:(12/32): python3-rbd-19.1.1-328.gad35db06.el9.x 2.2 MB/s | 301 kB 00:00 2024-09-16T09:33:58.039 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:33:58.039 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:33:58.053 INFO:teuthology.orchestra.run.smithi114.stdout:(13/32): python3-rgw-19.1.1-328.gad35db06.el9.x 743 kB/s | 99 kB 00:00 2024-09-16T09:33:58.153 INFO:teuthology.orchestra.run.smithi114.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-09-16T09:33:58.178 INFO:teuthology.orchestra.run.smithi114.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2024-09-16T09:33:58.254 INFO:teuthology.orchestra.run.smithi114.stdout:(16/32): boost-program-options-1.75.0-8.el9.x86 426 kB/s | 107 kB 00:00 2024-09-16T09:33:58.296 INFO:teuthology.orchestra.run.smithi114.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-16T09:33:58.329 INFO:teuthology.orchestra.run.smithi114.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-09-16T09:33:58.346 INFO:teuthology.orchestra.run.smithi114.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 457 kB/s | 42 kB 00:00 2024-09-16T09:33:58.371 INFO:teuthology.orchestra.run.smithi114.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-16T09:33:58.397 INFO:teuthology.orchestra.run.smithi114.stdout:(21/32): qatlib-service-24.02.0-1.el9.x86_64.rp 533 kB/s | 36 kB 00:00 2024-09-16T09:33:58.414 INFO:teuthology.orchestra.run.smithi114.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 704 kB/s | 47 kB 00:00 2024-09-16T09:33:58.464 INFO:teuthology.orchestra.run.smithi114.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 3.3 MB/s | 308 kB 00:00 2024-09-16T09:33:58.489 INFO:teuthology.orchestra.run.smithi114.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 384 kB/s | 26 kB 00:00 2024-09-16T09:33:58.506 INFO:teuthology.orchestra.run.smithi114.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-09-16T09:33:58.540 INFO:teuthology.orchestra.run.smithi114.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-16T09:33:58.582 INFO:teuthology.orchestra.run.smithi114.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-16T09:33:58.649 INFO:teuthology.orchestra.run.smithi114.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-16T09:33:58.691 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:33:58.692 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:33:58.715 INFO:teuthology.orchestra.run.smithi114.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-16T09:33:58.783 INFO:teuthology.orchestra.run.smithi114.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-16T09:33:58.891 INFO:teuthology.orchestra.run.smithi114.stdout:(31/32): librados2-19.1.1-328.gad35db06.el9.x86 14 MB/s | 3.4 MB 00:00 2024-09-16T09:33:58.970 INFO:teuthology.orchestra.run.smithi114.stdout:(32/32): librbd1-19.1.1-328.gad35db06.el9.x86_6 13 MB/s | 3.2 MB 00:00 2024-09-16T09:33:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:33:58.972 INFO:teuthology.orchestra.run.smithi114.stdout:Total 24 MB/s | 60 MB 00:02 2024-09-16T09:33:59.073 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:33:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:33:59.109 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:33:59.802 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:33:59.803 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:34:00.153 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:34:00.233 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-16T09:34:00.271 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-16T09:34:00.297 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-16T09:34:00.319 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-16T09:34:00.341 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-16T09:34:00.488 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-16T09:34:00.541 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-16T09:34:00.918 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-16T09:34:00.973 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:19.1.1-328.gad35db06.el9.x86_64 7/34 2024-09-16T09:34:01.065 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:19.1.1-328.gad35db06.el9.x86_64 7/34 2024-09-16T09:34:01.175 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 8/34 2024-09-16T09:34:01.218 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 9/34 2024-09-16T09:34:01.271 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:34:01.281 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 9/34 2024-09-16T09:34:01.309 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-16T09:34:01.350 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-16T09:34:01.352 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:19.1.1-328.gad35db06.el9.x 11/34 2024-09-16T09:34:01.380 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-16T09:34:01.405 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-16T09:34:01.421 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 12/34 2024-09-16T09:34:01.427 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-16T09:34:01.445 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 13/34 2024-09-16T09:34:01.451 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-16T09:34:01.509 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 13/34 2024-09-16T09:34:01.544 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-16T09:34:01.647 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-16T09:34:01.660 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-16T09:34:01.695 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-16T09:34:01.699 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-16T09:34:01.736 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-16T09:34:01.776 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-16T09:34:01.805 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-16T09:34:01.840 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-16T09:34:02.024 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-16T09:34:02.131 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:19.1.1-328.gad35db06.el9.x86_64 7/34 2024-09-16T09:34:02.179 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-16T09:34:02.224 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:19.1.1-328.gad35db06.el9.x86_64 7/34 2024-09-16T09:34:02.226 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:19.1.1-328.gad35db06.el9.x86_64 22/34 2024-09-16T09:34:02.318 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:19.1.1-328.gad35db06.el9.x86_64 22/34 2024-09-16T09:34:02.330 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 8/34 2024-09-16T09:34:02.348 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 23/34 2024-09-16T09:34:02.358 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 9/34 2024-09-16T09:34:02.384 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-16T09:34:02.438 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 9/34 2024-09-16T09:34:02.466 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-16T09:34:02.510 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:19.1.1-328.gad35db06.el9.x 11/34 2024-09-16T09:34:02.572 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 12/34 2024-09-16T09:34:02.594 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 13/34 2024-09-16T09:34:02.658 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 13/34 2024-09-16T09:34:02.692 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-16T09:34:02.803 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-16T09:34:02.835 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-16T09:34:02.876 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-16T09:34:02.895 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-16T09:34:02.910 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-16T09:34:02.920 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:19.1.1-328.gad35db06.el9.x86_64 26/34 2024-09-16T09:34:02.939 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-16T09:34:02.984 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-16T09:34:02.992 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:19.1.1-328.gad35db06.el9.x86_64 26/34 2024-09-16T09:34:03.071 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 27/34 2024-09-16T09:34:03.098 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:19.1.1-328.gad35db06.el9.x86 28/34 2024-09-16T09:34:03.306 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-16T09:34:03.351 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:19.1.1-328.gad35db06.el9.x86_64 22/34 2024-09-16T09:34:03.442 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:19.1.1-328.gad35db06.el9.x86_64 22/34 2024-09-16T09:34:03.473 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 23/34 2024-09-16T09:34:03.509 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-16T09:34:03.998 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-16T09:34:04.029 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:19.1.1-328.gad35db06.el9.x86_64 26/34 2024-09-16T09:34:04.083 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:19.1.1-328.gad35db06.el9.x86_64 26/34 2024-09-16T09:34:04.161 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 27/34 2024-09-16T09:34:04.189 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:19.1.1-328.gad35db06.el9.x86 28/34 2024-09-16T09:34:05.401 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 29/34 2024-09-16T09:34:05.436 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 29/34 2024-09-16T09:34:06.002 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 29/34 2024-09-16T09:34:06.047 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 30/34 2024-09-16T09:34:06.156 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 30/34 2024-09-16T09:34:06.156 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T09:34:06.157 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T09:34:06.157 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:06.190 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 31/34 2024-09-16T09:34:06.452 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 29/34 2024-09-16T09:34:06.494 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 29/34 2024-09-16T09:34:07.055 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 29/34 2024-09-16T09:34:07.097 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 30/34 2024-09-16T09:34:07.178 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 30/34 2024-09-16T09:34:07.178 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-16T09:34:07.178 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-16T09:34:07.178 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:07.207 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 31/34 2024-09-16T09:34:16.141 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 31/34 2024-09-16T09:34:16.141 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2024-09-16T09:34:16.141 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2024-09-16T09:34:16.142 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2024-09-16T09:34:16.142 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2024-09-16T09:34:16.142 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2024-09-16T09:34:16.142 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /root 2024-09-16T09:34:16.142 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2024-09-16T09:34:16.142 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:17.124 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 32/34 2024-09-16T09:34:17.150 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 32/34 2024-09-16T09:34:17.150 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:17.150 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T09:34:17.150 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T09:34:17.150 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T09:34:17.151 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:17.152 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 31/34 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-09-16T09:34:17.226 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /root 2024-09-16T09:34:17.227 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-09-16T09:34:17.227 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:17.252 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-16T09:34:17.252 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-16T09:34:18.216 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 32/34 2024-09-16T09:34:18.241 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 32/34 2024-09-16T09:34:18.242 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:18.242 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-16T09:34:18.242 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T09:34:18.242 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-16T09:34:18.242 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:18.244 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-16T09:34:18.327 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-16T09:34:18.327 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 1/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 2/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 3/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 4/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 5/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 6/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:19.1.1-328.gad35db06.el9.x86_64 7/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:19.1.1-328.gad35db06.el9.x 8/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:19.1.1-328.gad35db06.el9.x86 9/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 10/34 2024-09-16T09:34:18.461 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 11/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 12/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 13/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-16T09:34:18.462 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-16T09:34:18.463 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-16T09:34:18.463 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-16T09:34:18.463 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-16T09:34:18.464 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-16T09:34:18.464 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-16T09:34:18.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-16T09:34:18.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-16T09:34:18.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:19.1.1-328.gad35db06.el9.x86_64 31/34 2024-09-16T09:34:18.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-16T09:34:18.465 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:19.1.1-328.gad35db06.el9.x86_64 33/34 2024-09-16T09:34:19.537 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-16T09:34:19.537 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 1/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 2/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 3/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 4/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 5/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 6/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:19.1.1-328.gad35db06.el9.x86_64 7/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:19.1.1-328.gad35db06.el9.x 8/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:19.1.1-328.gad35db06.el9.x86 9/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 10/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 11/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 12/34 2024-09-16T09:34:19.538 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 13/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-16T09:34:19.539 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-16T09:34:19.540 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-16T09:34:19.540 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-16T09:34:19.541 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-16T09:34:19.541 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:19.1.1-328.gad35db06.el9.x86_64 31/34 2024-09-16T09:34:19.541 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-16T09:34:19.541 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:19.1.1-328.gad35db06.el9.x86_64 33/34 2024-09-16T09:34:19.586 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-16T09:34:19.586 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:19.586 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2024-09-16T09:34:19.586 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.586 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T09:34:19.587 INFO:teuthology.orchestra.run.smithi111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.588 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:19.589 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:19.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-test 2024-09-16T09:34:20.521 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:28 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:20.656 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:19.1.1-328.gad35db06.el9 ceph 49 M 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:19.1.1-328.gad35db06.el9 ceph 163 k 2024-09-16T09:34:20.657 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T09:34:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T09:34:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:20.658 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:34:20.658 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:20.658 INFO:teuthology.orchestra.run.smithi111.stdout:Install 4 Packages 2024-09-16T09:34:20.658 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:20.659 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 49 M 2024-09-16T09:34:20.659 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 209 M 2024-09-16T09:34:20.659 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:34:20.710 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-16T09:34:20.710 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:20.710 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-09-16T09:34:20.710 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-16T09:34:20.711 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-16T09:34:20.712 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: re2-1:20211101-20.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:20.713 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:20.948 INFO:teuthology.orchestra.run.smithi111.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-16T09:34:20.973 INFO:teuthology.orchestra.run.smithi111.stdout:(2/4): libcephsqlite-19.1.1-328.gad35db06.el9.x 757 kB/s | 163 kB 00:00 2024-09-16T09:34:20.998 INFO:teuthology.orchestra.run.smithi111.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T09:34:21.022 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-test 2024-09-16T09:34:21.587 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:27 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:21.727 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:19.1.1-328.gad35db06.el9 ceph 49 M 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:19.1.1-328.gad35db06.el9 ceph 163 k 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-16T09:34:21.728 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:21.729 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:34:21.729 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:21.729 INFO:teuthology.orchestra.run.smithi114.stdout:Install 4 Packages 2024-09-16T09:34:21.729 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:21.729 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 49 M 2024-09-16T09:34:21.730 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 209 M 2024-09-16T09:34:21.730 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:34:22.065 INFO:teuthology.orchestra.run.smithi114.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-16T09:34:22.090 INFO:teuthology.orchestra.run.smithi114.stdout:(2/4): libcephsqlite-19.1.1-328.gad35db06.el9.x 697 kB/s | 163 kB 00:00 2024-09-16T09:34:22.115 INFO:teuthology.orchestra.run.smithi114.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-16T09:34:22.291 INFO:teuthology.orchestra.run.smithi111.stdout:(4/4): ceph-test-19.1.1-328.gad35db06.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-16T09:34:22.293 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:22.293 INFO:teuthology.orchestra.run.smithi111.stdout:Total 30 MB/s | 49 MB 00:01 2024-09-16T09:34:22.321 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:34:22.342 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:34:22.342 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:34:22.712 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:34:22.713 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:34:23.238 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:34:23.310 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T09:34:23.355 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T09:34:23.384 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 3/4 2024-09-16T09:34:23.399 INFO:teuthology.orchestra.run.smithi114.stdout:(4/4): ceph-test-19.1.1-328.gad35db06.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-16T09:34:23.401 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:23.402 INFO:teuthology.orchestra.run.smithi114.stdout:Total 29 MB/s | 49 MB 00:01 2024-09-16T09:34:23.429 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:34:23.449 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:34:23.449 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:34:23.820 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:34:23.820 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:34:24.356 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:34:24.425 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-16T09:34:24.464 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-16T09:34:24.493 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 3/4 2024-09-16T09:34:28.031 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 3/4 2024-09-16T09:34:28.106 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 4/4 2024-09-16T09:34:29.127 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 3/4 2024-09-16T09:34:29.198 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 4/4 2024-09-16T09:34:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 4/4 2024-09-16T09:34:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 1/4 2024-09-16T09:34:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 2/4 2024-09-16T09:34:30.668 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:30.978 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:31.262 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph 2024-09-16T09:34:31.655 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 4/4 2024-09-16T09:34:31.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 1/4 2024-09-16T09:34:31.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 2/4 2024-09-16T09:34:31.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-16T09:34:31.838 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:39 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-16T09:34:31.966 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-16T09:34:31.967 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:31.967 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:31.991 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:31.994 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:31.994 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:34:31.994 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:31.994 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:34:31.994 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:19.1.1-328.gad35db06.el9 ceph 6.5 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:19.1.1-328.gad35db06.el9 ceph 2.4 M 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:19.1.1-328.gad35db06.el9 ceph 1.5 M 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 249 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:19.1.1-328.gad35db06.el9 ceph 4.7 M 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:19.1.1-328.gad35db06.el9 ceph 17 M 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T09:34:31.995 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T09:34:31.996 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:34:31.997 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:31.998 INFO:teuthology.orchestra.run.smithi111.stdout:Install 37 Packages 2024-09-16T09:34:31.998 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:31.998 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 30 M 2024-09-16T09:34:31.998 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 108 M 2024-09-16T09:34:31.998 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:34:32.235 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph 2024-09-16T09:34:32.741 INFO:teuthology.orchestra.run.smithi111.stdout:(1/37): ceph-19.1.1-328.gad35db06.el9.x86_64.rp 55 kB/s | 6.5 kB 00:00 2024-09-16T09:34:32.821 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:38 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:32.925 INFO:teuthology.orchestra.run.smithi111.stdout:(2/37): ceph-mgr-19.1.1-328.gad35db06.el9.x86_6 5.0 MB/s | 1.5 MB 00:00 2024-09-16T09:34:32.969 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:32.971 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:32.971 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:34:32.971 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:32.971 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:34:32.971 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:19.1.1-328.gad35db06.el9 ceph 6.5 k 2024-09-16T09:34:32.971 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:19.1.1-328.gad35db06.el9 ceph 2.4 M 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:19.1.1-328.gad35db06.el9 ceph 1.5 M 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 249 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:19.1.1-328.gad35db06.el9 ceph 4.7 M 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:19.1.1-328.gad35db06.el9 ceph 17 M 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-16T09:34:32.972 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-16T09:34:32.973 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-16T09:34:32.974 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout:Install 37 Packages 2024-09-16T09:34:32.975 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:32.976 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 30 M 2024-09-16T09:34:32.976 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 108 M 2024-09-16T09:34:32.976 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:34:32.992 INFO:teuthology.orchestra.run.smithi111.stdout:(3/37): ceph-mds-19.1.1-328.gad35db06.el9.x86_6 6.4 MB/s | 2.4 MB 00:00 2024-09-16T09:34:33.076 INFO:teuthology.orchestra.run.smithi111.stdout:(4/37): ceph-mon-19.1.1-328.gad35db06.el9.x86_6 14 MB/s | 4.7 MB 00:00 2024-09-16T09:34:33.100 INFO:teuthology.orchestra.run.smithi111.stdout:(5/37): ceph-mgr-modules-core-19.1.1-328.gad35d 2.3 MB/s | 249 kB 00:00 2024-09-16T09:34:33.218 INFO:teuthology.orchestra.run.smithi111.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-16T09:34:33.260 INFO:teuthology.orchestra.run.smithi111.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-16T09:34:33.310 INFO:teuthology.orchestra.run.smithi111.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 5.9 MB/s | 1.2 MB 00:00 2024-09-16T09:34:33.335 INFO:teuthology.orchestra.run.smithi111.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-16T09:34:33.361 INFO:teuthology.orchestra.run.smithi111.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-16T09:34:33.386 INFO:teuthology.orchestra.run.smithi111.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-16T09:34:33.586 INFO:teuthology.orchestra.run.smithi111.stdout:(12/37): ceph-osd-19.1.1-328.gad35db06.el9.x86_ 25 MB/s | 17 MB 00:00 2024-09-16T09:34:33.694 INFO:teuthology.orchestra.run.smithi111.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 565 kB/s | 188 kB 00:00 2024-09-16T09:34:33.720 INFO:teuthology.orchestra.run.smithi111.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 260 kB/s | 35 kB 00:00 2024-09-16T09:34:33.745 INFO:teuthology.orchestra.run.smithi111.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 480 kB/s | 172 kB 00:00 2024-09-16T09:34:33.770 INFO:teuthology.orchestra.run.smithi111.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 1.0 MB/s | 77 kB 00:00 2024-09-16T09:34:33.795 INFO:teuthology.orchestra.run.smithi111.stdout:(17/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-16T09:34:33.821 INFO:teuthology.orchestra.run.smithi111.stdout:(18/37): python3-pytz-2021.1-5.el9.noarch.rpm 506 kB/s | 51 kB 00:00 2024-09-16T09:34:33.863 INFO:teuthology.orchestra.run.smithi111.stdout:(19/37): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-09-16T09:34:33.905 INFO:teuthology.orchestra.run.smithi111.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 521 kB/s | 43 kB 00:00 2024-09-16T09:34:33.938 INFO:teuthology.orchestra.run.smithi111.stdout:(21/37): luarocks-3.9.2-5.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-09-16T09:34:33.964 INFO:teuthology.orchestra.run.smithi111.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-16T09:34:33.989 INFO:teuthology.orchestra.run.smithi111.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.3 MB/s | 358 kB 00:00 2024-09-16T09:34:34.014 INFO:teuthology.orchestra.run.smithi111.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-09-16T09:34:34.031 INFO:teuthology.orchestra.run.smithi111.stdout:(25/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-09-16T09:34:34.057 INFO:teuthology.orchestra.run.smithi111.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 345 kB/s | 23 kB 00:00 2024-09-16T09:34:34.059 INFO:teuthology.orchestra.run.smithi114.stdout:(1/37): ceph-19.1.1-328.gad35db06.el9.x86_64.rp 57 kB/s | 6.5 kB 00:00 2024-09-16T09:34:34.081 INFO:teuthology.orchestra.run.smithi111.stdout:(27/37): python3-jaraco-functools-3.5.0-2.el9.n 289 kB/s | 19 kB 00:00 2024-09-16T09:34:34.107 INFO:teuthology.orchestra.run.smithi111.stdout:(28/37): python3-jaraco-text-3.2.0-6.el9.noarch 260 kB/s | 20 kB 00:00 2024-09-16T09:34:34.132 INFO:teuthology.orchestra.run.smithi111.stdout:(29/37): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-09-16T09:34:34.157 INFO:teuthology.orchestra.run.smithi111.stdout:(30/37): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-16T09:34:34.183 INFO:teuthology.orchestra.run.smithi111.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-16T09:34:34.211 INFO:teuthology.orchestra.run.smithi111.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.6 MB/s | 90 kB 00:00 2024-09-16T09:34:34.284 INFO:teuthology.orchestra.run.smithi114.stdout:(2/37): ceph-mds-19.1.1-328.gad35db06.el9.x86_6 7.0 MB/s | 2.4 MB 00:00 2024-09-16T09:34:34.285 INFO:teuthology.orchestra.run.smithi111.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 351 kB/s | 36 kB 00:00 2024-09-16T09:34:34.325 INFO:teuthology.orchestra.run.smithi114.stdout:(3/37): ceph-mgr-19.1.1-328.gad35db06.el9.x86_6 4.0 MB/s | 1.5 MB 00:00 2024-09-16T09:34:34.370 INFO:teuthology.orchestra.run.smithi111.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.0 MB/s | 272 kB 00:00 2024-09-16T09:34:34.396 INFO:teuthology.orchestra.run.smithi111.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 796 kB/s | 20 kB 00:00 2024-09-16T09:34:34.421 INFO:teuthology.orchestra.run.smithi111.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-16T09:34:34.446 INFO:teuthology.orchestra.run.smithi111.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.6 MB/s | 427 kB 00:00 2024-09-16T09:34:34.450 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:34.450 INFO:teuthology.orchestra.run.smithi111.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-16T09:34:34.467 INFO:teuthology.orchestra.run.smithi114.stdout:(4/37): ceph-mon-19.1.1-328.gad35db06.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-16T09:34:34.493 INFO:teuthology.orchestra.run.smithi114.stdout:(5/37): ceph-mgr-modules-core-19.1.1-328.gad35d 1.5 MB/s | 249 kB 00:00 2024-09-16T09:34:34.595 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:34:34.636 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:34:34.636 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:34:34.668 INFO:teuthology.orchestra.run.smithi114.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-16T09:34:34.843 INFO:teuthology.orchestra.run.smithi114.stdout:(7/37): ceph-osd-19.1.1-328.gad35db06.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-16T09:34:34.869 INFO:teuthology.orchestra.run.smithi114.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 532 kB/s | 106 kB 00:00 2024-09-16T09:34:34.935 INFO:teuthology.orchestra.run.smithi114.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 1.8 MB/s | 125 kB 00:00 2024-09-16T09:34:34.977 INFO:teuthology.orchestra.run.smithi114.stdout:(10/37): python3-cryptography-36.0.1-4.el9.x86_ 2.5 MB/s | 1.2 MB 00:00 2024-09-16T09:34:35.002 INFO:teuthology.orchestra.run.smithi114.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-16T09:34:35.044 INFO:teuthology.orchestra.run.smithi114.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 674 kB/s | 135 kB 00:00 2024-09-16T09:34:35.107 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:34:35.107 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:34:35.337 INFO:teuthology.orchestra.run.smithi114.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-16T09:34:35.537 INFO:teuthology.orchestra.run.smithi114.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 337 kB/s | 188 kB 00:00 2024-09-16T09:34:35.562 INFO:teuthology.orchestra.run.smithi114.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 308 kB/s | 172 kB 00:00 2024-09-16T09:34:35.621 INFO:teuthology.orchestra.run.smithi114.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 272 kB/s | 77 kB 00:00 2024-09-16T09:34:35.646 INFO:teuthology.orchestra.run.smithi114.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-09-16T09:34:35.679 INFO:teuthology.orchestra.run.smithi114.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-16T09:34:35.713 INFO:teuthology.orchestra.run.smithi114.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-16T09:34:35.738 INFO:teuthology.orchestra.run.smithi114.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 767 kB/s | 43 kB 00:00 2024-09-16T09:34:35.767 INFO:teuthology.orchestra.run.smithi114.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.2 MB/s | 172 kB 00:00 2024-09-16T09:34:35.792 INFO:teuthology.orchestra.run.smithi114.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 427 kB/s | 11 kB 00:00 2024-09-16T09:34:35.817 INFO:teuthology.orchestra.run.smithi114.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 710 kB/s | 18 kB 00:00 2024-09-16T09:34:35.843 INFO:teuthology.orchestra.run.smithi114.stdout:(24/37): python3-jaraco-collections-3.0.0-8.el9 928 kB/s | 23 kB 00:00 2024-09-16T09:34:35.868 INFO:teuthology.orchestra.run.smithi114.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 786 kB/s | 19 kB 00:00 2024-09-16T09:34:35.893 INFO:teuthology.orchestra.run.smithi114.stdout:(26/37): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-09-16T09:34:35.918 INFO:teuthology.orchestra.run.smithi114.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-16T09:34:35.943 INFO:teuthology.orchestra.run.smithi114.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-09-16T09:34:35.969 INFO:teuthology.orchestra.run.smithi114.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-16T09:34:35.994 INFO:teuthology.orchestra.run.smithi114.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 663 kB/s | 16 kB 00:00 2024-09-16T09:34:36.019 INFO:teuthology.orchestra.run.smithi114.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-16T09:34:36.045 INFO:teuthology.orchestra.run.smithi114.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-16T09:34:36.070 INFO:teuthology.orchestra.run.smithi114.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-16T09:34:36.095 INFO:teuthology.orchestra.run.smithi114.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-16T09:34:36.120 INFO:teuthology.orchestra.run.smithi114.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-16T09:34:36.146 INFO:teuthology.orchestra.run.smithi114.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-09-16T09:34:36.462 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:34:36.524 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T09:34:36.557 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T09:34:36.585 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T09:34:36.658 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T09:34:36.725 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T09:34:36.758 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T09:34:36.851 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T09:34:36.938 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T09:34:36.986 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T09:34:37.021 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T09:34:37.051 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T09:34:37.085 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T09:34:37.118 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T09:34:37.129 INFO:teuthology.orchestra.run.smithi114.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 15 kB/s | 22 kB 00:01 2024-09-16T09:34:37.134 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:37.134 INFO:teuthology.orchestra.run.smithi114.stdout:Total 7.3 MB/s | 30 MB 00:04 2024-09-16T09:34:37.159 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T09:34:37.202 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T09:34:37.236 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T09:34:37.283 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:34:37.285 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T09:34:37.322 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:34:37.322 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:34:37.325 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T09:34:37.399 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T09:34:37.548 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T09:34:37.626 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T09:34:37.679 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T09:34:37.717 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T09:34:37.806 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T09:34:37.816 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:34:37.816 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:34:37.864 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T09:34:38.054 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T09:34:38.105 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T09:34:38.184 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T09:34:38.281 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T09:34:38.328 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T09:34:38.447 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T09:34:38.601 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-328.gad35db06.el9.n 32/37 2024-09-16T09:34:38.631 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 33/37 2024-09-16T09:34:38.657 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 33/37 2024-09-16T09:34:38.657 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:38.657 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T09:34:38.658 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T09:34:38.658 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T09:34:38.658 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:39.181 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:34:39.257 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-16T09:34:39.290 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-16T09:34:39.327 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-16T09:34:39.397 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-16T09:34:39.434 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-16T09:34:39.466 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-16T09:34:39.558 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-16T09:34:39.644 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-16T09:34:39.685 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-16T09:34:39.721 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-16T09:34:39.751 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-16T09:34:39.785 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-16T09:34:39.819 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-16T09:34:39.859 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-16T09:34:39.902 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-16T09:34:39.937 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-16T09:34:39.985 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-16T09:34:40.017 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-16T09:34:40.090 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-16T09:34:40.098 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 34/37 2024-09-16T09:34:40.125 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 34/37 2024-09-16T09:34:40.126 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:40.126 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T09:34:40.126 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T09:34:40.126 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T09:34:40.126 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:40.229 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-16T09:34:40.316 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-16T09:34:40.370 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-16T09:34:40.418 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-16T09:34:40.475 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-16T09:34:40.530 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-16T09:34:40.574 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 35/37 2024-09-16T09:34:40.598 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 35/37 2024-09-16T09:34:40.598 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:40.598 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T09:34:40.600 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T09:34:40.600 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T09:34:40.600 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:40.715 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-16T09:34:40.763 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-16T09:34:40.825 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 36/37 2024-09-16T09:34:40.841 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-16T09:34:40.848 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 36/37 2024-09-16T09:34:40.848 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:40.849 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T09:34:40.849 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T09:34:40.849 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T09:34:40.849 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:40.913 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:19.1.1-328.gad35db06.el9.x86_64 37/37 2024-09-16T09:34:40.930 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-16T09:34:40.980 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-16T09:34:41.095 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-16T09:34:41.254 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-328.gad35db06.el9.n 32/37 2024-09-16T09:34:41.281 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 33/37 2024-09-16T09:34:41.306 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 33/37 2024-09-16T09:34:41.307 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:41.307 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-16T09:34:41.307 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T09:34:41.307 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-16T09:34:41.307 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-2:19.1.1-328.gad35db06.el9.x86_64 37/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:19.1.1-328.gad35db06.el9.x86_64 1/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 2/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 3/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 4/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 5/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-328.gad35db06.el9.n 6/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T09:34:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T09:34:42.573 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T09:34:42.574 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T09:34:42.574 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T09:34:42.574 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T09:34:42.574 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T09:34:42.574 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T09:34:42.575 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T09:34:42.575 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T09:34:42.575 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T09:34:42.575 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T09:34:42.576 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T09:34:42.749 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 34/37 2024-09-16T09:34:42.776 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 34/37 2024-09-16T09:34:42.776 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:42.777 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-16T09:34:42.777 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T09:34:42.777 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-16T09:34:42.777 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:43.216 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 35/37 2024-09-16T09:34:43.241 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 35/37 2024-09-16T09:34:43.241 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:43.241 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-16T09:34:43.241 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T09:34:43.241 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-16T09:34:43.241 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:43.475 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 36/37 2024-09-16T09:34:43.498 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 36/37 2024-09-16T09:34:43.498 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:43.499 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-16T09:34:43.499 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T09:34:43.499 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-16T09:34:43.499 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:43.565 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:19.1.1-328.gad35db06.el9.x86_64 37/37 2024-09-16T09:34:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T09:34:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:43.695 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:34:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:43.695 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T09:34:43.696 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T09:34:43.697 INFO:teuthology.orchestra.run.smithi111.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T09:34:43.698 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T09:34:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T09:34:43.699 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:43.699 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:44.029 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-base 2024-09-16T09:34:44.598 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:52 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:44.687 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:34:44.728 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:44.729 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:34:44.729 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:44.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install cephadm 2024-09-16T09:34:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-2:19.1.1-328.gad35db06.el9.x86_64 37/37 2024-09-16T09:34:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:19.1.1-328.gad35db06.el9.x86_64 1/37 2024-09-16T09:34:45.224 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 2/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 3/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 4/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 5/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-328.gad35db06.el9.n 6/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-16T09:34:45.225 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-16T09:34:45.226 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-16T09:34:45.227 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-16T09:34:45.354 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:53 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:45.486 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:45.487 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:45.487 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:34:45.487 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 765 k 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 765 k 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 771 k 2024-09-16T09:34:45.488 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:34:45.774 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm-19.1.1-328.gad35db06.el9.noarch.rpm 2.6 MB/s | 765 kB 00:00 2024-09-16T09:34:45.774 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:45.774 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.6 MB/s | 765 kB 00:00 2024-09-16T09:34:45.775 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:34:45.780 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:34:45.780 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:34:45.786 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:34:45.786 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:34:45.863 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:46.336 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: lua-5.4.4-4.el9.x86_64 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-16T09:34:46.337 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-16T09:34:46.340 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-16T09:34:46.340 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-16T09:34:46.340 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-16T09:34:46.340 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-16T09:34:46.340 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ply-3.11-14.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-16T09:34:46.341 INFO:teuthology.orchestra.run.smithi114.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-16T09:34:46.342 INFO:teuthology.orchestra.run.smithi114.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-16T09:34:46.342 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-16T09:34:46.342 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-16T09:34:46.342 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-16T09:34:46.342 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:46.342 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:46.350 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:46.427 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:46.707 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-base 2024-09-16T09:34:46.802 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:47.030 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:47.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:47.030 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:34:47.030 INFO:teuthology.orchestra.run.smithi111.stdout: cephadm-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:47.031 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:47.031 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:47.237 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T09:34:47.278 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:53 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:47.368 INFO:teuthology.orchestra.run.smithi114.stdout:Package ceph-base-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:34:47.410 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:47.411 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:34:47.411 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:47.475 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install cephadm 2024-09-16T09:34:47.805 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:55 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:47.938 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:47.939 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:47.939 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-328.gad35db06.el9 ceph 145 k 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:47.940 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:34:47.941 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:47.941 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 145 k 2024-09-16T09:34:47.941 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 435 k 2024-09-16T09:34:47.941 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:34:48.034 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:54 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:48.146 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-immutable-object-cache-19.1.1-328.gad35db0 705 kB/s | 145 kB 00:00 2024-09-16T09:34:48.147 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:48.147 INFO:teuthology.orchestra.run.smithi111.stdout:Total 700 kB/s | 145 kB 00:00 2024-09-16T09:34:48.147 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:34:48.154 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:34:48.155 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:34:48.165 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 765 k 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 765 k 2024-09-16T09:34:48.166 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 771 k 2024-09-16T09:34:48.167 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:34:48.212 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:34:48.213 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:34:48.363 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:34:48.423 INFO:teuthology.orchestra.run.smithi114.stdout:cephadm-19.1.1-328.gad35db06.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-16T09:34:48.423 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:48.424 INFO:teuthology.orchestra.run.smithi114.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-16T09:34:48.424 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:34:48.429 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:34:48.429 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:34:48.435 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:34:48.435 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:34:48.447 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-328.gad35db06.e 1/1 2024-09-16T09:34:48.473 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-328.gad35db06.e 1/1 2024-09-16T09:34:48.474 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:48.474 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T09:34:48.474 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:48.508 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:34:48.958 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:49.052 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:49.458 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:49.466 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-328.gad35db06.e 1/1 2024-09-16T09:34:49.466 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:49.466 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:34:49.466 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:49.466 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:49.466 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:49.683 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr 2024-09-16T09:34:49.727 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/1 2024-09-16T09:34:49.727 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:49.727 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:34:49.727 INFO:teuthology.orchestra.run.smithi114.stdout: cephadm-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:49.727 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:49.728 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:49.936 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-immutable-object-cache 2024-09-16T09:34:50.254 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:58 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:50.348 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:34:50.390 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:50.391 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:34:50.391 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:50.452 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T09:34:50.500 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:56 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:50.634 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:50.635 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:50.635 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repo Size 2024-09-16T09:34:50.635 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:50.635 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-328.gad35db06.el9 ceph 145 k 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 145 k 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 435 k 2024-09-16T09:34:50.636 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:34:50.845 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-immutable-object-cache-19.1.1-328.gad35db0 693 kB/s | 145 kB 00:00 2024-09-16T09:34:50.846 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:50.846 INFO:teuthology.orchestra.run.smithi114.stdout:Total 689 kB/s | 145 kB 00:00 2024-09-16T09:34:50.847 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:34:50.854 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:34:50.854 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:34:50.910 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:34:50.911 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:34:51.011 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:59 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:51.066 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:34:51.143 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 3.6 M 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T09:34:51.144 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 32 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 16 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout:Install 12 Packages 2024-09-16T09:34:51.145 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:51.146 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 8.7 M 2024-09-16T09:34:51.146 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 104 M 2024-09-16T09:34:51.146 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:34:51.155 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-328.gad35db06.e 1/1 2024-09-16T09:34:51.179 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-328.gad35db06.e 1/1 2024-09-16T09:34:51.180 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:34:51.180 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-16T09:34:51.180 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:51.699 INFO:teuthology.orchestra.run.smithi111.stdout:(1/12): ceph-prometheus-alerts-19.1.1-328.gad35 97 kB/s | 16 kB 00:00 2024-09-16T09:34:51.725 INFO:teuthology.orchestra.run.smithi111.stdout:(2/12): ceph-grafana-dashboards-19.1.1-328.gad3 163 kB/s | 32 kB 00:00 2024-09-16T09:34:51.917 INFO:teuthology.orchestra.run.smithi111.stdout:(3/12): ceph-mgr-dashboard-19.1.1-328.gad35db06 9.2 MB/s | 3.6 MB 00:00 2024-09-16T09:34:51.959 INFO:teuthology.orchestra.run.smithi111.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-16T09:34:52.009 INFO:teuthology.orchestra.run.smithi111.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-16T09:34:52.034 INFO:teuthology.orchestra.run.smithi111.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-16T09:34:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-328.gad35db06.e 1/1 2024-09-16T09:34:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:52.051 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:34:52.051 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:34:52.052 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:52.052 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:52.076 INFO:teuthology.orchestra.run.smithi111.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-16T09:34:52.127 INFO:teuthology.orchestra.run.smithi111.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 22 MB/s | 2.0 MB 00:00 2024-09-16T09:34:52.152 INFO:teuthology.orchestra.run.smithi111.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.3 MB/s | 31 kB 00:00 2024-09-16T09:34:52.177 INFO:teuthology.orchestra.run.smithi111.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.4 MB/s | 188 kB 00:00 2024-09-16T09:34:52.202 INFO:teuthology.orchestra.run.smithi111.stdout:(11/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.1 MB/s | 144 kB 00:00 2024-09-16T09:34:52.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr 2024-09-16T09:34:52.819 INFO:teuthology.orchestra.run.smithi111.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 957 kB/s | 863 kB 00:00 2024-09-16T09:34:52.823 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:52.823 INFO:teuthology.orchestra.run.smithi111.stdout:Total 5.2 MB/s | 8.7 MB 00:01 2024-09-16T09:34:52.831 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:58 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:52.872 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:34:52.889 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:34:52.889 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:34:52.923 INFO:teuthology.orchestra.run.smithi114.stdout:Package ceph-mgr-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:34:52.966 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:52.966 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:34:52.967 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:53.040 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-dashboard 2024-09-16T09:34:53.085 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:34:53.085 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:34:53.602 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:59 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:53.609 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:34:53.678 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-16T09:34:53.713 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-16T09:34:53.735 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 3.6 M 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 32 k 2024-09-16T09:34:53.737 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 16 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:34:53.738 INFO:teuthology.orchestra.run.smithi114.stdout:Install 12 Packages 2024-09-16T09:34:53.739 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:53.739 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 8.7 M 2024-09-16T09:34:53.739 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 104 M 2024-09-16T09:34:53.739 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:34:53.759 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-16T09:34:53.798 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-16T09:34:53.899 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-16T09:34:54.032 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-16T09:34:54.091 INFO:teuthology.orchestra.run.smithi114.stdout:(1/12): ceph-prometheus-alerts-19.1.1-328.gad35 105 kB/s | 16 kB 00:00 2024-09-16T09:34:54.108 INFO:teuthology.orchestra.run.smithi114.stdout:(2/12): ceph-grafana-dashboards-19.1.1-328.gad3 182 kB/s | 32 kB 00:00 2024-09-16T09:34:54.119 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-16T09:34:54.171 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-16T09:34:54.200 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-16T09:34:54.231 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-328.gad35db06.el9. 10/12 2024-09-16T09:34:54.300 INFO:teuthology.orchestra.run.smithi114.stdout:(3/12): ceph-mgr-dashboard-19.1.1-328.gad35db06 9.7 MB/s | 3.6 MB 00:00 2024-09-16T09:34:54.458 INFO:teuthology.orchestra.run.smithi114.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.3 MB/s | 863 kB 00:00 2024-09-16T09:34:54.517 INFO:teuthology.orchestra.run.smithi114.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-16T09:34:54.542 INFO:teuthology.orchestra.run.smithi114.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-16T09:34:54.618 INFO:teuthology.orchestra.run.smithi114.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 27 MB/s | 2.0 MB 00:00 2024-09-16T09:34:54.643 INFO:teuthology.orchestra.run.smithi114.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-16T09:34:54.668 INFO:teuthology.orchestra.run.smithi114.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-16T09:34:54.694 INFO:teuthology.orchestra.run.smithi114.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 7.3 MB/s | 188 kB 00:00 2024-09-16T09:34:54.760 INFO:teuthology.orchestra.run.smithi114.stdout:(11/12): python3-protobuf-3.14.0-13.el9.noarch. 413 kB/s | 269 kB 00:00 2024-09-16T09:34:55.027 INFO:teuthology.orchestra.run.smithi114.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-16T09:34:55.030 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:34:55.030 INFO:teuthology.orchestra.run.smithi114.stdout:Total 6.7 MB/s | 8.7 MB 00:01 2024-09-16T09:34:55.079 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:34:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:34:55.096 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:34:55.284 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-328.gad35db06.el9 11/12 2024-09-16T09:34:55.310 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:34:55.311 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:34:55.324 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noar 12/12 2024-09-16T09:34:55.839 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:34:55.919 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-16T09:34:55.955 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-16T09:34:56.001 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-16T09:34:56.040 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-16T09:34:56.126 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-16T09:34:56.248 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-16T09:34:56.342 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-16T09:34:56.403 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-16T09:34:56.431 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-16T09:34:56.463 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-328.gad35db06.el9. 10/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noar 12/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-328.gad35db06.el9 1/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noar 2/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-328.gad35db06.el9. 3/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-16T09:34:56.664 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-16T09:34:56.665 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-16T09:34:56.665 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-16T09:34:56.996 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-16T09:34:56.996 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:56.996 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-grafana-dashboards-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-prometheus-alerts-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T09:34:56.997 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T09:34:56.998 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:56.998 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:34:57.227 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T09:34:57.510 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-328.gad35db06.el9 11/12 2024-09-16T09:34:57.555 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noar 12/12 2024-09-16T09:34:57.780 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:05 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:34:57.914 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout:====================================================================================== 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout:====================================================================================== 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 7.4 M 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T09:34:57.915 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout:====================================================================================== 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout:Install 12 Packages 2024-09-16T09:34:57.916 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:34:57.917 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 38 M 2024-09-16T09:34:57.917 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 212 M 2024-09-16T09:34:57.917 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:34:58.512 INFO:teuthology.orchestra.run.smithi111.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 864 kB/s | 191 kB 00:00 2024-09-16T09:34:58.579 INFO:teuthology.orchestra.run.smithi111.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 492 kB/s | 33 kB 00:00 2024-09-16T09:34:58.604 INFO:teuthology.orchestra.run.smithi111.stdout:(3/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-16T09:34:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noar 12/12 2024-09-16T09:34:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-328.gad35db06.el9 1/12 2024-09-16T09:34:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noar 2/12 2024-09-16T09:34:58.640 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-328.gad35db06.el9. 3/12 2024-09-16T09:34:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-16T09:34:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-16T09:34:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-16T09:34:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-16T09:34:58.641 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-16T09:34:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-16T09:34:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-16T09:34:58.642 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-16T09:34:58.671 INFO:teuthology.orchestra.run.smithi111.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-16T09:34:58.780 INFO:teuthology.orchestra.run.smithi111.stdout:(5/12): ceph-mgr-diskprediction-local-19.1.1-32 15 MB/s | 7.4 MB 00:00 2024-09-16T09:34:58.805 INFO:teuthology.orchestra.run.smithi111.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-16T09:34:58.872 INFO:teuthology.orchestra.run.smithi111.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-16T09:34:58.949 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-16T09:34:59.028 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:59.029 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:34:59.029 INFO:teuthology.orchestra.run.smithi114.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-16T09:34:59.029 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-grafana-dashboards-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:59.029 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-dashboard-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:59.029 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-prometheus-alerts-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:34:59.029 INFO:teuthology.orchestra.run.smithi114.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-16T09:34:59.030 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-16T09:34:59.030 INFO:teuthology.orchestra.run.smithi114.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-16T09:34:59.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-16T09:34:59.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-16T09:34:59.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-16T09:34:59.030 INFO:teuthology.orchestra.run.smithi114.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-16T09:34:59.031 INFO:teuthology.orchestra.run.smithi114.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-16T09:34:59.031 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:59.031 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:34:59.154 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-16T09:34:59.289 INFO:teuthology.orchestra.run.smithi111.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 4.2 MB/s | 3.0 MB 00:00 2024-09-16T09:34:59.372 INFO:teuthology.orchestra.run.smithi111.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.9 MB/s | 250 kB 00:00 2024-09-16T09:34:59.716 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:05 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:34:59.848 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:34:59.849 INFO:teuthology.orchestra.run.smithi114.stdout:====================================================================================== 2024-09-16T09:34:59.849 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:====================================================================================== 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 7.4 M 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-16T09:34:59.850 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:====================================================================================== 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout:Install 12 Packages 2024-09-16T09:34:59.851 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:34:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 38 M 2024-09-16T09:34:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 212 M 2024-09-16T09:34:59.852 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:00.064 INFO:teuthology.orchestra.run.smithi111.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.8 MB/s | 4.9 MB 00:01 2024-09-16T09:35:00.156 INFO:teuthology.orchestra.run.smithi111.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.0 MB/s | 5.1 MB 00:01 2024-09-16T09:35:00.176 INFO:teuthology.orchestra.run.smithi114.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 191 kB 00:00 2024-09-16T09:35:00.210 INFO:teuthology.orchestra.run.smithi114.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.2 MB/s | 801 kB 00:00 2024-09-16T09:35:00.310 INFO:teuthology.orchestra.run.smithi114.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 245 kB/s | 33 kB 00:00 2024-09-16T09:35:00.352 INFO:teuthology.orchestra.run.smithi114.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 440 kB/s | 18 kB 00:00 2024-09-16T09:35:00.394 INFO:teuthology.orchestra.run.smithi114.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 920 kB/s | 38 kB 00:00 2024-09-16T09:35:00.536 INFO:teuthology.orchestra.run.smithi114.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-32 14 MB/s | 7.4 MB 00:00 2024-09-16T09:35:00.703 INFO:teuthology.orchestra.run.smithi114.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-09-16T09:35:00.995 INFO:teuthology.orchestra.run.smithi114.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.8 MB/s | 3.0 MB 00:00 2024-09-16T09:35:01.112 INFO:teuthology.orchestra.run.smithi114.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.1 MB/s | 250 kB 00:00 2024-09-16T09:35:01.429 INFO:teuthology.orchestra.run.smithi114.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.8 MB/s | 4.9 MB 00:01 2024-09-16T09:35:01.495 INFO:teuthology.orchestra.run.smithi114.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.4 MB/s | 5.1 MB 00:00 2024-09-16T09:35:03.798 INFO:teuthology.orchestra.run.smithi111.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-16T09:35:03.798 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:03.799 INFO:teuthology.orchestra.run.smithi111.stdout:Total 6.5 MB/s | 38 MB 00:05 2024-09-16T09:35:04.156 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:04.181 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:04.181 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:04.337 INFO:teuthology.orchestra.run.smithi114.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.0 MB/s | 16 MB 00:03 2024-09-16T09:35:04.338 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:04.338 INFO:teuthology.orchestra.run.smithi114.stdout:Total 8.5 MB/s | 38 MB 00:04 2024-09-16T09:35:04.622 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:04.622 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:04.692 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:04.717 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:04.717 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:05.153 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:05.153 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:05.408 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:05.485 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T09:35:05.520 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T09:35:05.621 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T09:35:05.655 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T09:35:05.839 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T09:35:05.871 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T09:35:05.911 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:05.947 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T09:35:05.993 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-16T09:35:06.035 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-16T09:35:06.134 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-16T09:35:06.169 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-16T09:35:06.357 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-16T09:35:06.404 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-16T09:35:06.480 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-16T09:35:06.591 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T09:35:06.715 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T09:35:07.114 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-16T09:35:07.224 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-16T09:35:07.962 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T09:35:08.476 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T09:35:08.993 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T09:35:09.028 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db 12/12 2024-09-16T09:35:09.515 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-16T09:35:09.544 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db 12/12 2024-09-16T09:35:11.652 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db 12/12 2024-09-16T09:35:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db 1/12 2024-09-16T09:35:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T09:35:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T09:35:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T09:35:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T09:35:11.653 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T09:35:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T09:35:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T09:35:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T09:35:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T09:35:11.654 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T09:35:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T09:35:12.050 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:12.050 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T09:35:12.051 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:12.052 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db 12/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db 1/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-16T09:35:12.084 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-16T09:35:12.085 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-16T09:35:12.085 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-16T09:35:12.085 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-16T09:35:12.419 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-rook 2024-09-16T09:35:12.528 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-16T09:35:12.528 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:12.528 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-diskprediction-local-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-16T09:35:12.529 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:12.530 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:12.894 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-rook 2024-09-16T09:35:12.993 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:20 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:13.130 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:13.131 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:35:13.131 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:13.131 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:13.131 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 49 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T09:35:13.132 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout:Install 13 Packages 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.2 M 2024-09-16T09:35:13.133 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 26 M 2024-09-16T09:35:13.134 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:13.371 INFO:teuthology.orchestra.run.smithi111.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 215 kB/s | 19 kB 00:00 2024-09-16T09:35:13.395 INFO:teuthology.orchestra.run.smithi111.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 224 kB/s | 26 kB 00:00 2024-09-16T09:35:13.454 INFO:teuthology.orchestra.run.smithi111.stdout:(3/13): ceph-mgr-rook-19.1.1-328.gad35db06.el9. 285 kB/s | 49 kB 00:00 2024-09-16T09:35:13.472 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:19 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:13.505 INFO:teuthology.orchestra.run.smithi111.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-16T09:35:13.530 INFO:teuthology.orchestra.run.smithi111.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.4 MB/s | 222 kB 00:00 2024-09-16T09:35:13.563 INFO:teuthology.orchestra.run.smithi111.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 917 kB/s | 54 kB 00:00 2024-09-16T09:35:13.597 INFO:teuthology.orchestra.run.smithi111.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-16T09:35:13.608 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:13.609 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:13.609 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:35:13.609 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 49 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-16T09:35:13.610 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout:Install 13 Packages 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:13.611 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 2.2 M 2024-09-16T09:35:13.612 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 26 M 2024-09-16T09:35:13.612 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:13.622 INFO:teuthology.orchestra.run.smithi111.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 248 kB/s | 14 kB 00:00 2024-09-16T09:35:13.647 INFO:teuthology.orchestra.run.smithi111.stdout:(9/13): python3-google-auth-2.34.0-1.el9.noarch 4.4 MB/s | 220 kB 00:00 2024-09-16T09:35:13.673 INFO:teuthology.orchestra.run.smithi111.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T09:35:13.698 INFO:teuthology.orchestra.run.smithi111.stdout:(11/13): python3-pyasn1-modules-0.4.8-6.el9.noa 1.1 MB/s | 279 kB 00:00 2024-09-16T09:35:13.723 INFO:teuthology.orchestra.run.smithi111.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-16T09:35:13.765 INFO:teuthology.orchestra.run.smithi111.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-16T09:35:13.767 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:13.767 INFO:teuthology.orchestra.run.smithi111.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-16T09:35:13.804 INFO:teuthology.orchestra.run.smithi114.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 317 kB/s | 26 kB 00:00 2024-09-16T09:35:13.829 INFO:teuthology.orchestra.run.smithi114.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 181 kB/s | 19 kB 00:00 2024-09-16T09:35:13.831 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:13.846 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:13.846 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:13.904 INFO:teuthology.orchestra.run.smithi114.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-16T09:35:13.930 INFO:teuthology.orchestra.run.smithi114.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-16T09:35:13.935 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:13.936 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:13.955 INFO:teuthology.orchestra.run.smithi114.stdout:(5/13): ceph-mgr-rook-19.1.1-328.gad35db06.el9. 213 kB/s | 49 kB 00:00 2024-09-16T09:35:13.988 INFO:teuthology.orchestra.run.smithi114.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 918 kB/s | 54 kB 00:00 2024-09-16T09:35:14.014 INFO:teuthology.orchestra.run.smithi114.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-16T09:35:14.055 INFO:teuthology.orchestra.run.smithi114.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-16T09:35:14.072 INFO:teuthology.orchestra.run.smithi114.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 168 kB/s | 14 kB 00:00 2024-09-16T09:35:14.097 INFO:teuthology.orchestra.run.smithi114.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-16T09:35:14.189 INFO:teuthology.orchestra.run.smithi114.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.3 MB/s | 220 kB 00:00 2024-09-16T09:35:14.215 INFO:teuthology.orchestra.run.smithi114.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 767 kB/s | 90 kB 00:00 2024-09-16T09:35:14.248 INFO:teuthology.orchestra.run.smithi114.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 5.4 MB/s | 1.0 MB 00:00 2024-09-16T09:35:14.251 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:14.251 INFO:teuthology.orchestra.run.smithi114.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-16T09:35:14.313 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:14.328 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:14.328 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:14.418 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:14.419 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:14.440 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:14.595 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T09:35:14.649 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T09:35:14.714 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T09:35:14.759 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T09:35:14.800 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T09:35:14.910 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T09:35:14.919 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:15.012 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T09:35:15.060 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T09:35:15.079 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-16T09:35:15.141 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-16T09:35:15.197 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-16T09:35:15.242 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-16T09:35:15.284 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-16T09:35:15.386 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-16T09:35:15.487 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-16T09:35:15.535 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-16T09:35:15.780 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T09:35:15.833 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T09:35:15.866 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T09:35:15.914 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T09:35:15.936 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 13/13 2024-09-16T09:35:16.261 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-16T09:35:16.324 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-16T09:35:16.358 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-16T09:35:16.414 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-16T09:35:16.444 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 13/13 2024-09-16T09:35:16.629 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 13/13 2024-09-16T09:35:16.629 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 1/13 2024-09-16T09:35:16.629 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T09:35:16.630 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T09:35:16.943 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T09:35:16.944 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T09:35:16.945 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T09:35:16.945 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T09:35:16.945 INFO:teuthology.orchestra.run.smithi111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T09:35:16.945 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:16.945 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 13/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 1/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-16T09:35:17.186 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-16T09:35:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-16T09:35:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-16T09:35:17.187 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-16T09:35:17.197 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T09:35:17.515 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-rook-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-16T09:35:17.516 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-16T09:35:17.517 INFO:teuthology.orchestra.run.smithi114.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-16T09:35:17.517 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-16T09:35:17.517 INFO:teuthology.orchestra.run.smithi114.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-16T09:35:17.517 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:17.517 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:17.762 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr-cephadm 2024-09-16T09:35:17.766 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:25 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:17.900 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 146 k 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T09:35:17.901 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T09:35:17.902 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T09:35:17.902 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:17.902 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:17.902 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:17.902 INFO:teuthology.orchestra.run.smithi111.stdout:Install 6 Packages 2024-09-16T09:35:17.902 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:17.903 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 7.0 M 2024-09-16T09:35:17.903 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 33 M 2024-09-16T09:35:17.903 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:18.326 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:24 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:18.458 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm noarch 2:19.1.1-328.gad35db06.el9 ceph-noarch 146 k 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:35:18.459 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout:Install 6 Packages 2024-09-16T09:35:18.460 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:18.461 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 7.0 M 2024-09-16T09:35:18.461 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 33 M 2024-09-16T09:35:18.461 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:18.534 INFO:teuthology.orchestra.run.smithi111.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.6 MB/s | 248 kB 00:00 2024-09-16T09:35:18.585 INFO:teuthology.orchestra.run.smithi111.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-16T09:35:18.609 INFO:teuthology.orchestra.run.smithi111.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.3 MB/s | 58 kB 00:00 2024-09-16T09:35:18.643 INFO:teuthology.orchestra.run.smithi111.stdout:(4/6): ceph-mgr-cephadm-19.1.1-328.gad35db06.el 551 kB/s | 146 kB 00:00 2024-09-16T09:35:18.668 INFO:teuthology.orchestra.run.smithi111.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-16T09:35:18.760 INFO:teuthology.orchestra.run.smithi111.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-16T09:35:18.762 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:18.762 INFO:teuthology.orchestra.run.smithi111.stdout:Total 8.1 MB/s | 7.0 MB 00:00 2024-09-16T09:35:18.836 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:18.847 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:18.847 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:18.942 INFO:teuthology.orchestra.run.smithi114.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-16T09:35:18.946 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:18.946 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:18.992 INFO:teuthology.orchestra.run.smithi114.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-16T09:35:19.017 INFO:teuthology.orchestra.run.smithi114.stdout:(3/6): ceph-mgr-cephadm-19.1.1-328.gad35db06.el 615 kB/s | 146 kB 00:00 2024-09-16T09:35:19.043 INFO:teuthology.orchestra.run.smithi114.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-16T09:35:19.085 INFO:teuthology.orchestra.run.smithi114.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.1 MB/s | 74 kB 00:00 2024-09-16T09:35:19.160 INFO:teuthology.orchestra.run.smithi114.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-16T09:35:19.162 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:19.163 INFO:teuthology.orchestra.run.smithi114.stdout:Total 10 MB/s | 7.0 MB 00:00 2024-09-16T09:35:19.232 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:19.244 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:19.244 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:19.259 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:19.344 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:19.344 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:19.434 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T09:35:19.487 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T09:35:19.648 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:19.815 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-16T09:35:19.861 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-16T09:35:19.997 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T09:35:20.082 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T09:35:20.144 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T09:35:20.174 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 6/6 2024-09-16T09:35:20.378 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-16T09:35:20.464 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-16T09:35:20.527 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-16T09:35:20.557 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 6/6 2024-09-16T09:35:20.986 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 6/6 2024-09-16T09:35:20.987 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/6 2024-09-16T09:35:20.987 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T09:35:20.987 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T09:35:20.987 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T09:35:20.987 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T09:35:21.261 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:21.262 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 6/6 2024-09-16T09:35:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 1/6 2024-09-16T09:35:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-16T09:35:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-16T09:35:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-16T09:35:21.342 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-16T09:35:21.516 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-fuse 2024-09-16T09:35:21.623 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-cephadm-2:19.1.1-328.gad35db06.el9.noarch 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:21.624 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:21.851 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-fuse 2024-09-16T09:35:22.083 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:30 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:22.219 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:22.220 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:22.220 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-09-16T09:35:22.221 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:22.221 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:19.1.1-328.gad35db06.el9 ceph 898 k 2024-09-16T09:35:22.221 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-09-16T09:35:22.221 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T09:35:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:22.222 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:22.222 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:22.222 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2024-09-16T09:35:22.222 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:22.222 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 978 k 2024-09-16T09:35:22.223 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 2.9 M 2024-09-16T09:35:22.223 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:22.415 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:28 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:22.549 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:22.549 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:22.549 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-09-16T09:35:22.549 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:19.1.1-328.gad35db06.el9 ceph 898 k 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout:Install 2 Packages 2024-09-16T09:35:22.550 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:22.551 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 978 k 2024-09-16T09:35:22.551 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 2.9 M 2024-09-16T09:35:22.551 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:22.662 INFO:teuthology.orchestra.run.smithi111.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 484 kB/s | 80 kB 00:00 2024-09-16T09:35:22.796 INFO:teuthology.orchestra.run.smithi111.stdout:(2/2): ceph-fuse-19.1.1-328.gad35db06.el9.x86_6 2.9 MB/s | 898 kB 00:00 2024-09-16T09:35:22.796 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:22.796 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.7 MB/s | 978 kB 00:00 2024-09-16T09:35:22.809 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:22.832 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:22.833 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:22.861 INFO:teuthology.orchestra.run.smithi114.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 442 kB/s | 80 kB 00:00 2024-09-16T09:35:22.919 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:22.919 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:22.961 INFO:teuthology.orchestra.run.smithi114.stdout:(2/2): ceph-fuse-19.1.1-328.gad35db06.el9.x86_6 3.1 MB/s | 898 kB 00:00 2024-09-16T09:35:22.962 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:22.962 INFO:teuthology.orchestra.run.smithi114.stdout:Total 2.3 MB/s | 978 kB 00:00 2024-09-16T09:35:22.974 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:22.996 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:22.996 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:23.080 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:23.081 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:23.117 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:23.264 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T09:35:23.268 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:23.337 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 2/2 2024-09-16T09:35:23.397 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-16T09:35:23.460 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 2/2 2024-09-16T09:35:24.068 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 2/2 2024-09-16T09:35:24.068 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/2 2024-09-16T09:35:24.118 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 2/2 2024-09-16T09:35:24.118 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/2 2024-09-16T09:35:24.328 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T09:35:24.328 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:24.328 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:24.328 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T09:35:24.328 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:24.329 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:24.390 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-16T09:35:24.391 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:24.391 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:24.391 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:19.1.1-328.gad35db06.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-16T09:35:24.391 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:24.391 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:24.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados-devel 2024-09-16T09:35:24.656 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librados-devel 2024-09-16T09:35:25.169 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:25.239 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:31 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:25.304 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:25.305 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:25.305 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-16T09:35:25.305 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:25.305 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:25.305 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:19.1.1-328.gad35db06.el9 ceph 127 k 2024-09-16T09:35:25.305 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 127 k 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 456 k 2024-09-16T09:35:25.306 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:25.377 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repo Size 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:19.1.1-328.gad35db06.el9 ceph 127 k 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:25.378 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 127 k 2024-09-16T09:35:25.379 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 456 k 2024-09-16T09:35:25.379 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:25.524 INFO:teuthology.orchestra.run.smithi111.stdout:librados-devel-19.1.1-328.gad35db06.el9.x86_64. 581 kB/s | 127 kB 00:00 2024-09-16T09:35:25.525 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:25.525 INFO:teuthology.orchestra.run.smithi111.stdout:Total 577 kB/s | 127 kB 00:00 2024-09-16T09:35:25.525 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:25.530 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:25.530 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:25.590 INFO:teuthology.orchestra.run.smithi114.stdout:librados-devel-19.1.1-328.gad35db06.el9.x86_64. 599 kB/s | 127 kB 00:00 2024-09-16T09:35:25.591 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:25.591 INFO:teuthology.orchestra.run.smithi114.stdout:Total 594 kB/s | 127 kB 00:00 2024-09-16T09:35:25.591 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:25.594 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:25.594 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:25.597 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:25.597 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:25.661 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:25.661 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:25.744 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:25.807 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:25.847 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:25.905 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:26.281 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:26.405 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:26.515 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:26.515 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:26.516 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:26.516 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:26.689 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:26.689 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:26.689 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:26.788 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs2 2024-09-16T09:35:26.926 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install libcephfs2 2024-09-16T09:35:27.364 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:35 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:27.455 INFO:teuthology.orchestra.run.smithi111.stdout:Package libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:27.498 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:27.499 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:27.500 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:27.510 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:33 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:27.570 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs-devel 2024-09-16T09:35:27.605 INFO:teuthology.orchestra.run.smithi114.stdout:Package libcephfs2-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:27.651 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:27.652 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:27.652 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:27.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install libcephfs-devel 2024-09-16T09:35:28.135 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:28.267 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:19.1.1-328.gad35db06.el9 ceph 32 k 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:28.268 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:28.269 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:28.269 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:35:28.269 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:28.269 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 32 k 2024-09-16T09:35:28.269 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 142 k 2024-09-16T09:35:28.269 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:28.273 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:34 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:28.405 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repo Size 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:19.1.1-328.gad35db06.el9 ceph 32 k 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:35:28.406 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:28.407 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 32 k 2024-09-16T09:35:28.407 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 142 k 2024-09-16T09:35:28.407 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:28.428 INFO:teuthology.orchestra.run.smithi111.stdout:libcephfs-devel-19.1.1-328.gad35db06.el9.x86_64 200 kB/s | 32 kB 00:00 2024-09-16T09:35:28.428 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:28.429 INFO:teuthology.orchestra.run.smithi111.stdout:Total 198 kB/s | 32 kB 00:00 2024-09-16T09:35:28.429 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:28.432 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:28.432 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:28.449 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:28.449 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:28.533 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:28.560 INFO:teuthology.orchestra.run.smithi114.stdout:libcephfs-devel-19.1.1-328.gad35db06.el9.x86_64 206 kB/s | 32 kB 00:00 2024-09-16T09:35:28.561 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:28.561 INFO:teuthology.orchestra.run.smithi114.stdout:Total 204 kB/s | 32 kB 00:00 2024-09-16T09:35:28.561 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:28.565 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:28.565 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:28.583 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:28.584 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:28.642 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:28.672 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:28.790 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:29.017 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:29.138 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:29.292 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:29.292 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:29.292 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:29.387 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:29.387 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:29.387 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:29.388 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:29.388 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:29.388 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:29.470 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2024-09-16T09:35:29.567 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librados2 2024-09-16T09:35:30.038 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:38 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:30.129 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:30.132 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:30.172 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:30.173 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:30.173 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:30.223 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:30.238 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librbd1 2024-09-16T09:35:30.268 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:30.268 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:30.268 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:30.333 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librbd1 2024-09-16T09:35:30.806 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:38 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:30.897 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:30.898 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:36 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:30.940 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:30.941 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:30.941 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:30.988 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:31.004 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rados 2024-09-16T09:35:31.033 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:31.033 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:31.033 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:31.092 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-rados 2024-09-16T09:35:31.574 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:39 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:31.663 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:37 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:31.668 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:31.713 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:31.713 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:31.713 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:31.755 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-rados-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:31.781 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rgw 2024-09-16T09:35:31.800 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:31.800 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:31.800 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:31.869 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-rgw 2024-09-16T09:35:32.345 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:32.436 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:32.445 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:38 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:32.479 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:32.480 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:32.480 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:32.537 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-rgw-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:32.538 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-cephfs 2024-09-16T09:35:32.581 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:32.581 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:32.581 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:32.645 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-cephfs 2024-09-16T09:35:33.100 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:41 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:33.190 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:33.222 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:39 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:33.233 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:33.234 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:33.234 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:33.298 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rbd 2024-09-16T09:35:33.312 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-cephfs-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:33.355 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:33.356 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:33.356 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:33.427 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-rbd 2024-09-16T09:35:33.866 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:41 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:33.956 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:33.989 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:39 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:33.999 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:34.000 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-09-16T09:35:34.000 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:34.080 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-rbd-2:19.1.1-328.gad35db06.el9.x86_64 is already installed. 2024-09-16T09:35:34.086 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-fuse 2024-09-16T09:35:34.123 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:34.123 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-09-16T09:35:34.124 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:34.186 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-fuse 2024-09-16T09:35:34.652 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:42 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:34.753 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:40 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:34.786 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:19.1.1-328.gad35db06.el9 ceph 85 k 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:34.787 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 85 k 2024-09-16T09:35:34.788 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 231 k 2024-09-16T09:35:34.788 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:34.886 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:34.887 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:19.1.1-328.gad35db06.el9 ceph 85 k 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:35:34.888 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:34.889 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 85 k 2024-09-16T09:35:34.889 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 231 k 2024-09-16T09:35:34.889 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:34.981 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-fuse-19.1.1-328.gad35db06.el9.x86_64.rpm 442 kB/s | 85 kB 00:00 2024-09-16T09:35:34.981 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:34.981 INFO:teuthology.orchestra.run.smithi111.stdout:Total 439 kB/s | 85 kB 00:00 2024-09-16T09:35:34.981 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:34.988 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:34.988 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:35.052 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:35.052 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:35.080 INFO:teuthology.orchestra.run.smithi114.stdout:rbd-fuse-19.1.1-328.gad35db06.el9.x86_64.rpm 444 kB/s | 85 kB 00:00 2024-09-16T09:35:35.081 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:35.081 INFO:teuthology.orchestra.run.smithi114.stdout:Total 441 kB/s | 85 kB 00:00 2024-09-16T09:35:35.081 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:35.088 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:35.088 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:35.151 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:35.152 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:35.204 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:35.300 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:35.302 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:35.402 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:35.693 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:35.795 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:35.946 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:35.946 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:35.946 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:35.946 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:35.946 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:35.947 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:36.063 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:36.064 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:36.064 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:36.064 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:36.064 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:36.064 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:36.190 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-mirror 2024-09-16T09:35:36.328 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-mirror 2024-09-16T09:35:36.768 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:44 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:36.905 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:36.906 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:36.906 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-09-16T09:35:36.906 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:19.1.1-328.gad35db06.el9 ceph 3.1 M 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 3.1 M 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 13 M 2024-09-16T09:35:36.907 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:36.908 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:42 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:37.044 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repo Size 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:19.1.1-328.gad35db06.el9 ceph 3.1 M 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:37.045 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:37.046 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:35:37.046 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:37.046 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 3.1 M 2024-09-16T09:35:37.046 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 13 M 2024-09-16T09:35:37.046 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:37.225 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-mirror-19.1.1-328.gad35db06.el9.x86_64.rpm 9.7 MB/s | 3.1 MB 00:00 2024-09-16T09:35:37.226 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:37.226 INFO:teuthology.orchestra.run.smithi111.stdout:Total 9.7 MB/s | 3.1 MB 00:00 2024-09-16T09:35:37.226 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:37.235 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:37.235 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:37.316 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:37.316 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:37.350 INFO:teuthology.orchestra.run.smithi114.stdout:rbd-mirror-19.1.1-328.gad35db06.el9.x86_64.rpm 10 MB/s | 3.1 MB 00:00 2024-09-16T09:35:37.350 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:37.351 INFO:teuthology.orchestra.run.smithi114.stdout:Total 10 MB/s | 3.1 MB 00:00 2024-09-16T09:35:37.351 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:37.360 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:37.360 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:37.440 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:37.441 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:37.752 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:37.810 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:37.835 INFO:teuthology.orchestra.run.smithi111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:35:37.835 INFO:teuthology.orchestra.run.smithi111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T09:35:37.835 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T09:35:37.835 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T09:35:37.835 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:37.883 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:37.950 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:37.975 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:37.975 INFO:teuthology.orchestra.run.smithi114.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-16T09:35:37.975 INFO:teuthology.orchestra.run.smithi114.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-16T09:35:37.975 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T09:35:37.976 INFO:teuthology.orchestra.run.smithi114.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-16T09:35:37.976 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:38.893 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:38.893 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:38.893 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:39.038 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:39.038 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:39.038 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:39.038 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:39.038 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:39.038 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:39.171 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-nbd 2024-09-16T09:35:39.285 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-nbd 2024-09-16T09:35:39.752 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:47 ago on Mon 16 Sep 2024 09:33:52 AM UTC. 2024-09-16T09:35:39.866 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:45 ago on Mon 16 Sep 2024 09:33:54 AM UTC. 2024-09-16T09:35:39.886 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:19.1.1-328.gad35db06.el9 ceph 170 k 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-09-16T09:35:39.887 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-09-16T09:35:39.888 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-09-16T09:35:39.888 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:39.888 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 170 k 2024-09-16T09:35:39.888 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 494 k 2024-09-16T09:35:39.889 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-09-16T09:35:40.001 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-09-16T09:35:40.002 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:40.002 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-09-16T09:35:40.003 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:40.003 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-09-16T09:35:40.003 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:19.1.1-328.gad35db06.el9 ceph 170 k 2024-09-16T09:35:40.003 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:40.003 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-09-16T09:35:40.004 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-09-16T09:35:40.004 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-09-16T09:35:40.004 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:40.004 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 170 k 2024-09-16T09:35:40.004 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 494 k 2024-09-16T09:35:40.004 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-09-16T09:35:40.095 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-nbd-19.1.1-328.gad35db06.el9.x86_64.rpm 824 kB/s | 170 kB 00:00 2024-09-16T09:35:40.095 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:40.096 INFO:teuthology.orchestra.run.smithi111.stdout:Total 818 kB/s | 170 kB 00:00 2024-09-16T09:35:40.096 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-09-16T09:35:40.104 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-09-16T09:35:40.104 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-09-16T09:35:40.168 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-09-16T09:35:40.168 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-09-16T09:35:40.236 INFO:teuthology.orchestra.run.smithi114.stdout:rbd-nbd-19.1.1-328.gad35db06.el9.x86_64.rpm 730 kB/s | 170 kB 00:00 2024-09-16T09:35:40.237 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:35:40.237 INFO:teuthology.orchestra.run.smithi114.stdout:Total 726 kB/s | 170 kB 00:00 2024-09-16T09:35:40.237 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-09-16T09:35:40.244 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-09-16T09:35:40.245 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-09-16T09:35:40.308 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-09-16T09:35:40.308 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-09-16T09:35:40.321 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-09-16T09:35:40.434 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:40.458 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-09-16T09:35:40.567 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:40.893 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:40.991 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:41.141 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:41.142 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:41.142 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-09-16T09:35:41.142 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:41.142 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:35:41.142 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-09-16T09:35:41.246 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 1/1 2024-09-16T09:35:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:41.247 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-09-16T09:35:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:19.1.1-328.gad35db06.el9.x86_64 2024-09-16T09:35:41.247 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:35:41.247 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-09-16T09:35:41.438 DEBUG:teuthology.parallel:result is None 2024-09-16T09:35:41.508 DEBUG:teuthology.parallel:result is None 2024-09-16T09:35:41.509 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:35:41.509 INFO:teuthology.packaging:ref: None 2024-09-16T09:35:41.509 INFO:teuthology.packaging:tag: None 2024-09-16T09:35:41.509 INFO:teuthology.packaging:branch: squid 2024-09-16T09:35:41.509 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:35:41.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T09:35:41.713 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T09:35:41.735 INFO:teuthology.orchestra.run.smithi111.stdout:19.1.1-328.gad35db06.el9 2024-09-16T09:35:41.736 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-328.gad35db06.el9 2024-09-16T09:35:41.736 INFO:teuthology.task.install:The correct ceph version 19.1.1-328.gad35db06 is installed. 2024-09-16T09:35:41.738 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-16T09:35:41.738 INFO:teuthology.packaging:ref: None 2024-09-16T09:35:41.738 INFO:teuthology.packaging:tag: None 2024-09-16T09:35:41.738 INFO:teuthology.packaging:branch: squid 2024-09-16T09:35:41.738 INFO:teuthology.packaging:sha1: 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:35:41.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-16T09:35:41.965 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-16T09:35:41.987 INFO:teuthology.orchestra.run.smithi114.stdout:19.1.1-328.gad35db06.el9 2024-09-16T09:35:41.987 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-328.gad35db06.el9 2024-09-16T09:35:41.987 INFO:teuthology.task.install:The correct ceph version 19.1.1-328.gad35db06 is installed. 2024-09-16T09:35:41.989 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-16T09:35:41.989 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:35:41.989 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T09:35:42.016 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:35:42.016 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-16T09:35:42.053 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-16T09:35:42.053 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:35:42.053 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T09:35:42.081 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T09:35:42.146 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:35:42.146 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-09-16T09:35:42.170 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-16T09:35:42.248 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-16T09:35:42.248 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:35:42.248 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T09:35:42.272 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T09:35:42.337 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:35:42.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-16T09:35:42.361 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-16T09:35:42.425 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-16T09:35:42.426 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:35:42.426 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T09:35:42.451 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T09:35:42.516 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:35:42.516 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-09-16T09:35:42.541 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-16T09:35:42.606 INFO:teuthology.run_tasks:Running task print... 2024-09-16T09:35:42.615 INFO:teuthology.task.print:**** done install task... 2024-09-16T09:35:42.615 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-16T09:35:42.715 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '66e33d6af1496291b0602ee0a859e68145f17dad'} 2024-09-16T09:35:42.716 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-16T09:35:42.716 INFO:tasks.cephadm:Cluster fsid is 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:35:42.717 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-16T09:35:42.717 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-16T09:35:42.717 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi111': '172.21.15.111', 'mon.smithi114': '172.21.15.114'} 2024-09-16T09:35:42.717 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-16T09:35:42.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname $(hostname -s) 2024-09-16T09:35:42.743 DEBUG:teuthology.orchestra.run.smithi114:> sudo hostname $(hostname -s) 2024-09-16T09:35:42.768 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-16T09:35:42.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:35:42.912 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '66e33d6af1496291b0602ee0a859e68145f17dad', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83025/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4882-g66e33d6a', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4882.g66e33d6a'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-12-1857/66e33d6af1496291b0602ee0a859e68145f17dad/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-12 19:44:45.618408', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-athakkar-testing-2024-09-12-1857', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-athakkar-testing-2024-09-12-1857/66e33d6af1496291b0602ee0a859e68145f17dad/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-16T09:35:43.135 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 ad35db06e8924912f01e32b35576297c0f1352b4 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-16T09:35:43.137 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/x86_64/flavors/default/cephadm 2024-09-16T09:35:43.137 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/x86_64/flavors/default/cephadm 2024-09-16T09:35:43.137 DEBUG:teuthology.orchestra.run.smithi111:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T09:35:43.502 INFO:teuthology.orchestra.run.smithi111.stdout:-rw-r--r--. 1 ubuntu ubuntu 784503 Sep 16 09:35 /home/ubuntu/cephtest/cephadm 2024-09-16T09:35:43.503 DEBUG:teuthology.orchestra.run.smithi114:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/ad35db06e8924912f01e32b35576297c0f1352b4/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-16T09:35:43.893 INFO:teuthology.orchestra.run.smithi114.stdout:-rw-r--r--. 1 ubuntu ubuntu 784503 Sep 16 09:35 /home/ubuntu/cephtest/cephadm 2024-09-16T09:35:43.894 DEBUG:teuthology.orchestra.run.smithi111:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T09:35:43.911 DEBUG:teuthology.orchestra.run.smithi114:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-16T09:35:43.944 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-16T09:35:43.944 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-16T09:35:43.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-16T09:35:45.543 INFO:teuthology.orchestra.run.smithi111.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-16T09:35:45.717 INFO:teuthology.orchestra.run.smithi114.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-16T09:36:24.260 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:36:24.261 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_version": "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)", 2024-09-16T09:36:24.261 INFO:teuthology.orchestra.run.smithi111.stdout: "image_id": "b5388489f99eed1a2d8ee67f2b17c954a02a6e69a5719b62acb92235fc14bbfe", 2024-09-16T09:36:24.261 INFO:teuthology.orchestra.run.smithi111.stdout: "repo_digests": [ 2024-09-16T09:36:24.261 INFO:teuthology.orchestra.run.smithi111.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60" 2024-09-16T09:36:24.261 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-09-16T09:36:24.261 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:36:27.870 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-09-16T09:36:27.871 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)", 2024-09-16T09:36:27.871 INFO:teuthology.orchestra.run.smithi114.stdout: "image_id": "b5388489f99eed1a2d8ee67f2b17c954a02a6e69a5719b62acb92235fc14bbfe", 2024-09-16T09:36:27.871 INFO:teuthology.orchestra.run.smithi114.stdout: "repo_digests": [ 2024-09-16T09:36:27.871 INFO:teuthology.orchestra.run.smithi114.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60" 2024-09-16T09:36:27.871 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-09-16T09:36:27.871 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-09-16T09:36:27.896 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph 2024-09-16T09:36:27.930 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph 2024-09-16T09:36:27.957 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /etc/ceph 2024-09-16T09:36:27.999 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /etc/ceph 2024-09-16T09:36:28.023 INFO:tasks.cephadm:Writing seed config... 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-16T09:36:28.025 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-16T09:36:28.026 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-16T09:36:28.027 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-16T09:36:28.027 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-16T09:36:28.027 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-16T09:36:28.027 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-16T09:36:28.027 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:36:28.027 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-16T09:36:28.057 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 0ada01d2-740f-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-16T09:36:28.057 DEBUG:teuthology.orchestra.run.smithi111:mon.smithi111> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service 2024-09-16T09:36:28.100 INFO:tasks.cephadm:Bootstrapping... 2024-09-16T09:36:28.100 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.111 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:36:28.310 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-09-16T09:36:28.310 INFO:teuthology.orchestra.run.smithi111.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.111', '--skip-admin-label'] 2024-09-16T09:36:28.310 INFO:teuthology.orchestra.run.smithi111.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-16T09:36:28.311 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying podman|docker is present... 2024-09-16T09:36:28.334 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout 5.2.2 2024-09-16T09:36:28.334 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying lvm2 is present... 2024-09-16T09:36:28.334 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying time synchronization is in place... 2024-09-16T09:36:28.342 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T09:36:28.342 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T09:36:28.348 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T09:36:28.348 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-16T09:36:28.355 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout enabled 2024-09-16T09:36:28.361 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout active 2024-09-16T09:36:28.361 INFO:teuthology.orchestra.run.smithi111.stdout:Unit chronyd.service is enabled and running 2024-09-16T09:36:28.361 INFO:teuthology.orchestra.run.smithi111.stdout:Repeating the final host check... 2024-09-16T09:36:28.388 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout 5.2.2 2024-09-16T09:36:28.388 INFO:teuthology.orchestra.run.smithi111.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-16T09:36:28.388 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl is present 2024-09-16T09:36:28.388 INFO:teuthology.orchestra.run.smithi111.stdout:lvcreate is present 2024-09-16T09:36:28.394 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-16T09:36:28.394 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-16T09:36:28.400 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-16T09:36:28.400 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-16T09:36:28.407 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout enabled 2024-09-16T09:36:28.413 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout active 2024-09-16T09:36:28.413 INFO:teuthology.orchestra.run.smithi111.stdout:Unit chronyd.service is enabled and running 2024-09-16T09:36:28.413 INFO:teuthology.orchestra.run.smithi111.stdout:Host looks OK 2024-09-16T09:36:28.413 INFO:teuthology.orchestra.run.smithi111.stdout:Cluster fsid: 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:28.413 INFO:teuthology.orchestra.run.smithi111.stdout:Acquiring lock 139852940265312 on /run/cephadm/0ada01d2-740f-11ef-bceb-c7b262605968.lock 2024-09-16T09:36:28.414 INFO:teuthology.orchestra.run.smithi111.stdout:Lock 139852940265312 acquired on /run/cephadm/0ada01d2-740f-11ef-bceb-c7b262605968.lock 2024-09-16T09:36:28.414 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying IP 172.21.15.111 port 3300 ... 2024-09-16T09:36:28.414 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying IP 172.21.15.111 port 6789 ... 2024-09-16T09:36:28.414 INFO:teuthology.orchestra.run.smithi111.stdout:Base mon IP(s) is [172.21.15.111:3300, 172.21.15.111:6789], mon addrv is [v2:172.21.15.111:3300,v1:172.21.15.111:6789] 2024-09-16T09:36:28.417 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.111 metric 100 2024-09-16T09:36:28.417 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.111 metric 100 2024-09-16T09:36:28.420 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-16T09:36:28.420 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-16T09:36:28.420 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-16T09:36:28.422 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-16T09:36:28.422 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-16T09:36:28.422 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T09:36:28.423 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-16T09:36:28.423 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc2f/64 scope link noprefixroute 2024-09-16T09:36:28.423 INFO:teuthology.orchestra.run.smithi111.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-16T09:36:28.423 INFO:teuthology.orchestra.run.smithi111.stdout:Mon IP `172.21.15.111` is in CIDR network `172.21.0.0/20` 2024-09-16T09:36:28.423 INFO:teuthology.orchestra.run.smithi111.stdout:Mon IP `172.21.15.111` is in CIDR network `172.21.0.0/20` 2024-09-16T09:36:28.423 INFO:teuthology.orchestra.run.smithi111.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-16T09:36:28.424 INFO:teuthology.orchestra.run.smithi111.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-16T09:36:28.424 INFO:teuthology.orchestra.run.smithi111.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-16T09:36:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stdout b5388489f99eed1a2d8ee67f2b17c954a02a6e69a5719b62acb92235fc14bbfe 2024-09-16T09:36:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-16T09:36:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Getting image source signatures 2024-09-16T09:36:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Copying blob sha256:c36cbe791b3d764506503890ade2f6681b288212a4797b71c720377aeba8f6a3 2024-09-16T09:36:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-16T09:36:28.829 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Copying config sha256:b5388489f99eed1a2d8ee67f2b17c954a02a6e69a5719b62acb92235fc14bbfe 2024-09-16T09:36:28.829 INFO:teuthology.orchestra.run.smithi111.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-16T09:36:29.800 INFO:teuthology.orchestra.run.smithi111.stdout:ceph: stdout ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable) 2024-09-16T09:36:29.800 INFO:teuthology.orchestra.run.smithi111.stdout:Ceph version: ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable) 2024-09-16T09:36:29.801 INFO:teuthology.orchestra.run.smithi111.stdout:Extracting ceph user uid/gid from container image... 2024-09-16T09:36:30.681 INFO:teuthology.orchestra.run.smithi111.stdout:stat: stdout 167 167 2024-09-16T09:36:30.681 INFO:teuthology.orchestra.run.smithi111.stdout:Creating initial keys... 2024-09-16T09:36:31.711 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph-authtool: stdout AQAf/Odm9vavABAAiLMLMUMPxI6JKEBqUu0r9g== 2024-09-16T09:36:32.567 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph-authtool: stdout AQAg/OdmdYcWABAAwhN3ZdaTwwVJfesv2UykFQ== 2024-09-16T09:36:33.431 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph-authtool: stdout AQAg/OdmGhwjNBAA8xMqzTcJwgVusgnGjbYNLw== 2024-09-16T09:36:33.432 INFO:teuthology.orchestra.run.smithi111.stdout:Creating initial monmap... 2024-09-16T09:36:34.505 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T09:36:34.505 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-16T09:36:34.505 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:34.505 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T09:36:34.505 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool for smithi111 [v2:172.21.15.111:3300,v1:172.21.15.111:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-16T09:36:34.505 INFO:teuthology.orchestra.run.smithi111.stdout:setting min_mon_release = quincy 2024-09-16T09:36:34.506 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: set fsid to 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:34.506 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-16T09:36:34.506 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:36:34.506 INFO:teuthology.orchestra.run.smithi111.stdout:Creating mon... 2024-09-16T09:36:35.453 INFO:teuthology.orchestra.run.smithi111.stdout:create mon.smithi111 on 2024-09-16T09:36:35.657 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-16T09:36:35.828 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-16T09:36:36.007 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-0ada01d2-740f-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-0ada01d2-740f-11ef-bceb-c7b262605968.target. 2024-09-16T09:36:36.007 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-0ada01d2-740f-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-0ada01d2-740f-11ef-bceb-c7b262605968.target. 2024-09-16T09:36:36.251 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111 2024-09-16T09:36:36.251 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service: Unit ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service not loaded. 2024-09-16T09:36:36.424 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0ada01d2-740f-11ef-bceb-c7b262605968.target.wants/ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service → /etc/systemd/system/ceph-0ada01d2-740f-11ef-bceb-c7b262605968@.service. 2024-09-16T09:36:36.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:36 smithi111 podman[27609]: 2024-09-16 09:36:36.899108753 +0000 UTC m=+0.349209537 container start 4014c1388a702ec0fc49eab41cd29cc2235a785d17d540bdb9aa494b309cb7e0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-ad35db0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T09:36:36.942 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:36 smithi111 ceph-mon[27628]: mkfs 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:36.985 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T09:36:36.985 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-16T09:36:36.993 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T09:36:36.993 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-16T09:36:36.993 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-16T09:36:36.993 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T09:36:36.993 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mon to start... 2024-09-16T09:36:36.994 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mon... 2024-09-16T09:36:37.227 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:36 smithi111 ceph-mon[27628]: mon.smithi111 is new leader, mons smithi111 in quorum (ranks 0) 2024-09-16T09:36:37.228 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:36 smithi111 bash[27609]: 4014c1388a702ec0fc49eab41cd29cc2235a785d17d540bdb9aa494b309cb7e0 2024-09-16T09:36:37.228 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:36 smithi111 systemd[1]: Started Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout cluster: 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout id: 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout services: 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi111 (age 0.521929s) 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-16T09:36:37.992 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout data: 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout pgs: 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:mon is available 2024-09-16T09:36:37.993 INFO:teuthology.orchestra.run.smithi111.stdout:Assimilating anything we can from ceph.conf... 2024-09-16T09:36:38.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: mon.smithi111 is new leader, mons smithi111 in quorum (ranks 0) 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: monmap epoch 1 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: last_changed 2024-09-16T09:36:33.786442+0000 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: min_mon_release 19 (squid) 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: election_strategy: 1 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: fsmap 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: mgrmap e1: no daemons active 2024-09-16T09:36:38.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:37 smithi111 ceph-mon[27628]: from='client.? 172.21.15.111:0/1041232802' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-16T09:36:38.906 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:38.906 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T09:36:38.906 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout fsid = 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:38.906 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.111:3300,v1:172.21.15.111:6789] 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T09:36:38.907 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T09:36:38.908 INFO:teuthology.orchestra.run.smithi111.stdout:Generating new minimal ceph.conf... 2024-09-16T09:36:39.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:38 smithi111 ceph-mon[27628]: from='client.? 172.21.15.111:0/1597955982' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T09:36:39.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:38 smithi111 ceph-mon[27628]: from='client.? 172.21.15.111:0/1597955982' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-16T09:36:39.919 INFO:teuthology.orchestra.run.smithi111.stdout:Restarting the monitor... 2024-09-16T09:36:40.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:39 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:36:40.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:39 smithi111 ceph-mon[27628]: from='client.? 172.21.15.111:0/3096477890' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:36:40.595 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:40 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[27624]: 2024-09-16T09:36:40.210+0000 7f2623ae9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:36:40.596 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:40 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[27624]: 2024-09-16T09:36:40.210+0000 7f2623ae9640 -1 mon.smithi111@0(leader) e1 *** Got Signal Terminated *** 2024-09-16T09:36:40.596 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:40 smithi111 podman[27870]: 2024-09-16 09:36:40.374713213 +0000 UTC m=+0.295622009 container died 4014c1388a702ec0fc49eab41cd29cc2235a785d17d540bdb9aa494b309cb7e0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-ad35db0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True) 2024-09-16T09:36:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:40 smithi111 podman[27870]: 2024-09-16 09:36:40.693907896 +0000 UTC m=+0.614816644 container cleanup 4014c1388a702ec0fc49eab41cd29cc2235a785d17d540bdb9aa494b309cb7e0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-ad35db0) 2024-09-16T09:36:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:40 smithi111 bash[27870]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111 2024-09-16T09:36:43.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:43 smithi111 podman[27883]: 2024-09-16 09:36:43.022053521 +0000 UTC m=+2.640322089 container remove 4014c1388a702ec0fc49eab41cd29cc2235a785d17d540bdb9aa494b309cb7e0 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, RELEASE=squid-ad35db0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-16T09:36:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:43 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service: Deactivated successfully. 2024-09-16T09:36:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:43 smithi111 systemd[1]: Stopped Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:36:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:43 smithi111 systemd[1]: Starting Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:36:43.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:43 smithi111 podman[27978]: 2024-09-16 09:36:43.387977578 +0000 UTC m=+0.050843675 image pull b5388489f99eed1a2d8ee67f2b17c954a02a6e69a5719b62acb92235fc14bbfe quay.ceph.io/ceph-ci/ceph:squid 2024-09-16T09:36:44.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:44 smithi111 podman[27978]: 2024-09-16 09:36:44.373334682 +0000 UTC m=+1.036200813 container create 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, RELEASE=squid-ad35db0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T09:36:46.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 podman[27978]: 2024-09-16 09:36:46.207343337 +0000 UTC m=+2.870209427 container init 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, RELEASE=squid-ad35db0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T09:36:46.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 podman[27978]: 2024-09-16 09:36:46.211478392 +0000 UTC m=+2.874344480 container start 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-ad35db0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-16T09:36:46.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T09:36:46.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable), process ceph-mon, pid 2 2024-09-16T09:36:46.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: pidfile_write: ignore empty --pid-file 2024-09-16T09:36:46.504 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: load: jerasure load: lrc 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: RocksDB version: 7.9.2 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Git sha 0 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Compile date 2024-09-15 21:07:06 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: DB SUMMARY 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: DB Session ID: 5Z65IWE69A3TQC7QPQA1 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: CURRENT file: CURRENT 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi111/store.db dir, Total Num: 1, files: 000008.sst 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi111/store.db: 000009.log size: 95863 ; 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.error_if_exists: 0 2024-09-16T09:36:46.505 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.create_if_missing: 0 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.paranoid_checks: 1 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.env: 0x562a4dcb3940 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.info_log: 0x562a4f2e38c0 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.statistics: (nil) 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.use_fsync: 0 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_log_file_size: 0 2024-09-16T09:36:46.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.allow_fallocate: 1 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.use_direct_reads: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.db_log_dir: 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.wal_dir: 2024-09-16T09:36:46.507 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.write_buffer_manager: 0x562a4f2f2dc0 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T09:36:46.508 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.unordered_write: 0 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.row_cache: None 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.wal_filter: None 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T09:36:46.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.two_write_queues: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.wal_compression: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.atomic_flush: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.log_readahead_size: 0 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T09:36:46.511 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_background_jobs: 2 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_background_compactions: -1 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_subcompactions: 1 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T09:36:46.512 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_open_files: -1 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_background_flushes: -1 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Compression algorithms supported: 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kZSTD supported: 0 2024-09-16T09:36:46.513 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kXpressCompression supported: 0 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kBZip2Compression supported: 0 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kLZ4Compression supported: 1 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kZlibCompression supported: 1 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: kSnappyCompression supported: 1 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000010 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.merge_operator: 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_filter: None 2024-09-16T09:36:46.514 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562a4f2e3520) 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks: 1 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_top_level_index_and_filter: 1 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_type: 0 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_index_type: 0 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_shortening: 1 2024-09-16T09:36:46.515 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: checksum: 4 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: no_block_cache: 0 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache: 0x562a4f2d71f0 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_name: BinnedLRUCache 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_options: 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: capacity : 536870912 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_shard_bits : 4 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: strict_capacity_limit : 0 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: high_pri_pool_ratio: 0.000 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_compressed: (nil) 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: persistent_cache: (nil) 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size: 4096 2024-09-16T09:36:46.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size_deviation: 10 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_restart_interval: 16 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_block_restart_interval: 1 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_block_size: 4096 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: partition_filters: 0 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: use_delta_encoding: 1 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: filter_policy: bloomfilter 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: whole_key_filtering: 1 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: verify_compression: 0 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: read_amp_bytes_per_bit: 0 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: format_version: 5 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_index_compression: 1 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_align: 0 2024-09-16T09:36:46.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_auto_readahead_size: 262144 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: prepopulate_block_cache: 0 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: initial_auto_readahead_size: 8192 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression: NoCompression 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.num_levels: 7 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T09:36:46.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T09:36:46.519 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T09:36:46.520 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T09:36:46.521 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T09:36:46.522 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.inplace_update_support: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.bloom_locality: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.max_successive_merges: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T09:36:46.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.ttl: 2592000 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.enable_blob_files: false 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.min_blob_size: 0 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T09:36:46.524 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e8e913ce-6df6-4418-9962-2999ad9c6782 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726479406242567, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726479406243609, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91864, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89905, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83273, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726479406, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e8e913ce-6df6-4418-9962-2999ad9c6782", "db_session_id": "5Z65IWE69A3TQC7QPQA1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726479406243722, "job": 1, "event": "recovery_finished"} 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi111/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562a4f304e00 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: DB pointer 0x562a4f400000 2024-09-16T09:36:46.525 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** DB Stats ** 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:36:46.526 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L0 2/0 91.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Sum 2/0 91.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 128.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 128.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T09:36:46.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative compaction: 0.00 GB write, 24.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval compaction: 0.00 GB write, 24.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache BinnedLRUCache@0x562a4f2d71f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-16T09:36:46.528 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: starting mon.smithi111 rank 0 at public addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] at bind addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi111 fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???) e1 preinit fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).mds e1 new map 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).mds e1 print_map 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: e1 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: btime 2024-09-16T09:36:36:938245+0000 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: legacy client fscid: -1 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:36:46.529 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: No filesystems configured 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mon.smithi111 is new leader, mons smithi111 in quorum (ranks 0) 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: monmap epoch 1 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: last_changed 2024-09-16T09:36:33.786442+0000 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: min_mon_release 19 (squid) 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: election_strategy: 1 2024-09-16T09:36:46.530 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:36:46.531 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: fsmap 2024-09-16T09:36:46.531 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: osdmap e1: 0 total, 0 up, 0 in 2024-09-16T09:36:46.531 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:46 smithi111 ceph-mon[27997]: mgrmap e1: no daemons active 2024-09-16T09:36:47.086 INFO:teuthology.orchestra.run.smithi111.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-16T09:36:47.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:47 smithi111 bash[27978]: 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee 2024-09-16T09:36:47.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:47 smithi111 systemd[1]: Started Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:36:51.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:51 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/316239731' entity='client.admin' 2024-09-16T09:36:52.706 INFO:teuthology.orchestra.run.smithi111.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-16T09:36:52.727 INFO:teuthology.orchestra.run.smithi111.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:36:52.727 INFO:teuthology.orchestra.run.smithi111.stdout:Creating mgr... 2024-09-16T09:36:52.728 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-16T09:36:52.728 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-16T09:36:52.728 INFO:teuthology.orchestra.run.smithi111.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-16T09:36:52.974 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mgr.smithi111.erxodt 2024-09-16T09:36:52.974 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Failed to reset failed state of unit ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mgr.smithi111.erxodt.service: Unit ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mgr.smithi111.erxodt.service not loaded. 2024-09-16T09:36:53.117 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-0ada01d2-740f-11ef-bceb-c7b262605968.target.wants/ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mgr.smithi111.erxodt.service → /etc/systemd/system/ceph-0ada01d2-740f-11ef-bceb-c7b262605968@.service. 2024-09-16T09:36:53.622 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T09:36:53.622 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-16T09:36:53.629 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T09:36:53.629 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-16T09:36:53.629 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-16T09:36:53.629 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to enable service . firewalld.service is not available 2024-09-16T09:36:53.640 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T09:36:53.640 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-16T09:36:53.645 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T09:36:53.645 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-16T09:36:53.645 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-16T09:36:53.645 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-16T09:36:53.645 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr to start... 2024-09-16T09:36:53.645 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr... 2024-09-16T09:36:54.488 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:54 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2651181485' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "0ada01d2-740f-11ef-bceb-c7b262605968", 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T09:36:54.764 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T09:36:54.765 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T09:36:54.766 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T09:36:36:938245+0000", 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T09:36:54.767 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T09:36:54.768 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T09:36:36.938921+0000", 2024-09-16T09:36:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T09:36:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T09:36:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:36:54.769 INFO:teuthology.orchestra.run.smithi111.stdout:mgr not available, waiting (1/15)... 2024-09-16T09:36:57.609 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:57 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1411561123' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T09:36:58.392 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:36:58.392 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:36:58.392 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "0ada01d2-740f-11ef-bceb-c7b262605968", 2024-09-16T09:36:58.392 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T09:36:58.392 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T09:36:58.392 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T09:36:58.393 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T09:36:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T09:36:58.398 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.398 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T09:36:58.398 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T09:36:36:938245+0000", 2024-09-16T09:36:58.399 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:36:58.400 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T09:36:36.938921+0000", 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:36:58.401 INFO:teuthology.orchestra.run.smithi111.stdout:mgr not available, waiting (2/15)... 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: Activating manager daemon smithi111.erxodt 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: mgrmap e2: smithi111.erxodt(active, starting, since 0.00307289s) 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:36:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:36:58.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:36:58.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:36:58.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:36:58.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' 2024-09-16T09:36:58.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' 2024-09-16T09:36:58.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:36:58 smithi111 ceph-mon[27997]: from='mgr.14100 172.21.15.111:0/2118892567' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:00.797 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:00 smithi111 ceph-mon[27997]: mgrmap e3: smithi111.erxodt(active, since 1.00661s) 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsid": "0ada01d2-740f-11ef-bceb-c7b262605968", 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "health": { 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-16T09:37:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 0 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "smithi111" 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-16T09:37:01.665 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-16T09:37:01.666 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-16T09:37:01.669 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.669 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-16T09:37:01.669 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "btime": "2024-09-16T09:36:36:938245+0000", 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-16T09:37:01.670 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "restful" 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ], 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-16T09:37:01.671 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-16T09:37:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "modified": "2024-09-16T09:36:36.938921+0000", 2024-09-16T09:37:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-16T09:37:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout }, 2024-09-16T09:37:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-16T09:37:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:37:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:mgr is available 2024-09-16T09:37:01.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:01 smithi111 ceph-mon[27997]: mgrmap e4: smithi111.erxodt(active, since 2s) 2024-09-16T09:37:01.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:01 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/506091234' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-16T09:37:02.815 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:02 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/287231373' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-16T09:37:02.819 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [global] 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout fsid = 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.111:3300,v1:172.21.15.111:6789] 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 2024-09-16T09:37:02.820 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout [osd] 2024-09-16T09:37:02.821 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-16T09:37:02.821 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-16T09:37:02.821 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-16T09:37:02.821 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-16T09:37:02.821 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-16T09:37:02.821 INFO:teuthology.orchestra.run.smithi111.stdout:Enabling cephadm module... 2024-09-16T09:37:04.005 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:03 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1798641674' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-16T09:37:04.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:04 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1798641674' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-16T09:37:04.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:04 smithi111 ceph-mon[27997]: mgrmap e5: smithi111.erxodt(active, since 5s) 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "active_name": "smithi111.erxodt", 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for the mgr to restart... 2024-09-16T09:37:05.441 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr epoch 5... 2024-09-16T09:37:05.858 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:05 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3070871171' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: Active manager daemon smithi111.erxodt restarted 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: Activating manager daemon smithi111.erxodt 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: osdmap e2: 0 total, 0 up, 0 in 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: mgrmap e6: smithi111.erxodt(active, starting, since 0.00369684s) 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:37:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:37:08.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:08 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:37:09.811 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:09 smithi111 ceph-mon[27997]: Found migration_current of "None". Setting to last migration. 2024-09-16T09:37:09.812 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:09 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:09.812 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:09 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:09.812 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:09 smithi111 ceph-mon[27997]: mgrmap e7: smithi111.erxodt(active, since 1.00574s) 2024-09-16T09:37:10.005 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:37:10.005 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-16T09:37:10.005 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T09:37:10.005 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:37:10.006 INFO:teuthology.orchestra.run.smithi111.stdout:mgr epoch 5 is available 2024-09-16T09:37:10.006 INFO:teuthology.orchestra.run.smithi111.stdout:Setting orchestrator backend to cephadm... 2024-09-16T09:37:10.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:10 smithi111 ceph-mon[27997]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T09:37:10.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:10 smithi111 ceph-mon[27997]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T09:37:11.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:10] ENGINE Bus STARTING 2024-09-16T09:37:11.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: mgrmap e8: smithi111.erxodt(active, since 2s) 2024-09-16T09:37:11.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:10] ENGINE Serving on https://172.21.15.111:7150 2024-09-16T09:37:11.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:10] ENGINE Error in HTTPServer.serve 2024-09-16T09:37:11.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:37:11.794 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:10] ENGINE Serving on http://172.21.15.111:8765 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:10] ENGINE Bus STARTED 2024-09-16T09:37:11.795 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:11 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:12.593 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-16T09:37:12.594 INFO:teuthology.orchestra.run.smithi111.stdout:Generating ssh key... 2024-09-16T09:37:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:12 smithi111 ceph-mon[27997]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:14.413 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:14 smithi111 ceph-mon[27997]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:14.414 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:14 smithi111 ceph-mon[27997]: Generating ssh key... 2024-09-16T09:37:14.414 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:14 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:14.414 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:14 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:15.008 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/ypw9KyhsM70VRQOxksJ/8u4KEB+hfqHia4y3z9FrU4MDEzBGFugsLtZs309X7jMAvVm+kCVmiPssn9IU36G4QSZ+UV3GI3urWXzeFfC6JWuIofdLmHTowwvWKGQH6/rZHutI3H+amg7J+1gbutWdkTt68Jzi3cFP5vq7MEcw2gAfob0hCnVYqyEl1ca7uXUb2oTi4MkV1Loq2MISHRYXvZPESuVdOj0Sth8V1b0cD8vEdqNJKbs3y7b2jEgQ4kJp4Rjbz80/ZdlBEcAcKNOMogXeUQ36ygMF1rsafI1bofw2hv3x7aHjQYpv/KtvRT8PGGx/v6bsnCK00lN/dCcprRrfrrMgs3UAW+jmZhAG8fEcq+ufrq6HeciiwnyKmWfprpNse0FbdUQMu77+APNEONNQzuqeIvZH9GokGYwRYv82wlgp5FYb3HhX99x1TMWJ5SQwlK/zGF5s5C1X5vH2B2yYxzo+XSJkWE1xUO7MqnmX+p9/mTxNN3qcBljIrA8= ceph-0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:37:15.008 INFO:teuthology.orchestra.run.smithi111.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-16T09:37:15.008 INFO:teuthology.orchestra.run.smithi111.stdout:Adding key to root@localhost authorized_keys... 2024-09-16T09:37:15.017 INFO:teuthology.orchestra.run.smithi111.stdout:Adding host smithi111... 2024-09-16T09:37:15.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:15 smithi111 ceph-mon[27997]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:16.362 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:16 smithi111 ceph-mon[27997]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "addr": "172.21.15.111", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:17.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:17 smithi111 ceph-mon[27997]: Deploying cephadm binary to smithi111 2024-09-16T09:37:19.333 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Added host 'smithi111' with addr '172.21.15.111' 2024-09-16T09:37:19.333 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying mon service with default placement... 2024-09-16T09:37:19.944 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:19 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:19.945 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:19 smithi111 ceph-mon[27997]: Added host smithi111 2024-09-16T09:37:19.945 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:19 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:20.725 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-16T09:37:20.725 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying mgr service with default placement... 2024-09-16T09:37:21.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:20 smithi111 ceph-mon[27997]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:21.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:20 smithi111 ceph-mon[27997]: Saving service mon spec with placement count:5 2024-09-16T09:37:21.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:20 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-16T09:37:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying crash service with default placement... 2024-09-16T09:37:23.104 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:22 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:23.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:22 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:23.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:22 smithi111 ceph-mon[27997]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:23.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:22 smithi111 ceph-mon[27997]: Saving service mgr spec with placement count:2 2024-09-16T09:37:23.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:22 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:24.414 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-16T09:37:24.414 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying ceph-exporter service with default placement... 2024-09-16T09:37:24.635 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:24 smithi111 ceph-mon[27997]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:24.635 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:24 smithi111 ceph-mon[27997]: Saving service crash spec with placement * 2024-09-16T09:37:24.635 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:24 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:25.529 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-16T09:37:25.529 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying prometheus service with default placement... 2024-09-16T09:37:25.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:25 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:25.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:25 smithi111 ceph-mon[27997]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:25.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:25 smithi111 ceph-mon[27997]: Saving service ceph-exporter spec with placement * 2024-09-16T09:37:25.938 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:25 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:26.752 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-16T09:37:26.752 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying grafana service with default placement... 2024-09-16T09:37:27.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:27 smithi111 ceph-mon[27997]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:27.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:27 smithi111 ceph-mon[27997]: Saving service prometheus spec with placement count:1 2024-09-16T09:37:27.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:27 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:27.850 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-16T09:37:27.850 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying node-exporter service with default placement... 2024-09-16T09:37:28.502 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:28 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:28.502 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:28 smithi111 ceph-mon[27997]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:28.502 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:28 smithi111 ceph-mon[27997]: Saving service grafana spec with placement count:1 2024-09-16T09:37:28.502 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:28 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:29.017 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-16T09:37:29.017 INFO:teuthology.orchestra.run.smithi111.stdout:Deploying alertmanager service with default placement... 2024-09-16T09:37:29.601 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:29 smithi111 ceph-mon[27997]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:29.601 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:29 smithi111 ceph-mon[27997]: Saving service node-exporter spec with placement * 2024-09-16T09:37:29.601 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:29 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:29.601 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:29 smithi111 ceph-mon[27997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:37:30.375 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-16T09:37:30.792 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:30 smithi111 ceph-mon[27997]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:30.792 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:30 smithi111 ceph-mon[27997]: Saving service alertmanager spec with placement count:1 2024-09-16T09:37:30.793 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:30 smithi111 ceph-mon[27997]: from='mgr.14118 172.21.15.111:0/1767734286' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:31.757 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:31 smithi111 ceph-mon[27997]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:37:31.757 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:31 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1240992697' entity='client.admin' 2024-09-16T09:37:33.208 INFO:teuthology.orchestra.run.smithi111.stdout:Enabling the dashboard module... 2024-09-16T09:37:33.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:33 smithi111 ceph-mon[27997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:37:33.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:33 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1326482530' entity='client.admin' 2024-09-16T09:37:34.937 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:34 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3676898025' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-16T09:37:35.839 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:35 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3676898025' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-16T09:37:35.839 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:35 smithi111 ceph-mon[27997]: mgrmap e9: smithi111.erxodt(active, since 26s) 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "active_name": "smithi111.erxodt", 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for the mgr to restart... 2024-09-16T09:37:36.381 INFO:teuthology.orchestra.run.smithi111.stdout:Waiting for mgr epoch 9... 2024-09-16T09:37:36.813 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:36 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3275294186' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-16T09:37:39.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: Active manager daemon smithi111.erxodt restarted 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: Activating manager daemon smithi111.erxodt 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: osdmap e3: 0 total, 0 up, 0 in 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: mgrmap e10: smithi111.erxodt(active, starting, since 0.0057501s) 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:37:39.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:37:39.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:37:39.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:39 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:37:41.331 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout { 2024-09-16T09:37:41.331 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-16T09:37:41.331 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-16T09:37:41.332 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout } 2024-09-16T09:37:41.332 INFO:teuthology.orchestra.run.smithi111.stdout:mgr epoch 9 is available 2024-09-16T09:37:41.332 INFO:teuthology.orchestra.run.smithi111.stdout:Generating a dashboard self-signed certificate... 2024-09-16T09:37:41.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:41 smithi111 ceph-mon[27997]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-16T09:37:41.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:41 smithi111 ceph-mon[27997]: mgrmap e11: smithi111.erxodt(active, since 1.00593s) 2024-09-16T09:37:41.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:41 smithi111 ceph-mon[27997]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-16T09:37:41.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:41 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:42.555 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-16T09:37:42.555 INFO:teuthology.orchestra.run.smithi111.stdout:Creating initial admin user... 2024-09-16T09:37:42.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:41] ENGINE Bus STARTING 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:41] ENGINE Serving on http://172.21.15.111:8765 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:41] ENGINE Serving on https://172.21.15.111:7150 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:41] ENGINE Bus STARTED 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: [16/Sep/2024:09:37:41] ENGINE Error in HTTPServer.serve 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-16T09:37:42.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-16T09:37:42.785 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:37:42.786 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: mgrmap e12: smithi111.erxodt(active, since 2s) 2024-09-16T09:37:42.786 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:42.786 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:42.786 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:42 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:43.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:43 smithi111 ceph-mon[27997]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:43 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:44.598 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:44 smithi111 ceph-mon[27997]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:44.601 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$2QqskdhB.gJw7t1yff7ijeXyDiE3RO23krX1Yr/LK5INAfqRuPrb6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726479463, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-16T09:37:44.601 INFO:teuthology.orchestra.run.smithi111.stdout:Fetching dashboard port number... 2024-09-16T09:37:45.757 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:45 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2247803963' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-16T09:37:45.757 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stdout 8443 2024-09-16T09:37:45.768 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-16T09:37:45.768 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout disabled 2024-09-16T09:37:45.775 INFO:teuthology.orchestra.run.smithi111.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-16T09:37:45.775 INFO:teuthology.orchestra.run.smithi111.stdout:systemctl: stdout inactive 2024-09-16T09:37:45.775 INFO:teuthology.orchestra.run.smithi111.stdout:firewalld.service is not enabled 2024-09-16T09:37:45.775 INFO:teuthology.orchestra.run.smithi111.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout:Ceph Dashboard is now available at: 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout: URL: https://smithi111.front.sepia.ceph.com:8443/ 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout: User: admin 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout: Password: 5giuf1l8w9 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:45.777 INFO:teuthology.orchestra.run.smithi111.stdout:Saving cluster configuration to /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config directory 2024-09-16T09:37:46.685 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:46 smithi111 ceph-mon[27997]: mgrmap e13: smithi111.erxodt(active, since 6s) 2024-09-16T09:37:46.685 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:46 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3590957651' entity='client.admin' 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout:Or, if you are only running a single cluster on this host: 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.973 INFO:teuthology.orchestra.run.smithi111.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout: ceph telemetry on 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout:For more information see: 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:46.974 INFO:teuthology.orchestra.run.smithi111.stdout:Bootstrap complete. 2024-09-16T09:37:47.010 INFO:tasks.cephadm:Fetching config... 2024-09-16T09:37:47.011 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:37:47.011 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-16T09:37:47.027 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-16T09:37:47.027 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:37:47.027 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-16T09:37:47.082 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-16T09:37:47.083 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:37:47.083 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/keyring of=/dev/stdout 2024-09-16T09:37:47.147 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-16T09:37:47.147 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:37:47.147 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-16T09:37:47.203 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-16T09:37:47.204 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/ypw9KyhsM70VRQOxksJ/8u4KEB+hfqHia4y3z9FrU4MDEzBGFugsLtZs309X7jMAvVm+kCVmiPssn9IU36G4QSZ+UV3GI3urWXzeFfC6JWuIofdLmHTowwvWKGQH6/rZHutI3H+amg7J+1gbutWdkTt68Jzi3cFP5vq7MEcw2gAfob0hCnVYqyEl1ca7uXUb2oTi4MkV1Loq2MISHRYXvZPESuVdOj0Sth8V1b0cD8vEdqNJKbs3y7b2jEgQ4kJp4Rjbz80/ZdlBEcAcKNOMogXeUQ36ygMF1rsafI1bofw2hv3x7aHjQYpv/KtvRT8PGGx/v6bsnCK00lN/dCcprRrfrrMgs3UAW+jmZhAG8fEcq+ufrq6HeciiwnyKmWfprpNse0FbdUQMu77+APNEONNQzuqeIvZH9GokGYwRYv82wlgp5FYb3HhX99x1TMWJ5SQwlK/zGF5s5C1X5vH2B2yYxzo+XSJkWE1xUO7MqnmX+p9/mTxNN3qcBljIrA8= ceph-0ada01d2-740f-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T09:37:47.277 INFO:teuthology.orchestra.run.smithi111.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/ypw9KyhsM70VRQOxksJ/8u4KEB+hfqHia4y3z9FrU4MDEzBGFugsLtZs309X7jMAvVm+kCVmiPssn9IU36G4QSZ+UV3GI3urWXzeFfC6JWuIofdLmHTowwvWKGQH6/rZHutI3H+amg7J+1gbutWdkTt68Jzi3cFP5vq7MEcw2gAfob0hCnVYqyEl1ca7uXUb2oTi4MkV1Loq2MISHRYXvZPESuVdOj0Sth8V1b0cD8vEdqNJKbs3y7b2jEgQ4kJp4Rjbz80/ZdlBEcAcKNOMogXeUQ36ygMF1rsafI1bofw2hv3x7aHjQYpv/KtvRT8PGGx/v6bsnCK00lN/dCcprRrfrrMgs3UAW+jmZhAG8fEcq+ufrq6HeciiwnyKmWfprpNse0FbdUQMu77+APNEONNQzuqeIvZH9GokGYwRYv82wlgp5FYb3HhX99x1TMWJ5SQwlK/zGF5s5C1X5vH2B2yYxzo+XSJkWE1xUO7MqnmX+p9/mTxNN3qcBljIrA8= ceph-0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:37:47.288 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/ypw9KyhsM70VRQOxksJ/8u4KEB+hfqHia4y3z9FrU4MDEzBGFugsLtZs309X7jMAvVm+kCVmiPssn9IU36G4QSZ+UV3GI3urWXzeFfC6JWuIofdLmHTowwvWKGQH6/rZHutI3H+amg7J+1gbutWdkTt68Jzi3cFP5vq7MEcw2gAfob0hCnVYqyEl1ca7uXUb2oTi4MkV1Loq2MISHRYXvZPESuVdOj0Sth8V1b0cD8vEdqNJKbs3y7b2jEgQ4kJp4Rjbz80/ZdlBEcAcKNOMogXeUQ36ygMF1rsafI1bofw2hv3x7aHjQYpv/KtvRT8PGGx/v6bsnCK00lN/dCcprRrfrrMgs3UAW+jmZhAG8fEcq+ufrq6HeciiwnyKmWfprpNse0FbdUQMu77+APNEONNQzuqeIvZH9GokGYwRYv82wlgp5FYb3HhX99x1TMWJ5SQwlK/zGF5s5C1X5vH2B2yYxzo+XSJkWE1xUO7MqnmX+p9/mTxNN3qcBljIrA8= ceph-0ada01d2-740f-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-16T09:37:47.374 INFO:teuthology.orchestra.run.smithi114.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/ypw9KyhsM70VRQOxksJ/8u4KEB+hfqHia4y3z9FrU4MDEzBGFugsLtZs309X7jMAvVm+kCVmiPssn9IU36G4QSZ+UV3GI3urWXzeFfC6JWuIofdLmHTowwvWKGQH6/rZHutI3H+amg7J+1gbutWdkTt68Jzi3cFP5vq7MEcw2gAfob0hCnVYqyEl1ca7uXUb2oTi4MkV1Loq2MISHRYXvZPESuVdOj0Sth8V1b0cD8vEdqNJKbs3y7b2jEgQ4kJp4Rjbz80/ZdlBEcAcKNOMogXeUQ36ygMF1rsafI1bofw2hv3x7aHjQYpv/KtvRT8PGGx/v6bsnCK00lN/dCcprRrfrrMgs3UAW+jmZhAG8fEcq+ufrq6HeciiwnyKmWfprpNse0FbdUQMu77+APNEONNQzuqeIvZH9GokGYwRYv82wlgp5FYb3HhX99x1TMWJ5SQwlK/zGF5s5C1X5vH2B2yYxzo+XSJkWE1xUO7MqnmX+p9/mTxNN3qcBljIrA8= ceph-0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:37:47.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-16T09:37:47.636 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:37:49.601 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:49 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2491503940' entity='client.admin' 2024-09-16T09:37:49.808 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-16T09:37:49.809 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-16T09:37:50.469 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:37:51.700 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:37:51.701 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:51 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:51.728 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi114 2024-09-16T09:37:51.728 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:37:51.728 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/etc/ceph/ceph.conf 2024-09-16T09:37:51.748 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:37:51.748 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:37:51.806 INFO:tasks.cephadm:Adding host smithi114 to orchestrator... 2024-09-16T09:37:51.806 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch host add smithi114 2024-09-16T09:37:52.152 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:37:52.546 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:52 smithi111 ceph-mon[27997]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:54.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi114", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: Deploying daemon crash.smithi111 on smithi111 2024-09-16T09:37:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:54 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:55.840 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:55 smithi111 ceph-mon[27997]: Deploying cephadm binary to smithi114 2024-09-16T09:37:56.469 INFO:teuthology.orchestra.run.smithi111.stdout:Added host 'smithi114' with addr '172.21.15.114' 2024-09-16T09:37:57.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-16T09:37:57.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:57.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:57.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:57.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:57.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-16T09:37:57.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:37:57.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:56 smithi111 ceph-mon[27997]: Added host smithi114 2024-09-16T09:37:57.372 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:37:58.055 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:37:58.055 INFO:teuthology.orchestra.run.smithi111.stdout:[{"addr": "172.21.15.111", "hostname": "smithi111", "labels": [], "status": ""}, {"addr": "172.21.15.114", "hostname": "smithi114", "labels": [], "status": ""}] 2024-09-16T09:37:58.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:37:58 smithi111 ceph-mon[27997]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T09:37:59.199 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-16T09:37:59.200 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-16T09:37:59.489 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:38:00.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:00 smithi111 ceph-mon[27997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:00.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:00 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:00.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:00 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:00.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:00 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:00.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:00 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:00.611 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:00 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:01.545 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2024-09-16T09:38:01.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:01 smithi111 ceph-mon[27997]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-16T09:38:01.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:01 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3173063521' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T09:38:02.432 INFO:tasks.cephadm:Adding mon.smithi111 on smithi111 2024-09-16T09:38:02.433 INFO:tasks.cephadm:Adding mon.smithi114 on smithi114 2024-09-16T09:38:02.433 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi111:172.21.15.111=smithi111;smithi114:172.21.15.114=smithi114' 2024-09-16T09:38:02.677 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:02.722 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:02.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:02 smithi111 ceph-mon[27997]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:02.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:02 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3173063521' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T09:38:02.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:02 smithi111 ceph-mon[27997]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T09:38:03.283 INFO:teuthology.orchestra.run.smithi114.stdout:Scheduled mon update... 2024-09-16T09:38:03.799 DEBUG:teuthology.orchestra.run.smithi114:mon.smithi114> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi114.service 2024-09-16T09:38:03.801 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:03.801 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:04.071 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:04.116 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:04.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:04 smithi111 ceph-mon[27997]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi111:172.21.15.111=smithi111;smithi114:172.21.15.114=smithi114", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:04.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:04 smithi111 ceph-mon[27997]: Saving service mon spec with placement smithi111:172.21.15.111=smithi111;smithi114:172.21.15.114=smithi114;count:2 2024-09-16T09:38:04.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:04 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:04.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:04 smithi111 ceph-mon[27997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:04.771 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:04.771 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:04.771 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:05.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:05 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:05 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1230759947' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:06.366 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:06.367 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:06.609 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:06.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:06 smithi111 ceph-mon[27997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:06.653 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:07.489 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:07.490 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:07.490 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:07.803 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:07 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/585052454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:08.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:08 smithi111 ceph-mon[27997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:08.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:08 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.078 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:09.079 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:09.333 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:09.378 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T09:38:09.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T09:38:09.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:09.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: Deploying daemon grafana.smithi111 on smithi111 2024-09-16T09:38:09.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:09 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:10.012 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:10.013 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:10.013 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:10.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:10 smithi111 ceph-mon[27997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:10.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:10 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/374433712' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:11.582 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:11.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:11.845 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:11.887 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:12.515 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:12.515 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:12.515 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:12.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:12 smithi111 ceph-mon[27997]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:12 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1246789979' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:14.056 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:14.056 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:14.299 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:14.344 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:14.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:14 smithi111 ceph-mon[27997]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:14.970 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:14.970 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:14.971 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:15.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:15 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1767916819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:16.562 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:16.562 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:16.802 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:16.846 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:16.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:16 smithi111 ceph-mon[27997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:17.429 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:17.429 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:17.429 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:17.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:17 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3998456665' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:18.828 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.829 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:18 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:18.996 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:18.996 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:19.243 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:19.288 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:19.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:19 smithi111 ceph-mon[27997]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-16T09:38:19.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:19 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:19.908 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:19.908 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:19.908 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:20.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:20 smithi111 ceph-mon[27997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:20.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:20 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3214903215' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:21.457 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:21.458 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:21.703 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:21.748 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:22.390 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:22.390 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:22.391 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:22 smithi111 ceph-mon[27997]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:22 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3891703909' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:23.939 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:23.939 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:24.183 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:24.245 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:24.861 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:24.861 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:24.861 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:24.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:24 smithi111 ceph-mon[27997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:25.802 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:25 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/4011265558' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:26.496 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:26.496 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:26.739 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:26.784 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:26.841 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:26 smithi111 ceph-mon[27997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:27.427 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:27.428 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:27.428 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:27.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:27 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1635504307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:28.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:28 smithi111 ceph-mon[27997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:29.009 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:29.010 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:29.250 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:29.294 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:29.952 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:29.952 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:29.952 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:30.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:30.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:30.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:30.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-16T09:38:30.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:30.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:30.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:30 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/2233173410' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:31.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:31 smithi111 ceph-mon[27997]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-16T09:38:31.328 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:31 smithi111 ceph-mon[27997]: mgrmap e14: smithi111.erxodt(active, since 50s) 2024-09-16T09:38:31.585 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:31.585 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:31.830 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:31.875 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:32.482 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:32.482 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:32.483 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:32.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:32 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/4264986256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:34.014 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:34.014 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:34.256 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:34.315 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:34.912 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:34.912 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:34.912 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:35.108 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: Active manager daemon smithi111.erxodt restarted 2024-09-16T09:38:35.108 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: Activating manager daemon smithi111.erxodt 2024-09-16T09:38:35.108 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: mgrmap e15: smithi111.erxodt(active, starting, since 0.00558656s) 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:38:35.109 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:36.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:38:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:38:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:38:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:35 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/4251791252' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:35 smithi111 ceph-mon[27997]: mgrmap e16: smithi111.erxodt(active, since 1.00551s) 2024-09-16T09:38:36.546 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:36.546 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:36.791 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:36.840 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:37.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:36 smithi111 ceph-mon[27997]: [16/Sep/2024:09:38:35] ENGINE Bus STARTING 2024-09-16T09:38:37.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:36 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:37.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:36 smithi111 ceph-mon[27997]: [16/Sep/2024:09:38:36] ENGINE Serving on https://172.21.15.111:7150 2024-09-16T09:38:37.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:36 smithi111 ceph-mon[27997]: [16/Sep/2024:09:38:36] ENGINE Error in HTTPServer.serve 2024-09-16T09:38:37.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:38:37.213 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-16T09:38:37.214 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:38:37.214 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-16T09:38:37.214 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:38:37.214 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:36 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:37.526 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:37.526 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:37.527 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:38.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:37 smithi111 ceph-mon[27997]: [16/Sep/2024:09:38:36] ENGINE Serving on http://172.21.15.111:8765 2024-09-16T09:38:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:37 smithi111 ceph-mon[27997]: [16/Sep/2024:09:38:36] ENGINE Bus STARTED 2024-09-16T09:38:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:37 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1013192831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:37 smithi111 ceph-mon[27997]: mgrmap e17: smithi111.erxodt(active, since 2s) 2024-09-16T09:38:39.095 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:39.095 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:39.376 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:39.427 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-16T09:38:40.118 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:40.118 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:40.119 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:40.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:40.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:40.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:40.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:40.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:38:41.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3901926562' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:41.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:38:42.116 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:42.116 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:42.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:42.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:42.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:38:42.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T09:38:42.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:42.782 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:43.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:42 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:38:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:42 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:38:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:42 smithi111 ceph-mon[27997]: Deploying daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:38:43.566 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:43.566 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:43.566 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:44.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:43 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1824685424' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:45.314 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:45.314 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: Deploying daemon crash.smithi114 on smithi114 2024-09-16T09:38:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:46.230 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:47.051 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:47.052 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:47.052 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:47.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:47 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3555702094' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:48.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:48 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:48.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:48 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:48.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:48 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:48.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:48 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:48.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:48 smithi111 ceph-mon[27997]: Deploying daemon node-exporter.smithi114 on smithi114 2024-09-16T09:38:48.940 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:48.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:49.190 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:50.148 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:50.148 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:50.149 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:51.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:50 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:51.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:50 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:38:51.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:50 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/761355465' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:52.378 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:52.379 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:52.986 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:52 smithi111 ceph-mon[27997]: Deploying daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:38:53.817 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:53.817 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:53.817 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:54.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:53 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/2518415100' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:55.661 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:55.661 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:55.995 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:38:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:56.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:55 smithi111 ceph-mon[27997]: Deploying daemon mon.smithi114 on smithi114 2024-09-16T09:38:57.192 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:38:57.192 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":1,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:36:33.786442Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-16T09:38:57.192 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 1 2024-09-16T09:38:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:57 smithi111 ceph-mon[27997]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:38:57 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/2597238130' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:58.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 systemd[1]: Starting Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:38:58.742 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 podman[35616]: 2024-09-16 09:38:58.511629435 +0000 UTC m=+0.018450724 image pull b5388489f99eed1a2d8ee67f2b17c954a02a6e69a5719b62acb92235fc14bbfe quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60 2024-09-16T09:38:58.743 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 podman[35616]: 2024-09-16 09:38:58.635120601 +0000 UTC m=+0.141941874 container create cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-ad35db0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-16T09:38:59.047 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 podman[35616]: 2024-09-16 09:38:58.871001932 +0000 UTC m=+0.377823205 container init cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ad35db0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:38:59.047 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 podman[35616]: 2024-09-16 09:38:58.874438089 +0000 UTC m=+0.381259363 container start cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-ad35db0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:38:59.047 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable), process ceph-mon, pid 2 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pidfile_write: ignore empty --pid-file 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: load: jerasure load: lrc 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: RocksDB version: 7.9.2 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Git sha 0 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Compile date 2024-09-15 21:07:06 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: DB SUMMARY 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: DB Session ID: EDR17NU3MJBB93BL7Q7T 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: CURRENT file: CURRENT 2024-09-16T09:38:59.048 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi114/store.db dir, Total Num: 0, files: 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi114/store.db: 000004.log size: 511 ; 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.error_if_exists: 0 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.create_if_missing: 0 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.paranoid_checks: 1 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.env: 0x5564979c5940 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.info_log: 0x5564985b78c0 2024-09-16T09:38:59.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T09:38:59.050 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.statistics: (nil) 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.use_fsync: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_log_file_size: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.allow_fallocate: 1 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.use_direct_reads: 0 2024-09-16T09:38:59.051 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.db_log_dir: 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.wal_dir: 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.write_buffer_manager: 0x5564985c6dc0 2024-09-16T09:38:59.052 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.unordered_write: 0 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T09:38:59.053 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.row_cache: None 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.wal_filter: None 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.two_write_queues: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.wal_compression: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.atomic_flush: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.log_readahead_size: 0 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T09:38:59.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_background_jobs: 2 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_background_compactions: -1 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_subcompactions: 1 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T09:38:59.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_open_files: -1 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_background_flushes: -1 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Compression algorithms supported: 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kZSTD supported: 0 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kXpressCompression supported: 0 2024-09-16T09:38:59.056 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kBZip2Compression supported: 0 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kLZ4Compression supported: 1 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kZlibCompression supported: 1 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: kSnappyCompression supported: 1 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi114/store.db/MANIFEST-000005 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.merge_operator: 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_filter: None 2024-09-16T09:38:59.057 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5564985b7520) 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: cache_index_and_filter_blocks: 1 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: pin_top_level_index_and_filter: 1 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: index_type: 0 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: data_block_index_type: 0 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: index_shortening: 1 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T09:38:59.058 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: checksum: 4 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: no_block_cache: 0 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache: 0x5564985ab1f0 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache_name: BinnedLRUCache 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache_options: 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: capacity : 536870912 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: num_shard_bits : 4 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: strict_capacity_limit : 0 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: high_pri_pool_ratio: 0.000 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache_compressed: (nil) 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: persistent_cache: (nil) 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_size: 4096 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_size_deviation: 10 2024-09-16T09:38:59.059 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_restart_interval: 16 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: index_block_restart_interval: 1 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: metadata_block_size: 4096 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: partition_filters: 0 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: use_delta_encoding: 1 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: filter_policy: bloomfilter 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: whole_key_filtering: 1 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: verify_compression: 0 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: read_amp_bytes_per_bit: 0 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: format_version: 5 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: enable_index_compression: 1 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_align: 0 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: max_auto_readahead_size: 262144 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: prepopulate_block_cache: 0 2024-09-16T09:38:59.060 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: initial_auto_readahead_size: 8192 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression: NoCompression 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.num_levels: 7 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T09:38:59.061 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:38:59.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T09:38:59.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T09:38:59.064 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.inplace_update_support: 0 2024-09-16T09:38:59.065 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.bloom_locality: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.max_successive_merges: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.ttl: 2592000 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T09:38:59.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.enable_blob_files: false 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.min_blob_size: 0 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T09:38:59.068 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi114/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9ba833ca-e058-48b2-b679-fb7ca8393600 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726479538901335, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726479538901744, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726479538, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9ba833ca-e058-48b2-b679-fb7ca8393600", "db_session_id": "EDR17NU3MJBB93BL7Q7T", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726479538901848, "job": 1, "event": "recovery_finished"} 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi114/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T09:38:59.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5564985d8e00 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: DB pointer 0x5564986d4000 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** DB Stats ** 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** Compaction Stats [default] ** 2024-09-16T09:38:59.070 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** Compaction Stats [default] ** 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:38:59.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Block cache BinnedLRUCache@0x5564985ab1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T09:38:59.072 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114 does not exist in monmap, will attempt to join an existing cluster 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: using public_addr v2:172.21.15.114:0/0 -> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: starting mon.smithi114 rank -1 at public addrs [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] at bind addrs [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi114 fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(???) e0 preinit fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).mds e1 new map 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).mds e1 print_map 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: e1 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: btime 2024-09-16T09:36:36:938245+0000 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: legacy client fscid: -1 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:38:59.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: No filesystems configured 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-16T09:38:59.074 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Added host smithi114 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.075 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3173063521' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3173063521' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: osdmap e4: 0 total, 0 up, 0 in 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi111:172.21.15.111=smithi111;smithi114:172.21.15.114=smithi114", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Saving service mon spec with placement smithi111:172.21.15.111=smithi111;smithi114:172.21.15.114=smithi114;count:2 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1230759947' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.076 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/585052454' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T09:38:59.077 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon grafana.smithi111 on smithi111 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/374433712' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1246789979' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1767916819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3998456665' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.078 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3214903215' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.079 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3891703909' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/4011265558' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1635504307' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/2233173410' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.080 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14162 172.21.15.111:0/3910006642' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mgrmap e14: smithi111.erxodt(active, since 50s) 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/4264986256' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Active manager daemon smithi111.erxodt restarted 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Activating manager daemon smithi111.erxodt 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mgrmap e15: smithi111.erxodt(active, starting, since 0.00558656s) 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:38:59.081 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/4251791252' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mgrmap e16: smithi111.erxodt(active, since 1.00551s) 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: [16/Sep/2024:09:38:35] ENGINE Bus STARTING 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: [16/Sep/2024:09:38:36] ENGINE Serving on https://172.21.15.111:7150 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: [16/Sep/2024:09:38:36] ENGINE Error in HTTPServer.serve 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Traceback (most recent call last): 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:38:59.082 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._run(expiration_interval) 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: s = self.context.wrap_socket( 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: return self.sslsocket_class._create( 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self.do_handshake() 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._sslobj.do_handshake() 2024-09-16T09:38:59.083 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: [16/Sep/2024:09:38:36] ENGINE Serving on http://172.21.15.111:8765 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: [16/Sep/2024:09:38:36] ENGINE Bus STARTED 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1013192831' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mgrmap e17: smithi111.erxodt(active, since 2s) 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3901926562' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd/host:smithi114", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.085 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1824685424' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon crash.smithi114 on smithi114 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3555702094' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon node-exporter.smithi114 on smithi114 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/761355465' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/2518415100' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: Deploying daemon mon.smithi114 on smithi114 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/2597238130' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 ceph-mon[35635]: mon.smithi114@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 bash[35616]: cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba 2024-09-16T09:38:59.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:38:58 smithi114 systemd[1]: Started Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:38:59.325 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-16T09:38:59.325 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-16T09:38:59.593 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:39:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: mon.smithi111 calling monitor election 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: mon.smithi114 calling monitor election 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: mon.smithi111 is new leader, mons smithi111,smithi114 in quorum (ranks 0,1) 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: monmap epoch 2 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: last_changed 2024-09-16T09:38:58.929938+0000 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: min_mon_release 19 (squid) 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: election_strategy: 1 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: 1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.smithi114 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: fsmap 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: mgrmap e17: smithi111.erxodt(active, since 29s) 2024-09-16T09:39:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: overall HEALTH_OK 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.385 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: mon.smithi111 calling monitor election 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: mon.smithi114 calling monitor election 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: mon.smithi111 is new leader, mons smithi111,smithi114 in quorum (ranks 0,1) 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: monmap epoch 2 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: last_changed 2024-09-16T09:38:58.929938+0000 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: min_mon_release 19 (squid) 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: election_strategy: 1 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: 1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.smithi114 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: fsmap 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: osdmap e5: 0 total, 0 up, 0 in 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: mgrmap e17: smithi111.erxodt(active, since 29s) 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: overall HEALTH_OK 2024-09-16T09:39:04.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/551364984' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.440 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:04.737 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:39:04.738 INFO:teuthology.orchestra.run.smithi114.stdout:{"epoch":2,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","modified":"2024-09-16T09:38:58.929938Z","created":"2024-09-16T09:36:33.786442Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi111","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:3300","nonce":0},{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi114","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:3300","nonce":0},{"type":"v1","addr":"172.21.15.114:6789","nonce":0}]},"addr":"172.21.15.114:6789/0","public_addr":"172.21.15.114:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-16T09:39:04.738 INFO:teuthology.orchestra.run.smithi114.stderr:dumped monmap epoch 2 2024-09-16T09:39:05.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:05 smithi111 ceph-mon[27997]: mgrmap e18: smithi111.erxodt(active, since 29s), standbys: smithi114.xvotey 2024-09-16T09:39:05.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi114.xvotey", "id": "smithi114.xvotey"}]: dispatch 2024-09-16T09:39:05.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:05.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:05 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1673114446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:39:05.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:05.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:05 smithi114 ceph-mon[35635]: mgrmap e18: smithi111.erxodt(active, since 29s), standbys: smithi114.xvotey 2024-09-16T09:39:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi114.xvotey", "id": "smithi114.xvotey"}]: dispatch 2024-09-16T09:39:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:05 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1673114446' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-16T09:39:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:05.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:39:05.768 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-16T09:39:05.768 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-16T09:39:06.029 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:06.108 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:06 smithi114 ceph-mon[35635]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:06.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:06 smithi111 ceph-mon[27997]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:06.628 INFO:teuthology.orchestra.run.smithi111.stdout:# minimal ceph.conf for 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:39:06.628 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-09-16T09:39:06.628 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:39:06.628 INFO:teuthology.orchestra.run.smithi111.stdout: mon_host = [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] 2024-09-16T09:39:07.338 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-16T09:39:07.338 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:39:07.338 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T09:39:07.367 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:39:07.367 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:39:07.432 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:39:07.432 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.conf 2024-09-16T09:39:07.460 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:39:07.461 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:39:07.526 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-16T09:39:07.527 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-16T09:39:07.529 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-16T09:39:07.529 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set client debug_client 20 2024-09-16T09:39:07.572 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-16T09:39:07.572 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set client debug_ms 1 2024-09-16T09:39:07.616 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-16T09:39:07.616 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-16T09:39:07.659 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-16T09:39:07.659 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/4168014482' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:07.689 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:39:07.690 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:07.691 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-16T09:39:07.691 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-16T09:39:07.735 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-16T09:39:07.735 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-16T09:39:07.778 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-16T09:39:07.779 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-16T09:39:07.821 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-16T09:39:07.821 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-16T09:39:07.865 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-16T09:39:07.865 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-16T09:39:07.909 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-16T09:39:07.910 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-16T09:39:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:39:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:39:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/4168014482' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:39:07.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:39:07.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:07.952 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-16T09:39:07.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-16T09:39:07.996 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-16T09:39:07.997 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-16T09:39:08.040 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-16T09:39:08.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-16T09:39:08.083 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-16T09:39:08.084 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-16T09:39:08.127 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-16T09:39:08.127 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-16T09:39:08.183 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-16T09:39:08.183 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-16T09:39:08.231 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-16T09:39:08.232 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-16T09:39:08.274 DEBUG:tasks.cephadm:set 18 configs 2024-09-16T09:39:08.275 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi111') 2024-09-16T09:39:08.808 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:08 smithi111 ceph-mon[27997]: Reconfiguring mon.smithi111 (unknown last config time)... 2024-09-16T09:39:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:08 smithi111 ceph-mon[27997]: Reconfiguring daemon mon.smithi111 on smithi111 2024-09-16T09:39:08.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:08 smithi114 ceph-mon[35635]: Reconfiguring mon.smithi111 (unknown last config time)... 2024-09-16T09:39:08.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:08 smithi114 ceph-mon[35635]: Reconfiguring daemon mon.smithi111 on smithi111 2024-09-16T09:39:09.611 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.611 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.614 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.614 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.616 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.617 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.631 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.632 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.636 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.644 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.645 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.645 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.645 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.649 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.649 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:09.816 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:09.816 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: Reconfiguring mgr.smithi111.erxodt (unknown last config time)... 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.erxodt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: Reconfiguring daemon mgr.smithi111.erxodt on smithi111 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:09.817 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:09 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/305952928' entity='client.admin' 2024-09-16T09:39:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: Reconfiguring mgr.smithi111.erxodt (unknown last config time)... 2024-09-16T09:39:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.erxodt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:39:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:39:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:09.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: Reconfiguring daemon mgr.smithi111.erxodt on smithi111 2024-09-16T09:39:09.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:09.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:09.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:09 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/305952928' entity='client.admin' 2024-09-16T09:39:12.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 -- 172.21.15.111:0/367686722 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fba8c06e280 msgr2=0x7fba8c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:12.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 --2- 172.21.15.111:0/367686722 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fba8c06e280 0x7fba8c070740 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fba94000c00 tx=0x7fba94005bd0 comp rx=0 tx=0).stop 2024-09-16T09:39:12.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 -- 172.21.15.111:0/367686722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbaa4102450 msgr2=0x7fbaa4196960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:12.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 --2- 172.21.15.111:0/367686722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbaa4102450 0x7fbaa4196960 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fba9800b4e0 tx=0x7fba9800b9a0 comp rx=0 tx=0).stop 2024-09-16T09:39:12.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 -- 172.21.15.111:0/367686722 shutdown_connections 2024-09-16T09:39:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 --2- 172.21.15.111:0/367686722 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fba8c06e280 0x7fba8c070740 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 --2- 172.21.15.111:0/367686722 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbaa4104d80 0x7fbaa4196ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 --2- 172.21.15.111:0/367686722 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbaa4102450 0x7fbaa4196960 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.089+0000 7fbaa9ea2640 1 -- 172.21.15.111:0/367686722 >> 172.21.15.111:0/367686722 conn(0x7fbaa40fbff0 msgr2=0x7fbaa40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:12.092 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:11 smithi111 ceph-mon[27997]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:12.092 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:11 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2705374518' entity='client.admin' 2024-09-16T09:39:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.090+0000 7fbaa9ea2640 1 -- 172.21.15.111:0/367686722 shutdown_connections 2024-09-16T09:39:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:12.090+0000 7fbaa9ea2640 1 -- 172.21.15.111:0/367686722 wait complete. 2024-09-16T09:39:12.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:11 smithi114 ceph-mon[35635]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:12.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:11 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2705374518' entity='client.admin' 2024-09-16T09:39:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:12 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1476752323' entity='client.admin' 2024-09-16T09:39:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:12 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/367686722' entity='client.admin' 2024-09-16T09:39:13.247 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:12 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1476752323' entity='client.admin' 2024-09-16T09:39:13.247 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:12 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/367686722' entity='client.admin' 2024-09-16T09:39:14.332 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:14 smithi111 ceph-mon[27997]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:14.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:14 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1111256161' entity='client.admin' 2024-09-16T09:39:14.333 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:14 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3162712728' entity='client.admin' 2024-09-16T09:39:14.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/7657197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8101a40 msgr2=0x7f0fc8101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:14.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/7657197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8101a40 0x7f0fc8101ec0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0fb8009880 tx=0x7f0fb802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/7657197 shutdown_connections 2024-09-16T09:39:14.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/7657197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8101a40 0x7f0fc8101ec0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/7657197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8100840 0x7f0fc8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/7657197 >> 172.21.15.111:0/7657197 conn(0x7f0fc80fbff0 msgr2=0x7f0fc80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/7657197 shutdown_connections 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/7657197 wait complete. 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 Processor -- start 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- start start 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 0x7f0fc8104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8101a40 0x7f0fc8102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc81089d0 con 0x7f0fc8100840 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.413+0000 7f0fcfa7f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc8108850 con 0x7f0fc8101a40 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 0x7f0fc8104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 0x7f0fc8104760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52744/0 (socket says 172.21.15.111:52744) 2024-09-16T09:39:14.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 -- 172.21.15.111:0/108857064 learned_addr learned my addr 172.21.15.111:0/108857064 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd01a640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8101a40 0x7f0fc8102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 -- 172.21.15.111:0/108857064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8101a40 msgr2=0x7f0fc8102e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8101a40 0x7f0fc8102e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 -- 172.21.15.111:0/108857064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc8103360 con 0x7f0fc8100840 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcd81b640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 0x7f0fc8104760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400d8d0 tx=0x7f0fc400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0fc4017070 con 0x7f0fc8100840 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f0fc400be10 con 0x7f0fc8100840 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc8103650 con 0x7f0fc8100840 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0fc4010d10 con 0x7f0fc8100840 2024-09-16T09:39:14.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.414+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc8103c60 con 0x7f0fc8100840 2024-09-16T09:39:14.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.415+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc81091b0 con 0x7f0fc8100840 2024-09-16T09:39:14.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.416+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f0fc401a070 con 0x7f0fc8100840 2024-09-16T09:39:14.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.416+0000 7f0fbeffd640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0fb406e230 0x7f0fb40706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:14.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.416+0000 7f0fcd01a640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0fb406e230 0x7f0fb40706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:14.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.416+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0fc408cca0 con 0x7f0fc8100840 2024-09-16T09:39:14.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.417+0000 7f0fcd01a640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0fb406e230 0x7f0fb40706f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fc81044e0 tx=0x7f0fb8004c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:14.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.420+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0fc405b6e0 con 0x7f0fc8100840 2024-09-16T09:39:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:14 smithi114 ceph-mon[35635]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:14 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1111256161' entity='client.admin' 2024-09-16T09:39:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:14 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3162712728' entity='client.admin' 2024-09-16T09:39:14.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.593+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f0fc8100c40 con 0x7f0fc8100840 2024-09-16T09:39:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.597+0000 7f0fbeffd640 1 -- 172.21.15.111:0/108857064 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v17)=0 v17) ==== 115+0+0 (secure 0 0 0) 0x7f0fc405f390 con 0x7f0fc8100840 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0fb406e230 msgr2=0x7f0fb40706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0fb406e230 0x7f0fb40706f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0fc81044e0 tx=0x7f0fb8004c80 comp rx=0 tx=0).stop 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 msgr2=0x7f0fc8104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 0x7f0fc8104760 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0fc400d8d0 tx=0x7f0fc400dd90 comp rx=0 tx=0).stop 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 shutdown_connections 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0fb406e230 0x7f0fb40706f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0fc8101a40 0x7f0fc8102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 --2- 172.21.15.111:0/108857064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fc8100840 0x7f0fc8104760 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:14.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 >> 172.21.15.111:0/108857064 conn(0x7f0fc80fbff0 msgr2=0x7f0fc8069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:14.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 shutdown_connections 2024-09-16T09:39:14.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.599+0000 7f0fcfa7f640 1 -- 172.21.15.111:0/108857064 wait complete. 2024-09-16T09:39:15.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- 172.21.15.111:0/2969131347 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268100880 msgr2=0x7fd268100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/2969131347 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268100880 0x7fd268100c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd25c009880 tx=0x7fd25c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- 172.21.15.111:0/2969131347 shutdown_connections 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/2969131347 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd268101a80 0x7fd268101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/2969131347 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268100880 0x7fd268100c80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- 172.21.15.111:0/2969131347 >> 172.21.15.111:0/2969131347 conn(0x7fd2680fc010 msgr2=0x7fd2680fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- 172.21.15.111:0/2969131347 shutdown_connections 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- 172.21.15.111:0/2969131347 wait complete. 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 Processor -- start 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- start start 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd268100880 0x7fd268195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:15.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 0x7fd268195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd268108a70 con 0x7fd268101a80 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd26ebb7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd2681088f0 con 0x7fd268100880 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.774+0000 7fd267fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 0x7fd268195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd267fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 0x7fd268195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52754/0 (socket says 172.21.15.111:52754) 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd267fff640 1 -- 172.21.15.111:0/3388938281 learned_addr learned my addr 172.21.15.111:0/3388938281 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd267fff640 1 -- 172.21.15.111:0/3388938281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd268100880 msgr2=0x7fd268195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd267fff640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd268100880 0x7fd268195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd267fff640 1 -- 172.21.15.111:0/3388938281 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd268196510 con 0x7fd268101a80 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd267fff640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 0x7fd268195e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd25400b420 tx=0x7fd25400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd254011630 con 0x7fd268101a80 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7fd254016070 con 0x7fd268101a80 2024-09-16T09:39:15.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26819af50 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd254010b00 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.775+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26819b4d0 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.776+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd268109250 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.777+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7fd2540117d0 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.777+0000 7fd265ffb640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd25806e230 0x7fd2580706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.777+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fd25408c8a0 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.777+0000 7fd26c953640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd25806e230 0x7fd2580706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.777+0000 7fd26c953640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd25806e230 0x7fd2580706f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0096c0 tx=0x7fd25c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.781+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd25405b2e0 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.954+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fd268100d00 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.957+0000 7fd265ffb640 1 -- 172.21.15.111:0/3388938281 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v18)=0 v18) ==== 125+0+0 (secure 0 0 0) 0x7fd25405ef90 con 0x7fd268101a80 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd25806e230 msgr2=0x7fd2580706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd25806e230 0x7fd2580706f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd25c0096c0 tx=0x7fd25c000bc0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 msgr2=0x7fd268195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 0x7fd268195e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd25400b420 tx=0x7fd25400b8e0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 shutdown_connections 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd25806e230 0x7fd2580706f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd268101a80 0x7fd268195e90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 --2- 172.21.15.111:0/3388938281 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd268100880 0x7fd268195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 >> 172.21.15.111:0/3388938281 conn(0x7fd2680fc010 msgr2=0x7fd2681050d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 shutdown_connections 2024-09-16T09:39:15.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.959+0000 7fd26ebb7640 1 -- 172.21.15.111:0/3388938281 wait complete. 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 -- 172.21.15.111:0/3208260230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020103930 msgr2=0x7f30200ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 --2- 172.21.15.111:0/3208260230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020103930 0x7f30200ffa00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3010009880 tx=0x7f301002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 -- 172.21.15.111:0/3208260230 shutdown_connections 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 --2- 172.21.15.111:0/3208260230 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020103930 0x7f30200ffa00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 --2- 172.21.15.111:0/3208260230 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3020102f60 0x7f3020103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 -- 172.21.15.111:0/3208260230 >> 172.21.15.111:0/3208260230 conn(0x7f30200fb7b0 msgr2=0x7f30200fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:15.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 -- 172.21.15.111:0/3208260230 shutdown_connections 2024-09-16T09:39:15.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.436+0000 7f302742d640 1 -- 172.21.15.111:0/3208260230 wait complete. 2024-09-16T09:39:15.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.437+0000 7f302742d640 1 Processor -- start 2024-09-16T09:39:15.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.437+0000 7f302742d640 1 -- start start 2024-09-16T09:39:15.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.437+0000 7f302742d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 0x7f30201025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:15.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.437+0000 7f302742d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3020103930 0x7f3020100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.437+0000 7f302742d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3020109b00 con 0x7f3020102f60 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.437+0000 7f302742d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3020109980 con 0x7f3020103930 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 0x7f30201025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 0x7f30201025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52770/0 (socket says 172.21.15.111:52770) 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 -- 172.21.15.111:0/3618458956 learned_addr learned my addr 172.21.15.111:0/3618458956 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30249c8640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3020103930 0x7f3020100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 -- 172.21.15.111:0/3618458956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3020103930 msgr2=0x7f3020100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3020103930 0x7f3020100cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 -- 172.21.15.111:0/3618458956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201011f0 con 0x7f3020102f60 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.438+0000 7f30251c9640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 0x7f30201025f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c8f0 tx=0x7f301c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.439+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f301c004020 con 0x7f3020102f60 2024-09-16T09:39:15.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.439+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f301c007950 con 0x7f3020102f60 2024-09-16T09:39:15.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.440+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f301c003b70 con 0x7f3020102f60 2024-09-16T09:39:15.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.440+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30201014e0 con 0x7f3020102f60 2024-09-16T09:39:15.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.440+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3020101ac0 con 0x7f3020102f60 2024-09-16T09:39:15.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.441+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f302010a2e0 con 0x7f3020102f60 2024-09-16T09:39:15.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.442+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f301c003d10 con 0x7f3020102f60 2024-09-16T09:39:15.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.442+0000 7f30167fc640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f300c06e060 0x7f300c070520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:15.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.442+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f301c08d0d0 con 0x7f3020102f60 2024-09-16T09:39:15.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.442+0000 7f30249c8640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f300c06e060 0x7f300c070520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:15.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.443+0000 7f30249c8640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f300c06e060 0x7f300c070520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3010000c00 tx=0x7f3010005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:15.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.446+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f301c05bc30 con 0x7f3020102f60 2024-09-16T09:39:15.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.620+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f3020103360 con 0x7f3020102f60 2024-09-16T09:39:15.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:15 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/108857064' entity='client.admin' 2024-09-16T09:39:15.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:15 smithi111 ceph-mon[27997]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:15.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:15 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3388938281' entity='client.admin' 2024-09-16T09:39:15.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.624+0000 7f30167fc640 1 -- 172.21.15.111:0/3618458956 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v19)=0 v19) ==== 108+0+0 (secure 0 0 0) 0x7f3020103360 con 0x7f3020102f60 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f300c06e060 msgr2=0x7f300c070520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f300c06e060 0x7f300c070520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3010000c00 tx=0x7f3010005a20 comp rx=0 tx=0).stop 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 msgr2=0x7f30201025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 0x7f30201025f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c8f0 tx=0x7f301c00cdb0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 shutdown_connections 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f300c06e060 0x7f300c070520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3020103930 0x7f3020100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 --2- 172.21.15.111:0/3618458956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3020102f60 0x7f30201025f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:15.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 >> 172.21.15.111:0/3618458956 conn(0x7f30200fb7b0 msgr2=0x7f3020106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:15.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 shutdown_connections 2024-09-16T09:39:15.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.626+0000 7f302742d640 1 -- 172.21.15.111:0/3618458956 wait complete. 2024-09-16T09:39:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:15 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/108857064' entity='client.admin' 2024-09-16T09:39:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:15 smithi114 ceph-mon[35635]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:15 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3388938281' entity='client.admin' 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 -- 172.21.15.111:0/1495043151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4104d40 msgr2=0x7f19c4107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 --2- 172.21.15.111:0/1495043151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4104d40 0x7f19c4107130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f19b80098b0 tx=0x7f19b802a4d0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 -- 172.21.15.111:0/1495043151 shutdown_connections 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 --2- 172.21.15.111:0/1495043151 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4104d40 0x7f19c4107130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 --2- 172.21.15.111:0/1495043151 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19c4102410 0x7f19c4104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 -- 172.21.15.111:0/1495043151 >> 172.21.15.111:0/1495043151 conn(0x7f19c40fc010 msgr2=0x7f19c40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 -- 172.21.15.111:0/1495043151 shutdown_connections 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.900+0000 7f19c9d09640 1 -- 172.21.15.111:0/1495043151 wait complete. 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c9d09640 1 Processor -- start 2024-09-16T09:39:16.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c9d09640 1 -- start start 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c9d09640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 0x7f19c4196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c9d09640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19c4104d40 0x7f19c4196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c9d09640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f19c4109b20 con 0x7f19c4102410 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c9d09640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f19c41099a0 con 0x7f19c4104d40 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 0x7f19c4196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 0x7f19c4196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52728/0 (socket says 172.21.15.111:52728) 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 -- 172.21.15.111:0/3162712728 learned_addr learned my addr 172.21.15.111:0/3162712728 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 -- 172.21.15.111:0/3162712728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19c4104d40 msgr2=0x7f19c4196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19c4104d40 0x7f19c4196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 -- 172.21.15.111:0/3162712728 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c41975e0 con 0x7f19c4102410 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.901+0000 7f19c37fe640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 0x7f19c4196a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f19b400d6f0 tx=0x7f19b400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.902+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19b4017070 con 0x7f19c4102410 2024-09-16T09:39:16.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.902+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f19b400de00 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.902+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c419bfc0 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.902+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19b40049d0 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.902+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c419c5a0 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.903+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c410a300 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.903+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f19b4009a30 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.903+0000 7f19c0ff9640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f19ac06e280 0x7f19ac070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.904+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f19b408cbe0 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.904+0000 7f19c2ffd640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f19ac06e280 0x7f19ac070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.904+0000 7f19c2ffd640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f19ac06e280 0x7f19ac070740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19b80096c0 tx=0x7f19b8000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.908+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f19b405b6a0 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.076+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f19c419c8b0 con 0x7f19c4102410 2024-09-16T09:39:16.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.079+0000 7f19c0ff9640 1 -- 172.21.15.111:0/3162712728 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f19b405f350 con 0x7f19c4102410 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f19ac06e280 msgr2=0x7f19ac070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f19ac06e280 0x7f19ac070740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f19b80096c0 tx=0x7f19b8000bc0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 msgr2=0x7f19c4196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 0x7f19c4196a20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f19b400d6f0 tx=0x7f19b400dbb0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 shutdown_connections 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f19ac06e280 0x7f19ac070740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f19c4104d40 0x7f19c4196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 --2- 172.21.15.111:0/3162712728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f19c4102410 0x7f19c4196a20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 >> 172.21.15.111:0/3162712728 conn(0x7f19c40fc010 msgr2=0x7f19c40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 shutdown_connections 2024-09-16T09:39:16.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:14.081+0000 7f19c9d09640 1 -- 172.21.15.111:0/3162712728 wait complete. 2024-09-16T09:39:16.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 -- 172.21.15.111:0/3712428209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28100880 msgr2=0x7f5c28100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/3712428209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28100880 0x7f5c28100c80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009880 tx=0x7f5c2402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 -- 172.21.15.111:0/3712428209 shutdown_connections 2024-09-16T09:39:16.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/3712428209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c28101a80 0x7f5c28101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/3712428209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28100880 0x7f5c28100c80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 -- 172.21.15.111:0/3712428209 >> 172.21.15.111:0/3712428209 conn(0x7f5c280fc010 msgr2=0x7f5c280fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 -- 172.21.15.111:0/3712428209 shutdown_connections 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.723+0000 7f5c2fa91640 1 -- 172.21.15.111:0/3712428209 wait complete. 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2fa91640 1 Processor -- start 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2fa91640 1 -- start start 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2fa91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c28100880 0x7f5c28196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2fa91640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 0x7f5c28196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2fa91640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c28108a00 con 0x7f5c28101a80 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2fa91640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5c28108880 con 0x7f5c28100880 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 0x7f5c28196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 0x7f5c28196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52808/0 (socket says 172.21.15.111:52808) 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 -- 172.21.15.111:0/974406153 learned_addr learned my addr 172.21.15.111:0/974406153 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d82d640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c28100880 0x7f5c28196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 -- 172.21.15.111:0/974406153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c28100880 msgr2=0x7f5c28196940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c28100880 0x7f5c28196940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 -- 172.21.15.111:0/974406153 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c28197500 con 0x7f5c28101a80 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c2d02c640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 0x7f5c28196e80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c810 tx=0x7f5c1800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.724+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c18004020 con 0x7f5c28101a80 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.725+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f5c180079b0 con 0x7f5c28101a80 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.725+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c180054b0 con 0x7f5c28101a80 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.725+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c2819bf40 con 0x7f5c28101a80 2024-09-16T09:39:16.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.725+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c2819c4c0 con 0x7f5c28101a80 2024-09-16T09:39:16.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.726+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c281091e0 con 0x7f5c28101a80 2024-09-16T09:39:16.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.726+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f5c180041c0 con 0x7f5c28101a80 2024-09-16T09:39:16.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.726+0000 7f5c1effd640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5c1406e280 0x7f5c14070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.727+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5c1808ce80 con 0x7f5c28101a80 2024-09-16T09:39:16.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.727+0000 7f5c2d82d640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5c1406e280 0x7f5c14070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.727+0000 7f5c2d82d640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5c1406e280 0x7f5c14070740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c24000c00 tx=0x7f5c24004c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:16.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.731+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5c18014030 con 0x7f5c28101a80 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.068+0000 7f7adc34a640 1 -- 172.21.15.111:0/2153498962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4100840 msgr2=0x7f7ad4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.068+0000 7f7adc34a640 1 --2- 172.21.15.111:0/2153498962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4100840 0x7f7ad4100c40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009880 tx=0x7f7ad002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- 172.21.15.111:0/2153498962 shutdown_connections 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 --2- 172.21.15.111:0/2153498962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad4101a40 0x7f7ad4101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 --2- 172.21.15.111:0/2153498962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4100840 0x7f7ad4100c40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- 172.21.15.111:0/2153498962 >> 172.21.15.111:0/2153498962 conn(0x7f7ad40fbff0 msgr2=0x7f7ad40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- 172.21.15.111:0/2153498962 shutdown_connections 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- 172.21.15.111:0/2153498962 wait complete. 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 Processor -- start 2024-09-16T09:39:16.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- start start 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad4100840 0x7f7ad406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 0x7f7ad419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4108a30 con 0x7f7ad4101a40 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7adc34a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad41088b0 con 0x7f7ad4100840 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7ad98e5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 0x7f7ad419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.069+0000 7f7ad98e5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 0x7f7ad419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:51044/0 (socket says 172.21.15.111:51044) 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7ad98e5640 1 -- 172.21.15.111:0/1111256161 learned_addr learned my addr 172.21.15.111:0/1111256161 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7ada0e6640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad4100840 0x7f7ad406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7ad98e5640 1 -- 172.21.15.111:0/1111256161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad4100840 msgr2=0x7f7ad406a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7ad98e5640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad4100840 0x7f7ad406a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7ad98e5640 1 -- 172.21.15.111:0/1111256161 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad419e0b0 con 0x7f7ad4101a40 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7ad98e5640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 0x7f7ad419db70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400b420 tx=0x7f7ac400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:16.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ac4011630 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad419e280 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f7ac4016070 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ac4010af0 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.070+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad419e830 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.071+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad4109210 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.072+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f7ac40117d0 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.072+0000 7f7acb7fe640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f7ac006e230 0x7f7ac00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.072+0000 7f7ada0e6640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f7ac006e230 0x7f7ac00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.072+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7ac408c960 con 0x7f7ad4101a40 2024-09-16T09:39:16.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.073+0000 7f7ada0e6640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f7ac006e230 0x7f7ac00706f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0004ce0 tx=0x7f7ad0009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.077+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7ac405b310 con 0x7f7ad4101a40 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.245+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f7ad4100cc0 con 0x7f7ad4101a40 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.249+0000 7f7acb7fe640 1 -- 172.21.15.111:0/1111256161 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f7ac405efc0 con 0x7f7ad4101a40 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f7ac006e230 msgr2=0x7f7ac00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f7ac006e230 0x7f7ac00706f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0004ce0 tx=0x7f7ad0009560 comp rx=0 tx=0).stop 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 msgr2=0x7f7ad419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 0x7f7ad419db70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400b420 tx=0x7f7ac400b8e0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 shutdown_connections 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f7ac006e230 0x7f7ac00706f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7ad4101a40 0x7f7ad419db70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 --2- 172.21.15.111:0/1111256161 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7ad4100840 0x7f7ad406a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 >> 172.21.15.111:0/1111256161 conn(0x7f7ad40fbff0 msgr2=0x7f7ad40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:16.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 shutdown_connections 2024-09-16T09:39:16.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:13.251+0000 7f7adc34a640 1 -- 172.21.15.111:0/1111256161 wait complete. 2024-09-16T09:39:16.845 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:16 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3618458956' entity='client.admin' 2024-09-16T09:39:16.845 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:16 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/521952971' entity='client.admin' 2024-09-16T09:39:16.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.904+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5c2819c830 con 0x7f5c28101a80 2024-09-16T09:39:16.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.908+0000 7f5c1effd640 1 -- 172.21.15.111:0/974406153 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v21)=0 v21) ==== 120+0+0 (secure 0 0 0) 0x7f5c1805b940 con 0x7f5c28101a80 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5c1406e280 msgr2=0x7f5c14070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5c1406e280 0x7f5c14070740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c24000c00 tx=0x7f5c24004c80 comp rx=0 tx=0).stop 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 msgr2=0x7f5c28196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 0x7f5c28196e80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c810 tx=0x7f5c1800ccd0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 shutdown_connections 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5c1406e280 0x7f5c14070740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c28101a80 0x7f5c28196e80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 --2- 172.21.15.111:0/974406153 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c28100880 0x7f5c28196940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:16.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 >> 172.21.15.111:0/974406153 conn(0x7f5c280fc010 msgr2=0x7f5c280fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:16.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 shutdown_connections 2024-09-16T09:39:16.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.910+0000 7f5c2fa91640 1 -- 172.21.15.111:0/974406153 wait complete. 2024-09-16T09:39:16.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:16 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3618458956' entity='client.admin' 2024-09-16T09:39:16.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:16 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/521952971' entity='client.admin' 2024-09-16T09:39:17.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1148698111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188104d80 msgr2=0x7fb188107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1148698111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188104d80 0x7fb188107170 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb17c009880 tx=0x7fb17c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1148698111 shutdown_connections 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1148698111 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188104d80 0x7fb188107170 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1148698111 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188102450 0x7fb188104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1148698111 >> 172.21.15.111:0/1148698111 conn(0x7fb1880fbff0 msgr2=0x7fb1880fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1148698111 shutdown_connections 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.789+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1148698111 wait complete. 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb18dd3d640 1 Processor -- start 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb18dd3d640 1 -- start start 2024-09-16T09:39:17.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb18dd3d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 0x7fb188196940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb18dd3d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188104d80 0x7fb188196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb18dd3d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb188109ad0 con 0x7fb188102450 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb18dd3d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb188109950 con 0x7fb188104d80 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 0x7fb188196940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 0x7fb188196940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52826/0 (socket says 172.21.15.111:52826) 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.790+0000 7fb1877fe640 1 -- 172.21.15.111:0/1098170997 learned_addr learned my addr 172.21.15.111:0/1098170997 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb1877fe640 1 -- 172.21.15.111:0/1098170997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188104d80 msgr2=0x7fb188196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb186ffd640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188104d80 0x7fb188196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb1877fe640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188104d80 0x7fb188196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb1877fe640 1 -- 172.21.15.111:0/1098170997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb188197500 con 0x7fb188102450 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb186ffd640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188104d80 0x7fb188196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb1877fe640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 0x7fb188196940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb17800ea00 tx=0x7fb17800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:17.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb17800cb80 con 0x7fb188102450 2024-09-16T09:39:17.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7fb17800cd20 con 0x7fb188102450 2024-09-16T09:39:17.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb18819bf40 con 0x7fb188102450 2024-09-16T09:39:17.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb178005930 con 0x7fb188102450 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.791+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18819c470 con 0x7fb188102450 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.792+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18810a2b0 con 0x7fb188102450 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.793+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7fb178004a40 con 0x7fb188102450 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.793+0000 7fb184ff9640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb17006e230 0x7fb1700706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.793+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb17808d4d0 con 0x7fb188102450 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.793+0000 7fb186ffd640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb17006e230 0x7fb1700706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:17.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.794+0000 7fb186ffd640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb17006e230 0x7fb1700706f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb17c004ce0 tx=0x7fb17c0095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:17.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.797+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb178016030 con 0x7fb188102450 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 -- 172.21.15.111:0/3657790882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 msgr2=0x7f9ef8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 --2- 172.21.15.111:0/3657790882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8100c80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009880 tx=0x7f9eec02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 -- 172.21.15.111:0/3657790882 shutdown_connections 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 --2- 172.21.15.111:0/3657790882 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef8101a80 0x7f9ef8101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 --2- 172.21.15.111:0/3657790882 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8100c80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 -- 172.21.15.111:0/3657790882 >> 172.21.15.111:0/3657790882 conn(0x7f9ef80fc010 msgr2=0x7f9ef80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 -- 172.21.15.111:0/3657790882 shutdown_connections 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.815+0000 7f9eff191640 1 -- 172.21.15.111:0/3657790882 wait complete. 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9eff191640 1 Processor -- start 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9eff191640 1 -- start start 2024-09-16T09:39:17.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9eff191640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9eff191640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef8101a80 0x7f9ef8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9eff191640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef8108a70 con 0x7f9ef8100880 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9eff191640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef81088f0 con 0x7f9ef8101a80 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52780/0 (socket says 172.21.15.111:52780) 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 -- 172.21.15.111:0/521952971 learned_addr learned my addr 172.21.15.111:0/521952971 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9ef7fff640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef8101a80 0x7f9ef8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 -- 172.21.15.111:0/521952971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef8101a80 msgr2=0x7f9ef8196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef8101a80 0x7f9ef8196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 -- 172.21.15.111:0/521952971 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef8197610 con 0x7f9ef8100880 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9efcf2d640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8196a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9eec004ce0 tx=0x7f9eec005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.816+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9eec03f070 con 0x7f9ef8100880 2024-09-16T09:39:17.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.817+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f9eec003a30 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.817+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef819bff0 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.817+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9eec035030 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.817+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef819c520 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.818+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef8109250 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.818+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f9eec042070 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.818+0000 7f9ef5ffb640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9ee806e230 0x7f9ee80706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.819+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9eec0adb60 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.819+0000 7f9ef7fff640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9ee806e230 0x7f9ee80706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.819+0000 7f9ef7fff640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9ee806e230 0x7f9ee80706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8197f00 tx=0x7f9ee4009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:15.823+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9eec07c5a0 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.003+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9ef819c830 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.007+0000 7f9ef5ffb640 1 -- 172.21.15.111:0/521952971 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7f9eec080250 con 0x7f9ef8100880 2024-09-16T09:39:17.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9ee806e230 msgr2=0x7f9ee80706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9ee806e230 0x7f9ee80706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8197f00 tx=0x7f9ee4009110 comp rx=0 tx=0).stop 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 msgr2=0x7f9ef8196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8196a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9eec004ce0 tx=0x7f9eec005020 comp rx=0 tx=0).stop 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 shutdown_connections 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9ee806e230 0x7f9ee80706f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ef8101a80 0x7f9ef8196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 --2- 172.21.15.111:0/521952971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ef8100880 0x7f9ef8196a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 >> 172.21.15.111:0/521952971 conn(0x7f9ef80fc010 msgr2=0x7f9ef806a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 shutdown_connections 2024-09-16T09:39:17.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:16.009+0000 7f9eff191640 1 -- 172.21.15.111:0/521952971 wait complete. 2024-09-16T09:39:17.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.972+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fb188102830 con 0x7fb188102450 2024-09-16T09:39:17.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.975+0000 7fb184ff9640 1 -- 172.21.15.111:0/1098170997 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v22)=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7fb17805bf90 con 0x7fb188102450 2024-09-16T09:39:17.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb17006e230 msgr2=0x7fb1700706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb17006e230 0x7fb1700706f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb17c004ce0 tx=0x7fb17c0095f0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 msgr2=0x7fb188196940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 0x7fb188196940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb17800ea00 tx=0x7fb17800eec0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 shutdown_connections 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb17006e230 0x7fb1700706f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb188104d80 0x7fb188196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 --2- 172.21.15.111:0/1098170997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb188102450 0x7fb188196940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 >> 172.21.15.111:0/1098170997 conn(0x7fb1880fbff0 msgr2=0x7fb1880fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 shutdown_connections 2024-09-16T09:39:17.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:17.978+0000 7fb18dd3d640 1 -- 172.21.15.111:0/1098170997 wait complete. 2024-09-16T09:39:18.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:17 smithi111 ceph-mon[27997]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:18.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:17 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/974406153' entity='client.admin' 2024-09-16T09:39:18.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:17 smithi114 ceph-mon[35635]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:18.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:17 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/974406153' entity='client.admin' 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 -- 172.21.15.111:0/2256065599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8101a40 msgr2=0x7f14e8101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 --2- 172.21.15.111:0/2256065599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8101a40 0x7f14e8101ec0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009880 tx=0x7f14dc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 -- 172.21.15.111:0/2256065599 shutdown_connections 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 --2- 172.21.15.111:0/2256065599 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8101a40 0x7f14e8101ec0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 --2- 172.21.15.111:0/2256065599 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8100840 0x7f14e8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 -- 172.21.15.111:0/2256065599 >> 172.21.15.111:0/2256065599 conn(0x7f14e80fbff0 msgr2=0x7f14e80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 -- 172.21.15.111:0/2256065599 shutdown_connections 2024-09-16T09:39:19.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.063+0000 7f14ee10f640 1 -- 172.21.15.111:0/2256065599 wait complete. 2024-09-16T09:39:19.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14ee10f640 1 Processor -- start 2024-09-16T09:39:19.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14ee10f640 1 -- start start 2024-09-16T09:39:19.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14ee10f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 0x7f14e806a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:19.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14ee10f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8101a40 0x7f14e819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:19.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14ee10f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f14e81089d0 con 0x7f14e8100840 2024-09-16T09:39:19.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14ee10f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14e8108850 con 0x7f14e8101a40 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14e77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 0x7f14e806a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14e77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 0x7f14e806a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52862/0 (socket says 172.21.15.111:52862) 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14e77fe640 1 -- 172.21.15.111:0/530538254 learned_addr learned my addr 172.21.15.111:0/530538254 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.064+0000 7f14e6ffd640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8101a40 0x7f14e819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e77fe640 1 -- 172.21.15.111:0/530538254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8101a40 msgr2=0x7f14e819b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e77fe640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8101a40 0x7f14e819b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e77fe640 1 -- 172.21.15.111:0/530538254 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e819bc10 con 0x7f14e8100840 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e6ffd640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8101a40 0x7f14e819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e77fe640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 0x7f14e806a660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14d800e940 tx=0x7f14d800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14d800cac0 con 0x7f14e8100840 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7f14d8004470 con 0x7f14e8100840 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e819bf00 con 0x7f14e8100840 2024-09-16T09:39:19.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14d8003b70 con 0x7f14e8100840 2024-09-16T09:39:19.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.065+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e819c480 con 0x7f14e8100840 2024-09-16T09:39:19.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.066+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14e81091b0 con 0x7f14e8100840 2024-09-16T09:39:19.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.067+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f14d8003e60 con 0x7f14e8100840 2024-09-16T09:39:19.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.067+0000 7f14e4ff9640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d006e280 0x7f14d0070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:19.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.067+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f14d808d5f0 con 0x7f14e8100840 2024-09-16T09:39:19.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.067+0000 7f14e6ffd640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d006e280 0x7f14d0070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:19.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.068+0000 7f14e6ffd640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d006e280 0x7f14d0070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14e806a3e0 tx=0x7f14dc004c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:19.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.071+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14d805c020 con 0x7f14e8100840 2024-09-16T09:39:19.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.151+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 7 ==== config(24 keys) ==== 1016+0+0 (secure 0 0 0) 0x7f14d805fcd0 con 0x7f14e8100840 2024-09-16T09:39:19.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.961+0000 7efc6e875640 1 -- 172.21.15.111:0/2243549951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68101a60 msgr2=0x7efc68101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.961+0000 7efc6e875640 1 --2- 172.21.15.111:0/2243549951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68101a60 0x7efc68101ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc5c009880 tx=0x7efc5c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.961+0000 7efc6e875640 1 -- 172.21.15.111:0/2243549951 shutdown_connections 2024-09-16T09:39:19.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.961+0000 7efc6e875640 1 --2- 172.21.15.111:0/2243549951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68101a60 0x7efc68101ee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 --2- 172.21.15.111:0/2243549951 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc68100860 0x7efc68100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 -- 172.21.15.111:0/2243549951 >> 172.21.15.111:0/2243549951 conn(0x7efc680fbff0 msgr2=0x7efc680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 -- 172.21.15.111:0/2243549951 shutdown_connections 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 -- 172.21.15.111:0/2243549951 wait complete. 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 Processor -- start 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 -- start start 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 0x7efc6806ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.962+0000 7efc6e875640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc68101a60 0x7efc6819b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc6e875640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efc681089f0 con 0x7efc68100860 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc6e875640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efc68108870 con 0x7efc68101a60 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 0x7efc6806ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 0x7efc6806ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52852/0 (socket says 172.21.15.111:52852) 2024-09-16T09:39:19.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 -- 172.21.15.111:0/64323134 learned_addr learned my addr 172.21.15.111:0/64323134 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc677fe640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc68101a60 0x7efc6819b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 -- 172.21.15.111:0/64323134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc68101a60 msgr2=0x7efc6819b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc68101a60 0x7efc6819b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 -- 172.21.15.111:0/64323134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc6819bc20 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc67fff640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 0x7efc6806ae40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc5800d8d0 tx=0x7efc5800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc58017020 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(23 keys) ==== 991+0+0 (secure 0 0 0) 0x7efc58010460 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc6819bf10 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc5800f5f0 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.963+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc6819c410 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.964+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc681091b0 con 0x7efc68100860 2024-09-16T09:39:19.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.965+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7efc5801a020 con 0x7efc68100860 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.965+0000 7efc657fa640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efc5006e280 0x7efc50070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.966+0000 7efc677fe640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efc5006e280 0x7efc50070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.966+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efc5808d0b0 con 0x7efc68100860 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.966+0000 7efc677fe640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efc5006e280 0x7efc50070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc6806abc0 tx=0x7efc5c004c80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:18.970+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efc58021020 con 0x7efc68100860 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.147+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7efc68100c60 con 0x7efc68100860 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.150+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v23)=0 v23) ==== 114+0+0 (secure 0 0 0) 0x7efc5805bae0 con 0x7efc68100860 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.151+0000 7efc657fa640 1 -- 172.21.15.111:0/64323134 <== mon.0 v2:172.21.15.111:3300/0 8 ==== config(24 keys) ==== 1016+0+0 (secure 0 0 0) 0x7efc5805f790 con 0x7efc68100860 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efc5006e280 msgr2=0x7efc50070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efc5006e280 0x7efc50070740 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc6806abc0 tx=0x7efc5c004c80 comp rx=0 tx=0).stop 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 msgr2=0x7efc6806ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 0x7efc6806ae40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc5800d8d0 tx=0x7efc5800dd90 comp rx=0 tx=0).stop 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 shutdown_connections 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efc5006e280 0x7efc50070740 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc68101a60 0x7efc6819b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 --2- 172.21.15.111:0/64323134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc68100860 0x7efc6806ae40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 >> 172.21.15.111:0/64323134 conn(0x7efc680fbff0 msgr2=0x7efc680fe340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 shutdown_connections 2024-09-16T09:39:19.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.153+0000 7efc6e875640 1 -- 172.21.15.111:0/64323134 wait complete. 2024-09-16T09:39:19.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.249+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f14e8100c40 con 0x7f14e8100840 2024-09-16T09:39:19.251 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:18 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1098170997' entity='client.admin' 2024-09-16T09:39:19.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.252+0000 7f14e4ff9640 1 -- 172.21.15.111:0/530538254 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v24)=0 v24) ==== 120+0+0 (secure 0 0 0) 0x7f14d8064500 con 0x7f14e8100840 2024-09-16T09:39:19.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d006e280 msgr2=0x7f14d0070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d006e280 0x7f14d0070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14e806a3e0 tx=0x7f14dc004c80 comp rx=0 tx=0).stop 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 msgr2=0x7f14e806a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 0x7f14e806a660 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f14d800e940 tx=0x7f14d800ee00 comp rx=0 tx=0).stop 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 shutdown_connections 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d006e280 0x7f14d0070740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14e8101a40 0x7f14e819b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 --2- 172.21.15.111:0/530538254 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14e8100840 0x7f14e806a660 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 >> 172.21.15.111:0/530538254 conn(0x7f14e80fbff0 msgr2=0x7f14e80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 shutdown_connections 2024-09-16T09:39:19.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:19.255+0000 7f14ee10f640 1 -- 172.21.15.111:0/530538254 wait complete. 2024-09-16T09:39:19.410 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:18 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1098170997' entity='client.admin' 2024-09-16T09:39:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:19 smithi114 ceph-mon[35635]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:19 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/64323134' entity='client.admin' 2024-09-16T09:39:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:19 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/530538254' entity='client.admin' 2024-09-16T09:39:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:19 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:20.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:19 smithi111 ceph-mon[27997]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:19 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/64323134' entity='client.admin' 2024-09-16T09:39:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:19 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/530538254' entity='client.admin' 2024-09-16T09:39:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:19 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:22.211 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:21 smithi111 ceph-mon[27997]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:22.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:22.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:22.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:39:22.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:21 smithi114 ceph-mon[35635]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:39:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:22.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 -- 172.21.15.111:0/3554912536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0100200 msgr2=0x7f17f0102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:22.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 --2- 172.21.15.111:0/3554912536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0100200 0x7f17f0102610 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009880 tx=0x7f17e002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:22.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 -- 172.21.15.111:0/3554912536 shutdown_connections 2024-09-16T09:39:22.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 --2- 172.21.15.111:0/3554912536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0102b50 0x7f17f0104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:22.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 --2- 172.21.15.111:0/3554912536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0100200 0x7f17f0102610 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 -- 172.21.15.111:0/3554912536 >> 172.21.15.111:0/3554912536 conn(0x7f17f00fc010 msgr2=0x7f17f00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 -- 172.21.15.111:0/3554912536 shutdown_connections 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.950+0000 7f17f511e640 1 -- 172.21.15.111:0/3554912536 wait complete. 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.951+0000 7f17f511e640 1 Processor -- start 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.951+0000 7f17f511e640 1 -- start start 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17f511e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0100200 0x7f17f019cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17f511e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 0x7f17f019d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17f511e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f17f01101e0 con 0x7f17f0102b50 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17f511e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f17f0110060 con 0x7f17f0100200 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 0x7f17f019d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 0x7f17f019d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52884/0 (socket says 172.21.15.111:52884) 2024-09-16T09:39:22.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 -- 172.21.15.111:0/3400302924 learned_addr learned my addr 172.21.15.111:0/3400302924 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17eed9d640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0100200 0x7f17f019cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 -- 172.21.15.111:0/3400302924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0100200 msgr2=0x7f17f019cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0100200 0x7f17f019cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 -- 172.21.15.111:0/3400302924 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f019dbb0 con 0x7f17f0102b50 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17eed9d640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0100200 0x7f17f019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17e7fff640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 0x7f17f019d530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c8f0 tx=0x7f17d800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17d80079b0 con 0x7f17f0102b50 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(24 keys) ==== 1016+0+0 (secure 0 0 0) 0x7f17d8005020 con 0x7f17f0102b50 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f01a25f0 con 0x7f17f0102b50 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.952+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17d8004c20 con 0x7f17f0102b50 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.953+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01a2c00 con 0x7f17f0102b50 2024-09-16T09:39:22.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.954+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f01109c0 con 0x7f17f0102b50 2024-09-16T09:39:22.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.954+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f17d800f450 con 0x7f17f0102b50 2024-09-16T09:39:22.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.954+0000 7f17ecd99640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f17dc06e280 0x7f17dc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:22.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.955+0000 7f17eed9d640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f17dc06e280 0x7f17dc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:22.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.955+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f17d808cf70 con 0x7f17f0102b50 2024-09-16T09:39:22.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.955+0000 7f17eed9d640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f17dc06e280 0x7f17dc070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000c00 tx=0x7f17e0004d10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:22.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:22.959+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17d8014030 con 0x7f17f0102b50 2024-09-16T09:39:23.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.131+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f17f01a2f70 con 0x7f17f0102b50 2024-09-16T09:39:23.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.136+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v25)=0 v25) ==== 123+0+0 (secure 0 0 0) 0x7f17d805ba30 con 0x7f17f0102b50 2024-09-16T09:39:23.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.137+0000 7f17ecd99640 1 -- 172.21.15.111:0/3400302924 <== mon.0 v2:172.21.15.111:3300/0 8 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f17d805f6e0 con 0x7f17f0102b50 2024-09-16T09:39:23.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f17dc06e280 msgr2=0x7f17dc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:23.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f17dc06e280 0x7f17dc070740 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f17e0000c00 tx=0x7f17e0004d10 comp rx=0 tx=0).stop 2024-09-16T09:39:23.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 msgr2=0x7f17f019d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:23.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 0x7f17f019d530 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f17d800c8f0 tx=0x7f17d800cdb0 comp rx=0 tx=0).stop 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 shutdown_connections 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f17dc06e280 0x7f17dc070740 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17f0102b50 0x7f17f019d530 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 --2- 172.21.15.111:0/3400302924 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17f0100200 0x7f17f019cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 >> 172.21.15.111:0/3400302924 conn(0x7f17f00fc010 msgr2=0x7f17f00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 shutdown_connections 2024-09-16T09:39:23.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:23.139+0000 7f17f511e640 1 -- 172.21.15.111:0/3400302924 wait complete. 2024-09-16T09:39:23.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:22 smithi111 ceph-mon[27997]: Reconfiguring ceph-exporter.smithi111 (monmap changed)... 2024-09-16T09:39:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:22 smithi111 ceph-mon[27997]: Reconfiguring daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:39:23.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:22 smithi114 ceph-mon[35635]: Reconfiguring ceph-exporter.smithi111 (monmap changed)... 2024-09-16T09:39:23.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:22 smithi114 ceph-mon[35635]: Reconfiguring daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:39:24.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:23 smithi111 ceph-mon[27997]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:23 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3400302924' entity='client.admin' 2024-09-16T09:39:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:23 smithi114 ceph-mon[35635]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:23 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3400302924' entity='client.admin' 2024-09-16T09:39:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 -- 172.21.15.111:0/3319475952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 msgr2=0x7f168c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 --2- 172.21.15.111:0/3319475952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c100c80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f167c009880 tx=0x7f167c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 -- 172.21.15.111:0/3319475952 shutdown_connections 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 --2- 172.21.15.111:0/3319475952 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f168c101a80 0x7f168c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 --2- 172.21.15.111:0/3319475952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c100c80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 -- 172.21.15.111:0/3319475952 >> 172.21.15.111:0/3319475952 conn(0x7f168c0fc010 msgr2=0x7f168c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 -- 172.21.15.111:0/3319475952 shutdown_connections 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.589+0000 7f1692420640 1 -- 172.21.15.111:0/3319475952 wait complete. 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f1692420640 1 Processor -- start 2024-09-16T09:39:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f1692420640 1 -- start start 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f1692420640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f1692420640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f168c101a80 0x7f168c19c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f1692420640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f168c109440 con 0x7f168c100880 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f1692420640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f168c1092c0 con 0x7f168c101a80 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f168bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f168bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c06ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58418/0 (socket says 172.21.15.111:58418) 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.590+0000 7f168bfff640 1 -- 172.21.15.111:0/3545817930 learned_addr learned my addr 172.21.15.111:0/3545817930 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:24.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f168b7fe640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f168c101a80 0x7f168c19c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f168bfff640 1 -- 172.21.15.111:0/3545817930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f168c101a80 msgr2=0x7f168c19c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f168bfff640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f168c101a80 0x7f168c19c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f168bfff640 1 -- 172.21.15.111:0/3545817930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168c19c610 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f168bfff640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c06ae30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f167c004e70 tx=0x7f167c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f167c03f070 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f167c004ac0 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f167c035030 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f168c19c8a0 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.591+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f168c19ce20 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.592+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f168c109c20 con 0x7f168c100880 2024-09-16T09:39:24.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.593+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f167c042070 con 0x7f168c100880 2024-09-16T09:39:24.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.593+0000 7f16897fa640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f167406e230 0x7f16740706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:24.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.593+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f167c0adcb0 con 0x7f168c100880 2024-09-16T09:39:24.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.593+0000 7f168b7fe640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f167406e230 0x7f16740706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:24.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.594+0000 7f168b7fe640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f167406e230 0x7f16740706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1680005fd0 tx=0x7f1680005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:24.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.598+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f167c07c660 con 0x7f168c100880 2024-09-16T09:39:24.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.767+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f168c100c80 con 0x7f168c100880 2024-09-16T09:39:24.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.770+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 123+0+0 (secure 0 0 0) 0x7f167c080310 con 0x7f168c100880 2024-09-16T09:39:24.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.770+0000 7f16897fa640 1 -- 172.21.15.111:0/3545817930 <== mon.0 v2:172.21.15.111:3300/0 8 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f167c084b40 con 0x7f168c100880 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f167406e230 msgr2=0x7f16740706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f167406e230 0x7f16740706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1680005fd0 tx=0x7f1680005850 comp rx=0 tx=0).stop 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 msgr2=0x7f168c06ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c06ae30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f167c004e70 tx=0x7f167c0046c0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 shutdown_connections 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f167406e230 0x7f16740706f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f168c101a80 0x7f168c19c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 --2- 172.21.15.111:0/3545817930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f168c100880 0x7f168c06ae30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 >> 172.21.15.111:0/3545817930 conn(0x7f168c0fc010 msgr2=0x7f168c104fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:24.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 shutdown_connections 2024-09-16T09:39:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:24.772+0000 7f1692420640 1 -- 172.21.15.111:0/3545817930 wait complete. 2024-09-16T09:39:25.024 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi111') 2024-09-16T09:39:25.024 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi111') 2024-09-16T09:39:25.024 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-16T09:39:25.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 -- 172.21.15.111:0/3546177812 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c100970 msgr2=0x7f175c100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:25.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 --2- 172.21.15.111:0/3546177812 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c100970 0x7f175c100df0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f174c009880 tx=0x7f174c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 -- 172.21.15.111:0/3546177812 shutdown_connections 2024-09-16T09:39:25.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 --2- 172.21.15.111:0/3546177812 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c100970 0x7f175c100df0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 --2- 172.21.15.111:0/3546177812 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f175c0ffc00 0x7f175c100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 -- 172.21.15.111:0/3546177812 >> 172.21.15.111:0/3546177812 conn(0x7f175c0fb750 msgr2=0x7f175c0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:25.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 -- 172.21.15.111:0/3546177812 shutdown_connections 2024-09-16T09:39:25.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.196+0000 7f1761962640 1 -- 172.21.15.111:0/3546177812 wait complete. 2024-09-16T09:39:25.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f1761962640 1 Processor -- start 2024-09-16T09:39:25.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f1761962640 1 -- start start 2024-09-16T09:39:25.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f1761962640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 0x7f175c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:25.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f1761962640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f175c100970 0x7f175c199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f1761962640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f175c10c820 con 0x7f175c0ffc00 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f1761962640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f175c10c6a0 con 0x7f175c100970 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f175affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 0x7f175c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f175affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 0x7f175c1995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58438/0 (socket says 172.21.15.111:58438) 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.197+0000 7f175affd640 1 -- 172.21.15.111:0/230753169 learned_addr learned my addr 172.21.15.111:0/230753169 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f175affd640 1 -- 172.21.15.111:0/230753169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f175c100970 msgr2=0x7f175c199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f175a7fc640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f175c100970 0x7f175c199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f175affd640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f175c100970 0x7f175c199af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f175affd640 1 -- 172.21.15.111:0/230753169 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c19a0e0 con 0x7f175c0ffc00 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f175affd640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 0x7f175c1995b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f175000c8a0 tx=0x7f175000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17500079b0 con 0x7f175c0ffc00 2024-09-16T09:39:25.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c19eb50 con 0x7f175c0ffc00 2024-09-16T09:39:25.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c19f0b0 con 0x7f175c0ffc00 2024-09-16T09:39:25.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f175000f450 con 0x7f175c0ffc00 2024-09-16T09:39:25.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.198+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1750018400 con 0x7f175c0ffc00 2024-09-16T09:39:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.199+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17480052c0 con 0x7f175c0ffc00 2024-09-16T09:39:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.200+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f175000f600 con 0x7f175c0ffc00 2024-09-16T09:39:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.201+0000 7f1760960640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f174406e230 0x7f17440706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.201+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f175008d120 con 0x7f175c0ffc00 2024-09-16T09:39:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.201+0000 7f175a7fc640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f174406e230 0x7f17440706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:25.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.201+0000 7f175a7fc640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f174406e230 0x7f17440706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f174c0096c0 tx=0x7f174c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:25.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.209+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1750014030 con 0x7f175c0ffc00 2024-09-16T09:39:25.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.383+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f17480055b0 con 0x7f175c0ffc00 2024-09-16T09:39:25.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.386+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 123+0+0 (secure 0 0 0) 0x7f175005bb60 con 0x7f175c0ffc00 2024-09-16T09:39:25.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.387+0000 7f1760960640 1 -- 172.21.15.111:0/230753169 <== mon.0 v2:172.21.15.111:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f175005f810 con 0x7f175c0ffc00 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f174406e230 msgr2=0x7f17440706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f174406e230 0x7f17440706f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f174c0096c0 tx=0x7f174c000bc0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 msgr2=0x7f175c1995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 0x7f175c1995b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f175000c8a0 tx=0x7f175000cd60 comp rx=0 tx=0).stop 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 shutdown_connections 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f174406e230 0x7f17440706f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f175c100970 0x7f175c199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 --2- 172.21.15.111:0/230753169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f175c0ffc00 0x7f175c1995b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 >> 172.21.15.111:0/230753169 conn(0x7f175c0fb750 msgr2=0x7f175c109300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:25.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 shutdown_connections 2024-09-16T09:39:25.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:25.388+0000 7f1761962640 1 -- 172.21.15.111:0/230753169 wait complete. 2024-09-16T09:39:25.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:25 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3545817930' entity='client.admin' 2024-09-16T09:39:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:25 smithi111 ceph-mon[27997]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:25 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/230753169' entity='client.admin' 2024-09-16T09:39:25.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-16T09:39:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:25 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3545817930' entity='client.admin' 2024-09-16T09:39:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:25 smithi114 ceph-mon[35635]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:25 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/230753169' entity='client.admin' 2024-09-16T09:39:26.544 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi111') 2024-09-16T09:39:26.545 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi111') 2024-09-16T09:39:26.545 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi111') 2024-09-16T09:39:27.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 -- 172.21.15.111:0/416602292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 msgr2=0x7f35881047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:27.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 --2- 172.21.15.111:0/416602292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f35881047c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f35780098b0 tx=0x7f357802a4d0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 -- 172.21.15.111:0/416602292 shutdown_connections 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 --2- 172.21.15.111:0/416602292 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3588104d00 0x7f35881070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 --2- 172.21.15.111:0/416602292 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f35881047c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 -- 172.21.15.111:0/416602292 >> 172.21.15.111:0/416602292 conn(0x7f35880fbff0 msgr2=0x7f35880fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 -- 172.21.15.111:0/416602292 shutdown_connections 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 -- 172.21.15.111:0/416602292 wait complete. 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.764+0000 7f358d6af640 1 Processor -- start 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 -- start start 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f3588197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3588104d00 0x7f3588197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f358810a7c0 con 0x7f35881023d0 2024-09-16T09:39:27.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f358810a640 con 0x7f3588104d00 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f3588197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f3588197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58470/0 (socket says 172.21.15.111:58470) 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 -- 172.21.15.111:0/683423768 learned_addr learned my addr 172.21.15.111:0/683423768 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f35867fc640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3588104d00 0x7f3588197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 -- 172.21.15.111:0/683423768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3588104d00 msgr2=0x7f3588197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3588104d00 0x7f3588197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 -- 172.21.15.111:0/683423768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35881980e0 con 0x7f35881023d0 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f3586ffd640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f3588197520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f35780099d0 tx=0x7f35780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f357803f070 con 0x7f35881023d0 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3578004a40 con 0x7f35881023d0 2024-09-16T09:39:27.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358819cac0 con 0x7f35881023d0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3578035030 con 0x7f35881023d0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.765+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358819d050 con 0x7f35881023d0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.767+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35881027b0 con 0x7f35881023d0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.767+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f3578042070 con 0x7f35881023d0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.767+0000 7f356ffff640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f357006e280 0x7f3570070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.767+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f35780adba0 con 0x7f35881023d0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.767+0000 7f35867fc640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f357006e280 0x7f3570070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:27.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.768+0000 7f35867fc640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f357006e280 0x7f3570070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f357c005fd0 tx=0x7f357c005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:27.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.772+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f357807c660 con 0x7f35881023d0 2024-09-16T09:39:27.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.944+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f358819d340 con 0x7f35881023d0 2024-09-16T09:39:27.947 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:27 smithi111 ceph-mon[27997]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:27.947 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:27 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:27.948 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:27 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:27.948 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:27 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:39:27.948 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:27 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:27.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.948+0000 7f356ffff640 1 -- 172.21.15.111:0/683423768 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v28)=0 v28) ==== 106+0+0 (secure 0 0 0) 0x7f3578080310 con 0x7f35881023d0 2024-09-16T09:39:27.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f357006e280 msgr2=0x7f3570070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f357006e280 0x7f3570070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f357c005fd0 tx=0x7f357c005850 comp rx=0 tx=0).stop 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 msgr2=0x7f3588197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f3588197520 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f35780099d0 tx=0x7f35780046c0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 shutdown_connections 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f357006e280 0x7f3570070740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3588104d00 0x7f3588197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 --2- 172.21.15.111:0/683423768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f35881023d0 0x7f3588197520 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 >> 172.21.15.111:0/683423768 conn(0x7f35880fbff0 msgr2=0x7f35880fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 shutdown_connections 2024-09-16T09:39:27.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:27.950+0000 7f358d6af640 1 -- 172.21.15.111:0/683423768 wait complete. 2024-09-16T09:39:28.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:27 smithi114 ceph-mon[35635]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:28.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:27 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:28.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:27 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:28.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:27 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:39:28.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:27 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:28.574 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.574 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.575 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.576 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '0ada01d2-740f-11ef-bceb-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi111') 2024-09-16T09:39:28.576 INFO:tasks.cephadm:Deploying OSDs... 2024-09-16T09:39:28.576 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:39:28.576 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T09:39:28.592 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T09:39:28.593 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-16 09:38:28.397994968 +0000 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-16 09:33:09.794624907 +0000 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-16 09:33:09.794624907 +0000 2024-09-16T09:39:28.648 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-16 09:33:09.794624907 +0000 2024-09-16T09:39:28.649 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T09:39:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-16T09:39:28.714 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-16T09:39:28.715 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000320292 s, 1.6 MB/s 2024-09-16T09:39:28.716 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T09:39:28.772 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-16 09:38:28.398994949 +0000 2024-09-16T09:39:28.828 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-16 09:33:10.122618734 +0000 2024-09-16T09:39:28.829 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-16 09:33:10.122618734 +0000 2024-09-16T09:39:28.829 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-16 09:33:10.122618734 +0000 2024-09-16T09:39:28.829 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T09:39:28.892 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-16T09:39:28.892 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-16T09:39:28.892 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000208624 s, 2.5 MB/s 2024-09-16T09:39:28.894 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T09:39:28.951 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-16 09:38:28.398994949 +0000 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-16 09:33:10.464612297 +0000 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-16 09:33:10.464612297 +0000 2024-09-16T09:39:29.007 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-16 09:33:10.464612297 +0000 2024-09-16T09:39:29.008 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T09:39:29.070 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-16T09:39:29.071 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-16T09:39:29.071 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000204603 s, 2.5 MB/s 2024-09-16T09:39:29.072 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T09:39:29.129 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-09-16T09:39:29.184 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-09-16 09:38:28.399994930 +0000 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-16 09:33:10.786606236 +0000 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-16 09:33:10.786606236 +0000 2024-09-16T09:39:29.185 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-16 09:33:10.786606236 +0000 2024-09-16T09:39:29.185 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T09:39:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:28 smithi114 ceph-mon[35635]: Reconfiguring crash.smithi111 (monmap changed)... 2024-09-16T09:39:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:28 smithi114 ceph-mon[35635]: Reconfiguring daemon crash.smithi111 on smithi111 2024-09-16T09:39:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:28 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/683423768' entity='client.admin' 2024-09-16T09:39:29.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:28 smithi111 ceph-mon[27997]: Reconfiguring crash.smithi111 (monmap changed)... 2024-09-16T09:39:29.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:28 smithi111 ceph-mon[27997]: Reconfiguring daemon crash.smithi111 on smithi111 2024-09-16T09:39:29.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:28 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/683423768' entity='client.admin' 2024-09-16T09:39:29.248 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-09-16T09:39:29.248 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-09-16T09:39:29.248 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000237761 s, 2.2 MB/s 2024-09-16T09:39:29.249 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T09:39:29.305 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:39:29.305 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/scratch_devs of=/dev/stdout 2024-09-16T09:39:29.325 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-16T09:39:29.325 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_1 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 09:38:58.328533626 +0000 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 09:33:05.378656857 +0000 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 09:33:05.378656857 +0000 2024-09-16T09:39:29.384 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 09:33:05.378656857 +0000 2024-09-16T09:39:29.385 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-16T09:39:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T09:39:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T09:39:29.454 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000223915 s, 2.3 MB/s 2024-09-16T09:39:29.455 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-16T09:39:29.512 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_2 2024-09-16T09:39:29.569 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-16T09:39:29.569 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:29.569 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-16T09:39:29.570 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:29.570 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:29.570 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 09:38:58.329533604 +0000 2024-09-16T09:39:29.570 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 09:33:05.713649655 +0000 2024-09-16T09:39:29.570 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 09:33:05.713649655 +0000 2024-09-16T09:39:29.570 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 09:33:05.713649655 +0000 2024-09-16T09:39:29.570 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-16T09:39:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T09:39:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T09:39:29.633 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000210135 s, 2.4 MB/s 2024-09-16T09:39:29.634 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-16T09:39:29.691 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_3 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 09:38:58.329533604 +0000 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 09:33:06.045642518 +0000 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 09:33:06.045642518 +0000 2024-09-16T09:39:29.748 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 09:33:06.045642518 +0000 2024-09-16T09:39:29.749 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-16T09:39:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T09:39:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T09:39:29.811 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000194173 s, 2.6 MB/s 2024-09-16T09:39:29.812 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-16T09:39:29.868 DEBUG:teuthology.orchestra.run.smithi114:> stat /dev/vg_nvme/lv_4 2024-09-16T09:39:29.923 INFO:teuthology.orchestra.run.smithi114.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:device_t:s0 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 2024-09-16 09:38:58.330533582 +0000 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 09:33:06.372635489 +0000 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 09:33:06.372635489 +0000 2024-09-16T09:39:29.924 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 09:33:06.372635489 +0000 2024-09-16T09:39:29.924 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-16T09:39:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records in 2024-09-16T09:39:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:1+0 records out 2024-09-16T09:39:29.987 INFO:teuthology.orchestra.run.smithi114.stderr:512 bytes copied, 0.000187941 s, 2.7 MB/s 2024-09-16T09:39:29.988 DEBUG:teuthology.orchestra.run.smithi114:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-16T09:39:30.044 INFO:tasks.cephadm:Deploying osd.0 on smithi111 with /dev/vg_nvme/lv_4... 2024-09-16T09:39:30.045 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T09:39:30.066 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:29 smithi111 ceph-mon[27997]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:30.067 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:30.067 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:29 smithi114 ceph-mon[35635]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:31.058 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:31.236 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:30 smithi111 ceph-mon[27997]: Reconfiguring alertmanager.smithi111 (dependencies changed)... 2024-09-16T09:39:31.236 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:30 smithi111 ceph-mon[27997]: Reconfiguring daemon alertmanager.smithi111 on smithi111 2024-09-16T09:39:31.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:30 smithi114 ceph-mon[35635]: Reconfiguring alertmanager.smithi111 (dependencies changed)... 2024-09-16T09:39:31.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:30 smithi114 ceph-mon[35635]: Reconfiguring daemon alertmanager.smithi111 on smithi111 2024-09-16T09:39:32.125 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:31 smithi111 ceph-mon[27997]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:32.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:31 smithi114 ceph-mon[35635]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:34.337 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:33 smithi111 ceph-mon[27997]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:33 smithi114 ceph-mon[35635]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:35 smithi111 ceph-mon[27997]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:35 smithi111 ceph-mon[27997]: Reconfiguring grafana.smithi111 (dependencies changed)... 2024-09-16T09:39:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:35 smithi111 ceph-mon[27997]: Reconfiguring daemon grafana.smithi111 on smithi111 2024-09-16T09:39:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:35 smithi114 ceph-mon[35635]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:35 smithi114 ceph-mon[35635]: Reconfiguring grafana.smithi111 (dependencies changed)... 2024-09-16T09:39:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:35 smithi114 ceph-mon[35635]: Reconfiguring daemon grafana.smithi111 on smithi111 2024-09-16T09:39:36.218 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:39:36.245 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi111:vg_nvme/lv_4 2024-09-16T09:39:36.953 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:39:37.952 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:37 smithi111 ceph-mon[27997]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:37 smithi114 ceph-mon[35635]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:38.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.790+0000 7ff088d06640 1 -- 172.21.15.111:0/1431912718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 msgr2=0x7ff084100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:38.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.790+0000 7ff088d06640 1 --2- 172.21.15.111:0/1431912718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084100640 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff074009c20 tx=0x7ff07402a970 comp rx=0 tx=0).stop 2024-09-16T09:39:38.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 -- 172.21.15.111:0/1431912718 shutdown_connections 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 --2- 172.21.15.111:0/1431912718 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff084100b80 0x7ff084100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 --2- 172.21.15.111:0/1431912718 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084100640 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 -- 172.21.15.111:0/1431912718 >> 172.21.15.111:0/1431912718 conn(0x7ff0840fbff0 msgr2=0x7ff0840fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 -- 172.21.15.111:0/1431912718 shutdown_connections 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 -- 172.21.15.111:0/1431912718 wait complete. 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.791+0000 7ff088d06640 1 Processor -- start 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff088d06640 1 -- start start 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff088d06640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff088d06640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff084100b80 0x7ff084199b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff088d06640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410c960 con 0x7ff084100240 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff088d06640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff08410c7e0 con 0x7ff084100b80 2024-09-16T09:39:38.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084199650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40408/0 (socket says 172.21.15.111:40408) 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 -- 172.21.15.111:0/2803488200 learned_addr learned my addr 172.21.15.111:0/2803488200 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff081d9b640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff084100b80 0x7ff084199b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 -- 172.21.15.111:0/2803488200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff084100b80 msgr2=0x7ff084199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff084100b80 0x7ff084199b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 -- 172.21.15.111:0/2803488200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08419a210 con 0x7ff084100240 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff08259c640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084199650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff07402f730 tx=0x7ff07402f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff074047070 con 0x7ff084100240 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08419ebf0 con 0x7ff084100240 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff074003e30 con 0x7ff084100240 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.792+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff074034070 con 0x7ff084100240 2024-09-16T09:39:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.793+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08419f180 con 0x7ff084100240 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.794+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff084100640 con 0x7ff084100240 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.794+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7ff07404a070 con 0x7ff084100240 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.794+0000 7ff0737fe640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff06c06e240 0x7ff06c070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.794+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff0740ae0a0 con 0x7ff084100240 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.794+0000 7ff081d9b640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff06c06e240 0x7ff06c070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.795+0000 7ff081d9b640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff06c06e240 0x7ff06c070700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff08419ab00 tx=0x7ff07800a4c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:39:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.799+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff07403f070 con 0x7ff084100240 2024-09-16T09:39:38.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:39:38.994+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff084062630 con 0x7ff06c06e240 2024-09-16T09:39:40.072 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:39 smithi111 ceph-mon[27997]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:40.072 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:39 smithi111 ceph-mon[27997]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:40.072 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:39:40.072 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:39:40.072 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:39 smithi114 ceph-mon[35635]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:39 smithi114 ceph-mon[35635]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:39:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:39 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:39:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:39 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:39:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:39 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:41.956 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:41 smithi111 ceph-mon[27997]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:41.956 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:41.956 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:41 smithi114 ceph-mon[35635]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:41 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:41 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:43.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-16T09:39:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-16T09:39:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2551661303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457c10db-ac0b-4edf-8f9e-7f77092fdf7c"}]: dispatch 2024-09-16T09:39:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2551661303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457c10db-ac0b-4edf-8f9e-7f77092fdf7c"}]': finished 2024-09-16T09:39:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T09:39:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:39:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:42 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1143089620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2551661303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457c10db-ac0b-4edf-8f9e-7f77092fdf7c"}]: dispatch 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2551661303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457c10db-ac0b-4edf-8f9e-7f77092fdf7c"}]': finished 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: osdmap e6: 1 total, 0 up, 1 in 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:39:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:42 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1143089620' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:39:44.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:43 smithi111 ceph-mon[27997]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:43 smithi114 ceph-mon[35635]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:45 smithi111 ceph-mon[27997]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:45 smithi114 ceph-mon[35635]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:47.996 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:47 smithi111 ceph-mon[27997]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:48.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:47 smithi114 ceph-mon[35635]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:50.006 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:49 smithi114 ceph-mon[35635]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:50.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:49 smithi111 ceph-mon[27997]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:51.108 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:50 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:51.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:50 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:39:51.991 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:51 smithi111 ceph-mon[27997]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:51 smithi114 ceph-mon[35635]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:53.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:53 smithi114 ceph-mon[35635]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:53.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:53 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:53.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:53 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:53 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:39:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:53 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:53 smithi111 ceph-mon[27997]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:53 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:53 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:53 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:39:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:53 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: Reconfiguring ceph-exporter.smithi114 (monmap changed)... 2024-09-16T09:39:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: Reconfiguring daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:39:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:39:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T09:39:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:54 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:55.044 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: Reconfiguring ceph-exporter.smithi114 (monmap changed)... 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: Reconfiguring daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-16T09:39:55.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:54 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:56.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: Reconfiguring crash.smithi114 (monmap changed)... 2024-09-16T09:39:56.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: Reconfiguring daemon crash.smithi114 on smithi114 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: Deploying daemon osd.0 on smithi111 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:39:56.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: Reconfiguring crash.smithi114 (monmap changed)... 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: Reconfiguring daemon crash.smithi114 on smithi114 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: Deploying daemon osd.0 on smithi111 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:39:56.184 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:57.157 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:56 smithi111 ceph-mon[27997]: Reconfiguring mgr.smithi114.xvotey (monmap changed)... 2024-09-16T09:39:57.158 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:56 smithi111 ceph-mon[27997]: Reconfiguring daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:39:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:56 smithi114 ceph-mon[35635]: Reconfiguring mgr.smithi114.xvotey (monmap changed)... 2024-09-16T09:39:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:56 smithi114 ceph-mon[35635]: Reconfiguring daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:39:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: Reconfiguring mon.smithi114 (monmap changed)... 2024-09-16T09:39:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:39:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:39:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:57 smithi111 ceph-mon[27997]: Reconfiguring daemon mon.smithi114 on smithi114 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: Reconfiguring mon.smithi114 (monmap changed)... 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:39:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:57 smithi114 ceph-mon[35635]: Reconfiguring daemon mon.smithi114 on smithi114 2024-09-16T09:39:59.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.453 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:39:59.454 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T09:39:59.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T09:39:59.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:59.455 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:39:59 smithi111 ceph-mon[27997]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:39:59.584 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.584 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.584 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:39:59.584 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi111.front.sepia.ceph.com:9093"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:39:59.585 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:39:59.586 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:39:59 smithi114 ceph-mon[35635]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:00.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:00 smithi111 ceph-mon[27997]: overall HEALTH_OK 2024-09-16T09:40:00.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:00.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:00 smithi114 ceph-mon[35635]: overall HEALTH_OK 2024-09-16T09:40:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:01 smithi111 ceph-mon[27997]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:01.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:01 smithi114 ceph-mon[35635]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:03.748 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.748 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.748 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:03 smithi111 ceph-mon[27997]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:03.748 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.748 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:03 smithi114 ceph-mon[35635]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:03.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:03.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:04.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:04.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:04.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:04.610 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:05.838 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:05 smithi111 ceph-mon[27997]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:05.838 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:05.839 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:05.839 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:05.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:05 smithi114 ceph-mon[35635]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:05.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:05.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:05.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:06.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.640+0000 7ff0737fe640 1 -- 172.21.15.111:0/2803488200 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff084062630 con 0x7ff06c06e240 2024-09-16T09:40:06.642 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 0 on host 'smithi111' 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff06c06e240 msgr2=0x7ff06c070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff06c06e240 0x7ff06c070700 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff08419ab00 tx=0x7ff07800a4c0 comp rx=0 tx=0).stop 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 msgr2=0x7ff084199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084199650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff07402f730 tx=0x7ff07402f760 comp rx=0 tx=0).stop 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 shutdown_connections 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff06c06e240 0x7ff06c070700 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff084100b80 0x7ff084199b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 --2- 172.21.15.111:0/2803488200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff084100240 0x7ff084199650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:06.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 >> 172.21.15.111:0/2803488200 conn(0x7ff0840fbff0 msgr2=0x7ff084108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:40:06.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 shutdown_connections 2024-09-16T09:40:06.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:06.642+0000 7ff088d06640 1 -- 172.21.15.111:0/2803488200 wait complete. 2024-09-16T09:40:07.540 DEBUG:teuthology.orchestra.run.smithi111:osd.0> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.0.service 2024-09-16T09:40:07.542 INFO:tasks.cephadm:Deploying osd.1 on smithi111 with /dev/vg_nvme/lv_3... 2024-09-16T09:40:07.542 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T09:40:07.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:07.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:07.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:07 smithi111 ceph-mon[27997]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:07.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:07 smithi114 ceph-mon[35635]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:08.244 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:40:08.632 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:40:08 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[49125]: 2024-09-16T09:40:08.395+0000 7feaa79d8640 -1 osd.0 0 log_to_monitors true 2024-09-16T09:40:08.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:08 smithi114 ceph-mon[35635]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T09:40:09.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:08 smithi111 ceph-mon[27997]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-16T09:40:09.781 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[49125]: 2024-09-16T09:40:09.653+0000 7feaa3138640 -1 osd.0 0 waiting for initial osdmap 2024-09-16T09:40:09.781 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[49125]: 2024-09-16T09:40:09.660+0000 7fea9f772640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:40:09.781 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-mon[27997]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T09:40:09.781 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-mon[27997]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T09:40:09.781 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-mon[27997]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-16T09:40:09.781 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:09.781 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:09 smithi111 ceph-mon[27997]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:09 smithi114 ceph-mon[35635]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T09:40:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:09 smithi114 ceph-mon[35635]: osdmap e7: 1 total, 0 up, 1 in 2024-09-16T09:40:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:09 smithi114 ceph-mon[35635]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-16T09:40:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:09.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:09 smithi114 ceph-mon[35635]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:10 smithi114 ceph-mon[35635]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-16T09:40:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:10 smithi114 ceph-mon[35635]: osdmap e8: 1 total, 0 up, 1 in 2024-09-16T09:40:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:10.947 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:10 smithi111 ceph-mon[27997]: from='osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-16T09:40:10.947 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:10 smithi111 ceph-mon[27997]: osdmap e8: 1 total, 0 up, 1 in 2024-09-16T09:40:10.947 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:10.948 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:10.950 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:40:10.976 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi111:vg_nvme/lv_3 2024-09-16T09:40:11.763 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:40:11.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: purged_snaps scrub starts 2024-09-16T09:40:11.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: purged_snaps scrub ok 2024-09-16T09:40:11.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:11.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] boot 2024-09-16T09:40:11.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T09:40:11.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:11.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:11 smithi111 ceph-mon[27997]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:11.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: purged_snaps scrub starts 2024-09-16T09:40:11.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: purged_snaps scrub ok 2024-09-16T09:40:11.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:11.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: osd.0 [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] boot 2024-09-16T09:40:11.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: osdmap e9: 1 total, 1 up, 1 in 2024-09-16T09:40:11.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:40:11.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:11 smithi114 ceph-mon[35635]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-16T09:40:12.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 -- 172.21.15.111:0/912765278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 msgr2=0x7f285c101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 --2- 172.21.15.111:0/912765278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c101f00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f284c009880 tx=0x7f284c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 -- 172.21.15.111:0/912765278 shutdown_connections 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 --2- 172.21.15.111:0/912765278 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c101f00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 --2- 172.21.15.111:0/912765278 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285c100880 0x7f285c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 -- 172.21.15.111:0/912765278 >> 172.21.15.111:0/912765278 conn(0x7f285c0fc010 msgr2=0x7f285c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 -- 172.21.15.111:0/912765278 shutdown_connections 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.202+0000 7f2863aaf640 1 -- 172.21.15.111:0/912765278 wait complete. 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f2863aaf640 1 Processor -- start 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f2863aaf640 1 -- start start 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f2863aaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285c100880 0x7f285c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:40:12.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f2863aaf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f2863aaf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f285c109740 con 0x7f285c101a80 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f2863aaf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f285c1095c0 con 0x7f285c100880 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f286104a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f286104a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42664/0 (socket says 172.21.15.111:42664) 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.203+0000 7f286104a640 1 -- 172.21.15.111:0/844293001 learned_addr learned my addr 172.21.15.111:0/844293001 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f286184b640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285c100880 0x7f285c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f286104a640 1 -- 172.21.15.111:0/844293001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285c100880 msgr2=0x7f285c197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f286104a640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285c100880 0x7f285c197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f286104a640 1 -- 172.21.15.111:0/844293001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285c1980c0 con 0x7f285c101a80 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f286104a640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c197a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f284c006010 tx=0x7f284c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:40:12.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f284c03f070 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285c19caa0 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f284c0044d0 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f284c035030 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.204+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285c19d0b0 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.205+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285c100c60 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.206+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f284c042070 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.206+0000 7f2852ffd640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f284806e230 0x7f28480706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.206+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7f284c0ae030 con 0x7f285c101a80 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.206+0000 7f286184b640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f284806e230 0x7f28480706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.206+0000 7f286184b640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f284806e230 0x7f28480706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f285c1018e0 tx=0x7f2858008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:40:12.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.210+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f284c07c810 con 0x7f285c101a80 2024-09-16T09:40:12.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:12.395+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f285c062630 con 0x7f284806e230 2024-09-16T09:40:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:12 smithi111 ceph-mon[27997]: osdmap e10: 1 total, 1 up, 1 in 2024-09-16T09:40:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:40:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:40:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:12 smithi114 ceph-mon[35635]: osdmap e10: 1 total, 1 up, 1 in 2024-09-16T09:40:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:40:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:40:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:13.797 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:13 smithi111 ceph-mon[27997]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:13.797 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:13 smithi111 ceph-mon[27997]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:13 smithi114 ceph-mon[35635]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:13 smithi114 ceph-mon[35635]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: Detected new or changed devices on smithi111 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi111 to 11840M 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:16.280 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:16 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: Detected new or changed devices on smithi111 2024-09-16T09:40:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:40:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi111 to 11840M 2024-09-16T09:40:16.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:16.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:16.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:16.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:16 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1422314960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb30de27-8d11-407d-aa23-0861cff63597"}]: dispatch 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1422314960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb30de27-8d11-407d-aa23-0861cff63597"}]': finished 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:17 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1089635898' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1422314960' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cb30de27-8d11-407d-aa23-0861cff63597"}]: dispatch 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1422314960' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cb30de27-8d11-407d-aa23-0861cff63597"}]': finished 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: osdmap e11: 2 total, 1 up, 2 in 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:17 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1089635898' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:40:18.324 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:18 smithi111 ceph-mon[27997]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:18 smithi114 ceph-mon[35635]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:20.295 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:22.291 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:22 smithi111 ceph-mon[27997]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:22 smithi114 ceph-mon[35635]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:24 smithi111 ceph-mon[27997]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:24 smithi114 ceph-mon[35635]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:25.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T09:40:25.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-16T09:40:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:26.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:26 smithi111 ceph-mon[27997]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:26.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:26 smithi111 ceph-mon[27997]: Deploying daemon osd.1 on smithi111 2024-09-16T09:40:26.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:26 smithi114 ceph-mon[35635]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:26.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:26 smithi114 ceph-mon[35635]: Deploying daemon osd.1 on smithi111 2024-09-16T09:40:28.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:28 smithi111 ceph-mon[27997]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:28 smithi114 ceph-mon[35635]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:30.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:30 smithi111 ceph-mon[27997]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:30 smithi114 ceph-mon[35635]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:32 smithi111 ceph-mon[27997]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:32 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:32 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:32 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:32.301 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:32 smithi114 ceph-mon[35635]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:32.301 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:32 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:32.301 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:32 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:32.301 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:32 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:34.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:34.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:34.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:33 smithi111 ceph-mon[27997]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:33 smithi114 ceph-mon[35635]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:34.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.615+0000 7f2852ffd640 1 -- 172.21.15.111:0/844293001 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f285c062630 con 0x7f284806e230 2024-09-16T09:40:34.617 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 1 on host 'smithi111' 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f284806e230 msgr2=0x7f28480706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f284806e230 0x7f28480706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f285c1018e0 tx=0x7f2858008040 comp rx=0 tx=0).stop 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 msgr2=0x7f285c197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c197a40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f284c006010 tx=0x7f284c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 shutdown_connections 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f284806e230 0x7f28480706f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f285c101a80 0x7f285c197a40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 --2- 172.21.15.111:0/844293001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f285c100880 0x7f285c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 >> 172.21.15.111:0/844293001 conn(0x7f285c0fc010 msgr2=0x7f285c0fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 shutdown_connections 2024-09-16T09:40:34.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:34.617+0000 7f2863aaf640 1 -- 172.21.15.111:0/844293001 wait complete. 2024-09-16T09:40:35.577 DEBUG:teuthology.orchestra.run.smithi111:osd.1> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1.service 2024-09-16T09:40:35.580 INFO:tasks.cephadm:Deploying osd.2 on smithi111 with /dev/vg_nvme/lv_2... 2024-09-16T09:40:35.580 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T09:40:35.807 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:35.807 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:35.807 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:35 smithi111 ceph-mon[27997]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:35.807 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:35 smithi114 ceph-mon[35635]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:36.271 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:40:37.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:40:37 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[57110]: 2024-09-16T09:40:37.375+0000 7f2ecbd9a640 -1 osd.1 0 log_to_monitors true 2024-09-16T09:40:38.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:37 smithi111 ceph-mon[27997]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:38.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:37 smithi111 ceph-mon[27997]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T09:40:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:37 smithi114 ceph-mon[35635]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:37 smithi114 ceph-mon[35635]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:38 smithi111 ceph-mon[27997]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-16T09:40:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T09:40:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: osdmap e12: 2 total, 1 up, 2 in 2024-09-16T09:40:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-16T09:40:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:39.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:38 smithi114 ceph-mon[35635]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-16T09:40:39.881 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[57110]: 2024-09-16T09:40:39.733+0000 7f2ec74fa640 -1 osd.1 0 waiting for initial osdmap 2024-09-16T09:40:39.882 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[57110]: 2024-09-16T09:40:39.738+0000 7f2ebfb2c640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:40:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:39 smithi114 ceph-mon[35635]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:39 smithi114 ceph-mon[35635]: osdmap e13: 2 total, 1 up, 2 in 2024-09-16T09:40:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:39 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:39 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:39 smithi114 ceph-mon[35635]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' 2024-09-16T09:40:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:39 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:40.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-mon[27997]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:40.246 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-mon[27997]: osdmap e13: 2 total, 1 up, 2 in 2024-09-16T09:40:40.247 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:40.247 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:40.247 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-mon[27997]: from='osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577]' entity='osd.1' 2024-09-16T09:40:40.247 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:39 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:40.627 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:40:40.654 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi111:vg_nvme/lv_2 2024-09-16T09:40:41.189 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:40:41.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:40 smithi111 ceph-mon[27997]: purged_snaps scrub starts 2024-09-16T09:40:41.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:40 smithi111 ceph-mon[27997]: purged_snaps scrub ok 2024-09-16T09:40:41.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:40 smithi111 ceph-mon[27997]: osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] boot 2024-09-16T09:40:41.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:40 smithi111 ceph-mon[27997]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T09:40:41.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:40 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:41.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:40 smithi114 ceph-mon[35635]: purged_snaps scrub starts 2024-09-16T09:40:41.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:40 smithi114 ceph-mon[35635]: purged_snaps scrub ok 2024-09-16T09:40:41.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:40 smithi114 ceph-mon[35635]: osd.1 [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] boot 2024-09-16T09:40:41.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:40 smithi114 ceph-mon[35635]: osdmap e14: 2 total, 2 up, 2 in 2024-09-16T09:40:41.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:40 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.694+0000 7f0d8061b640 1 -- 172.21.15.111:0/2335422752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78101a40 msgr2=0x7f0d78101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.694+0000 7f0d8061b640 1 --2- 172.21.15.111:0/2335422752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78101a40 0x7f0d78101ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009880 tx=0x7f0d6802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 -- 172.21.15.111:0/2335422752 shutdown_connections 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 --2- 172.21.15.111:0/2335422752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78101a40 0x7f0d78101ec0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 --2- 172.21.15.111:0/2335422752 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d78100840 0x7f0d78100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 -- 172.21.15.111:0/2335422752 >> 172.21.15.111:0/2335422752 conn(0x7f0d780fbff0 msgr2=0x7f0d780fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:40:41.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 -- 172.21.15.111:0/2335422752 shutdown_connections 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 -- 172.21.15.111:0/2335422752 wait complete. 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 Processor -- start 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.695+0000 7f0d8061b640 1 -- start start 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d8061b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 0x7f0d781996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d8061b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d78101a40 0x7f0d78199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d8061b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78109680 con 0x7f0d78100840 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d8061b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78109500 con 0x7f0d78101a40 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 0x7f0d781996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 0x7f0d781996f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48098/0 (socket says 172.21.15.111:48098) 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 -- 172.21.15.111:0/3023864574 learned_addr learned my addr 172.21.15.111:0/3023864574 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7dbb6640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d78101a40 0x7f0d78199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:40:41.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 -- 172.21.15.111:0/3023864574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d78101a40 msgr2=0x7f0d78199c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d78101a40 0x7f0d78199c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 -- 172.21.15.111:0/3023864574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7819a2b0 con 0x7f0d78100840 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.696+0000 7f0d7e3b7640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 0x7f0d781996f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400d8d0 tx=0x7f0d7400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.697+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d74017070 con 0x7f0d78100840 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.697+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d7400be10 con 0x7f0d78100840 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.697+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7819ecf0 con 0x7f0d78100840 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.697+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d7400f3c0 con 0x7f0d78100840 2024-09-16T09:40:41.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.697+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7819f1a0 con 0x7f0d78100840 2024-09-16T09:40:41.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.698+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d78100c40 con 0x7f0d78100840 2024-09-16T09:40:41.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.699+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f0d7401a070 con 0x7f0d78100840 2024-09-16T09:40:41.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.699+0000 7f0d6f7fe640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0d6406e230 0x7f0d640706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:40:41.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.699+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2414+0+0 (secure 0 0 0) 0x7f0d7408d010 con 0x7f0d78100840 2024-09-16T09:40:41.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.699+0000 7f0d7dbb6640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0d6406e230 0x7f0d640706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:40:41.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.700+0000 7f0d7dbb6640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0d6406e230 0x7f0d640706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d680058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:40:41.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.704+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0d7405f2f0 con 0x7f0d78100840 2024-09-16T09:40:41.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:40:41.893+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f0d7806a310 con 0x7f0d6406e230 2024-09-16T09:40:42.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:41 smithi111 ceph-mon[27997]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:42.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:40:42.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:40:42.345 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:41 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:41 smithi114 ceph-mon[35635]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-16T09:40:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:41 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:40:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:41 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:40:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:41 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:43.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: osdmap e15: 2 total, 2 up, 2 in 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:42 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:43.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: osdmap e15: 2 total, 2 up, 2 in 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:43.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:42 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:40:44.058 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:43 smithi111 ceph-mon[27997]: Detected new or changed devices on smithi111 2024-09-16T09:40:44.058 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:43 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi111 to 5920M 2024-09-16T09:40:44.058 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:43 smithi111 ceph-mon[27997]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:43 smithi114 ceph-mon[35635]: Detected new or changed devices on smithi111 2024-09-16T09:40:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:43 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi111 to 5920M 2024-09-16T09:40:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:43 smithi114 ceph-mon[35635]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:46.089 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:45 smithi111 ceph-mon[27997]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:46.089 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:45 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/4286756748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3159d59-4af3-4a9a-bcbd-9d37153c8701"}]: dispatch 2024-09-16T09:40:46.089 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:45 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/4286756748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3159d59-4af3-4a9a-bcbd-9d37153c8701"}]': finished 2024-09-16T09:40:46.089 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:45 smithi111 ceph-mon[27997]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T09:40:46.089 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:40:46.089 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:45 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3328927057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:40:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:45 smithi114 ceph-mon[35635]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:45 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/4286756748' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f3159d59-4af3-4a9a-bcbd-9d37153c8701"}]: dispatch 2024-09-16T09:40:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:45 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/4286756748' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f3159d59-4af3-4a9a-bcbd-9d37153c8701"}]': finished 2024-09-16T09:40:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:45 smithi114 ceph-mon[35635]: osdmap e16: 3 total, 2 up, 3 in 2024-09-16T09:40:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:45 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:40:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:45 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3328927057' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:40:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:47 smithi111 ceph-mon[27997]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:47 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:47 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:47 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:47 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:47 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:47 smithi114 ceph-mon[35635]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:47 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:47 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:47 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:47 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:40:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:47 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:40:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:49 smithi114 ceph-mon[35635]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:49 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:50.288 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:49 smithi111 ceph-mon[27997]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:50.288 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:49 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:40:52.226 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:51 smithi111 ceph-mon[27997]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:52.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:51 smithi114 ceph-mon[35635]: pgmap v72: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:54.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:53 smithi111 ceph-mon[27997]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:53 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T09:40:54.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:53 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:53 smithi114 ceph-mon[35635]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:53 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-16T09:40:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:53 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:40:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:54 smithi114 ceph-mon[35635]: Deploying daemon osd.2 on smithi111 2024-09-16T09:40:55.241 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:54 smithi111 ceph-mon[27997]: Deploying daemon osd.2 on smithi111 2024-09-16T09:40:56.290 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:55 smithi111 ceph-mon[27997]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:55 smithi114 ceph-mon[35635]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:58.321 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:57 smithi111 ceph-mon[27997]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:40:58.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:57 smithi114 ceph-mon[35635]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:59 smithi114 ceph-mon[35635]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:40:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:00.260 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:59 smithi111 ceph-mon[27997]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:00.260 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:00.260 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:00.260 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:40:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:02.214 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:01 smithi111 ceph-mon[27997]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:01 smithi114 ceph-mon[35635]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:03.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.644+0000 7f0d6f7fe640 1 -- 172.21.15.111:0/3023864574 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0d7806a310 con 0x7f0d6406e230 2024-09-16T09:41:03.646 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 2 on host 'smithi111' 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0d6406e230 msgr2=0x7f0d640706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0d6406e230 0x7f0d640706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d68000c00 tx=0x7f0d680058d0 comp rx=0 tx=0).stop 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 msgr2=0x7f0d781996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 0x7f0d781996f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400d8d0 tx=0x7f0d7400dd90 comp rx=0 tx=0).stop 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 shutdown_connections 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0d6406e230 0x7f0d640706f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0d78101a40 0x7f0d78199c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:03.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 --2- 172.21.15.111:0/3023864574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0d78100840 0x7f0d781996f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:03.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 >> 172.21.15.111:0/3023864574 conn(0x7f0d780fbff0 msgr2=0x7f0d78069c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:41:03.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 shutdown_connections 2024-09-16T09:41:03.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:41:03.647+0000 7f0d8061b640 1 -- 172.21.15.111:0/3023864574 wait complete. 2024-09-16T09:41:04.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:03 smithi111 ceph-mon[27997]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:04.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:04.265 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:03 smithi114 ceph-mon[35635]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:04.913 DEBUG:teuthology.orchestra.run.smithi111:osd.2> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.2.service 2024-09-16T09:41:04.915 INFO:tasks.cephadm:Deploying osd.3 on smithi114 with /dev/vg_nvme/lv_4... 2024-09-16T09:41:04.915 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-16T09:41:05.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:05.171 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:41:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:05.876 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:05 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[64715]: 2024-09-16T09:41:05.610+0000 7f8b8c6d3640 -1 osd.2 0 log_to_monitors true 2024-09-16T09:41:06.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:06 smithi111 ceph-mon[27997]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:06.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:06 smithi111 ceph-mon[27997]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T09:41:06.278 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:06 smithi114 ceph-mon[35635]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:06.278 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:06 smithi114 ceph-mon[35635]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-16T09:41:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:07 smithi114 ceph-mon[35635]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T09:41:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:07 smithi114 ceph-mon[35635]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T09:41:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:07 smithi114 ceph-mon[35635]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-16T09:41:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:07 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:07.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-mon[27997]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T09:41:07.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-mon[27997]: osdmap e17: 3 total, 2 up, 3 in 2024-09-16T09:41:07.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-mon[27997]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-09-16T09:41:07.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:07.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:07.317 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:07.465 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:41:07.492 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi114:vg_nvme/lv_4 2024-09-16T09:41:07.733 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:41:08.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:08 smithi114 ceph-mon[35635]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:08.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:08 smithi114 ceph-mon[35635]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-16T09:41:08.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:08 smithi114 ceph-mon[35635]: osdmap e18: 3 total, 2 up, 3 in 2024-09-16T09:41:08.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:08 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:08.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:08 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:08.108 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:08 smithi114 ceph-mon[35635]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' 2024-09-16T09:41:08.131 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[64715]: 2024-09-16T09:41:07.855+0000 7f8b87e33640 -1 osd.2 0 waiting for initial osdmap 2024-09-16T09:41:08.132 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:07 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[64715]: 2024-09-16T09:41:07.862+0000 7f8b80465640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:41:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:08 smithi111 ceph-mon[27997]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:08 smithi111 ceph-mon[27997]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-09-16T09:41:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:08 smithi111 ceph-mon[27997]: osdmap e18: 3 total, 2 up, 3 in 2024-09-16T09:41:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:08 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:08 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:08 smithi111 ceph-mon[27997]: from='osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958]' entity='osd.2' 2024-09-16T09:41:08.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 -- 172.21.15.114:0/4274853877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 msgr2=0x7f7454100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 --2- 172.21.15.114:0/4274853877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454100c40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7444009880 tx=0x7f744402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 -- 172.21.15.114:0/4274853877 shutdown_connections 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 --2- 172.21.15.114:0/4274853877 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7454101a40 0x7f7454101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 --2- 172.21.15.114:0/4274853877 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454100c40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 -- 172.21.15.114:0/4274853877 >> 172.21.15.114:0/4274853877 conn(0x7f74540fbff0 msgr2=0x7f74540fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 -- 172.21.15.114:0/4274853877 shutdown_connections 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 -- 172.21.15.114:0/4274853877 wait complete. 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 Processor -- start 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.188+0000 7f745a184640 1 -- start start 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f745a184640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f745a184640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7454101a40 0x7f7454197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:08.192 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f745a184640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7454109680 con 0x7f7454101a40 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f745a184640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7454109500 con 0x7f7454100840 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:41312/0 (socket says 172.21.15.114:41312) 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 -- 172.21.15.114:0/1718966126 learned_addr learned my addr 172.21.15.114:0/1718966126 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f7452ffd640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7454101a40 0x7f7454197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 -- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7454101a40 msgr2=0x7f7454197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7454101a40 0x7f7454197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 -- 172.21.15.114:0/1718966126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7454198130 con 0x7f7454100840 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f74537fe640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454197570 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7444006010 tx=0x7f74440045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f744403f070 con 0x7f7454100840 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f745419cac0 con 0x7f7454100840 2024-09-16T09:41:08.193 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74440049d0 con 0x7f7454100840 2024-09-16T09:41:08.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7444035030 con 0x7f7454100840 2024-09-16T09:41:08.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.189+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f745419d050 con 0x7f7454100840 2024-09-16T09:41:08.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.191+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7454100c40 con 0x7f7454100840 2024-09-16T09:41:08.194 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.191+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 18) ==== 92497+0+0 (secure 0 0 0) 0x7f7444042070 con 0x7f7454100840 2024-09-16T09:41:08.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.191+0000 7f7450ff9640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f743c06e230 0x7f743c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:08.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.191+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2566+0+0 (secure 0 0 0) 0x7f74440ae010 con 0x7f7454100840 2024-09-16T09:41:08.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.191+0000 7f7452ffd640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f743c06e230 0x7f743c0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:08.195 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.192+0000 7f7452ffd640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f743c06e230 0x7f743c0706f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74541989d0 tx=0x7f7448005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:41:08.197 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.196+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7444084a80 con 0x7f7454100840 2024-09-16T09:41:08.372 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:08.370+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f745406a2b0 con 0x7f743c06e230 2024-09-16T09:41:09.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: purged_snaps scrub starts 2024-09-16T09:41:09.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: purged_snaps scrub ok 2024-09-16T09:41:09.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:09.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:41:09.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:41:09.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:09.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] boot 2024-09-16T09:41:09.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T09:41:09.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:09 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:09.577 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: purged_snaps scrub starts 2024-09-16T09:41:09.577 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: purged_snaps scrub ok 2024-09-16T09:41:09.577 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:09.577 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:41:09.577 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:41:09.577 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:09.578 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: osd.2 [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] boot 2024-09-16T09:41:09.578 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: osdmap e19: 3 total, 3 up, 3 in 2024-09-16T09:41:09.578 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:09 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:41:10.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:10.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:10.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T09:41:10.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T09:41:10.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: Detected new or changed devices on smithi111 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi111 to 3946M 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: osdmap e20: 3 total, 3 up, 3 in 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: Detected new or changed devices on smithi111 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:10.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi111 to 3946M 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:10.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:11.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:11.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:11.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/1488082340' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5a7c3b7-9672-46d2-ba12-be708f7ca38c"}]: dispatch 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5a7c3b7-9672-46d2-ba12-be708f7ca38c"}]: dispatch 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5a7c3b7-9672-46d2-ba12-be708f7ca38c"}]': finished 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:11.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:11 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/538777616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:41:11.613 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69480]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T09:41:11.614 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69480]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:11.614 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:11.614 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69480]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/1488082340' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5a7c3b7-9672-46d2-ba12-be708f7ca38c"}]: dispatch 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a5a7c3b7-9672-46d2-ba12-be708f7ca38c"}]: dispatch 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a5a7c3b7-9672-46d2-ba12-be708f7ca38c"}]': finished 2024-09-16T09:41:11.614 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: osdmap e21: 4 total, 3 up, 4 in 2024-09-16T09:41:11.615 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:11.615 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:11.615 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:11 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/538777616' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:41:11.881 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69483]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T09:41:11.881 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69483]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:11.882 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:11.882 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69483]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:12.154 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69486]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T09:41:12.154 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69486]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:12.154 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:12.155 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:11 smithi111 sudo[69486]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:12.415 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69492]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T09:41:12.415 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69492]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:12.415 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:12.416 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69492]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:12.416 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69489]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T09:41:12.416 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69489]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:12.416 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:12.416 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69489]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:12.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 ceph-mon[27997]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T09:41:12.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:12.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:12.882 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69495]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T09:41:12.882 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69495]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:12.882 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:12.882 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69495]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:12 smithi114 ceph-mon[35635]: osdmap e22: 4 total, 3 up, 4 in 2024-09-16T09:41:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:12.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:13.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69498]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T09:41:13.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69498]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:13.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:13.159 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:12 smithi111 sudo[69498]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:13.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 sudo[69501]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T09:41:13.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 sudo[69501]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:13.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 sudo[69501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:13.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 sudo[69501]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:13.665 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39946]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-16T09:41:13.665 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39946]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:13.665 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:13.665 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39946]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:13.673 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:13.671+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f7444003c20 con 0x7f7454100840 2024-09-16T09:41:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39952]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-16T09:41:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39952]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-16T09:41:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-16T09:41:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 sudo[39952]: pam_unix(sudo:session): session closed for user root 2024-09-16T09:41:13.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T09:41:13.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: pgmap v89: 1 pgs: 1 creating+activating; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:13.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T09:41:13.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:41:13.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:41:13.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:41:13.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:13 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: pgmap v89: 1 pgs: 1 creating+activating; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:41:14.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:13 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:41:14.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:14 smithi114 ceph-mon[35635]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T09:41:14.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:14 smithi114 ceph-mon[35635]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T09:41:14.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:14 smithi114 ceph-mon[35635]: mgrmap e19: smithi111.erxodt(active, since 2m), standbys: smithi114.xvotey 2024-09-16T09:41:14.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:14 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:15.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:14 smithi111 ceph-mon[27997]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-16T09:41:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:14 smithi111 ceph-mon[27997]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-16T09:41:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:14 smithi111 ceph-mon[27997]: mgrmap e19: smithi111.erxodt(active, since 2m), standbys: smithi114.xvotey 2024-09-16T09:41:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:14 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:15.924 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:15 smithi114 ceph-mon[35635]: pgmap v90: 1 pgs: 1 creating+activating; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:16.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:15 smithi111 ceph-mon[27997]: pgmap v90: 1 pgs: 1 creating+activating; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:18.129 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:17 smithi114 ceph-mon[35635]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:18.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:17 smithi111 ceph-mon[27997]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T09:41:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-16T09:41:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:20.105 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:19 smithi114 ceph-mon[35635]: Deploying daemon osd.3 on smithi114 2024-09-16T09:41:20.105 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:19 smithi114 ceph-mon[35635]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:20.105 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:19 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:20.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:19 smithi111 ceph-mon[27997]: Deploying daemon osd.3 on smithi114 2024-09-16T09:41:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:19 smithi111 ceph-mon[27997]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:19 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:22.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:21 smithi114 ceph-mon[35635]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:22.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:21 smithi111 ceph-mon[27997]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:24.170 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:23 smithi114 ceph-mon[35635]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:24.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:23 smithi111 ceph-mon[27997]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:25.203 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:25.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:25.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:26.335 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:25 smithi114 ceph-mon[35635]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:26.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:25 smithi111 ceph-mon[27997]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:28.255 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:27 smithi114 ceph-mon[35635]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:28.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:27 smithi111 ceph-mon[27997]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:28.939 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.937+0000 7f7450ff9640 1 -- 172.21.15.114:0/1718966126 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f745406a2b0 con 0x7f743c06e230 2024-09-16T09:41:28.939 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 3 on host 'smithi114' 2024-09-16T09:41:28.941 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.939+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f743c06e230 msgr2=0x7f743c0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.939+0000 7f745a184640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f743c06e230 0x7f743c0706f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74541989d0 tx=0x7f7448005f90 comp rx=0 tx=0).stop 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.939+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 msgr2=0x7f7454197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.939+0000 7f745a184640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454197570 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7444006010 tx=0x7f74440045e0 comp rx=0 tx=0).stop 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 shutdown_connections 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f743c06e230 0x7f743c0706f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7454101a40 0x7f7454197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 --2- 172.21.15.114:0/1718966126 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7454100840 0x7f7454197570 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 >> 172.21.15.114:0/1718966126 conn(0x7f74540fbff0 msgr2=0x7f7454069ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 shutdown_connections 2024-09-16T09:41:28.942 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:28.940+0000 7f745a184640 1 -- 172.21.15.114:0/1718966126 wait complete. 2024-09-16T09:41:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:29 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:29 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:29.518 DEBUG:teuthology.orchestra.run.smithi114:osd.3> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.3.service 2024-09-16T09:41:29.521 INFO:tasks.cephadm:Deploying osd.4 on smithi114 with /dev/vg_nvme/lv_3... 2024-09-16T09:41:29.521 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-16T09:41:30.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:30 smithi111 ceph-mon[27997]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:30 smithi114 ceph-mon[35635]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:31.044 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:41:31.435 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:41:31 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[41573]: 2024-09-16T09:41:31.297+0000 7f9e988db640 -1 osd.3 0 log_to_monitors true 2024-09-16T09:41:32.254 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:32 smithi114 ceph-mon[35635]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:32.254 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:32 smithi114 ceph-mon[35635]: from='osd.3 [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T09:41:32.254 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:32 smithi114 ceph-mon[35635]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T09:41:32.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:32 smithi111 ceph-mon[27997]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:32.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:32 smithi111 ceph-mon[27997]: from='osd.3 [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T09:41:32.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:32 smithi111 ceph-mon[27997]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-16T09:41:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T09:41:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='osd.3 [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='osd.3 [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: osdmap e23: 4 total, 3 up, 4 in 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:41:33.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: Detected new or changed devices on smithi114 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi114 to 14912M 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:34.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:34 smithi114 ceph-mon[35635]: from='osd.3 ' entity='osd.3' 2024-09-16T09:41:34.139 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[41573]: 2024-09-16T09:41:33.981+0000 7f9e9403b640 -1 osd.3 0 waiting for initial osdmap 2024-09-16T09:41:34.139 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:41:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[41573]: 2024-09-16T09:41:33.989+0000 7f9e8c66d640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:41:34.140 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:41:34.165 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi114:vg_nvme/lv_3 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: Detected new or changed devices on smithi114 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi114 to 14912M 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: osdmap e24: 4 total, 3 up, 4 in 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:34 smithi111 ceph-mon[27997]: from='osd.3 ' entity='osd.3' 2024-09-16T09:41:34.412 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:41:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 -- 172.21.15.114:0/1196015679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734101a80 msgr2=0x7ff734101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1196015679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734101a80 0x7ff734101f00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff724009880 tx=0x7ff72402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:41:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 -- 172.21.15.114:0/1196015679 shutdown_connections 2024-09-16T09:41:34.834 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1196015679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734101a80 0x7ff734101f00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1196015679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734100880 0x7ff734100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 -- 172.21.15.114:0/1196015679 >> 172.21.15.114:0/1196015679 conn(0x7ff7340fc010 msgr2=0x7ff7340fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 -- 172.21.15.114:0/1196015679 shutdown_connections 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.830+0000 7ff73c08d640 1 -- 172.21.15.114:0/1196015679 wait complete. 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff73c08d640 1 Processor -- start 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff73c08d640 1 -- start start 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff73c08d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 0x7ff734197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff73c08d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734101a80 0x7ff7341979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff73c08d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341096c0 con 0x7ff734101a80 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff73c08d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff734109540 con 0x7ff734100880 2024-09-16T09:41:34.835 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff739e29640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 0x7ff734197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff739e29640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 0x7ff734197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:57560/0 (socket says 172.21.15.114:57560) 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff739e29640 1 -- 172.21.15.114:0/1878613124 learned_addr learned my addr 172.21.15.114:0/1878613124 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.831+0000 7ff739628640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734101a80 0x7ff7341979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff739e29640 1 -- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734101a80 msgr2=0x7ff7341979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff739e29640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734101a80 0x7ff7341979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff739e29640 1 -- 172.21.15.114:0/1878613124 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff734198050 con 0x7ff734100880 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff739e29640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 0x7ff734197490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff73000e940 tx=0x7ff73000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff73000cac0 con 0x7ff734100880 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73419ca90 con 0x7ff734100880 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff73000cc60 con 0x7ff734100880 2024-09-16T09:41:34.836 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff730003e30 con 0x7ff734100880 2024-09-16T09:41:34.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.832+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff734102ed0 con 0x7ff734100880 2024-09-16T09:41:34.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.833+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff734109ea0 con 0x7ff734100880 2024-09-16T09:41:34.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.834+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff730004000 con 0x7ff734100880 2024-09-16T09:41:34.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.834+0000 7ff72affd640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff7200726c0 0x7ff720074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:34.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.834+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3807+0+0 (secure 0 0 0) 0x7ff73008e090 con 0x7ff734100880 2024-09-16T09:41:34.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.834+0000 7ff739628640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff7200726c0 0x7ff720074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:34.838 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.835+0000 7ff739628640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff7200726c0 0x7ff720074b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff724000c00 tx=0x7ff7240058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:41:34.840 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:34.839+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff73005c070 con 0x7ff734100880 2024-09-16T09:41:35.015 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:35.014+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff7340633a0 con 0x7ff7200726c0 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: purged_snaps scrub starts 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: purged_snaps scrub ok 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: osd.3 [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] boot 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:41:35.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:41:35.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: purged_snaps scrub starts 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: purged_snaps scrub ok 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: osd.3 [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] boot 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: osdmap e25: 4 total, 4 up, 4 in 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:41:35.424 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:36.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:36 smithi111 ceph-mon[27997]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:36.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:36 smithi111 ceph-mon[27997]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:36.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:36 smithi111 ceph-mon[27997]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T09:41:36.431 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:36 smithi114 ceph-mon[35635]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:36.431 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:36 smithi114 ceph-mon[35635]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:41:36.431 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:36 smithi114 ceph-mon[35635]: osdmap e26: 4 total, 4 up, 4 in 2024-09-16T09:41:37.379 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T09:41:37.379 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: osdmap e28: 4 total, 4 up, 4 in 2024-09-16T09:41:37.380 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3588694405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9820d754-6da1-4ef4-a6a9-77b310c1c3a3"}]: dispatch 2024-09-16T09:41:37.380 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9820d754-6da1-4ef4-a6a9-77b310c1c3a3"}]: dispatch 2024-09-16T09:41:37.380 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9820d754-6da1-4ef4-a6a9-77b310c1c3a3"}]': finished 2024-09-16T09:41:37.380 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T09:41:37.380 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:41:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: osdmap e27: 4 total, 4 up, 4 in 2024-09-16T09:41:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: osdmap e28: 4 total, 4 up, 4 in 2024-09-16T09:41:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3588694405' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9820d754-6da1-4ef4-a6a9-77b310c1c3a3"}]: dispatch 2024-09-16T09:41:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9820d754-6da1-4ef4-a6a9-77b310c1c3a3"}]: dispatch 2024-09-16T09:41:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9820d754-6da1-4ef4-a6a9-77b310c1c3a3"}]': finished 2024-09-16T09:41:37.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: osdmap e29: 5 total, 4 up, 5 in 2024-09-16T09:41:37.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:41:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:38 smithi114 ceph-mon[35635]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:38 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3622227080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:41:38.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:38 smithi111 ceph-mon[27997]: pgmap v107: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:38.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:38 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3622227080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:41:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:39 smithi114 ceph-mon[35635]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:39.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:39 smithi111 ceph-mon[27997]: pgmap v109: 1 pgs: 1 remapped+peering; 577 KiB data, 336 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:41 smithi114 ceph-mon[35635]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:42.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:41 smithi111 ceph-mon[27997]: pgmap v110: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:43 smithi114 ceph-mon[35635]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-16T09:41:44.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:43 smithi111 ceph-mon[27997]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 85 KiB/s, 0 objects/s recovering 2024-09-16T09:41:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:45 smithi114 ceph-mon[35635]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-16T09:41:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:45 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T09:41:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:45 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:46.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:45 smithi111 ceph-mon[27997]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-16T09:41:46.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-16T09:41:46.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:45 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:41:47.217 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:46 smithi114 ceph-mon[35635]: Deploying daemon osd.4 on smithi114 2024-09-16T09:41:47.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:46 smithi111 ceph-mon[27997]: Deploying daemon osd.4 on smithi114 2024-09-16T09:41:48.154 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:47 smithi114 ceph-mon[35635]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T09:41:48.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:47 smithi111 ceph-mon[27997]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-16T09:41:50.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:49 smithi114 ceph-mon[35635]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T09:41:50.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:49 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:50.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:49 smithi111 ceph-mon[27997]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-16T09:41:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:49 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:41:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:51 smithi114 ceph-mon[35635]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T09:41:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:51 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:51 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:51 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:52.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:51 smithi111 ceph-mon[27997]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T09:41:52.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:51 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:41:52.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:51 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:52.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:51 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:54.267 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:53 smithi114 ceph-mon[35635]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T09:41:54.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:53 smithi111 ceph-mon[27997]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-16T09:41:54.571 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.570+0000 7ff72affd640 1 -- 172.21.15.114:0/1878613124 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff7340633a0 con 0x7ff7200726c0 2024-09-16T09:41:54.572 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 4 on host 'smithi114' 2024-09-16T09:41:54.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.572+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff7200726c0 msgr2=0x7ff720074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:54.574 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.572+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff7200726c0 0x7ff720074b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff724000c00 tx=0x7ff7240058d0 comp rx=0 tx=0).stop 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.572+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 msgr2=0x7ff734197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.572+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 0x7ff734197490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff73000e940 tx=0x7ff73000ee00 comp rx=0 tx=0).stop 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.572+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 shutdown_connections 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.573+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff7200726c0 0x7ff720074b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.573+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734101a80 0x7ff7341979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.573+0000 7ff73c08d640 1 --2- 172.21.15.114:0/1878613124 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff734100880 0x7ff734197490 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.573+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 >> 172.21.15.114:0/1878613124 conn(0x7ff7340fc010 msgr2=0x7ff7340fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.573+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 shutdown_connections 2024-09-16T09:41:54.575 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:54.573+0000 7ff73c08d640 1 -- 172.21.15.114:0/1878613124 wait complete. 2024-09-16T09:41:55.155 DEBUG:teuthology.orchestra.run.smithi114:osd.4> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.4.service 2024-09-16T09:41:55.158 INFO:tasks.cephadm:Deploying osd.5 on smithi114 with /dev/vg_nvme/lv_2... 2024-09-16T09:41:55.158 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-16T09:41:55.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:55.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:55 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:55.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:55 smithi114 ceph-mon[35635]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:55.870 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:41:55.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:55.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:55 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:55.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:55 smithi111 ceph-mon[27997]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:58.084 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:41:57 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[48021]: 2024-09-16T09:41:57.788+0000 7f56403f2640 -1 osd.4 0 log_to_monitors true 2024-09-16T09:41:58.175 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-09-16T09:41:58.200 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi114:vg_nvme/lv_2 2024-09-16T09:41:58.348 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:58 smithi114 ceph-mon[35635]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:58.348 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:58.348 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:58 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:58.348 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:58 smithi114 ceph-mon[35635]: from='osd.4 [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T09:41:58.348 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:58 smithi114 ceph-mon[35635]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T09:41:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:58 smithi111 ceph-mon[27997]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:41:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:58 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:58 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:41:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:58 smithi111 ceph-mon[27997]: from='osd.4 [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T09:41:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:58 smithi111 ceph-mon[27997]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-16T09:41:59.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:59 smithi111 ceph-mon[27997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T09:41:59.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:59 smithi111 ceph-mon[27997]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T09:41:59.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:59 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:41:59.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:59 smithi111 ceph-mon[27997]: from='osd.4 [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:59.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:41:59 smithi111 ceph-mon[27997]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:59.413 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[48021]: 2024-09-16T09:41:59.100+0000 7f563bb52640 -1 osd.4 0 waiting for initial osdmap 2024-09-16T09:41:59.413 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[48021]: 2024-09-16T09:41:59.106+0000 7f563818c640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:41:59.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-mon[35635]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T09:41:59.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-mon[35635]: osdmap e30: 5 total, 4 up, 5 in 2024-09-16T09:41:59.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:41:59.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-mon[35635]: from='osd.4 [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:59.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:41:59 smithi114 ceph-mon[35635]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:41:59.499 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:41:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 -- 172.21.15.114:0/3152028660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 msgr2=0x7f67181070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 --2- 172.21.15.114:0/3152028660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f67181070f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f670c009880 tx=0x7f670c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:41:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 -- 172.21.15.114:0/3152028660 shutdown_connections 2024-09-16T09:41:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 --2- 172.21.15.114:0/3152028660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f67181070f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:59.949 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 --2- 172.21.15.114:0/3152028660 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 0x7f67181047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 -- 172.21.15.114:0/3152028660 >> 172.21.15.114:0/3152028660 conn(0x7f67180fbff0 msgr2=0x7f67180fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 -- 172.21.15.114:0/3152028660 shutdown_connections 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 -- 172.21.15.114:0/3152028660 wait complete. 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.940+0000 7f671deb6640 1 Processor -- start 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f671deb6640 1 -- start start 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f671deb6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 0x7f67181974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f671deb6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f6718197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f671deb6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f671810a770 con 0x7f67181023d0 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f671deb6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f671810a5f0 con 0x7f6718104d00 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f6718197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:59.950 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f6718197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:40632/0 (socket says 172.21.15.114:40632) 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 -- 172.21.15.114:0/1971479296 learned_addr learned my addr 172.21.15.114:0/1971479296 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f67177fe640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 0x7f67181974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 -- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 msgr2=0x7f67181974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 0x7f67181974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 -- 172.21.15.114:0/1971479296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6718198020 con 0x7f6718104d00 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f67177fe640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 0x7f67181974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.941+0000 7f6716ffd640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f6718197a30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f670c0048f0 tx=0x7f670c004920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.942+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f670c03f070 con 0x7f6718104d00 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.942+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f670c003ab0 con 0x7f6718104d00 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.942+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671819ca30 con 0x7f6718104d00 2024-09-16T09:41:59.951 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.942+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f670c035030 con 0x7f6718104d00 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.942+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f671819cf30 con 0x7f6718104d00 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.943+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67181027b0 con 0x7f6718104d00 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.943+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f670c042070 con 0x7f6718104d00 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.944+0000 7f6714ff9640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f670006e2b0 0x7f6700070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.944+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3926+0+0 (secure 0 0 0) 0x7f670c0ae820 con 0x7f6718104d00 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.944+0000 7f67177fe640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f670006e2b0 0x7f6700070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:41:59.952 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.945+0000 7f67177fe640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f670006e2b0 0x7f6700070770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f670800baa0 tx=0x7f6708005d90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:41:59.953 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:41:59.951+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f670c07c780 con 0x7f6718104d00 2024-09-16T09:42:00.134 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:00.132+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f67181057a0 con 0x7f670006e2b0 2024-09-16T09:42:00.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:00 smithi111 ceph-mon[27997]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:42:00.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:00 smithi111 ceph-mon[27997]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-16T09:42:00.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:00 smithi111 ceph-mon[27997]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T09:42:00.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:42:00.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:42:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:00 smithi114 ceph-mon[35635]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:42:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:00 smithi114 ceph-mon[35635]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-16T09:42:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:00 smithi114 ceph-mon[35635]: osdmap e31: 5 total, 4 up, 5 in 2024-09-16T09:42:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:42:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: purged_snaps scrub starts 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: purged_snaps scrub ok 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: osd.4 [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] boot 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: osdmap e32: 5 total, 5 up, 5 in 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:01.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:01.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:01.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:01.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: purged_snaps scrub starts 2024-09-16T09:42:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: purged_snaps scrub ok 2024-09-16T09:42:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: osd.4 [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] boot 2024-09-16T09:42:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: osdmap e32: 5 total, 5 up, 5 in 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='client.24217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi114:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:01.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:01.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:01.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:01.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:01.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:02.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:02 smithi111 ceph-mon[27997]: Detected new or changed devices on smithi114 2024-09-16T09:42:02.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:02 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi114 to 7456M 2024-09-16T09:42:02.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:02 smithi111 ceph-mon[27997]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:42:02.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:02 smithi111 ceph-mon[27997]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T09:42:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:02 smithi114 ceph-mon[35635]: Detected new or changed devices on smithi114 2024-09-16T09:42:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:02 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi114 to 7456M 2024-09-16T09:42:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:02 smithi114 ceph-mon[35635]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-16T09:42:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:02 smithi114 ceph-mon[35635]: osdmap e33: 5 total, 5 up, 5 in 2024-09-16T09:42:03.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:03 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3534182828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ec8880-8d5b-492b-bcf6-8effa0183acf"}]: dispatch 2024-09-16T09:42:03.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:03 smithi111 ceph-mon[27997]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ec8880-8d5b-492b-bcf6-8effa0183acf"}]: dispatch 2024-09-16T09:42:03.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:03 smithi111 ceph-mon[27997]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76ec8880-8d5b-492b-bcf6-8effa0183acf"}]': finished 2024-09-16T09:42:03.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:03 smithi111 ceph-mon[27997]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T09:42:03.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:03 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:03.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:03 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/768279887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:42:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:03 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3534182828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ec8880-8d5b-492b-bcf6-8effa0183acf"}]: dispatch 2024-09-16T09:42:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:03 smithi114 ceph-mon[35635]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "76ec8880-8d5b-492b-bcf6-8effa0183acf"}]: dispatch 2024-09-16T09:42:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:03 smithi114 ceph-mon[35635]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "76ec8880-8d5b-492b-bcf6-8effa0183acf"}]': finished 2024-09-16T09:42:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:03 smithi114 ceph-mon[35635]: osdmap e34: 6 total, 5 up, 6 in 2024-09-16T09:42:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:03 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:03 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/768279887' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-16T09:42:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:04 smithi111 ceph-mon[27997]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:04 smithi114 ceph-mon[35635]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:05.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:06.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:06 smithi111 ceph-mon[27997]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:06.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:06 smithi114 ceph-mon[35635]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:08.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:08 smithi114 ceph-mon[35635]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:08.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:08 smithi111 ceph-mon[27997]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:10.293 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:10 smithi114 ceph-mon[35635]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:10.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:10 smithi111 ceph-mon[27997]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:11.332 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T09:42:11.333 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:11.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-16T09:42:11.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:12 smithi111 ceph-mon[27997]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:12.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:12 smithi111 ceph-mon[27997]: Deploying daemon osd.5 on smithi114 2024-09-16T09:42:12.436 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:12 smithi114 ceph-mon[35635]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:12.436 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:12 smithi114 ceph-mon[35635]: Deploying daemon osd.5 on smithi114 2024-09-16T09:42:14.355 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:14 smithi114 ceph-mon[35635]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:14.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:14 smithi111 ceph-mon[27997]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:16.345 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:16 smithi114 ceph-mon[35635]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:16.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:16 smithi111 ceph-mon[27997]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:17.357 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:17 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:17.357 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:17 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:17.357 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:17 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:17.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:17 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:17.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:17 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:17.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:17 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:18 smithi114 ceph-mon[35635]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:18.598 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:18 smithi111 ceph-mon[27997]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:20 smithi114 ceph-mon[35635]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:20.546 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.544+0000 7f6714ff9640 1 -- 172.21.15.114:0/1971479296 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f67181057a0 con 0x7f670006e2b0 2024-09-16T09:42:20.546 INFO:teuthology.orchestra.run.smithi114.stdout:Created osd(s) 5 on host 'smithi114' 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f670006e2b0 msgr2=0x7f6700070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f670006e2b0 0x7f6700070770 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f670800baa0 tx=0x7f6708005d90 comp rx=0 tx=0).stop 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 msgr2=0x7f6718197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f6718197a30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f670c0048f0 tx=0x7f670c004920 comp rx=0 tx=0).stop 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 shutdown_connections 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f670006e2b0 0x7f6700070770 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6718104d00 0x7f6718197a30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 --2- 172.21.15.114:0/1971479296 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67181023d0 0x7f67181974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 >> 172.21.15.114:0/1971479296 conn(0x7f67180fbff0 msgr2=0x7f67180fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 shutdown_connections 2024-09-16T09:42:20.548 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:20.546+0000 7f671deb6640 1 -- 172.21.15.114:0/1971479296 wait complete. 2024-09-16T09:42:20.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:20 smithi111 ceph-mon[27997]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:20.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:21.203 DEBUG:teuthology.orchestra.run.smithi114:osd.5> sudo journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.5.service 2024-09-16T09:42:21.206 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-16T09:42:21.206 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T09:42:21.484 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:21.789 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.790 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.790 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:21 smithi111 ceph-mon[27997]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:21.790 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.790 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:21 smithi114 ceph-mon[35635]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 -- 172.21.15.111:0/2123273448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 msgr2=0x7fda68104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 --2- 172.21.15.111:0/2123273448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68104800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fda58009c50 tx=0x7fda5802a9a0 comp rx=0 tx=0).stop 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 -- 172.21.15.111:0/2123273448 shutdown_connections 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 --2- 172.21.15.111:0/2123273448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda68104d40 0x7fda68107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 --2- 172.21.15.111:0/2123273448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68104800 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 -- 172.21.15.111:0/2123273448 >> 172.21.15.111:0/2123273448 conn(0x7fda680fc010 msgr2=0x7fda680fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 -- 172.21.15.111:0/2123273448 shutdown_connections 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.989+0000 7fda6de16640 1 -- 172.21.15.111:0/2123273448 wait complete. 2024-09-16T09:42:21.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda6de16640 1 Processor -- start 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda6de16640 1 -- start start 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda6de16640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda6de16640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda68104d40 0x7fda68197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda6de16640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fda6810a7e0 con 0x7fda68102410 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda6de16640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda6810a660 con 0x7fda68104d40 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda677fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda677fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58424/0 (socket says 172.21.15.111:58424) 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda677fe640 1 -- 172.21.15.111:0/1014773193 learned_addr learned my addr 172.21.15.111:0/1014773193 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda66ffd640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda68104d40 0x7fda68197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda677fe640 1 -- 172.21.15.111:0/1014773193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda68104d40 msgr2=0x7fda68197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda677fe640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda68104d40 0x7fda68197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:21.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.990+0000 7fda677fe640 1 -- 172.21.15.111:0/1014773193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681980c0 con 0x7fda68102410 2024-09-16T09:42:21.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.991+0000 7fda677fe640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68197500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda58009d70 tx=0x7fda5802fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:21.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.991+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda58034030 con 0x7fda68102410 2024-09-16T09:42:21.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.991+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6819caa0 con 0x7fda68102410 2024-09-16T09:42:21.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.991+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda58030b20 con 0x7fda68102410 2024-09-16T09:42:21.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.991+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda580046b0 con 0x7fda68102410 2024-09-16T09:42:21.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.991+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6819d030 con 0x7fda68102410 2024-09-16T09:42:21.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.992+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda681027f0 con 0x7fda68102410 2024-09-16T09:42:21.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.992+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fda58037020 con 0x7fda68102410 2024-09-16T09:42:21.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.993+0000 7fda64ff9640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fda5406e2b0 0x7fda54070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:21.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.993+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4321+0+0 (secure 0 0 0) 0x7fda580aecb0 con 0x7fda68102410 2024-09-16T09:42:21.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.993+0000 7fda66ffd640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fda5406e2b0 0x7fda54070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:21.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.993+0000 7fda66ffd640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fda5406e2b0 0x7fda54070770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda681989b0 tx=0x7fda5000b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:21.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:21.997+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fda5807ca80 con 0x7fda68102410 2024-09-16T09:42:22.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.161+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fda6819d440 con 0x7fda68102410 2024-09-16T09:42:22.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.161+0000 7fda64ff9640 1 -- 172.21.15.111:0/1014773193 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v34) ==== 74+0+130 (secure 0 0 0) 0x7fda58080730 con 0x7fda68102410 2024-09-16T09:42:22.163 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fda5406e2b0 msgr2=0x7fda54070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fda5406e2b0 0x7fda54070770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda681989b0 tx=0x7fda5000b410 comp rx=0 tx=0).stop 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 msgr2=0x7fda68197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68197500 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fda58009d70 tx=0x7fda5802fb90 comp rx=0 tx=0).stop 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 shutdown_connections 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fda5406e2b0 0x7fda54070770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda68104d40 0x7fda68197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:22.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 --2- 172.21.15.111:0/1014773193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda68102410 0x7fda68197500 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 >> 172.21.15.111:0/1014773193 conn(0x7fda680fc010 msgr2=0x7fda680fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 shutdown_connections 2024-09-16T09:42:22.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:22.163+0000 7fda6de16640 1 -- 172.21.15.111:0/1014773193 wait complete. 2024-09-16T09:42:22.683 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:22 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1014773193' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T09:42:22.850 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:22 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1014773193' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T09:42:22.879 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":34,"num_osds":6,"num_up_osds":5,"osd_up_since":1726479720,"num_in_osds":6,"osd_in_since":1726479722,"num_remapped_pgs":0} 2024-09-16T09:42:22.937 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:42:22 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[54756]: 2024-09-16T09:42:22.681+0000 7f582006d640 -1 osd.5 0 log_to_monitors true 2024-09-16T09:42:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:23 smithi114 ceph-mon[35635]: from='osd.5 [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T09:42:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:23 smithi114 ceph-mon[35635]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T09:42:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:23 smithi114 ceph-mon[35635]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:23.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T09:42:23.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:23 smithi111 ceph-mon[27997]: from='osd.5 [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T09:42:23.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:23 smithi111 ceph-mon[27997]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-16T09:42:23.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:23 smithi111 ceph-mon[27997]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:24.143 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:24.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 -- 172.21.15.111:0/100294165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0100840 msgr2=0x7f97b0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 --2- 172.21.15.111:0/100294165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0100840 0x7f97b0100c40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009880 tx=0x7f97a002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 -- 172.21.15.111:0/100294165 shutdown_connections 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 --2- 172.21.15.111:0/100294165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97b0101a40 0x7f97b0101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 --2- 172.21.15.111:0/100294165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0100840 0x7f97b0100c40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 -- 172.21.15.111:0/100294165 >> 172.21.15.111:0/100294165 conn(0x7f97b00fbff0 msgr2=0x7f97b00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 -- 172.21.15.111:0/100294165 shutdown_connections 2024-09-16T09:42:24.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 -- 172.21.15.111:0/100294165 wait complete. 2024-09-16T09:42:24.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 Processor -- start 2024-09-16T09:42:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.566+0000 7f97b4d47640 1 -- start start 2024-09-16T09:42:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97b4d47640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97b0100840 0x7f97b01963c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97b4d47640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 0x7f97b0196900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97b4d47640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0109680 con 0x7f97b0101a40 2024-09-16T09:42:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97b4d47640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f97b0109500 con 0x7f97b0100840 2024-09-16T09:42:24.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 0x7f97b0196900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 0x7f97b0196900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41384/0 (socket says 172.21.15.111:41384) 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 -- 172.21.15.111:0/2617159053 learned_addr learned my addr 172.21.15.111:0/2617159053 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97ae59c640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97b0100840 0x7f97b01963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 -- 172.21.15.111:0/2617159053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97b0100840 msgr2=0x7f97b01963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97b0100840 0x7f97b01963c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 -- 172.21.15.111:0/2617159053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b0196f80 con 0x7f97b0101a40 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97add9b640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 0x7f97b0196900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97a400e970 tx=0x7f97a400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97a400cac0 con 0x7f97b0101a40 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97a40054e0 con 0x7f97b0101a40 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.567+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b019b9c0 con 0x7f97b0101a40 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.568+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f97a4010430 con 0x7f97b0101a40 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.568+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b019bf50 con 0x7f97b0101a40 2024-09-16T09:42:24.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.569+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b0100c40 con 0x7f97b0101a40 2024-09-16T09:42:24.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.569+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f97a4004f00 con 0x7f97b0101a40 2024-09-16T09:42:24.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.569+0000 7f979f7fe640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f979806e2b0 0x7f9798070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:24.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.570+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4358+0+0 (secure 0 0 0) 0x7f97a408e3b0 con 0x7f97b0101a40 2024-09-16T09:42:24.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.570+0000 7f97ae59c640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f979806e2b0 0x7f9798070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:24.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.570+0000 7f97ae59c640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f979806e2b0 0x7f9798070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009230 tx=0x7f97a00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:24.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.574+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f97a405c160 con 0x7f97b0101a40 2024-09-16T09:42:24.656 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-mon[35635]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T09:42:24.656 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-mon[35635]: from='osd.5 [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:42:24.656 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-mon[35635]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T09:42:24.656 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:24.656 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-mon[35635]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:42:24.657 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[54756]: 2024-09-16T09:42:24.564+0000 7f581b7cd640 -1 osd.5 0 waiting for initial osdmap 2024-09-16T09:42:24.657 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:42:24 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[54756]: 2024-09-16T09:42:24.570+0000 7f5817e07640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:42:24.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.746+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f97b0062df0 con 0x7f97b0101a40 2024-09-16T09:42:24.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.746+0000 7f979f7fe640 1 -- 172.21.15.111:0/2617159053 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7f97a405fe10 con 0x7f97b0101a40 2024-09-16T09:42:24.748 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f979806e2b0 msgr2=0x7f9798070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f979806e2b0 0x7f9798070770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f97a0009230 tx=0x7f97a00058d0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 msgr2=0x7f97b0196900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 0x7f97b0196900 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f97a400e970 tx=0x7f97a400ed70 comp rx=0 tx=0).stop 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 shutdown_connections 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f979806e2b0 0x7f9798070770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97b0101a40 0x7f97b0196900 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 --2- 172.21.15.111:0/2617159053 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f97b0100840 0x7f97b01963c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:24.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 >> 172.21.15.111:0/2617159053 conn(0x7f97b00fbff0 msgr2=0x7f97b0104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:24.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 shutdown_connections 2024-09-16T09:42:24.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:24.748+0000 7f97b4d47640 1 -- 172.21.15.111:0/2617159053 wait complete. 2024-09-16T09:42:24.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:24 smithi111 ceph-mon[27997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T09:42:24.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:24 smithi111 ceph-mon[27997]: from='osd.5 [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:42:24.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:24 smithi111 ceph-mon[27997]: osdmap e35: 6 total, 5 up, 6 in 2024-09-16T09:42:24.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:24.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:24 smithi111 ceph-mon[27997]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]: dispatch 2024-09-16T09:42:25.694 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726479720,"num_in_osds":6,"osd_in_since":1726479722,"num_remapped_pgs":0} 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: Detected new or changed devices on smithi114 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi114 to 4970M 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2617159053' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:25 smithi111 ceph-mon[27997]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:25.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]}]': finished 2024-09-16T09:42:25.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: osdmap e36: 6 total, 5 up, 6 in 2024-09-16T09:42:25.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: Detected new or changed devices on smithi114 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi114 to 4970M 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2617159053' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T09:42:25.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:42:25.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:42:25.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:42:25.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:42:25.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:25 smithi114 ceph-mon[35635]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-09-16T09:42:26.696 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-16T09:42:26.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:26 smithi111 ceph-mon[27997]: purged_snaps scrub starts 2024-09-16T09:42:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:26 smithi111 ceph-mon[27997]: purged_snaps scrub ok 2024-09-16T09:42:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:26 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:26 smithi111 ceph-mon[27997]: osd.5 [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] boot 2024-09-16T09:42:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:26 smithi111 ceph-mon[27997]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T09:42:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:26 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:26.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:26 smithi114 ceph-mon[35635]: purged_snaps scrub starts 2024-09-16T09:42:26.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:26 smithi114 ceph-mon[35635]: purged_snaps scrub ok 2024-09-16T09:42:26.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:26 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:26.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:26 smithi114 ceph-mon[35635]: osd.5 [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] boot 2024-09-16T09:42:26.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:26 smithi114 ceph-mon[35635]: osdmap e37: 6 total, 6 up, 6 in 2024-09-16T09:42:26.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:26 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:42:26.957 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 -- 172.21.15.111:0/2258765380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 msgr2=0x7fd034100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/2258765380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd034100400 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd02c009880 tx=0x7fd02c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 -- 172.21.15.111:0/2258765380 shutdown_connections 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/2258765380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd034101200 0x7fd034101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/2258765380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd034100400 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 -- 172.21.15.111:0/2258765380 >> 172.21.15.111:0/2258765380 conn(0x7fd0340fb790 msgr2=0x7fd0340fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:27.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 -- 172.21.15.111:0/2258765380 shutdown_connections 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.363+0000 7fd03ab5f640 1 -- 172.21.15.111:0/2258765380 wait complete. 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd03ab5f640 1 Processor -- start 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd03ab5f640 1 -- start start 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd03ab5f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd03419db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd03ab5f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd034101200 0x7fd03419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd03ab5f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd034109720 con 0x7fd034100000 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd03ab5f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd0341095a0 con 0x7fd034101200 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd0388fb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd03419db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd0388fb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd03419db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41392/0 (socket says 172.21.15.111:41392) 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd0388fb640 1 -- 172.21.15.111:0/824218889 learned_addr learned my addr 172.21.15.111:0/824218889 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd033fff640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd034101200 0x7fd03419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:27.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd0388fb640 1 -- 172.21.15.111:0/824218889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd034101200 msgr2=0x7fd03419e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd0388fb640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd034101200 0x7fd03419e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.364+0000 7fd0388fb640 1 -- 172.21.15.111:0/824218889 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03419e6d0 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.365+0000 7fd0388fb640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd03419db10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd02c006010 tx=0x7fd02c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.365+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd02c03f070 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.365+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0341a30b0 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.365+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd02c0044d0 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.365+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd02c035030 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.365+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0341a36c0 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.366+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd034100400 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.366+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd02c042070 con 0x7fd034100000 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.367+0000 7fd031ffb640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd02006e2b0 0x7fd020070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:27.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.367+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fd02c0aeae0 con 0x7fd034100000 2024-09-16T09:42:27.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.367+0000 7fd033fff640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd02006e2b0 0x7fd020070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:27.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.367+0000 7fd033fff640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd02006e2b0 0x7fd020070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd03419efc0 tx=0x7fd0240094f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:27.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.371+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd02c07c780 con 0x7fd034100000 2024-09-16T09:42:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.537+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd0341a3f40 con 0x7fd034100000 2024-09-16T09:42:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.537+0000 7fd031ffb640 1 -- 172.21.15.111:0/824218889 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7fd02c080430 con 0x7fd034100000 2024-09-16T09:42:27.539 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd02006e2b0 msgr2=0x7fd020070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd02006e2b0 0x7fd020070770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd03419efc0 tx=0x7fd0240094f0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 msgr2=0x7fd03419db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd03419db10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd02c006010 tx=0x7fd02c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 shutdown_connections 2024-09-16T09:42:27.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd02006e2b0 0x7fd020070770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd034101200 0x7fd03419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 --2- 172.21.15.111:0/824218889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd034100000 0x7fd03419db10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:27.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.539+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 >> 172.21.15.111:0/824218889 conn(0x7fd0340fb790 msgr2=0x7fd034190e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:27.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.540+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 shutdown_connections 2024-09-16T09:42:27.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:27.540+0000 7fd03ab5f640 1 -- 172.21.15.111:0/824218889 wait complete. 2024-09-16T09:42:27.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:27 smithi111 ceph-mon[27997]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T09:42:27.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:27 smithi111 ceph-mon[27997]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:27.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:27 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/824218889' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T09:42:27.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:27 smithi114 ceph-mon[35635]: osdmap e38: 6 total, 6 up, 6 in 2024-09-16T09:42:27.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:27 smithi114 ceph-mon[35635]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:27.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:27 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/824218889' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-16T09:42:28.182 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726479745,"num_in_osds":6,"osd_in_since":1726479722,"num_remapped_pgs":0} 2024-09-16T09:42:28.183 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T09:42:28.434 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:28.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 -- 172.21.15.111:0/3932784806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81067e0 msgr2=0x7fddb8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:28.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 --2- 172.21.15.111:0/3932784806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81067e0 0x7fddb8106bc0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdda8009880 tx=0x7fdda802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 -- 172.21.15.111:0/3932784806 shutdown_connections 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 --2- 172.21.15.111:0/3932784806 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81007e0 0x7fddb8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 --2- 172.21.15.111:0/3932784806 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81067e0 0x7fddb8106bc0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 -- 172.21.15.111:0/3932784806 >> 172.21.15.111:0/3932784806 conn(0x7fddb80fc4c0 msgr2=0x7fddb80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 -- 172.21.15.111:0/3932784806 shutdown_connections 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 -- 172.21.15.111:0/3932784806 wait complete. 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 Processor -- start 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.864+0000 7fddbd94e640 1 -- start start 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddbd94e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 0x7fddb819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:28.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddbd94e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81067e0 0x7fddb819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddbd94e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810dcb0 con 0x7fddb81007e0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddbd94e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fddb810db30 con 0x7fddb81067e0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 0x7fddb819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 0x7fddb819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41410/0 (socket says 172.21.15.111:41410) 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 -- 172.21.15.111:0/369633457 learned_addr learned my addr 172.21.15.111:0/369633457 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddae7fc640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81067e0 0x7fddb819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 -- 172.21.15.111:0/369633457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81067e0 msgr2=0x7fddb819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81067e0 0x7fddb819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 -- 172.21.15.111:0/369633457 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddb8199a00 con 0x7fddb81007e0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.865+0000 7fddb6ffd640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 0x7fddb819f840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdda8031460 tx=0x7fdda80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.866+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdda803f070 con 0x7fddb81007e0 2024-09-16T09:42:28.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.866+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdda80035f0 con 0x7fddb81007e0 2024-09-16T09:42:28.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.866+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddb8199c90 con 0x7fddb81007e0 2024-09-16T09:42:28.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.866+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdda8035030 con 0x7fddb81007e0 2024-09-16T09:42:28.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.866+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddb819a1c0 con 0x7fddb81007e0 2024-09-16T09:42:28.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.867+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddb8101f20 con 0x7fddb81007e0 2024-09-16T09:42:28.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.867+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fdda8042070 con 0x7fddb81007e0 2024-09-16T09:42:28.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.868+0000 7fddbc94c640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdda406e310 0x7fdda40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:28.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.868+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fdda80ae670 con 0x7fddb81007e0 2024-09-16T09:42:28.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.868+0000 7fddae7fc640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdda406e310 0x7fdda40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:28.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.868+0000 7fddae7fc640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdda406e310 0x7fdda40707d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fddb8105cc0 tx=0x7fdda000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:28.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:28.872+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdda8080040 con 0x7fddb81007e0 2024-09-16T09:42:29.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.040+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddb819af30 con 0x7fddb81007e0 2024-09-16T09:42:29.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.041+0000 7fddbc94c640 1 -- 172.21.15.111:0/369633457 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+11445 (secure 0 0 0) 0x7fdda8084870 con 0x7fddb81007e0 2024-09-16T09:42:29.042 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:29.043 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":38,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","created":"2024-09-16T09:36:36.938441+0000","modified":"2024-09-16T09:42:26.569187+0000","last_up_change":"2024-09-16T09:42:25.561865+0000","last_in_change":"2024-09-16T09:42:02.504734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T09:41:09.164545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"457c10db-ac0b-4edf-8f9e-7f77092fdf7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6803","nonce":2640087294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6805","nonce":2640087294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6809","nonce":2640087294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6807","nonce":2640087294}]},"public_addr":"172.21.15.111:6803/2640087294","cluster_addr":"172.21.15.111:6805/2640087294","heartbeat_back_addr":"172.21.15.111:6809/2640087294","heartbeat_front_addr":"172.21.15.111:6807/2640087294","state":["exists","up"]},{"osd":1,"uuid":"cb30de27-8d11-407d-aa23-0861cff63597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6811","nonce":3853314577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6813","nonce":3853314577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6817","nonce":3853314577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6815","nonce":3853314577}]},"public_addr":"172.21.15.111:6811/3853314577","cluster_addr":"172.21.15.111:6813/3853314577","heartbeat_back_addr":"172.21.15.111:6817/3853314577","heartbeat_front_addr":"172.21.15.111:6815/3853314577","state":["exists","up"]},{"osd":2,"uuid":"f3159d59-4af3-4a9a-bcbd-9d37153c8701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6819","nonce":3599318958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6821","nonce":3599318958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6825","nonce":3599318958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6823","nonce":3599318958}]},"public_addr":"172.21.15.111:6819/3599318958","cluster_addr":"172.21.15.111:6821/3599318958","heartbeat_back_addr":"172.21.15.111:6825/3599318958","heartbeat_front_addr":"172.21.15.111:6823/3599318958","state":["exists","up"]},{"osd":3,"uuid":"a5a7c3b7-9672-46d2-ba12-be708f7ca38c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6801","nonce":3824663540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6803","nonce":3824663540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6807","nonce":3824663540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6805","nonce":3824663540}]},"public_addr":"172.21.15.114:6801/3824663540","cluster_addr":"172.21.15.114:6803/3824663540","heartbeat_back_addr":"172.21.15.114:6807/3824663540","heartbeat_front_addr":"172.21.15.114:6805/3824663540","state":["exists","up"]},{"osd":4,"uuid":"9820d754-6da1-4ef4-a6a9-77b310c1c3a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6809","nonce":878847632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6811","nonce":878847632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6815","nonce":878847632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6813","nonce":878847632}]},"public_addr":"172.21.15.114:6809/878847632","cluster_addr":"172.21.15.114:6811/878847632","heartbeat_back_addr":"172.21.15.114:6815/878847632","heartbeat_front_addr":"172.21.15.114:6813/878847632","state":["exists","up"]},{"osd":5,"uuid":"76ec8880-8d5b-492b-bcf6-8effa0183acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6817","nonce":3093901704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6819","nonce":3093901704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6823","nonce":3093901704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6821","nonce":3093901704}]},"public_addr":"172.21.15.114:6817/3093901704","cluster_addr":"172.21.15.114:6819/3093901704","heartbeat_back_addr":"172.21.15.114:6823/3093901704","heartbeat_front_addr":"172.21.15.114:6821/3093901704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:40:09.353626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:40:38.424522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:06.565798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:32.271953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:58.826231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:42:23.722188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6801/4032555979":"2024-09-17T09:38:34.840593+0000","172.21.15.111:0/323192077":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/1453802272":"2024-09-17T09:37:08.491284+0000","172.21.15.111:6801/3108753484":"2024-09-17T09:37:08.491284+0000","172.21.15.111:6800/3108753484":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/3905288646":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/2154493900":"2024-09-17T09:38:34.840593+0000","172.21.15.111:6800/1312194133":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/515452109":"2024-09-17T09:37:39.495256+0000","172.21.15.111:6801/1312194133":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/1023452280":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/402500126":"2024-09-17T09:38:34.840593+0000","172.21.15.111:0/1755678140":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/1365706184":"2024-09-17T09:38:34.840593+0000","172.21.15.111:6800/4032555979":"2024-09-17T09:38:34.840593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdda406e310 msgr2=0x7fdda40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdda406e310 0x7fdda40707d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fddb8105cc0 tx=0x7fdda000b390 comp rx=0 tx=0).stop 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 msgr2=0x7fddb819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 0x7fddb819f840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdda8031460 tx=0x7fdda80045e0 comp rx=0 tx=0).stop 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 shutdown_connections 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdda406e310 0x7fdda40707d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fddb81067e0 0x7fddb819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 --2- 172.21.15.111:0/369633457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fddb81007e0 0x7fddb819f840 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 >> 172.21.15.111:0/369633457 conn(0x7fddb80fc4c0 msgr2=0x7fddb8069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 shutdown_connections 2024-09-16T09:42:29.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:29.043+0000 7fddbd94e640 1 -- 172.21.15.111:0/369633457 wait complete. 2024-09-16T09:42:29.718 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-16T09:41:09.164545+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-16T09:42:29.719 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-16T09:42:29.964 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:30.082 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:29 smithi111 ceph-mon[27997]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:30.082 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:29 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/369633457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T09:42:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:29 smithi114 ceph-mon[35635]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:29 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/369633457' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T09:42:30.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1634144238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4100820 msgr2=0x7f32d4100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:30.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1634144238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4100820 0x7f32d4100c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f32c8009c20 tx=0x7f32c802a970 comp rx=0 tx=0).stop 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1634144238 shutdown_connections 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1634144238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4100820 0x7f32d4100c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1634144238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32d4106820 0x7f32d4106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1634144238 >> 172.21.15.111:0/1634144238 conn(0x7f32d40fc520 msgr2=0x7f32d40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1634144238 shutdown_connections 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.356+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1634144238 wait complete. 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d8f1f640 1 Processor -- start 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d8f1f640 1 -- start start 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d8f1f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32d4100820 0x7f32d41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d8f1f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 0x7f32d4198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:30.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d8f1f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410dcd0 con 0x7f32d4106820 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d8f1f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f32d410db50 con 0x7f32d4100820 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d1d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 0x7f32d4198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d1d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 0x7f32d4198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41434/0 (socket says 172.21.15.111:41434) 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.357+0000 7f32d1d9b640 1 -- 172.21.15.111:0/1383576200 learned_addr learned my addr 172.21.15.111:0/1383576200 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32d1d9b640 1 -- 172.21.15.111:0/1383576200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32d4100820 msgr2=0x7f32d41987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32d1d9b640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32d4100820 0x7f32d41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32d1d9b640 1 -- 172.21.15.111:0/1383576200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d41992b0 con 0x7f32d4106820 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32d1d9b640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 0x7f32d4198cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32c8005cc0 tx=0x7f32c802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32c8047070 con 0x7f32d4106820 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32c802f7e0 con 0x7f32d4106820 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32d4199540 con 0x7f32d4106820 2024-09-16T09:42:30.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32c8034070 con 0x7f32d4106820 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.358+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32d41a1b00 con 0x7f32d4106820 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.359+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32d4101f60 con 0x7f32d4106820 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.360+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f32c804a070 con 0x7f32d4106820 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.360+0000 7f32c37fe640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f32bc06e310 0x7f32bc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.360+0000 7f32d259c640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f32bc06e310 0x7f32bc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.360+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f32c80aec20 con 0x7f32d4106820 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.360+0000 7f32d259c640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f32bc06e310 0x7f32bc0707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00a990 tx=0x7f32cc005c70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:30.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.364+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f32c803f070 con 0x7f32d4106820 2024-09-16T09:42:30.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.552+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32d4108db0 con 0x7f32d4106820 2024-09-16T09:42:30.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.552+0000 7f32c37fe640 1 -- 172.21.15.111:0/1383576200 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f32c807c940 con 0x7f32d4106820 2024-09-16T09:42:30.554 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-09-16T09:42:30.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f32bc06e310 msgr2=0x7f32bc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:30.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f32bc06e310 0x7f32bc0707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00a990 tx=0x7f32cc005c70 comp rx=0 tx=0).stop 2024-09-16T09:42:30.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 msgr2=0x7f32d4198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:30.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 0x7f32d4198cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f32c8005cc0 tx=0x7f32c802f5f0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 shutdown_connections 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f32bc06e310 0x7f32bc0707d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.554+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f32d4106820 0x7f32d4198cf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.555+0000 7f32d8f1f640 1 --2- 172.21.15.111:0/1383576200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f32d4100820 0x7f32d41987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.555+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 >> 172.21.15.111:0/1383576200 conn(0x7f32d40fc520 msgr2=0x7f32d40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.555+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 shutdown_connections 2024-09-16T09:42:30.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:30.555+0000 7f32d8f1f640 1 -- 172.21.15.111:0/1383576200 wait complete. 2024-09-16T09:42:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:30 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1383576200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T09:42:31.166 INFO:tasks.cephadm:Setting up client nodes... 2024-09-16T09:42:31.167 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T09:42:31.254 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:30 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1383576200' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-16T09:42:31.414 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 -- 172.21.15.111:0/1654425342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc100880 msgr2=0x7f42cc100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 --2- 172.21.15.111:0/1654425342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc100880 0x7f42cc100c80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009880 tx=0x7f42c802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 -- 172.21.15.111:0/1654425342 shutdown_connections 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 --2- 172.21.15.111:0/1654425342 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42cc101a80 0x7f42cc101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 --2- 172.21.15.111:0/1654425342 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc100880 0x7f42cc100c80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 -- 172.21.15.111:0/1654425342 >> 172.21.15.111:0/1654425342 conn(0x7f42cc0fc010 msgr2=0x7f42cc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:31.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 -- 172.21.15.111:0/1654425342 shutdown_connections 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 -- 172.21.15.111:0/1654425342 wait complete. 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.869+0000 7f42d367a640 1 Processor -- start 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d367a640 1 -- start start 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d367a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42cc100880 0x7f42cc1963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d367a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 0x7f42cc196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d367a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc1096c0 con 0x7f42cc101a80 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d367a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc109540 con 0x7f42cc100880 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 0x7f42cc196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 0x7f42cc196920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41454/0 (socket says 172.21.15.111:41454) 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 -- 172.21.15.111:0/644891025 learned_addr learned my addr 172.21.15.111:0/644891025 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d1416640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42cc100880 0x7f42cc1963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:31.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 -- 172.21.15.111:0/644891025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42cc100880 msgr2=0x7f42cc1963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42cc100880 0x7f42cc1963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 -- 172.21.15.111:0/644891025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc196fa0 con 0x7f42cc101a80 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42d0c15640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 0x7f42cc196920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009860 tx=0x7f42bc009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.870+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42bc005020 con 0x7f42cc101a80 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.871+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc06a0a0 con 0x7f42cc101a80 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.871+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42bc0047a0 con 0x7f42cc101a80 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.871+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42bc007b00 con 0x7f42cc101a80 2024-09-16T09:42:31.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.871+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc06a630 con 0x7f42cc101a80 2024-09-16T09:42:31.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.872+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc100c80 con 0x7f42cc101a80 2024-09-16T09:42:31.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.872+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f42bc004950 con 0x7f42cc101a80 2024-09-16T09:42:31.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.873+0000 7f42c27fc640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f42b806e2b0 0x7f42b8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:31.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.873+0000 7f42d1416640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f42b806e2b0 0x7f42b8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:31.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.873+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f42bc013030 con 0x7f42cc101a80 2024-09-16T09:42:31.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.873+0000 7f42d1416640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f42b806e2b0 0x7f42b8070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009230 tx=0x7f42c80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:31.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:31.877+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42bc060f80 con 0x7f42cc101a80 2024-09-16T09:42:32.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.106+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f42cc06a9a0 con 0x7f42cc101a80 2024-09-16T09:42:32.108 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:31 smithi111 ceph-mon[27997]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:32.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.108+0000 7f42c27fc640 1 -- 172.21.15.111:0/644891025 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f42bc0657b0 con 0x7f42cc101a80 2024-09-16T09:42:32.109 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-09-16T09:42:32.110 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQCI/edmLJNqBhAA235CuwYzp8XIyhfntR6+3g== 2024-09-16T09:42:32.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f42b806e2b0 msgr2=0x7f42b8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f42b806e2b0 0x7f42b8070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009230 tx=0x7f42c80058d0 comp rx=0 tx=0).stop 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 msgr2=0x7f42cc196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 0x7f42cc196920 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009860 tx=0x7f42bc009d20 comp rx=0 tx=0).stop 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 shutdown_connections 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f42b806e2b0 0x7f42b8070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42cc101a80 0x7f42cc196920 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 --2- 172.21.15.111:0/644891025 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f42cc100880 0x7f42cc1963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 >> 172.21.15.111:0/644891025 conn(0x7f42cc0fc010 msgr2=0x7f42cc104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 shutdown_connections 2024-09-16T09:42:32.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:32.111+0000 7f42d367a640 1 -- 172.21.15.111:0/644891025 wait complete. 2024-09-16T09:42:32.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:31 smithi114 ceph-mon[35635]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:32.800 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:42:32.801 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-16T09:42:32.801 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-16T09:42:32.839 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-16T09:42:33.100 INFO:teuthology.orchestra.run.smithi114.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi114/config 2024-09-16T09:42:33.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:32 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/644891025' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T09:42:33.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:32 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/644891025' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T09:42:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:32 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/644891025' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T09:42:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:32 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/644891025' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T09:42:33.599 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 -- 172.21.15.114:0/118714887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 msgr2=0x7f53b01071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 --2- 172.21.15.114:0/118714887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b01071d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f53a4009880 tx=0x7f53a402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 -- 172.21.15.114:0/118714887 shutdown_connections 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 --2- 172.21.15.114:0/118714887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b01071d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 --2- 172.21.15.114:0/118714887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53b01024b0 0x7f53b01048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 -- 172.21.15.114:0/118714887 >> 172.21.15.114:0/118714887 conn(0x7f53b00fc010 msgr2=0x7f53b00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 -- 172.21.15.114:0/118714887 shutdown_connections 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 -- 172.21.15.114:0/118714887 wait complete. 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.596+0000 7f53b5d60640 1 Processor -- start 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53b5d60640 1 -- start start 2024-09-16T09:42:33.600 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53b5d60640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53b01024b0 0x7f53b0101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53b5d60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b0100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53b5d60640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010a7c0 con 0x7f53b01024b0 2024-09-16T09:42:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53b5d60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f53b010a640 con 0x7f53b0104de0 2024-09-16T09:42:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b0100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b0100460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.114:47346/0 (socket says 172.21.15.114:47346) 2024-09-16T09:42:33.601 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 -- 172.21.15.114:0/3981264188 learned_addr learned my addr 172.21.15.114:0/3981264188 (peer_addr_for_me v2:172.21.15.114:0/0) 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53af7fe640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53b01024b0 0x7f53b0101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 -- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53b01024b0 msgr2=0x7f53b0101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53b01024b0 0x7f53b0101da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 -- 172.21.15.114:0/3981264188 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53b01009a0 con 0x7f53b0104de0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.597+0000 7f53aeffd640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b0100460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006010 tx=0x7f53a40048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.598+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53a403f070 con 0x7f53b0104de0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.598+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53a40044d0 con 0x7f53b0104de0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.598+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f53a4035030 con 0x7f53b0104de0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.598+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53b0100c30 con 0x7f53b0104de0 2024-09-16T09:42:33.602 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.598+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53b0101160 con 0x7f53b0104de0 2024-09-16T09:42:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.599+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b0102890 con 0x7f53b0104de0 2024-09-16T09:42:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.599+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f53a4042070 con 0x7f53b0104de0 2024-09-16T09:42:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.600+0000 7f53acff9640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f539806e310 0x7f53980707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:33.603 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.600+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f53a40ae960 con 0x7f53b0104de0 2024-09-16T09:42:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.600+0000 7f53af7fe640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f539806e310 0x7f53980707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:33.604 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.601+0000 7f53af7fe640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f539806e310 0x7f53980707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53a0005c40 tx=0x7f53a000a570 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:33.606 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.604+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f53a4080330 con 0x7f53b0104de0 2024-09-16T09:42:33.837 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.835+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f53b019fa60 con 0x7f53b0104de0 2024-09-16T09:42:33.841 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.840+0000 7f53acff9640 1 -- 172.21.15.114:0/3981264188 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f53a4084b60 con 0x7f53b0104de0 2024-09-16T09:42:33.842 INFO:teuthology.orchestra.run.smithi114.stdout:[client.1] 2024-09-16T09:42:33.842 INFO:teuthology.orchestra.run.smithi114.stdout: key = AQCJ/edmPXXsMRAArfiyFSCr7PQai7GMTVWHRQ== 2024-09-16T09:42:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f539806e310 msgr2=0x7f53980707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f539806e310 0x7f53980707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f53a0005c40 tx=0x7f53a000a570 comp rx=0 tx=0).stop 2024-09-16T09:42:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 msgr2=0x7f53b0100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b0100460 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53a4006010 tx=0x7f53a40048f0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 shutdown_connections 2024-09-16T09:42:33.844 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f539806e310 0x7f53980707d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f53b0104de0 0x7f53b0100460 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 --2- 172.21.15.114:0/3981264188 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53b01024b0 0x7f53b0101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.842+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 >> 172.21.15.114:0/3981264188 conn(0x7f53b00fc010 msgr2=0x7f53b00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.843+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 shutdown_connections 2024-09-16T09:42:33.845 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:42:33.843+0000 7f53b5d60640 1 -- 172.21.15.114:0/3981264188 wait complete. 2024-09-16T09:42:34.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:34 smithi111 ceph-mon[27997]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:34 smithi111 ceph-mon[27997]: from='client.? 172.21.15.114:0/3981264188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T09:42:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:34 smithi111 ceph-mon[27997]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T09:42:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:34 smithi111 ceph-mon[27997]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T09:42:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:34 smithi114 ceph-mon[35635]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:34 smithi114 ceph-mon[35635]: from='client.? 172.21.15.114:0/3981264188' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T09:42:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:34 smithi114 ceph-mon[35635]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-16T09:42:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:34 smithi114 ceph-mon[35635]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-16T09:42:34.506 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:42:34.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-16T09:42:34.506 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-16T09:42:34.544 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph config log 1 --format=json 2024-09-16T09:42:34.802 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:35.245 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 -- 172.21.15.111:0/2756622159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 msgr2=0x7fe238101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/2756622159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe238101d90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009880 tx=0x7fe22c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 -- 172.21.15.111:0/2756622159 shutdown_connections 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/2756622159 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe238101d90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/2756622159 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe238107930 0x7fe238107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 -- 172.21.15.111:0/2756622159 >> 172.21.15.111:0/2756622159 conn(0x7fe2380fd630 msgr2=0x7fe2380ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 -- 172.21.15.111:0/2756622159 shutdown_connections 2024-09-16T09:42:35.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 -- 172.21.15.111:0/2756622159 wait complete. 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 Processor -- start 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.244+0000 7fe23e2d7640 1 -- start start 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe23e2d7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe2380744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe23e2d7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe238107930 0x7fe238074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe23e2d7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe23810ede0 con 0x7fe238101930 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe23e2d7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe23810ec60 con 0x7fe238107930 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe2380744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe2380744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37364/0 (socket says 172.21.15.111:37364) 2024-09-16T09:42:35.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 -- 172.21.15.111:0/187971789 learned_addr learned my addr 172.21.15.111:0/187971789 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe2377fe640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe238107930 0x7fe238074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 -- 172.21.15.111:0/187971789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe238107930 msgr2=0x7fe238074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe238107930 0x7fe238074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 -- 172.21.15.111:0/187971789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe238074f70 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe237fff640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe2380744f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c8a0 tx=0x7fe22800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2280079b0 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe238075260 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe228007b50 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe228018700 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.245+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2381a3e70 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.246+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe238103070 con 0x7fe238101930 2024-09-16T09:42:35.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.247+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe228007d00 con 0x7fe238101930 2024-09-16T09:42:35.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.247+0000 7fe2357fa640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe22006e2b0 0x7fe220070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:35.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.247+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fe22808e110 con 0x7fe238101930 2024-09-16T09:42:35.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.247+0000 7fe2377fe640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe22006e2b0 0x7fe220070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:35.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.248+0000 7fe2377fe640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe22006e2b0 0x7fe220070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe238075f80 tx=0x7fe22c031420 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:35.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.252+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe228014030 con 0x7fe238101930 2024-09-16T09:42:35.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.419+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fe238101d90 con 0x7fe238101930 2024-09-16T09:42:35.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.419+0000 7fe2357fa640 1 -- 172.21.15.111:0/187971789 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v40) ==== 86+0+187 (secure 0 0 0) 0x7fe228016300 con 0x7fe238101930 2024-09-16T09:42:35.421 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe22006e2b0 msgr2=0x7fe220070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe22006e2b0 0x7fe220070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe238075f80 tx=0x7fe22c031420 comp rx=0 tx=0).stop 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 msgr2=0x7fe2380744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe2380744f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe22800c8a0 tx=0x7fe22800cd60 comp rx=0 tx=0).stop 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 shutdown_connections 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe22006e2b0 0x7fe220070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe238107930 0x7fe238074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 --2- 172.21.15.111:0/187971789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe238101930 0x7fe2380744f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 >> 172.21.15.111:0/187971789 conn(0x7fe2380fd630 msgr2=0x7fe2380fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:35.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 shutdown_connections 2024-09-16T09:42:35.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:35.421+0000 7fe23e2d7640 1 -- 172.21.15.111:0/187971789 wait complete. 2024-09-16T09:42:35.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:36.164 INFO:teuthology.orchestra.run.smithi111.stdout:[{"version":40,"timestamp":"2024-09-16T09:42:24.697612+0000","name":"","changes":[{"name":"osd/host:smithi114/osd_memory_target","previous_value":"7818211532","new_value":"5212141021"}]}] 2024-09-16T09:42:36.165 INFO:tasks.ceph_manager:config epoch is 40 2024-09-16T09:42:36.165 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-16T09:42:36.165 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-16T09:42:36.166 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-16T09:42:36.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:36 smithi111 ceph-mon[27997]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:36.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:36 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/187971789' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-16T09:42:36.413 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:36.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:36 smithi114 ceph-mon[35635]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:36.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:36 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/187971789' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-16T09:42:36.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 -- 172.21.15.111:0/2827587333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 msgr2=0x7fb9f8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:36.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 --2- 172.21.15.111:0/2827587333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f8106c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009880 tx=0x7fb9e802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 -- 172.21.15.111:0/2827587333 shutdown_connections 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 --2- 172.21.15.111:0/2827587333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9f8100820 0x7fb9f8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 --2- 172.21.15.111:0/2827587333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f8106c00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 -- 172.21.15.111:0/2827587333 >> 172.21.15.111:0/2827587333 conn(0x7fb9f80fc520 msgr2=0x7fb9f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 -- 172.21.15.111:0/2827587333 shutdown_connections 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.824+0000 7fb9fd316640 1 -- 172.21.15.111:0/2827587333 wait complete. 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9fd316640 1 Processor -- start 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9fd316640 1 -- start start 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9fd316640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9f8100820 0x7fb9f819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9fd316640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9fd316640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f810dd50 con 0x7fb9f8106820 2024-09-16T09:42:36.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9fd316640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f810dbd0 con 0x7fb9f8100820 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9ee7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9ee7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37386/0 (socket says 172.21.15.111:37386) 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.825+0000 7fb9ee7fc640 1 -- 172.21.15.111:0/742496076 learned_addr learned my addr 172.21.15.111:0/742496076 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9f6ffd640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9f8100820 0x7fb9f819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9ee7fc640 1 -- 172.21.15.111:0/742496076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9f8100820 msgr2=0x7fb9f819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9ee7fc640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9f8100820 0x7fb9f819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9ee7fc640 1 -- 172.21.15.111:0/742496076 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f8197840 con 0x7fb9f8106820 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9ee7fc640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f819dc00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000b420 tx=0x7fb9e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9e0011630 con 0x7fb9f8106820 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9e0016070 con 0x7fb9f8106820 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f8197b30 con 0x7fb9f8106820 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb9e0010d40 con 0x7fb9f8106820 2024-09-16T09:42:36.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.826+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f81980c0 con 0x7fb9f8106820 2024-09-16T09:42:36.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.827+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f8101f60 con 0x7fb9f8106820 2024-09-16T09:42:36.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.828+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb9e001b460 con 0x7fb9f8106820 2024-09-16T09:42:36.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.828+0000 7fb9f4ff9640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb9e406e2b0 0x7fb9e4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:36.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.828+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fb9e008d680 con 0x7fb9f8106820 2024-09-16T09:42:36.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.828+0000 7fb9f6ffd640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb9e406e2b0 0x7fb9e4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:36.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.828+0000 7fb9f6ffd640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb9e406e2b0 0x7fb9e4070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80096c0 tx=0x7fb9e8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:36.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:36.834+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb9e005b320 con 0x7fb9f8106820 2024-09-16T09:42:37.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.043+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb9f8109da0 con 0x7fb9f8106820 2024-09-16T09:42:37.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.046+0000 7fb9f4ff9640 1 -- 172.21.15.111:0/742496076 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176574 (secure 0 0 0) 0x7fb9e005efd0 con 0x7fb9f8106820 2024-09-16T09:42:37.052 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:37.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb9e406e2b0 msgr2=0x7fb9e4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:37.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb9e406e2b0 0x7fb9e4070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb9e80096c0 tx=0x7fb9e8031400 comp rx=0 tx=0).stop 2024-09-16T09:42:37.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 msgr2=0x7fb9f819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:37.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f819dc00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000b420 tx=0x7fb9e000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:37.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 shutdown_connections 2024-09-16T09:42:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb9e406e2b0 0x7fb9e4070770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb9f8106820 0x7fb9f819dc00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 --2- 172.21.15.111:0/742496076 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb9f8100820 0x7fb9f819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 >> 172.21.15.111:0/742496076 conn(0x7fb9f80fc520 msgr2=0x7fb9f806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 shutdown_connections 2024-09-16T09:42:37.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:37.049+0000 7fb9fd316640 1 -- 172.21.15.111:0/742496076 wait complete. 2024-09-16T09:42:37.401 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:37 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/742496076' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T09:42:37.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:37 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/742496076' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-16T09:42:37.714 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi111.erxodt","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6800","nonce":4213406747},{"type":"v1","addr":"172.21.15.111:6801","nonce":4213406747}]},"active_addr":"172.21.15.111:6801/4213406747","active_change":"2024-09-16T09:38:34.840700+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14242,"name":"smithi114.xvotey","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.111:8443/","prometheus":"http://172.21.15.111:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1021150125}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":516969193}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3045241611}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1417608659}]}]} 2024-09-16T09:42:37.719 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-16T09:42:37.719 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-16T09:42:37.719 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T09:42:37.968 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:38.341 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:38 smithi111 ceph-mon[27997]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:38 smithi114 ceph-mon[35635]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.414+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/1730831612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100630 msgr2=0x7f4a38100a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.414+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/1730831612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100630 0x7f4a38100a10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009c20 tx=0x7f4a2802a960 comp rx=0 tx=0).stop 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/1730831612 shutdown_connections 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/1730831612 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100fe0 0x7f4a3810dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/1730831612 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100630 0x7f4a38100a10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/1730831612 >> 172.21.15.111:0/1730831612 conn(0x7f4a380fc4c0 msgr2=0x7f4a380fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/1730831612 shutdown_connections 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/1730831612 wait complete. 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 Processor -- start 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.415+0000 7f4a3d9a3640 1 -- start start 2024-09-16T09:42:38.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3d9a3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100630 0x7f4a3819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3d9a3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 0x7f4a3819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3d9a3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38110fe0 con 0x7f4a38100fe0 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3d9a3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4a38110e60 con 0x7f4a38100630 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 0x7f4a3819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 0x7f4a3819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37412/0 (socket says 172.21.15.111:37412) 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 -- 172.21.15.111:0/912503328 learned_addr learned my addr 172.21.15.111:0/912503328 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a36ffd640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100630 0x7f4a3819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 -- 172.21.15.111:0/912503328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100630 msgr2=0x7f4a3819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100630 0x7f4a3819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 -- 172.21.15.111:0/912503328 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a38199a70 con 0x7f4a38100fe0 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a36ffd640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100630 0x7f4a3819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a367fc640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 0x7f4a3819fdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00b420 tx=0x7f4a2c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:38.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a2c011630 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4a2c016070 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a38199d60 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4a2c010d40 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.416+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a3819a2f0 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.417+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a3806a410 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.418+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f4a2c01b460 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.418+0000 7f4a3c9a1640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4a2006e2b0 0x7f4a20070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.418+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f4a2c08d6b0 con 0x7f4a38100fe0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.418+0000 7f4a36ffd640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4a2006e2b0 0x7f4a20070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.419+0000 7f4a36ffd640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4a2006e2b0 0x7f4a20070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a28006010 tx=0x7f4a28009a00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:38.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.422+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4a2c05b350 con 0x7f4a38100fe0 2024-09-16T09:42:38.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.588+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a3819afa0 con 0x7f4a38100fe0 2024-09-16T09:42:38.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.589+0000 7f4a3c9a1640 1 -- 172.21.15.111:0/912503328 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+11445 (secure 0 0 0) 0x7f4a2c05f000 con 0x7f4a38100fe0 2024-09-16T09:42:38.590 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:38.591 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":38,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","created":"2024-09-16T09:36:36.938441+0000","modified":"2024-09-16T09:42:26.569187+0000","last_up_change":"2024-09-16T09:42:25.561865+0000","last_in_change":"2024-09-16T09:42:02.504734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T09:41:09.164545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"457c10db-ac0b-4edf-8f9e-7f77092fdf7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6803","nonce":2640087294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6805","nonce":2640087294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6809","nonce":2640087294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6807","nonce":2640087294}]},"public_addr":"172.21.15.111:6803/2640087294","cluster_addr":"172.21.15.111:6805/2640087294","heartbeat_back_addr":"172.21.15.111:6809/2640087294","heartbeat_front_addr":"172.21.15.111:6807/2640087294","state":["exists","up"]},{"osd":1,"uuid":"cb30de27-8d11-407d-aa23-0861cff63597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6811","nonce":3853314577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6813","nonce":3853314577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6817","nonce":3853314577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6815","nonce":3853314577}]},"public_addr":"172.21.15.111:6811/3853314577","cluster_addr":"172.21.15.111:6813/3853314577","heartbeat_back_addr":"172.21.15.111:6817/3853314577","heartbeat_front_addr":"172.21.15.111:6815/3853314577","state":["exists","up"]},{"osd":2,"uuid":"f3159d59-4af3-4a9a-bcbd-9d37153c8701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6819","nonce":3599318958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6821","nonce":3599318958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6825","nonce":3599318958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6823","nonce":3599318958}]},"public_addr":"172.21.15.111:6819/3599318958","cluster_addr":"172.21.15.111:6821/3599318958","heartbeat_back_addr":"172.21.15.111:6825/3599318958","heartbeat_front_addr":"172.21.15.111:6823/3599318958","state":["exists","up"]},{"osd":3,"uuid":"a5a7c3b7-9672-46d2-ba12-be708f7ca38c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6801","nonce":3824663540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6803","nonce":3824663540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6807","nonce":3824663540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6805","nonce":3824663540}]},"public_addr":"172.21.15.114:6801/3824663540","cluster_addr":"172.21.15.114:6803/3824663540","heartbeat_back_addr":"172.21.15.114:6807/3824663540","heartbeat_front_addr":"172.21.15.114:6805/3824663540","state":["exists","up"]},{"osd":4,"uuid":"9820d754-6da1-4ef4-a6a9-77b310c1c3a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6809","nonce":878847632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6811","nonce":878847632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6815","nonce":878847632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6813","nonce":878847632}]},"public_addr":"172.21.15.114:6809/878847632","cluster_addr":"172.21.15.114:6811/878847632","heartbeat_back_addr":"172.21.15.114:6815/878847632","heartbeat_front_addr":"172.21.15.114:6813/878847632","state":["exists","up"]},{"osd":5,"uuid":"76ec8880-8d5b-492b-bcf6-8effa0183acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6817","nonce":3093901704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6819","nonce":3093901704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6823","nonce":3093901704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6821","nonce":3093901704}]},"public_addr":"172.21.15.114:6817/3093901704","cluster_addr":"172.21.15.114:6819/3093901704","heartbeat_back_addr":"172.21.15.114:6823/3093901704","heartbeat_front_addr":"172.21.15.114:6821/3093901704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:40:09.353626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:40:38.424522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:06.565798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:32.271953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:58.826231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:42:23.722188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6801/4032555979":"2024-09-17T09:38:34.840593+0000","172.21.15.111:0/323192077":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/1453802272":"2024-09-17T09:37:08.491284+0000","172.21.15.111:6801/3108753484":"2024-09-17T09:37:08.491284+0000","172.21.15.111:6800/3108753484":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/3905288646":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/2154493900":"2024-09-17T09:38:34.840593+0000","172.21.15.111:6800/1312194133":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/515452109":"2024-09-17T09:37:39.495256+0000","172.21.15.111:6801/1312194133":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/1023452280":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/402500126":"2024-09-17T09:38:34.840593+0000","172.21.15.111:0/1755678140":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/1365706184":"2024-09-17T09:38:34.840593+0000","172.21.15.111:6800/4032555979":"2024-09-17T09:38:34.840593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T09:42:38.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4a2006e2b0 msgr2=0x7f4a20070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:38.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4a2006e2b0 0x7f4a20070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a28006010 tx=0x7f4a28009a00 comp rx=0 tx=0).stop 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 msgr2=0x7f4a3819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 0x7f4a3819fdf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00b420 tx=0x7f4a2c00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 shutdown_connections 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4a2006e2b0 0x7f4a20070770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a38100fe0 0x7f4a3819fdf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 --2- 172.21.15.111:0/912503328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4a38100630 0x7f4a3819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 >> 172.21.15.111:0/912503328 conn(0x7f4a380fc4c0 msgr2=0x7f4a380fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 shutdown_connections 2024-09-16T09:42:38.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:38.591+0000 7f4a3d9a3640 1 -- 172.21.15.111:0/912503328 wait complete. 2024-09-16T09:42:39.191 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:39 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/912503328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T09:42:39.218 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-16T09:42:39.218 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-16T09:42:39.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:39 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/912503328' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T09:42:39.462 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:39.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 -- 172.21.15.111:0/2692536160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 msgr2=0x7f0414106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:39.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 --2- 172.21.15.111:0/2692536160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f0414106bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0404009c20 tx=0x7f040402a970 comp rx=0 tx=0).stop 2024-09-16T09:42:39.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 -- 172.21.15.111:0/2692536160 shutdown_connections 2024-09-16T09:42:39.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 --2- 172.21.15.111:0/2692536160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04141007e0 0x7f0414100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:39.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 --2- 172.21.15.111:0/2692536160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f0414106bc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 -- 172.21.15.111:0/2692536160 >> 172.21.15.111:0/2692536160 conn(0x7f04140fc4c0 msgr2=0x7f04140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 -- 172.21.15.111:0/2692536160 shutdown_connections 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 -- 172.21.15.111:0/2692536160 wait complete. 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 Processor -- start 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.897+0000 7f0419fad640 1 -- start start 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0419fad640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04141007e0 0x7f04141023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0419fad640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f04141028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0419fad640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f041410dcb0 con 0x7f04141067e0 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0419fad640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f041410db30 con 0x7f04141007e0 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f04141028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f04141028f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37420/0 (socket says 172.21.15.111:37420) 2024-09-16T09:42:39.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 -- 172.21.15.111:0/422489448 learned_addr learned my addr 172.21.15.111:0/422489448 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f04137fe640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04141007e0 0x7f04141023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 -- 172.21.15.111:0/422489448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04141007e0 msgr2=0x7f04141023b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04141007e0 0x7f04141023b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 -- 172.21.15.111:0/422489448 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0414102e30 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0412ffd640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f04141028f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f040800c8f0 tx=0x7f040800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04080079b0 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0414103120 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04080054e0 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0408004dd0 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.898+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04141a3e30 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.899+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0414101f20 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.900+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0408005020 con 0x7f04141067e0 2024-09-16T09:42:39.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.900+0000 7f0410ff9640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f03fc06e260 0x7f03fc070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:39.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.900+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f040808de00 con 0x7f04141067e0 2024-09-16T09:42:39.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.900+0000 7f04137fe640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f03fc06e260 0x7f03fc070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:39.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.901+0000 7f04137fe640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f03fc06e260 0x7f03fc070720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0404009430 tx=0x7f04040093a0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:39.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:39.905+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0408014030 con 0x7f04141067e0 2024-09-16T09:42:40.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.072+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04141a4150 con 0x7f04141067e0 2024-09-16T09:42:40.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.073+0000 7f0410ff9640 1 -- 172.21.15.111:0/422489448 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+11445 (secure 0 0 0) 0x7f040805baa0 con 0x7f04141067e0 2024-09-16T09:42:40.075 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:40.075 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":38,"fsid":"0ada01d2-740f-11ef-bceb-c7b262605968","created":"2024-09-16T09:36:36.938441+0000","modified":"2024-09-16T09:42:26.569187+0000","last_up_change":"2024-09-16T09:42:25.561865+0000","last_in_change":"2024-09-16T09:42:02.504734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-16T09:41:09.164545+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"457c10db-ac0b-4edf-8f9e-7f77092fdf7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6802","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6803","nonce":2640087294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6804","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6805","nonce":2640087294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6808","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6809","nonce":2640087294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6806","nonce":2640087294},{"type":"v1","addr":"172.21.15.111:6807","nonce":2640087294}]},"public_addr":"172.21.15.111:6803/2640087294","cluster_addr":"172.21.15.111:6805/2640087294","heartbeat_back_addr":"172.21.15.111:6809/2640087294","heartbeat_front_addr":"172.21.15.111:6807/2640087294","state":["exists","up"]},{"osd":1,"uuid":"cb30de27-8d11-407d-aa23-0861cff63597","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6810","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6811","nonce":3853314577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6812","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6813","nonce":3853314577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6816","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6817","nonce":3853314577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6814","nonce":3853314577},{"type":"v1","addr":"172.21.15.111:6815","nonce":3853314577}]},"public_addr":"172.21.15.111:6811/3853314577","cluster_addr":"172.21.15.111:6813/3853314577","heartbeat_back_addr":"172.21.15.111:6817/3853314577","heartbeat_front_addr":"172.21.15.111:6815/3853314577","state":["exists","up"]},{"osd":2,"uuid":"f3159d59-4af3-4a9a-bcbd-9d37153c8701","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6818","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6819","nonce":3599318958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6820","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6821","nonce":3599318958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6824","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6825","nonce":3599318958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6822","nonce":3599318958},{"type":"v1","addr":"172.21.15.111:6823","nonce":3599318958}]},"public_addr":"172.21.15.111:6819/3599318958","cluster_addr":"172.21.15.111:6821/3599318958","heartbeat_back_addr":"172.21.15.111:6825/3599318958","heartbeat_front_addr":"172.21.15.111:6823/3599318958","state":["exists","up"]},{"osd":3,"uuid":"a5a7c3b7-9672-46d2-ba12-be708f7ca38c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6800","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6801","nonce":3824663540}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6802","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6803","nonce":3824663540}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6806","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6807","nonce":3824663540}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6804","nonce":3824663540},{"type":"v1","addr":"172.21.15.114:6805","nonce":3824663540}]},"public_addr":"172.21.15.114:6801/3824663540","cluster_addr":"172.21.15.114:6803/3824663540","heartbeat_back_addr":"172.21.15.114:6807/3824663540","heartbeat_front_addr":"172.21.15.114:6805/3824663540","state":["exists","up"]},{"osd":4,"uuid":"9820d754-6da1-4ef4-a6a9-77b310c1c3a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6808","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6809","nonce":878847632}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6810","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6811","nonce":878847632}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6814","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6815","nonce":878847632}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6812","nonce":878847632},{"type":"v1","addr":"172.21.15.114:6813","nonce":878847632}]},"public_addr":"172.21.15.114:6809/878847632","cluster_addr":"172.21.15.114:6811/878847632","heartbeat_back_addr":"172.21.15.114:6815/878847632","heartbeat_front_addr":"172.21.15.114:6813/878847632","state":["exists","up"]},{"osd":5,"uuid":"76ec8880-8d5b-492b-bcf6-8effa0183acf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6816","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6817","nonce":3093901704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6818","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6819","nonce":3093901704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6822","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6823","nonce":3093901704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6820","nonce":3093901704},{"type":"v1","addr":"172.21.15.114:6821","nonce":3093901704}]},"public_addr":"172.21.15.114:6817/3093901704","cluster_addr":"172.21.15.114:6819/3093901704","heartbeat_back_addr":"172.21.15.114:6823/3093901704","heartbeat_front_addr":"172.21.15.114:6821/3093901704","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:40:09.353626+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:40:38.424522+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:06.565798+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:32.271953+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:41:58.826231+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-16T09:42:23.722188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6801/4032555979":"2024-09-17T09:38:34.840593+0000","172.21.15.111:0/323192077":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/1453802272":"2024-09-17T09:37:08.491284+0000","172.21.15.111:6801/3108753484":"2024-09-17T09:37:08.491284+0000","172.21.15.111:6800/3108753484":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/3905288646":"2024-09-17T09:37:08.491284+0000","172.21.15.111:0/2154493900":"2024-09-17T09:38:34.840593+0000","172.21.15.111:6800/1312194133":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/515452109":"2024-09-17T09:37:39.495256+0000","172.21.15.111:6801/1312194133":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/1023452280":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/402500126":"2024-09-17T09:38:34.840593+0000","172.21.15.111:0/1755678140":"2024-09-17T09:37:39.495256+0000","172.21.15.111:0/1365706184":"2024-09-17T09:38:34.840593+0000","172.21.15.111:6800/4032555979":"2024-09-17T09:38:34.840593+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f03fc06e260 msgr2=0x7f03fc070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f03fc06e260 0x7f03fc070720 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0404009430 tx=0x7f04040093a0 comp rx=0 tx=0).stop 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 msgr2=0x7f04141028f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f04141028f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f040800c8f0 tx=0x7f040800cdb0 comp rx=0 tx=0).stop 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 shutdown_connections 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f03fc06e260 0x7f03fc070720 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f04141067e0 0x7f04141028f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:40.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 --2- 172.21.15.111:0/422489448 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f04141007e0 0x7f04141023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:40.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 >> 172.21.15.111:0/422489448 conn(0x7f04140fc4c0 msgr2=0x7f04141045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:40.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 shutdown_connections 2024-09-16T09:42:40.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:40.075+0000 7f0419fad640 1 -- 172.21.15.111:0/422489448 wait complete. 2024-09-16T09:42:40.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:40 smithi114 ceph-mon[35635]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:40.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:40 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/422489448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T09:42:40.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:40 smithi111 ceph-mon[27997]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:40.586 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:40 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/422489448' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-16T09:42:40.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-16T09:42:40.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-16T09:42:40.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-16T09:42:40.796 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-16T09:42:40.796 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-16T09:42:40.797 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-16T09:42:41.089 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:41.099 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:41.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:41 smithi114 ceph-mon[35635]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:41.471 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:41 smithi111 ceph-mon[27997]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:41.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.855+0000 7fbfa8afc640 1 -- 172.21.15.111:0/3823112759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa41033c0 msgr2=0x7fbfa410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.855+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/3823112759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa41033c0 0x7fbfa410b8b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c009880 tx=0x7fbf8c02a530 comp rx=0 tx=0).stop 2024-09-16T09:42:41.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.855+0000 7fbfa8afc640 1 -- 172.21.15.111:0/3823112759 shutdown_connections 2024-09-16T09:42:41.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.855+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/3823112759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa41033c0 0x7fbfa410b8b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.855+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/3823112759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa4102aa0 0x7fbfa4102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.855+0000 7fbfa8afc640 1 -- 172.21.15.111:0/3823112759 >> 172.21.15.111:0/3823112759 conn(0x7fbfa40fc4c0 msgr2=0x7fbfa40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:41.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 -- 172.21.15.111:0/3823112759 shutdown_connections 2024-09-16T09:42:41.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 -- 172.21.15.111:0/3823112759 wait complete. 2024-09-16T09:42:41.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 Processor -- start 2024-09-16T09:42:41.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 -- start start 2024-09-16T09:42:41.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 0x7fbfa419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa41033c0 0x7fbfa419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa410edd0 con 0x7fbfa4102aa0 2024-09-16T09:42:41.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.856+0000 7fbfa8afc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa410ec50 con 0x7fbfa41033c0 2024-09-16T09:42:41.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 0x7fbfa419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 0x7fbfa419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37458/0 (socket says 172.21.15.111:37458) 2024-09-16T09:42:41.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 -- 172.21.15.111:0/2211298558 learned_addr learned my addr 172.21.15.111:0/2211298558 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:41.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa1d9b640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa41033c0 0x7fbfa419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 -- 172.21.15.111:0/2211298558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa41033c0 msgr2=0x7fbfa419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa41033c0 0x7fbfa419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 -- 172.21.15.111:0/2211298558 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa4197860 con 0x7fbfa4102aa0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa259c640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 0x7fbfa419d6a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400cc60 tx=0x7fbf9400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf9400ad30 con 0x7fbfa4102aa0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbf94005020 con 0x7fbfa4102aa0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbf9400f640 con 0x7fbfa4102aa0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa4197b50 con 0x7fbfa4102aa0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.857+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa41980b0 con 0x7fbfa4102aa0 2024-09-16T09:42:41.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.858+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbfa4198650 con 0x7fbfa4102aa0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fbf940051d0 con 0x7fbfa4102aa0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbf9b7fe640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fbf9006e310 0x7fbf900707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fbf9408e050 con 0x7fbfa4102aa0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbfa1d9b640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fbf9006e310 0x7fbf900707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbf9b7fe640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] conn(0x7fbf90074100 0x7fbf90076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 --> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf94004810 con 0x7fbf90074100 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.859+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbf94095050 con 0x7fbfa4102aa0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.860+0000 7fbfa2d9d640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] conn(0x7fbf90074100 0x7fbf90076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.860+0000 7fbfa1d9b640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fbf9006e310 0x7fbf900707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4199050 tx=0x7fbf8c031420 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.860+0000 7fbfa2d9d640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] conn(0x7fbf90074100 0x7fbf90076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:41.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.861+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== osd.2 v2:172.21.15.111:6818/3599318958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf94004810 con 0x7fbf90074100 2024-09-16T09:42:41.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.874+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 --> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbfa4062880 con 0x7fbf90074100 2024-09-16T09:42:41.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.874+0000 7fbf9b7fe640 1 -- 172.21.15.111:0/2211298558 <== osd.2 v2:172.21.15.111:6818/3599318958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbfa4062880 con 0x7fbf90074100 2024-09-16T09:42:41.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.874+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] conn(0x7fbf90074100 msgr2=0x7fbf90076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.874+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] conn(0x7fbf90074100 0x7fbf90076520 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.874+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fbf9006e310 msgr2=0x7fbf900707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.874+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fbf9006e310 0x7fbf900707d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4199050 tx=0x7fbf8c031420 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 msgr2=0x7fbfa419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 0x7fbfa419d6a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf9400cc60 tx=0x7fbf9400a620 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 shutdown_connections 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fbf9006e310 0x7fbf900707d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbfa41033c0 0x7fbfa419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:6818/3599318958,v1:172.21.15.111:6819/3599318958] conn(0x7fbf90074100 0x7fbf90076520 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 --2- 172.21.15.111:0/2211298558 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbfa4102aa0 0x7fbfa419d6a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 >> 172.21.15.111:0/2211298558 conn(0x7fbfa40fc4c0 msgr2=0x7fbfa4107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 shutdown_connections 2024-09-16T09:42:41.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.875+0000 7fbfa8afc640 1 -- 172.21.15.111:0/2211298558 wait complete. 2024-09-16T09:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 -- 172.21.15.111:0/4018797680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 msgr2=0x7f8100100180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 --2- 172.21.15.111:0/4018797680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f8100100180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f80f4009880 tx=0x7f80f402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 -- 172.21.15.111:0/4018797680 shutdown_connections 2024-09-16T09:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 --2- 172.21.15.111:0/4018797680 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f8100100180 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 --2- 172.21.15.111:0/4018797680 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8100106900 0x7f8100106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 -- 172.21.15.111:0/4018797680 >> 172.21.15.111:0/4018797680 conn(0x7f81000fbc10 msgr2=0x7f81000fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 -- 172.21.15.111:0/4018797680 shutdown_connections 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.777+0000 7f810614a640 1 -- 172.21.15.111:0/4018797680 wait complete. 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f810614a640 1 Processor -- start 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f810614a640 1 -- start start 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f810614a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f810019d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f810614a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8100106900 0x7f810019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f810614a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f810010ef00 con 0x7f81000ffd20 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f810614a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f810010ed80 con 0x7f8100106900 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f810019d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80ff7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f810019d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:37440/0 (socket says 172.21.15.111:37440) 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80ff7fe640 1 -- 172.21.15.111:0/3363466368 learned_addr learned my addr 172.21.15.111:0/3363466368 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80feffd640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8100106900 0x7f810019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80ff7fe640 1 -- 172.21.15.111:0/3363466368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8100106900 msgr2=0x7f810019dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80ff7fe640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8100106900 0x7f810019dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.778+0000 7f80ff7fe640 1 -- 172.21.15.111:0/3363466368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81001978c0 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.779+0000 7f80ff7fe640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f810019d700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f80f000b420 tx=0x7f80f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.779+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80f0011630 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.779+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8100197bb0 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.779+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80f0016070 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.779+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f80f0010d40 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.779+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8100198110 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.780+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8100198670 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.780+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f80f00243d0 con 0x7f81000ffd20 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80fcff9640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f80e806e2b0 0x7f80e8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f80f008e0c0 con 0x7f81000ffd20 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80feffd640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f80e806e2b0 0x7f80e8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80fcff9640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] conn(0x7f80e80740a0 0x7f80e80764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 --> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80e8076b70 con 0x7f80e80740a0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f80f008e560 con 0x7f81000ffd20 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80fffff640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] conn(0x7f80e80740a0 0x7f80e80764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.781+0000 7f80feffd640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f80e806e2b0 0x7f80e8070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81001990b0 tx=0x7f80f4031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.782+0000 7f80fffff640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] conn(0x7f80e80740a0 0x7f80e80764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.783+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== osd.0 v2:172.21.15.111:6802/2640087294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f80e8076b70 con 0x7f80e80740a0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.796+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 --> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8100062880 con 0x7f80e80740a0 2024-09-16T09:42:41.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.796+0000 7f80fcff9640 1 -- 172.21.15.111:0/3363466368 <== osd.0 v2:172.21.15.111:6802/2640087294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8100062880 con 0x7f80e80740a0 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] conn(0x7f80e80740a0 msgr2=0x7f80e80764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] conn(0x7f80e80740a0 0x7f80e80764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f80e806e2b0 msgr2=0x7f80e8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f80e806e2b0 0x7f80e8070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f81001990b0 tx=0x7f80f4031400 comp rx=0 tx=0).stop 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 msgr2=0x7f810019d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f810019d700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f80f000b420 tx=0x7f80f000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 shutdown_connections 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6802/2640087294,v1:172.21.15.111:6803/2640087294] conn(0x7f80e80740a0 0x7f80e80764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f80e806e2b0 0x7f80e8070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8100106900 0x7f810019dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 --2- 172.21.15.111:0/3363466368 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81000ffd20 0x7f810019d700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:41.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 >> 172.21.15.111:0/3363466368 conn(0x7f81000fbc10 msgr2=0x7f81000fc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:41.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 shutdown_connections 2024-09-16T09:42:41.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:41.797+0000 7f810614a640 1 -- 172.21.15.111:0/3363466368 wait complete. 2024-09-16T09:42:42.705 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-09-16T09:42:42.706 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-16T09:42:43.393 INFO:teuthology.orchestra.run.smithi111.stdout:81604378646 2024-09-16T09:42:43.393 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-16T09:42:43.536 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:43.536 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:43.537 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:43.538 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:43.543 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:44.206 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:43 smithi111 ceph-mon[27997]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.284+0000 7febcc67c640 1 -- 172.21.15.111:0/3428299402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 msgr2=0x7febc4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.284+0000 7febcc67c640 1 --2- 172.21.15.111:0/3428299402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc4101d70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7febb8009880 tx=0x7febb802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- 172.21.15.111:0/3428299402 shutdown_connections 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 --2- 172.21.15.111:0/3428299402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc4101d70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 --2- 172.21.15.111:0/3428299402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4107910 0x7febc4107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- 172.21.15.111:0/3428299402 >> 172.21.15.111:0/3428299402 conn(0x7febc40fd5f0 msgr2=0x7febc40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- 172.21.15.111:0/3428299402 shutdown_connections 2024-09-16T09:42:44.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- 172.21.15.111:0/3428299402 wait complete. 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 Processor -- start 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- start start 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4107910 0x7febc419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7febc410ee40 con 0x7febc4101910 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.285+0000 7febcc67c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7febc410ecc0 con 0x7febc4107910 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45718/0 (socket says 172.21.15.111:45718) 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 -- 172.21.15.111:0/1445678524 learned_addr learned my addr 172.21.15.111:0/1445678524 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febc9c17640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4107910 0x7febc419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 -- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4107910 msgr2=0x7febc419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4107910 0x7febc419dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 -- 172.21.15.111:0/1445678524 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febc4197830 con 0x7febc4101910 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febca418640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc419d6b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7febbc00b420 tx=0x7febbc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febbc011630 con 0x7febc4101910 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7febbc016070 con 0x7febc4101910 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7febbc010d40 con 0x7febc4101910 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febc4197b20 con 0x7febc4101910 2024-09-16T09:42:44.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.286+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febc4198080 con 0x7febc4101910 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.287+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7febc41986a0 con 0x7febc4101910 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7febbc01b460 con 0x7febc4101910 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc37fe640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7febac06e310 0x7febac0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc9c17640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7febac06e310 0x7febac0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7febbc08d5f0 con 0x7febc4101910 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc37fe640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] conn(0x7febac074100 0x7febac076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 --> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7febac076bd0 con 0x7febac074100 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.288+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7febbc094050 con 0x7febc4101910 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.289+0000 7febc9c17640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7febac06e310 0x7febac0707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7febc4198b80 tx=0x7febb8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.289+0000 7febcac19640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] conn(0x7febac074100 0x7febac076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.289+0000 7febcac19640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] conn(0x7febac074100 0x7febac076520 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:44.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.290+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== osd.3 v2:172.21.15.114:6800/3824663540 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7febac076bd0 con 0x7febac074100 2024-09-16T09:42:44.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.303+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 --> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7febc4062900 con 0x7febac074100 2024-09-16T09:42:44.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.303+0000 7febc37fe640 1 -- 172.21.15.111:0/1445678524 <== osd.3 v2:172.21.15.114:6800/3824663540 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7febc4062900 con 0x7febac074100 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] conn(0x7febac074100 msgr2=0x7febac076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] conn(0x7febac074100 0x7febac076520 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7febac06e310 msgr2=0x7febac0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7febac06e310 0x7febac0707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7febc4198b80 tx=0x7febb8031400 comp rx=0 tx=0).stop 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 msgr2=0x7febc419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc419d6b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7febbc00b420 tx=0x7febbc00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 shutdown_connections 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:6800/3824663540,v1:172.21.15.114:6801/3824663540] conn(0x7febac074100 0x7febac076520 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7febac06e310 0x7febac0707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7febc4107910 0x7febc419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 --2- 172.21.15.111:0/1445678524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7febc4101910 0x7febc419d6b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 >> 172.21.15.111:0/1445678524 conn(0x7febc40fd5f0 msgr2=0x7febc40fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:44.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 shutdown_connections 2024-09-16T09:42:44.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.304+0000 7febcc67c640 1 -- 172.21.15.111:0/1445678524 wait complete. 2024-09-16T09:42:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:43 smithi114 ceph-mon[35635]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:44.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 -- 172.21.15.111:0/1638397361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 msgr2=0x7fce94106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.700 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 --2- 172.21.15.111:0/1638397361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce94106c00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce84009880 tx=0x7fce8402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 -- 172.21.15.111:0/1638397361 shutdown_connections 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 --2- 172.21.15.111:0/1638397361 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce94100820 0x7fce94100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 --2- 172.21.15.111:0/1638397361 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce94106c00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 -- 172.21.15.111:0/1638397361 >> 172.21.15.111:0/1638397361 conn(0x7fce940fc520 msgr2=0x7fce940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 -- 172.21.15.111:0/1638397361 shutdown_connections 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.469+0000 7fce99af1640 1 -- 172.21.15.111:0/1638397361 wait complete. 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce99af1640 1 Processor -- start 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce99af1640 1 -- start start 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce99af1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce94100820 0x7fce9419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce99af1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce9419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce99af1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fce9410dcd0 con 0x7fce94106820 2024-09-16T09:42:44.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce99af1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fce9410db50 con 0x7fce94100820 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce92ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce9419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce92ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce9419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45746/0 (socket says 172.21.15.111:45746) 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce92ffd640 1 -- 172.21.15.111:0/4211178172 learned_addr learned my addr 172.21.15.111:0/4211178172 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce937fe640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce94100820 0x7fce9419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce92ffd640 1 -- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce94100820 msgr2=0x7fce9419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.470+0000 7fce92ffd640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce94100820 0x7fce9419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce92ffd640 1 -- 172.21.15.111:0/4211178172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941966f0 con 0x7fce94106820 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce92ffd640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce9419cb60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c8a0 tx=0x7fce8800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce880079b0 con 0x7fce94106820 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce941969e0 con 0x7fce94106820 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce88007b50 con 0x7fce94106820 2024-09-16T09:42:44.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce88018700 con 0x7fce94106820 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.471+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce94196f70 con 0x7fce94106820 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.472+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fce94197510 con 0x7fce94106820 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.472+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fce88007d00 con 0x7fce94106820 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce90ff9640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fce7c06e2b0 0x7fce7c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce937fe640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fce7c06e2b0 0x7fce7c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fce8808e010 con 0x7fce94106820 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce90ff9640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] conn(0x7fce7c0740a0 0x7fce7c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:44.703 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 --> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fce88012ec0 con 0x7fce7c0740a0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fce88095050 con 0x7fce94106820 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce937fe640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fce7c06e2b0 0x7fce7c070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fce84000c00 tx=0x7fce84031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.473+0000 7fce93fff640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] conn(0x7fce7c0740a0 0x7fce7c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.474+0000 7fce93fff640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] conn(0x7fce7c0740a0 0x7fce7c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.475+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== osd.5 v2:172.21.15.114:6816/3093901704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fce88012ec0 con 0x7fce7c0740a0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.488+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 --> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fce940628b0 con 0x7fce7c0740a0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.488+0000 7fce90ff9640 1 -- 172.21.15.111:0/4211178172 <== osd.5 v2:172.21.15.114:6816/3093901704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fce940628b0 con 0x7fce7c0740a0 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] conn(0x7fce7c0740a0 msgr2=0x7fce7c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] conn(0x7fce7c0740a0 0x7fce7c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fce7c06e2b0 msgr2=0x7fce7c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fce7c06e2b0 0x7fce7c070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fce84000c00 tx=0x7fce84031400 comp rx=0 tx=0).stop 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 msgr2=0x7fce9419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:44.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce9419cb60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c8a0 tx=0x7fce8800cd60 comp rx=0 tx=0).stop 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 shutdown_connections 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:6816/3093901704,v1:172.21.15.114:6817/3093901704] conn(0x7fce7c0740a0 0x7fce7c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fce7c06e2b0 0x7fce7c070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fce94106820 0x7fce9419cb60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 --2- 172.21.15.111:0/4211178172 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fce94100820 0x7fce9419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 >> 172.21.15.111:0/4211178172 conn(0x7fce940fc520 msgr2=0x7fce940fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 shutdown_connections 2024-09-16T09:42:44.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:44.489+0000 7fce99af1640 1 -- 172.21.15.111:0/4211178172 wait complete. 2024-09-16T09:42:45.576 INFO:teuthology.orchestra.run.smithi111.stdout:158913789959 2024-09-16T09:42:45.577 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-16T09:42:46.228 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:45 smithi111 ceph-mon[27997]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:46.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.236+0000 7f170c546640 1 -- 172.21.15.111:0/1212109874 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041007e0 msgr2=0x7f1704100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.236+0000 7f170c546640 1 --2- 172.21.15.111:0/1212109874 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041007e0 0x7f1704100c40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f16f4009880 tx=0x7f16f402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 -- 172.21.15.111:0/1212109874 shutdown_connections 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 --2- 172.21.15.111:0/1212109874 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041007e0 0x7f1704100c40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 --2- 172.21.15.111:0/1212109874 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17041067e0 0x7f1704106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 -- 172.21.15.111:0/1212109874 >> 172.21.15.111:0/1212109874 conn(0x7f17040fc4c0 msgr2=0x7f17040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 -- 172.21.15.111:0/1212109874 shutdown_connections 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 -- 172.21.15.111:0/1212109874 wait complete. 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 Processor -- start 2024-09-16T09:42:46.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 -- start start 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.237+0000 7f170c546640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17041007e0 0x7f170419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f170c546640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 0x7f170419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f170c546640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f170410dcb0 con 0x7f17041067e0 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f170c546640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f170410db30 con 0x7f17041007e0 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 0x7f170419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 0x7f170419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45782/0 (socket says 172.21.15.111:45782) 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 -- 172.21.15.111:0/2892996201 learned_addr learned my addr 172.21.15.111:0/2892996201 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f170a2e2640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17041007e0 0x7f170419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 -- 172.21.15.111:0/2892996201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17041007e0 msgr2=0x7f170419d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17041007e0 0x7f170419d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 -- 172.21.15.111:0/2892996201 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1704197830 con 0x7f17041067e0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f1709ae1640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 0x7f170419dbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16f4031460 tx=0x7f16f40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16f403f070 con 0x7f17041067e0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16f40035f0 con 0x7f17041067e0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16f4035030 con 0x7f17041067e0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1704197ac0 con 0x7f17041067e0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.238+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1704197ff0 con 0x7f17041067e0 2024-09-16T09:42:46.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.239+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1704198670 con 0x7f17041067e0 2024-09-16T09:42:46.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.240+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f16f4042070 con 0x7f17041067e0 2024-09-16T09:42:46.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.240+0000 7f16fb7fe640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f16f006e310 0x7f16f00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.240+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f16f40ae720 con 0x7f17041067e0 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.240+0000 7f170a2e2640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f16f006e310 0x7f16f00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.241+0000 7f16fb7fe640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] conn(0x7f16f0074100 0x7f16f0076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.241+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 --> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f16f40054e0 con 0x7f16f0074100 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.241+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f16f40b5050 con 0x7f17041067e0 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.241+0000 7f170aae3640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] conn(0x7f16f0074100 0x7f16f0076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.241+0000 7f170a2e2640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f16f006e310 0x7f16f00707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1700005fd0 tx=0x7f1700005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.241+0000 7f170aae3640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] conn(0x7f16f0074100 0x7f16f0076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:46.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.242+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== osd.1 v2:172.21.15.111:6810/3853314577 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f16f40054e0 con 0x7f16f0074100 2024-09-16T09:42:46.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.255+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 --> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1704062900 con 0x7f16f0074100 2024-09-16T09:42:46.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.255+0000 7f16fb7fe640 1 -- 172.21.15.111:0/2892996201 <== osd.1 v2:172.21.15.111:6810/3853314577 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1704062900 con 0x7f16f0074100 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] conn(0x7f16f0074100 msgr2=0x7f16f0076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] conn(0x7f16f0074100 0x7f16f0076520 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f16f006e310 msgr2=0x7f16f00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f16f006e310 0x7f16f00707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1700005fd0 tx=0x7f1700005850 comp rx=0 tx=0).stop 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 msgr2=0x7f170419dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 0x7f170419dbf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f16f4031460 tx=0x7f16f40045e0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 shutdown_connections 2024-09-16T09:42:46.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6810/3853314577,v1:172.21.15.111:6811/3853314577] conn(0x7f16f0074100 0x7f16f0076520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f16f006e310 0x7f16f00707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f17041067e0 0x7f170419dbf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 --2- 172.21.15.111:0/2892996201 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f17041007e0 0x7f170419d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 >> 172.21.15.111:0/2892996201 conn(0x7f17040fc4c0 msgr2=0x7f1704069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:46.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 shutdown_connections 2024-09-16T09:42:46.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.256+0000 7f170c546640 1 -- 172.21.15.111:0/2892996201 wait complete. 2024-09-16T09:42:46.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 -- 172.21.15.111:0/2907640593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 msgr2=0x7fad60106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 --2- 172.21.15.111:0/2907640593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad60106bc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fad54009880 tx=0x7fad5402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 -- 172.21.15.111:0/2907640593 shutdown_connections 2024-09-16T09:42:46.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 --2- 172.21.15.111:0/2907640593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad601007e0 0x7fad60100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 --2- 172.21.15.111:0/2907640593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad60106bc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 -- 172.21.15.111:0/2907640593 >> 172.21.15.111:0/2907640593 conn(0x7fad600fc4c0 msgr2=0x7fad600fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 -- 172.21.15.111:0/2907640593 shutdown_connections 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.131+0000 7fad67b6d640 1 -- 172.21.15.111:0/2907640593 wait complete. 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad67b6d640 1 Processor -- start 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad67b6d640 1 -- start start 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad67b6d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad601007e0 0x7fad6019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad67b6d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad6019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad67b6d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fad6010dd10 con 0x7fad601067e0 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad67b6d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad6010db90 con 0x7fad601007e0 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad65108640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad6019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad65108640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad6019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45766/0 (socket says 172.21.15.111:45766) 2024-09-16T09:42:46.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad65108640 1 -- 172.21.15.111:0/1122377958 learned_addr learned my addr 172.21.15.111:0/1122377958 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.132+0000 7fad65909640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad601007e0 0x7fad6019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad65108640 1 -- 172.21.15.111:0/1122377958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad601007e0 msgr2=0x7fad6019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad65108640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad601007e0 0x7fad6019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad65108640 1 -- 172.21.15.111:0/1122377958 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad601999e0 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad65108640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad6019fd60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00b420 tx=0x7fad5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad5c011630 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad5c016070 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad60199cd0 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad5c010d40 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.133+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad6019a260 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.134+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad60101f20 con 0x7fad601067e0 2024-09-16T09:42:46.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.134+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fad5c01b460 con 0x7fad601067e0 2024-09-16T09:42:46.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.135+0000 7fad52ffd640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fad4c06e310 0x7fad4c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:46.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.135+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fad5c08d550 con 0x7fad601067e0 2024-09-16T09:42:46.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.135+0000 7fad65909640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fad4c06e310 0x7fad4c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:46.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.135+0000 7fad65909640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fad4c06e310 0x7fad4c0707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fad54000c00 tx=0x7fad54031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:46.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.139+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fad5c05b270 con 0x7fad601067e0 2024-09-16T09:42:46.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.354+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fad6019afe0 con 0x7fad601067e0 2024-09-16T09:42:46.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.355+0000 7fad52ffd640 1 -- 172.21.15.111:0/1122377958 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fad5c08d370 con 0x7fad601067e0 2024-09-16T09:42:46.356 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-09-16T09:42:46.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fad4c06e310 msgr2=0x7fad4c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fad4c06e310 0x7fad4c0707d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fad54000c00 tx=0x7fad54031400 comp rx=0 tx=0).stop 2024-09-16T09:42:46.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 msgr2=0x7fad6019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:46.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad6019fd60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fad5c00b420 tx=0x7fad5c00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 shutdown_connections 2024-09-16T09:42:46.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fad4c06e310 0x7fad4c0707d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad601067e0 0x7fad6019fd60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 --2- 172.21.15.111:0/1122377958 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad601007e0 0x7fad6019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:46.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 >> 172.21.15.111:0/1122377958 conn(0x7fad600fc4c0 msgr2=0x7fad60069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:46.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 shutdown_connections 2024-09-16T09:42:46.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:46.357+0000 7fad67b6d640 1 -- 172.21.15.111:0/1122377958 wait complete. 2024-09-16T09:42:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:45 smithi114 ceph-mon[35635]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:47.020 INFO:teuthology.orchestra.run.smithi111.stdout:107374182416 2024-09-16T09:42:47.020 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-16T09:42:47.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:46 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1122377958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T09:42:47.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:46 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1122377958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-16T09:42:47.649 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705698 for osd.0 2024-09-16T09:42:47.649 DEBUG:teuthology.parallel:result is None 2024-09-16T09:42:48.018 INFO:teuthology.orchestra.run.smithi111.stdout:60129542173 2024-09-16T09:42:48.019 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3880809596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 msgr2=0x7f6efc106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3880809596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc106bc0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6eec009880 tx=0x7f6eec02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3880809596 shutdown_connections 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3880809596 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc1007e0 0x7f6efc100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3880809596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc106bc0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3880809596 >> 172.21.15.111:0/3880809596 conn(0x7f6efc0fc4c0 msgr2=0x7f6efc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3880809596 shutdown_connections 2024-09-16T09:42:48.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.180+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3880809596 wait complete. 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6f00ea0640 1 Processor -- start 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6f00ea0640 1 -- start start 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6f00ea0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc1007e0 0x7f6efc1988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6f00ea0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6f00ea0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc10dd10 con 0x7f6efc1067e0 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6f00ea0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6efc10db90 con 0x7f6efc1007e0 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6ef9d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6ef9d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc198e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45794/0 (socket says 172.21.15.111:45794) 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6ef9d9b640 1 -- 172.21.15.111:0/3270868665 learned_addr learned my addr 172.21.15.111:0/3270868665 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:48.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.181+0000 7f6efa59c640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc1007e0 0x7f6efc1988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6ef9d9b640 1 -- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc1007e0 msgr2=0x7f6efc1988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6ef9d9b640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc1007e0 0x7f6efc1988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6ef9d9b640 1 -- 172.21.15.111:0/3270868665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6efc199400 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6ef9d9b640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc198e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000b420 tx=0x7f6ef000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ef0011630 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ef0016070 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ef0010d40 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6efc1996f0 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.182+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6efc1a1cf0 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.183+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6efc0628c0 con 0x7f6efc1067e0 2024-09-16T09:42:48.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.183+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6ef00117d0 con 0x7f6efc1067e0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6eeb7fe640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6ee406e2b0 0x7f6ee4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f6ef008d660 con 0x7f6efc1067e0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6efa59c640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6ee406e2b0 0x7f6ee4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6eeb7fe640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] conn(0x7f6ee40740a0 0x7f6ee40764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 --> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ee4076b70 con 0x7f6ee40740a0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6ef0094050 con 0x7f6efc1067e0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6efad9d640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] conn(0x7f6ee40740a0 0x7f6ee40764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.184+0000 7f6efa59c640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6ee406e2b0 0x7f6ee4070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0096c0 tx=0x7f6eec031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.185+0000 7f6efad9d640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] conn(0x7f6ee40740a0 0x7f6ee40764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:48.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.186+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== osd.4 v2:172.21.15.114:6808/878847632 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ee4076b70 con 0x7f6ee40740a0 2024-09-16T09:42:48.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.199+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 --> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6efc062d80 con 0x7f6ee40740a0 2024-09-16T09:42:48.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6eeb7fe640 1 -- 172.21.15.111:0/3270868665 <== osd.4 v2:172.21.15.114:6808/878847632 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6efc062d80 con 0x7f6ee40740a0 2024-09-16T09:42:48.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] conn(0x7f6ee40740a0 msgr2=0x7f6ee40764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:48.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] conn(0x7f6ee40740a0 0x7f6ee40764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6ee406e2b0 msgr2=0x7f6ee4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:48.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6ee406e2b0 0x7f6ee4070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0096c0 tx=0x7f6eec031400 comp rx=0 tx=0).stop 2024-09-16T09:42:48.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 msgr2=0x7f6efc198e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:48.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.200+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc198e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000b420 tx=0x7f6ef000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 shutdown_connections 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:6808/878847632,v1:172.21.15.114:6809/878847632] conn(0x7f6ee40740a0 0x7f6ee40764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6ee406e2b0 0x7f6ee4070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6efc1067e0 0x7f6efc198e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 --2- 172.21.15.111:0/3270868665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6efc1007e0 0x7f6efc1988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 >> 172.21.15.111:0/3270868665 conn(0x7f6efc0fc4c0 msgr2=0x7f6efc0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 shutdown_connections 2024-09-16T09:42:48.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:48.201+0000 7f6f00ea0640 1 -- 172.21.15.111:0/3270868665 wait complete. 2024-09-16T09:42:48.212 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:47 smithi111 ceph-mon[27997]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:47 smithi114 ceph-mon[35635]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:48.540 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:48.540 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:48.541 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:48.544 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:49.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.604+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/1637486879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 msgr2=0x7ff9cc10b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:49.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.604+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/1637486879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc10b930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009880 tx=0x7ff9c002a530 comp rx=0 tx=0).stop 2024-09-16T09:42:49.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.604+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/1637486879 shutdown_connections 2024-09-16T09:42:49.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.604+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/1637486879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc10b930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.605+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/1637486879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9cc102b20 0x7ff9cc102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.605+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/1637486879 >> 172.21.15.111:0/1637486879 conn(0x7ff9cc0fc4c0 msgr2=0x7ff9cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:49.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.605+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/1637486879 shutdown_connections 2024-09-16T09:42:49.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.605+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/1637486879 wait complete. 2024-09-16T09:42:49.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.605+0000 7ff9d3d3f640 1 Processor -- start 2024-09-16T09:42:49.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.605+0000 7ff9d3d3f640 1 -- start start 2024-09-16T09:42:49.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d3d3f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9cc102b20 0x7ff9cc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:49.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d3d3f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:49.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d3d3f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10ee30 con 0x7ff9cc103440 2024-09-16T09:42:49.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d3d3f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc10ecb0 con 0x7ff9cc102b20 2024-09-16T09:42:49.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:49.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45804/0 (socket says 172.21.15.111:45804) 2024-09-16T09:42:49.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 -- 172.21.15.111:0/565437723 learned_addr learned my addr 172.21.15.111:0/565437723 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:49.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d1adb640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9cc102b20 0x7ff9cc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:49.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 -- 172.21.15.111:0/565437723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9cc102b20 msgr2=0x7ff9cc19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:49.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9cc102b20 0x7ff9cc19d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 -- 172.21.15.111:0/565437723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc197840 con 0x7ff9cc103440 2024-09-16T09:42:49.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d12da640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc19dc00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0004f90 tx=0x7ff9c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:49.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9c003f070 con 0x7ff9cc103440 2024-09-16T09:42:49.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9c0004cf0 con 0x7ff9cc103440 2024-09-16T09:42:49.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc197ad0 con 0x7ff9cc103440 2024-09-16T09:42:49.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.606+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9c0035030 con 0x7ff9cc103440 2024-09-16T09:42:49.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.607+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc198000 con 0x7ff9cc103440 2024-09-16T09:42:49.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.608+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc06a390 con 0x7ff9cc103440 2024-09-16T09:42:49.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.608+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff9c0042070 con 0x7ff9cc103440 2024-09-16T09:42:49.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.608+0000 7ff9caffd640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff9b406e2b0 0x7ff9b4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:49.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.609+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff9c00ae900 con 0x7ff9cc103440 2024-09-16T09:42:49.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.609+0000 7ff9d1adb640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff9b406e2b0 0x7ff9b4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:49.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.609+0000 7ff9d1adb640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff9b406e2b0 0x7ff9b4070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009f20 tx=0x7ff9bc0094f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:49.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.613+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff9c007c5a0 con 0x7ff9cc103440 2024-09-16T09:42:49.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.783+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff9cc105f40 con 0x7ff9cc103440 2024-09-16T09:42:49.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.784+0000 7ff9caffd640 1 -- 172.21.15.111:0/565437723 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff9c0080250 con 0x7ff9cc103440 2024-09-16T09:42:49.785 INFO:teuthology.orchestra.run.smithi111.stdout:81604378647 2024-09-16T09:42:49.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.786+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff9b406e2b0 msgr2=0x7ff9b4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:49.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.786+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff9b406e2b0 0x7ff9b4070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009f20 tx=0x7ff9bc0094f0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.786+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 msgr2=0x7ff9cc19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:49.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.786+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc19dc00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0004f90 tx=0x7ff9c00048f0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 shutdown_connections 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff9b406e2b0 0x7ff9b4070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff9cc103440 0x7ff9cc19dc00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 --2- 172.21.15.111:0/565437723 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff9cc102b20 0x7ff9cc19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 >> 172.21.15.111:0/565437723 conn(0x7ff9cc0fc4c0 msgr2=0x7ff9cc108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 shutdown_connections 2024-09-16T09:42:49.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.787+0000 7ff9d3d3f640 1 -- 172.21.15.111:0/565437723 wait complete. 2024-09-16T09:42:49.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 -- 172.21.15.111:0/2562716906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 msgr2=0x7f7274102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:49.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 --2- 172.21.15.111:0/2562716906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274102f10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f72680098b0 tx=0x7f726802a560 comp rx=0 tx=0).stop 2024-09-16T09:42:49.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 -- 172.21.15.111:0/2562716906 shutdown_connections 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 --2- 172.21.15.111:0/2562716906 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f727410b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 --2- 172.21.15.111:0/2562716906 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274102f10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 -- 172.21.15.111:0/2562716906 >> 172.21.15.111:0/2562716906 conn(0x7f72740fc510 msgr2=0x7f72740fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 -- 172.21.15.111:0/2562716906 shutdown_connections 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.816+0000 7f727ae81640 1 -- 172.21.15.111:0/2562716906 wait complete. 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f727ae81640 1 Processor -- start 2024-09-16T09:42:49.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f727ae81640 1 -- start start 2024-09-16T09:42:49.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f727ae81640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274100790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f727ae81640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f7274100cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f727ae81640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f727410ee60 con 0x7f7274102b30 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f727ae81640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f727410ece0 con 0x7f7274103450 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f7278c1d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274100790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f7273fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f7274100cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f7273fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f7274100cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:50566/0 (socket says 172.21.15.111:50566) 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f7278c1d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274100790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45826/0 (socket says 172.21.15.111:45826) 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.817+0000 7f7273fff640 1 -- 172.21.15.111:0/2498707661 learned_addr learned my addr 172.21.15.111:0/2498707661 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7273fff640 1 -- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 msgr2=0x7f7274100790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7273fff640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274100790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:49.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7273fff640 1 -- 172.21.15.111:0/2498707661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7274101210 con 0x7f7274103450 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7278c1d640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7273fff640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f7274100cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f726000b420 tx=0x7f726000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7260011630 con 0x7f7274103450 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7274101500 con 0x7f7274103450 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7260016070 con 0x7f7274103450 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.818+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7260010d40 con 0x7f7274103450 2024-09-16T09:42:49.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.819+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72741a3f70 con 0x7f7274103450 2024-09-16T09:42:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.820+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f727406abd0 con 0x7f7274103450 2024-09-16T09:42:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.821+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f72600117d0 con 0x7f7274103450 2024-09-16T09:42:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.821+0000 7f7271ffb640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f726406e310 0x7f72640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.821+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f726008d550 con 0x7f7274103450 2024-09-16T09:42:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.821+0000 7f7278c1d640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f726406e310 0x7f72640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:49.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.822+0000 7f7278c1d640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f726406e310 0x7f72640707d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7268000c00 tx=0x7f7268031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:49.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.826+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f726005b270 con 0x7f7274103450 2024-09-16T09:42:49.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.996+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7274101cf0 con 0x7f7274103450 2024-09-16T09:42:49.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.997+0000 7f7271ffb640 1 -- 172.21.15.111:0/2498707661 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7274101cf0 con 0x7f7274103450 2024-09-16T09:42:49.999 INFO:teuthology.orchestra.run.smithi111.stdout:60129542173 2024-09-16T09:42:50.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f726406e310 msgr2=0x7f72640707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:50.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f726406e310 0x7f72640707d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7268000c00 tx=0x7f7268031400 comp rx=0 tx=0).stop 2024-09-16T09:42:50.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 msgr2=0x7f7274100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:50.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f7274100cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f726000b420 tx=0x7f726000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 shutdown_connections 2024-09-16T09:42:50.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f726406e310 0x7f72640707d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7274103450 0x7f7274100cd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 --2- 172.21.15.111:0/2498707661 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7274102b30 0x7f7274100790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 >> 172.21.15.111:0/2498707661 conn(0x7f72740fc510 msgr2=0x7f7274107e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:50.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 shutdown_connections 2024-09-16T09:42:50.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:49.999+0000 7f727ae81640 1 -- 172.21.15.111:0/2498707661 wait complete. 2024-09-16T09:42:50.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:49 smithi111 ceph-mon[27997]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:50.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:49 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/565437723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T09:42:50.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:49 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:49 smithi114 ceph-mon[35635]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:49 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/565437723' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-16T09:42:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:49 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:42:50.501 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378646 got 81604378647 for osd.2 2024-09-16T09:42:50.502 DEBUG:teuthology.parallel:result is None 2024-09-16T09:42:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 -- 172.21.15.111:0/622398149 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 msgr2=0x7fa4a8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 --2- 172.21.15.111:0/622398149 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8106c00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4009880 tx=0x7fa4a402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 -- 172.21.15.111:0/622398149 shutdown_connections 2024-09-16T09:42:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 --2- 172.21.15.111:0/622398149 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 0x7fa4a8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 --2- 172.21.15.111:0/622398149 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8106c00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 -- 172.21.15.111:0/622398149 >> 172.21.15.111:0/622398149 conn(0x7fa4a80fc520 msgr2=0x7fa4a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 -- 172.21.15.111:0/622398149 shutdown_connections 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.937+0000 7fa4afa24640 1 -- 172.21.15.111:0/622398149 wait complete. 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.938+0000 7fa4afa24640 1 Processor -- start 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.938+0000 7fa4afa24640 1 -- start start 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.938+0000 7fa4afa24640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 0x7fa4a8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.938+0000 7fa4afa24640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.938+0000 7fa4afa24640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a810dd50 con 0x7fa4a8106820 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.938+0000 7fa4afa24640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a810dbd0 con 0x7fa4a8100820 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45846/0 (socket says 172.21.15.111:45846) 2024-09-16T09:42:50.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 -- 172.21.15.111:0/184400369 learned_addr learned my addr 172.21.15.111:0/184400369 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4ad7c0640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 0x7fa4a8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 -- 172.21.15.111:0/184400369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 msgr2=0x7fa4a8198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 0x7fa4a8198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 -- 172.21.15.111:0/184400369 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a81993a0 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4ad7c0640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 0x7fa4a8198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4acfbf640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8198da0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00b420 tx=0x7fa49c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa49c011630 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a8199690 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa49c016070 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa49c010d40 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.939+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a81a1c90 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.940+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a8101f60 con 0x7fa4a8106820 2024-09-16T09:42:50.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.941+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fa49c01b460 con 0x7fa4a8106820 2024-09-16T09:42:50.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.941+0000 7fa49a7fc640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa49406e2b0 0x7fa494070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:50.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.941+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fa49c08d680 con 0x7fa4a8106820 2024-09-16T09:42:50.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.941+0000 7fa4ad7c0640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa49406e2b0 0x7fa494070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:50.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.941+0000 7fa4ad7c0640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa49406e2b0 0x7fa494070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4006010 tx=0x7fa4a40095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:50.961 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:50.945+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4a8199690 con 0x7fa4a8106820 2024-09-16T09:42:51.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:50 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2498707661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T09:42:51.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.138+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa4a8108d90 con 0x7fa4a8106820 2024-09-16T09:42:51.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.139+0000 7fa49a7fc640 1 -- 172.21.15.111:0/184400369 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa49c05b320 con 0x7fa4a8106820 2024-09-16T09:42:51.142 INFO:teuthology.orchestra.run.smithi111.stdout:158913789960 2024-09-16T09:42:51.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.140+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa49406e2b0 msgr2=0x7fa494070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:51.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa49406e2b0 0x7fa494070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa4a4006010 tx=0x7fa4a40095f0 comp rx=0 tx=0).stop 2024-09-16T09:42:51.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 msgr2=0x7fa4a8198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:51.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8198da0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa49c00b420 tx=0x7fa49c00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:51.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 shutdown_connections 2024-09-16T09:42:51.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa49406e2b0 0x7fa494070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:51.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4a8106820 0x7fa4a8198da0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:51.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 --2- 172.21.15.111:0/184400369 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4a8100820 0x7fa4a8198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:51.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 >> 172.21.15.111:0/184400369 conn(0x7fa4a80fc520 msgr2=0x7fa4a80fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:51.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 shutdown_connections 2024-09-16T09:42:51.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:51.141+0000 7fa4afa24640 1 -- 172.21.15.111:0/184400369 wait complete. 2024-09-16T09:42:51.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:50 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2498707661' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-16T09:42:51.853 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789959 got 158913789960 for osd.5 2024-09-16T09:42:51.853 DEBUG:teuthology.parallel:result is None 2024-09-16T09:42:52.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:51 smithi111 ceph-mon[27997]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:52.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:51 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/184400369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T09:42:52.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:51 smithi114 ceph-mon[35635]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:52.413 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:51 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/184400369' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-16T09:42:52.510 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542173 for osd.1 2024-09-16T09:42:52.511 DEBUG:teuthology.parallel:result is None 2024-09-16T09:42:52.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 -- 172.21.15.111:0/879960467 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc103400 msgr2=0x7f62fc10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:52.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 --2- 172.21.15.111:0/879960467 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc103400 0x7f62fc10b8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f62ec009880 tx=0x7f62ec02a530 comp rx=0 tx=0).stop 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 -- 172.21.15.111:0/879960467 shutdown_connections 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 --2- 172.21.15.111:0/879960467 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc103400 0x7f62fc10b8f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 --2- 172.21.15.111:0/879960467 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62fc102ae0 0x7f62fc102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 -- 172.21.15.111:0/879960467 >> 172.21.15.111:0/879960467 conn(0x7f62fc0fc520 msgr2=0x7f62fc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 -- 172.21.15.111:0/879960467 shutdown_connections 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 -- 172.21.15.111:0/879960467 wait complete. 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 Processor -- start 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.711+0000 7f63047e5640 1 -- start start 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f63047e5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 0x7f62fc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f63047e5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62fc103400 0x7f62fc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f63047e5640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc10ee70 con 0x7f62fc102ae0 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f63047e5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f62fc10ecf0 con 0x7f62fc103400 2024-09-16T09:42:52.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 0x7f62fc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 0x7f62fc19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45862/0 (socket says 172.21.15.111:45862) 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 -- 172.21.15.111:0/3453051483 learned_addr learned my addr 172.21.15.111:0/3453051483 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6301d80640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62fc103400 0x7f62fc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 -- 172.21.15.111:0/3453051483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62fc103400 msgr2=0x7f62fc19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62fc103400 0x7f62fc19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 -- 172.21.15.111:0/3453051483 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc197880 con 0x7f62fc102ae0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f6302581640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 0x7f62fc19d6c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f62f800b420 tx=0x7f62f800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62f8011630 con 0x7f62fc102ae0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62f8016070 con 0x7f62fc102ae0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62fc197b70 con 0x7f62fc102ae0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62f8010d40 con 0x7f62fc102ae0 2024-09-16T09:42:52.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.712+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62fc1980d0 con 0x7f62fc102ae0 2024-09-16T09:42:52.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.713+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62fc06abe0 con 0x7f62fc102ae0 2024-09-16T09:42:52.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.714+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f62f801b460 con 0x7f62fc102ae0 2024-09-16T09:42:52.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.714+0000 7f62f37fe640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f62e806e310 0x7f62e80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:52.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.714+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f62f808d620 con 0x7f62fc102ae0 2024-09-16T09:42:52.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.714+0000 7f6301d80640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f62e806e310 0x7f62e80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:52.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.715+0000 7f6301d80640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f62e806e310 0x7f62e80707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62fc199070 tx=0x7f62ec031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:52.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.719+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62f805eff0 con 0x7f62fc102ae0 2024-09-16T09:42:52.774 INFO:teuthology.orchestra.run.smithi111.stdout:137438953485 2024-09-16T09:42:52.774 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-16T09:42:52.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.892+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f62fc198db0 con 0x7f62fc102ae0 2024-09-16T09:42:52.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.892+0000 7f62f37fe640 1 -- 172.21.15.111:0/3453051483 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f62f808d440 con 0x7f62fc102ae0 2024-09-16T09:42:52.895 INFO:teuthology.orchestra.run.smithi111.stdout:107374182417 2024-09-16T09:42:52.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f62e806e310 msgr2=0x7f62e80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:52.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f62e806e310 0x7f62e80707d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f62fc199070 tx=0x7f62ec031400 comp rx=0 tx=0).stop 2024-09-16T09:42:52.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 msgr2=0x7f62fc19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:52.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 0x7f62fc19d6c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f62f800b420 tx=0x7f62f800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 shutdown_connections 2024-09-16T09:42:52.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f62e806e310 0x7f62e80707d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f62fc103400 0x7f62fc19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 --2- 172.21.15.111:0/3453051483 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62fc102ae0 0x7f62fc19d6c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:52.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.894+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 >> 172.21.15.111:0/3453051483 conn(0x7f62fc0fc520 msgr2=0x7f62fc108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:52.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.895+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 shutdown_connections 2024-09-16T09:42:52.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:52.895+0000 7f63047e5640 1 -- 172.21.15.111:0/3453051483 wait complete. 2024-09-16T09:42:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:52 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3453051483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T09:42:53.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:52 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3453051483' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-16T09:42:53.527 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182416 got 107374182417 for osd.3 2024-09-16T09:42:53.527 DEBUG:teuthology.parallel:result is None 2024-09-16T09:42:53.566 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:54.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:53 smithi111 ceph-mon[27997]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:54.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.019+0000 7f79a8e36640 1 -- 172.21.15.111:0/2823000287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 msgr2=0x7f79a4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:54.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.019+0000 7f79a8e36640 1 --2- 172.21.15.111:0/2823000287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a4100c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f798c009880 tx=0x7f798c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 -- 172.21.15.111:0/2823000287 shutdown_connections 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 --2- 172.21.15.111:0/2823000287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a4100c40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 --2- 172.21.15.111:0/2823000287 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79a41067e0 0x7f79a4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 -- 172.21.15.111:0/2823000287 >> 172.21.15.111:0/2823000287 conn(0x7f79a40fc4c0 msgr2=0x7f79a40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 -- 172.21.15.111:0/2823000287 shutdown_connections 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 -- 172.21.15.111:0/2823000287 wait complete. 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.020+0000 7f79a8e36640 1 Processor -- start 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a8e36640 1 -- start start 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a8e36640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a41023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a8e36640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79a41067e0 0x7f79a41028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a8e36640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410dd10 con 0x7f79a41007e0 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a8e36640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f79a410db90 con 0x7f79a41067e0 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a41023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:54.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a41023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56050/0 (socket says 172.21.15.111:56050) 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 -- 172.21.15.111:0/1845231880 learned_addr learned my addr 172.21.15.111:0/1845231880 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f799bfff640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79a41067e0 0x7f79a41028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 -- 172.21.15.111:0/1845231880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79a41067e0 msgr2=0x7f79a41028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79a41067e0 0x7f79a41028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 -- 172.21.15.111:0/1845231880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a4102e30 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a259c640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a41023b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f799400b420 tx=0x7f799400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7994011630 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a4103120 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7994016070 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.021+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7994010d40 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.022+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a41a3ea0 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.023+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a4101f20 con 0x7f79a41007e0 2024-09-16T09:42:54.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.023+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f799401b460 con 0x7f79a41007e0 2024-09-16T09:42:54.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.024+0000 7f799b7fe640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f799006e2b0 0x7f7990070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:54.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.024+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f799408d6e0 con 0x7f79a41007e0 2024-09-16T09:42:54.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.024+0000 7f799bfff640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f799006e2b0 0x7f7990070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:54.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.024+0000 7f799bfff640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f799006e2b0 0x7f7990070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79a4103e40 tx=0x7f798c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:54.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.029+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f799405b380 con 0x7f79a41007e0 2024-09-16T09:42:54.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.202+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f79a41a41c0 con 0x7f79a41007e0 2024-09-16T09:42:54.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.203+0000 7f799b7fe640 1 -- 172.21.15.111:0/1845231880 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f799405f030 con 0x7f79a41007e0 2024-09-16T09:42:54.205 INFO:teuthology.orchestra.run.smithi111.stdout:137438953486 2024-09-16T09:42:54.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f799006e2b0 msgr2=0x7f7990070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f799006e2b0 0x7f7990070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f79a4103e40 tx=0x7f798c031400 comp rx=0 tx=0).stop 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 msgr2=0x7f79a41023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a41023b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f799400b420 tx=0x7f799400b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 shutdown_connections 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f799006e2b0 0x7f7990070770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f79a41067e0 0x7f79a41028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 --2- 172.21.15.111:0/1845231880 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a41007e0 0x7f79a41023b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 >> 172.21.15.111:0/1845231880 conn(0x7f79a40fc4c0 msgr2=0x7f79a41045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 shutdown_connections 2024-09-16T09:42:54.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:54.205+0000 7f79a8e36640 1 -- 172.21.15.111:0/1845231880 wait complete. 2024-09-16T09:42:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:53 smithi114 ceph-mon[35635]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:54.886 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953485 got 137438953486 for osd.4 2024-09-16T09:42:54.886 DEBUG:teuthology.parallel:result is None 2024-09-16T09:42:54.886 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-16T09:42:54.886 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T09:42:55.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:54 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1845231880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T09:42:55.178 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:54 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1845231880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.741+0000 7efe3805b640 1 -- 172.21.15.111:0/2304232065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 msgr2=0x7efe30074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.741+0000 7efe3805b640 1 --2- 172.21.15.111:0/2304232065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe30074970 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009880 tx=0x7efe2c02a530 comp rx=0 tx=0).stop 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.741+0000 7efe3805b640 1 -- 172.21.15.111:0/2304232065 shutdown_connections 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.741+0000 7efe3805b640 1 --2- 172.21.15.111:0/2304232065 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe30074eb0 0x7efe301123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.741+0000 7efe3805b640 1 --2- 172.21.15.111:0/2304232065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe30074970 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.741+0000 7efe3805b640 1 -- 172.21.15.111:0/2304232065 >> 172.21.15.111:0/2304232065 conn(0x7efe300fd620 msgr2=0x7efe300ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:55.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 -- 172.21.15.111:0/2304232065 shutdown_connections 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 -- 172.21.15.111:0/2304232065 wait complete. 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 Processor -- start 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 -- start start 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe3019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe30074eb0 0x7efe3019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efe301153d0 con 0x7efe30074590 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe3805b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efe30115250 con 0x7efe30074eb0 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe35df7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe3019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe35df7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe3019dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56064/0 (socket says 172.21.15.111:56064) 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.742+0000 7efe35df7640 1 -- 172.21.15.111:0/4047513093 learned_addr learned my addr 172.21.15.111:0/4047513093 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe355f6640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe30074eb0 0x7efe3019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe35df7640 1 -- 172.21.15.111:0/4047513093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe30074eb0 msgr2=0x7efe3019e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:55.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe35df7640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe30074eb0 0x7efe3019e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe35df7640 1 -- 172.21.15.111:0/4047513093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3019eba0 con 0x7efe30074590 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe35df7640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe3019dfb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe2c031460 tx=0x7efe2c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe2c03f070 con 0x7efe30074590 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efe2c004cf0 con 0x7efe30074590 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe301a28e0 con 0x7efe30074590 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efe2c035030 con 0x7efe30074590 2024-09-16T09:42:55.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.743+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe301a2e10 con 0x7efe30074590 2024-09-16T09:42:55.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.744+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe30075cd0 con 0x7efe30074590 2024-09-16T09:42:55.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.744+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7efe2c042070 con 0x7efe30074590 2024-09-16T09:42:55.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.745+0000 7efe26ffd640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efe1c06e2b0 0x7efe1c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:55.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.745+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7efe2c0ae8a0 con 0x7efe30074590 2024-09-16T09:42:55.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.745+0000 7efe355f6640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efe1c06e2b0 0x7efe1c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:55.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.745+0000 7efe355f6640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efe1c06e2b0 0x7efe1c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe301047f0 tx=0x7efe20005cc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:55.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.749+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efe2c07c540 con 0x7efe30074590 2024-09-16T09:42:55.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.915+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe3010f5f0 con 0x7efe1c06e2b0 2024-09-16T09:42:55.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.916+0000 7efe26ffd640 1 -- 172.21.15.111:0/4047513093 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7efe3010f5f0 con 0x7efe1c06e2b0 2024-09-16T09:42:55.919 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:55.919 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efe1c06e2b0 msgr2=0x7efe1c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efe1c06e2b0 0x7efe1c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe301047f0 tx=0x7efe20005cc0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 msgr2=0x7efe3019dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe3019dfb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efe2c031460 tx=0x7efe2c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 shutdown_connections 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7efe1c06e2b0 0x7efe1c070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efe30074eb0 0x7efe3019e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 --2- 172.21.15.111:0/4047513093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe30074590 0x7efe3019dfb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:55.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 >> 172.21.15.111:0/4047513093 conn(0x7efe300fd620 msgr2=0x7efe30104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:55.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 shutdown_connections 2024-09-16T09:42:55.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:55.918+0000 7efe3805b640 1 -- 172.21.15.111:0/4047513093 wait complete. 2024-09-16T09:42:56.232 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:55 smithi111 ceph-mon[27997]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:55 smithi114 ceph-mon[35635]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:56.585 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-16T09:42:54.889135+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178448,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":174518,"kb_avail":562292464,"statfs":{"total":575970213888,"available":575787483136,"internally_reserved":0,"allocated":3870720,"data_stored":2566116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":178707105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001748"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T09:42:26.577105+0000","last_change":"2024-09-16T09:42:00.102329+0000","last_active":"2024-09-16T09:42:26.577105+0000","last_peered":"2024-09-16T09:42:26.577105+0000","last_clean":"2024-09-16T09:42:26.577105+0000","last_became_active":"2024-09-16T09:42:00.102034+0000","last_became_peered":"2024-09-16T09:42:00.102034+0000","last_unstale":"2024-09-16T09:42:26.577105+0000","last_undegraded":"2024-09-16T09:42:26.577105+0000","last_fullsized":"2024-09-16T09:42:26.577105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T09:41:09.860685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T09:41:09.860685+0000","last_clean_scrub_stamp":"2024-09-16T09:41:09.860685+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:44:17.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717784,"statfs":{"total":95995035648,"available":95967010816,"internally_reserved":0,"allocated":348160,"data_stored":132502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953486,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717780,"statfs":{"total":95995035648,"available":95967006720,"internally_reserved":0,"allocated":348160,"data_stored":132502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182418,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":942080,"data_stored":722870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713624,"statfs":{"total":95995035648,"available":95962750976,"internally_reserved":0,"allocated":348160,"data_stored":132502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":942080,"data_stored":722870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":722870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T09:42:56.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-16T09:42:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:57.228 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:56 smithi111 ceph-mon[27997]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T09:42:57.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 -- 172.21.15.111:0/2185045148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 msgr2=0x7ff48c101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 --2- 172.21.15.111:0/2185045148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c101d50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff478009880 tx=0x7ff47802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 -- 172.21.15.111:0/2185045148 shutdown_connections 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 --2- 172.21.15.111:0/2185045148 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c101d50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 --2- 172.21.15.111:0/2185045148 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c1078f0 0x7ff48c107cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 -- 172.21.15.111:0/2185045148 >> 172.21.15.111:0/2185045148 conn(0x7ff48c0fd630 msgr2=0x7ff48c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 -- 172.21.15.111:0/2185045148 shutdown_connections 2024-09-16T09:42:57.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 -- 172.21.15.111:0/2185045148 wait complete. 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.305+0000 7ff492c57640 1 Processor -- start 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff492c57640 1 -- start start 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff492c57640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff492c57640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c1078f0 0x7ff48c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff492c57640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c10ee20 con 0x7ff48c1018f0 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff492c57640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c10eca0 con 0x7ff48c1078f0 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:57.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56072/0 (socket says 172.21.15.111:56072) 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 -- 172.21.15.111:0/1141606894 learned_addr learned my addr 172.21.15.111:0/1141606894 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff48bfff640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c1078f0 0x7ff48c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 -- 172.21.15.111:0/1141606894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c1078f0 msgr2=0x7ff48c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c1078f0 0x7ff48c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 -- 172.21.15.111:0/1141606894 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c074f70 con 0x7ff48c1018f0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff4909f3640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c0744f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b420 tx=0x7ff48000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff480011630 con 0x7ff48c1018f0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.306+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c075260 con 0x7ff48c1018f0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.307+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff480016070 con 0x7ff48c1018f0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.307+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff480010d40 con 0x7ff48c1018f0 2024-09-16T09:42:57.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.307+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c1a3e90 con 0x7ff48c1018f0 2024-09-16T09:42:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.308+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c103030 con 0x7ff48c1018f0 2024-09-16T09:42:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.308+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff48001b460 con 0x7ff48c1018f0 2024-09-16T09:42:57.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.309+0000 7ff489ffb640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff47c06e2b0 0x7ff47c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.309+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff48008d640 con 0x7ff48c1018f0 2024-09-16T09:42:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.309+0000 7ff48bfff640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff47c06e2b0 0x7ff47c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:57.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.309+0000 7ff48bfff640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff47c06e2b0 0x7ff47c070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff48c075f80 tx=0x7ff478031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:57.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.313+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff48005b2e0 con 0x7ff48c1018f0 2024-09-16T09:42:57.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:56 smithi114 ceph-mon[35635]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T09:42:57.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.476+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff48c062630 con 0x7ff47c06e2b0 2024-09-16T09:42:57.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.477+0000 7ff489ffb640 1 -- 172.21.15.111:0/1141606894 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7ff48c062630 con 0x7ff47c06e2b0 2024-09-16T09:42:57.479 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:57.480 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-09-16T09:42:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff47c06e2b0 msgr2=0x7ff47c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff47c06e2b0 0x7ff47c070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff48c075f80 tx=0x7ff478031400 comp rx=0 tx=0).stop 2024-09-16T09:42:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 msgr2=0x7ff48c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:57.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c0744f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff48000b420 tx=0x7ff48000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 shutdown_connections 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff47c06e2b0 0x7ff47c070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff48c1078f0 0x7ff48c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 --2- 172.21.15.111:0/1141606894 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff48c1018f0 0x7ff48c0744f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 >> 172.21.15.111:0/1141606894 conn(0x7ff48c0fd630 msgr2=0x7ff48c0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 shutdown_connections 2024-09-16T09:42:57.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:57.479+0000 7ff492c57640 1 -- 172.21.15.111:0/1141606894 wait complete. 2024-09-16T09:42:58.042 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2024-09-16T09:42:56.889509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":178448,"kb_used_data":3780,"kb_used_omap":9,"kb_used_meta":174518,"kb_avail":562292464,"statfs":{"total":575970213888,"available":575787483136,"internally_reserved":0,"allocated":3870720,"data_stored":2566116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":178707105},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001846"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":191,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-16T09:42:26.577105+0000","last_change":"2024-09-16T09:42:00.102329+0000","last_active":"2024-09-16T09:42:26.577105+0000","last_peered":"2024-09-16T09:42:26.577105+0000","last_clean":"2024-09-16T09:42:26.577105+0000","last_became_active":"2024-09-16T09:42:00.102034+0000","last_became_peered":"2024-09-16T09:42:00.102034+0000","last_unstale":"2024-09-16T09:42:26.577105+0000","last_undegraded":"2024-09-16T09:42:26.577105+0000","last_fullsized":"2024-09-16T09:42:26.577105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-16T09:41:09.860685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-16T09:41:09.860685+0000","last_clean_scrub_stamp":"2024-09-16T09:41:09.860685+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T14:44:17.971596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717784,"statfs":{"total":95995035648,"available":95967010816,"internally_reserved":0,"allocated":348160,"data_stored":132502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953487,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27372,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717780,"statfs":{"total":95995035648,"available":95967006720,"internally_reserved":0,"allocated":348160,"data_stored":132502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182418,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":942080,"data_stored":722870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":31528,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713624,"statfs":{"total":95995035648,"available":95962750976,"internally_reserved":0,"allocated":348160,"data_stored":132502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":942080,"data_stored":722870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705701,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":942080,"data_stored":722870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-16T09:42:58.043 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-16T09:42:58.043 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-16T09:42:58.043 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-16T09:42:58.043 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-16T09:42:58.287 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:42:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:57 smithi111 ceph-mon[27997]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:58.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:57 smithi114 ceph-mon[35635]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 -- 172.21.15.111:0/961796653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 msgr2=0x7f3ee8100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 --2- 172.21.15.111:0/961796653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee8100c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4009880 tx=0x7f3ed402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 -- 172.21.15.111:0/961796653 shutdown_connections 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 --2- 172.21.15.111:0/961796653 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee8100c80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 --2- 172.21.15.111:0/961796653 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ee8106820 0x7f3ee8106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 -- 172.21.15.111:0/961796653 >> 172.21.15.111:0/961796653 conn(0x7f3ee80fc520 msgr2=0x7f3ee80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:58.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 -- 172.21.15.111:0/961796653 shutdown_connections 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 -- 172.21.15.111:0/961796653 wait complete. 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 Processor -- start 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.760+0000 7f3eef08c640 1 -- start start 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eef08c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eef08c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ee8106820 0x7f3ee819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eef08c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee810dcd0 con 0x7f3ee8100820 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eef08c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee810db50 con 0x7f3ee8106820 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56086/0 (socket says 172.21.15.111:56086) 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 -- 172.21.15.111:0/114461702 learned_addr learned my addr 172.21.15.111:0/114461702 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3ee7fff640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ee8106820 0x7f3ee819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 -- 172.21.15.111:0/114461702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ee8106820 msgr2=0x7f3ee819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:58.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ee8106820 0x7f3ee819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 -- 172.21.15.111:0/114461702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee81977c0 con 0x7f3ee8100820 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eece28640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee819d640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c810 tx=0x7f3edc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3edc004020 con 0x7f3ee8100820 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3edc0041c0 con 0x7f3ee8100820 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee8197ab0 con 0x7f3ee8100820 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.761+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3edc0047a0 con 0x7f3ee8100820 2024-09-16T09:42:58.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.762+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee8198010 con 0x7f3ee8100820 2024-09-16T09:42:58.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.763+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee8101f60 con 0x7f3ee8100820 2024-09-16T09:42:58.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.763+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f3edc0079b0 con 0x7f3ee8100820 2024-09-16T09:42:58.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.763+0000 7f3ee5ffb640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f3ed806e2b0 0x7f3ed8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:42:58.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.763+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f3edc08dc60 con 0x7f3ee8100820 2024-09-16T09:42:58.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.763+0000 7f3ee7fff640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f3ed806e2b0 0x7f3ed8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:42:58.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.764+0000 7f3ee7fff640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f3ed806e2b0 0x7f3ed8070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8198b10 tx=0x7f3ed4031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:42:58.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.768+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3edc014030 con 0x7f3ee8100820 2024-09-16T09:42:58.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.974+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f3ee8109dc0 con 0x7f3ee8100820 2024-09-16T09:42:58.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.974+0000 7f3ee5ffb640 1 -- 172.21.15.111:0/114461702 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f3edc055e20 con 0x7f3ee8100820 2024-09-16T09:42:58.977 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:42:58.977 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-16T09:42:58.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f3ed806e2b0 msgr2=0x7f3ed8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:58.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f3ed806e2b0 0x7f3ed8070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8198b10 tx=0x7f3ed4031400 comp rx=0 tx=0).stop 2024-09-16T09:42:58.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 msgr2=0x7f3ee819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:42:58.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee819d640 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00c810 tx=0x7f3edc00ccd0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 shutdown_connections 2024-09-16T09:42:58.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f3ed806e2b0 0x7f3ed8070770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3ee8106820 0x7f3ee819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 --2- 172.21.15.111:0/114461702 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ee8100820 0x7f3ee819d640 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:42:58.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.976+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 >> 172.21.15.111:0/114461702 conn(0x7f3ee80fc520 msgr2=0x7f3ee806a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:42:58.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.977+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 shutdown_connections 2024-09-16T09:42:58.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:42:58.977+0000 7f3eef08c640 1 -- 172.21.15.111:0/114461702 wait complete. 2024-09-16T09:42:59.329 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:58 smithi111 ceph-mon[27997]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T09:42:59.330 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:58 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/114461702' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T09:42:59.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:58 smithi114 ceph-mon[35635]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-16T09:42:59.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:58 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/114461702' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-16T09:42:59.742 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-16T09:42:59.742 INFO:tasks.cephadm:Setup complete, yielding 2024-09-16T09:42:59.742 INFO:teuthology.run_tasks:Running task print... 2024-09-16T09:42:59.751 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-16T09:42:59.752 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:42:59.762 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:42:59.762 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-16T09:43:00.012 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:42:59 smithi114 ceph-mon[35635]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:00.256 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:42:59 smithi111 ceph-mon[27997]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:00.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.431+0000 7fa112467640 1 -- 172.21.15.111:0/4043576676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 msgr2=0x7fa10c101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:00.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.431+0000 7fa112467640 1 --2- 172.21.15.111:0/4043576676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c101f00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa100009880 tx=0x7fa10002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.431+0000 7fa112467640 1 -- 172.21.15.111:0/4043576676 shutdown_connections 2024-09-16T09:43:00.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.431+0000 7fa112467640 1 --2- 172.21.15.111:0/4043576676 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c101f00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.431+0000 7fa112467640 1 --2- 172.21.15.111:0/4043576676 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa10c100880 0x7fa10c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.431+0000 7fa112467640 1 -- 172.21.15.111:0/4043576676 >> 172.21.15.111:0/4043576676 conn(0x7fa10c0fc010 msgr2=0x7fa10c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 -- 172.21.15.111:0/4043576676 shutdown_connections 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 -- 172.21.15.111:0/4043576676 wait complete. 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 Processor -- start 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 -- start start 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa10c100880 0x7fa10c06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c19c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c1096a0 con 0x7fa10c101a80 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.432+0000 7fa112467640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa10c109520 con 0x7fa10c100880 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c19c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:00.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c19c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56104/0 (socket says 172.21.15.111:56104) 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 -- 172.21.15.111:0/2146659714 learned_addr learned my addr 172.21.15.111:0/2146659714 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10bfff640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa10c100880 0x7fa10c06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 -- 172.21.15.111:0/2146659714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa10c100880 msgr2=0x7fa10c06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa10c100880 0x7fa10c06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 -- 172.21.15.111:0/2146659714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa10c19c7a0 con 0x7fa10c101a80 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa10b7fe640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c19c1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa100006010 tx=0x7fa1000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa10003f070 con 0x7fa10c101a80 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa10c19ca30 con 0x7fa10c101a80 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1000044d0 con 0x7fa10c101a80 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa100035030 con 0x7fa10c101a80 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.433+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa10c19cf60 con 0x7fa10c101a80 2024-09-16T09:43:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.434+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa10c100c80 con 0x7fa10c101a80 2024-09-16T09:43:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.435+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fa100042070 con 0x7fa10c101a80 2024-09-16T09:43:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.435+0000 7fa1097fa640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa0f406e2b0 0x7fa0f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.435+0000 7fa10bfff640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa0f406e2b0 0x7fa0f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.435+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fa1000aebf0 con 0x7fa10c101a80 2024-09-16T09:43:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.436+0000 7fa10bfff640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa0f406e2b0 0x7fa0f4070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc005db0 tx=0x7fa0fc005d40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.439+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa10007c800 con 0x7fa10c101a80 2024-09-16T09:43:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.605+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7fa10c062fb0 con 0x7fa10c101a80 2024-09-16T09:43:00.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.608+0000 7fa1097fa640 1 -- 172.21.15.111:0/2146659714 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v41)=0 v41) ==== 143+0+0 (secure 0 0 0) 0x7fa1000804b0 con 0x7fa10c101a80 2024-09-16T09:43:00.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa0f406e2b0 msgr2=0x7fa0f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:00.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa0f406e2b0 0x7fa0f4070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc005db0 tx=0x7fa0fc005d40 comp rx=0 tx=0).stop 2024-09-16T09:43:00.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 msgr2=0x7fa10c19c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:00.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c19c1e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa100006010 tx=0x7fa1000048f0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 shutdown_connections 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa0f406e2b0 0x7fa0f4070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa10c101a80 0x7fa10c19c1e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 --2- 172.21.15.111:0/2146659714 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa10c100880 0x7fa10c06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 >> 172.21.15.111:0/2146659714 conn(0x7fa10c0fc010 msgr2=0x7fa10c104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 shutdown_connections 2024-09-16T09:43:00.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:00.611+0000 7fa112467640 1 -- 172.21.15.111:0/2146659714 wait complete. 2024-09-16T09:43:01.324 INFO:teuthology.run_tasks:Running task print... 2024-09-16T09:43:01.333 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-16T09:43:01.333 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:43:01.363 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:01.363 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-16T09:43:01.609 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:01.875 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:01 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2146659714' entity='client.admin' 2024-09-16T09:43:01.876 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:01.876 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:01.876 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:01.876 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:01 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:01.876 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:01 smithi111 ceph-mon[27997]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:01.928 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:01 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2146659714' entity='client.admin' 2024-09-16T09:43:01.928 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:01.928 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:01.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:01.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:01 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:01.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:01 smithi114 ceph-mon[35635]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:02.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.062+0000 7f6f396a7640 1 -- 172.21.15.111:0/667335264 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 msgr2=0x7f6f341071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.062+0000 7f6f396a7640 1 --2- 172.21.15.111:0/667335264 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f341071c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009880 tx=0x7f6f1c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 -- 172.21.15.111:0/667335264 shutdown_connections 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 --2- 172.21.15.111:0/667335264 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f341071c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 --2- 172.21.15.111:0/667335264 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 0x7f6f34104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 -- 172.21.15.111:0/667335264 >> 172.21.15.111:0/667335264 conn(0x7f6f340fc020 msgr2=0x7f6f340fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 -- 172.21.15.111:0/667335264 shutdown_connections 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 -- 172.21.15.111:0/667335264 wait complete. 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 Processor -- start 2024-09-16T09:43:02.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 -- start start 2024-09-16T09:43:02.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 0x7f6f341974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:02.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.063+0000 7f6f396a7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f34197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:02.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f396a7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3410a790 con 0x7f6f34104dd0 2024-09-16T09:43:02.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f396a7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3410a610 con 0x7f6f341024a0 2024-09-16T09:43:02.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f34197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:02.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f34197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56126/0 (socket says 172.21.15.111:56126) 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 -- 172.21.15.111:0/1551875096 learned_addr learned my addr 172.21.15.111:0/1551875096 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f32ffd640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 0x7f6f341974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 -- 172.21.15.111:0/1551875096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 msgr2=0x7f6f341974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 0x7f6f341974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 -- 172.21.15.111:0/1551875096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f34198010 con 0x7f6f34104dd0 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f32ffd640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 0x7f6f341974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f2a7fc640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f34197a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009230 tx=0x7f6f1c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c03f070 con 0x7f6f34104dd0 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f3419ca20 con 0x7f6f34104dd0 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f1c0044d0 con 0x7f6f34104dd0 2024-09-16T09:43:02.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f1c035030 con 0x7f6f34104dd0 2024-09-16T09:43:02.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.064+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f3419cf20 con 0x7f6f34104dd0 2024-09-16T09:43:02.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.066+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f34102880 con 0x7f6f34104dd0 2024-09-16T09:43:02.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.066+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f6f1c042070 con 0x7f6f34104dd0 2024-09-16T09:43:02.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.066+0000 7f6f30ff9640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6f2006e2b0 0x7f6f20070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:02.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.067+0000 7f6f32ffd640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6f2006e2b0 0x7f6f20070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:02.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.067+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f6f1c0aea90 con 0x7f6f34104dd0 2024-09-16T09:43:02.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.067+0000 7f6f32ffd640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6f2006e2b0 0x7f6f20070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400abe0 tx=0x7f6f2400a5c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.071+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6f1c07c730 con 0x7f6f34104dd0 2024-09-16T09:43:02.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.253+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f6f34105750 con 0x7f6f2006e2b0 2024-09-16T09:43:02.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.254+0000 7f6f30ff9640 1 -- 172.21.15.111:0/1551875096 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f6f34105750 con 0x7f6f2006e2b0 2024-09-16T09:43:02.256 INFO:teuthology.orchestra.run.smithi111.stdout:Backend: cephadm 2024-09-16T09:43:02.256 INFO:teuthology.orchestra.run.smithi111.stdout:Available: Yes 2024-09-16T09:43:02.256 INFO:teuthology.orchestra.run.smithi111.stdout:Paused: No 2024-09-16T09:43:02.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6f2006e2b0 msgr2=0x7f6f20070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:02.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6f2006e2b0 0x7f6f20070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400abe0 tx=0x7f6f2400a5c0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 msgr2=0x7f6f34197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:02.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f34197a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009230 tx=0x7f6f1c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 shutdown_connections 2024-09-16T09:43:02.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f6f2006e2b0 0x7f6f20070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f34104dd0 0x7f6f34197a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 --2- 172.21.15.111:0/1551875096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f341024a0 0x7f6f341974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:02.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 >> 172.21.15.111:0/1551875096 conn(0x7f6f340fc020 msgr2=0x7f6f340fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:02.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 shutdown_connections 2024-09-16T09:43:02.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:02.256+0000 7f6f396a7640 1 -- 172.21.15.111:0/1551875096 wait complete. 2024-09-16T09:43:02.835 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-16T09:43:03.081 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:03.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 -- 172.21.15.111:0/3194655289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 msgr2=0x7f14ec101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:03.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 --2- 172.21.15.111:0/3194655289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec101f00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009880 tx=0x7f14d402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 -- 172.21.15.111:0/3194655289 shutdown_connections 2024-09-16T09:43:03.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 --2- 172.21.15.111:0/3194655289 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec101f00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 --2- 172.21.15.111:0/3194655289 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14ec100880 0x7f14ec100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 -- 172.21.15.111:0/3194655289 >> 172.21.15.111:0/3194655289 conn(0x7f14ec0fc010 msgr2=0x7f14ec0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 -- 172.21.15.111:0/3194655289 shutdown_connections 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 -- 172.21.15.111:0/3194655289 wait complete. 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.525+0000 7f14f102d640 1 Processor -- start 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14f102d640 1 -- start start 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14f102d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14ec100880 0x7f14ec06adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14f102d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14f102d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec1096c0 con 0x7f14ec101a80 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14f102d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14ec109540 con 0x7f14ec100880 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec19c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59516/0 (socket says 172.21.15.111:59516) 2024-09-16T09:43:03.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 -- 172.21.15.111:0/3511680047 learned_addr learned my addr 172.21.15.111:0/3511680047 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14ead9d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14ec100880 0x7f14ec06adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 -- 172.21.15.111:0/3511680047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14ec100880 msgr2=0x7f14ec06adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14ec100880 0x7f14ec06adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 -- 172.21.15.111:0/3511680047 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ec19c7c0 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e3fff640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec19c200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f14d4006010 tx=0x7f14d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.526+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14d403f070 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.527+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ec19ca50 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.527+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14d4004ac0 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.527+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14d4035030 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.527+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ec19cf80 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.528+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ec100c80 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.528+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f14d4042070 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.528+0000 7f14e8d99640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d806e2b0 0x7f14d8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.529+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f14d40aea00 con 0x7f14ec101a80 2024-09-16T09:43:03.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.529+0000 7f14ead9d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d806e2b0 0x7f14d8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:03.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.529+0000 7f14ead9d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d806e2b0 0x7f14d8070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005fd0 tx=0x7f14dc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:03.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.533+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f14d40802c0 con 0x7f14ec101a80 2024-09-16T09:43:03.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.709+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f14ec0626f0 con 0x7f14d806e2b0 2024-09-16T09:43:03.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.717+0000 7f14e8d99640 1 -- 172.21.15.111:0/3511680047 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3080 (secure 0 0 0) 0x7f14ec0626f0 con 0x7f14d806e2b0 2024-09-16T09:43:03.719 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:43:03.719 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (3m) 117s ago 4m 26.4M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:43:03.719 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (5m) 117s ago 5m 7658k - 19.1.1-328-gad35db06 b5388489f99e 8786fd2f4c05 2024-09-16T09:43:03.719 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (4m) 42s ago 4m 5263k - 19.1.1-328-gad35db06 b5388489f99e 7fe7397f669d 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (5m) 117s ago 5m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (4m) 42s ago 4m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (3m) 117s ago 4m 76.1M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:9283,8765,8443 running (6m) 117s ago 6m 490M - 19.1.1-328-gad35db06 b5388489f99e f32e13ae383f 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (4m) 42s ago 4m 443M - 19.1.1-328-gad35db06 b5388489f99e 6d8deba4ede4 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (6m) 117s ago 6m 44.9M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (4m) 42s ago 4m 40.8M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 117s ago 5m 13.8M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (4m) 42s ago 4m 16.6M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (3m) 117s ago 3m 37.7M 3946M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (2m) 117s ago 2m 46.2M 3946M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (2m) 117s ago 2m 11.8M 3946M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (99s) 42s ago 98s 48.1M 4970M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:43:03.720 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (72s) 42s ago 72s 36.5M 4970M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:43:03.721 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (47s) 42s ago 47s 13.3M 4970M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:43:03.721 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (3m) 117s ago 4m 40.5M - 2.43.0 a07b618ecd1d ef0faa2f353d 2024-09-16T09:43:03.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d806e2b0 msgr2=0x7f14d8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:03.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d806e2b0 0x7f14d8070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005fd0 tx=0x7f14dc00b390 comp rx=0 tx=0).stop 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 msgr2=0x7f14ec19c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec19c200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f14d4006010 tx=0x7f14d40046c0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 shutdown_connections 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f14d806e2b0 0x7f14d8070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f14ec101a80 0x7f14ec19c200 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 --2- 172.21.15.111:0/3511680047 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f14ec100880 0x7f14ec06adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 >> 172.21.15.111:0/3511680047 conn(0x7f14ec0fc010 msgr2=0x7f14ec104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 shutdown_connections 2024-09-16T09:43:03.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:03.720+0000 7f14f102d640 1 -- 172.21.15.111:0/3511680047 wait complete. 2024-09-16T09:43:04.362 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:03 smithi111 ceph-mon[27997]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:04.363 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:03 smithi111 ceph-mon[27997]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:04.390 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-16T09:43:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:03 smithi114 ceph-mon[35635]: from='client.14522 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:03 smithi114 ceph-mon[35635]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:04.637 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:05.016 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:04 smithi111 ceph-mon[27997]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:05.016 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:05.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 -- 172.21.15.111:0/2277869790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0104d40 msgr2=0x7fa5d0107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:05.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/2277869790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0104d40 0x7fa5d0107130 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80098b0 tx=0x7fa5b802a4d0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 -- 172.21.15.111:0/2277869790 shutdown_connections 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/2277869790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0104d40 0x7fa5d0107130 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/2277869790 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d0102410 0x7fa5d0104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 -- 172.21.15.111:0/2277869790 >> 172.21.15.111:0/2277869790 conn(0x7fa5d00fc010 msgr2=0x7fa5d00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 -- 172.21.15.111:0/2277869790 shutdown_connections 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.094+0000 7fa5d63f3640 1 -- 172.21.15.111:0/2277869790 wait complete. 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5d63f3640 1 Processor -- start 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5d63f3640 1 -- start start 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5d63f3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 0x7fa5d01974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5d63f3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d0104d40 0x7fa5d0197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:05.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5d63f3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d010a7d0 con 0x7fa5d0102410 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5d63f3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa5d010a650 con 0x7fa5d0104d40 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 0x7fa5d01974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 0x7fa5d01974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59526/0 (socket says 172.21.15.111:59526) 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 -- 172.21.15.111:0/1598150298 learned_addr learned my addr 172.21.15.111:0/1598150298 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 -- 172.21.15.111:0/1598150298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d0104d40 msgr2=0x7fa5d0197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d0104d40 0x7fa5d0197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 -- 172.21.15.111:0/1598150298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5d01980b0 con 0x7fa5d0102410 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.095+0000 7fa5cffff640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 0x7fa5d01974f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000c8f0 tx=0x7fa5c000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.096+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5c00079b0 con 0x7fa5d0102410 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.096+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5c00054e0 con 0x7fa5d0102410 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.096+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5d019caf0 con 0x7fa5d0102410 2024-09-16T09:43:05.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.096+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5c0004dd0 con 0x7fa5d0102410 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.096+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5d019d080 con 0x7fa5d0102410 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.097+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5d01027f0 con 0x7fa5d0102410 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.097+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fa5c0005020 con 0x7fa5d0102410 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.098+0000 7fa5cdffb640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa5bc06e260 0x7fa5bc070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.098+0000 7fa5c7fff640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa5bc06e260 0x7fa5bc070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.098+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7fa5c008de20 con 0x7fa5d0102410 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.098+0000 7fa5c7fff640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa5bc06e260 0x7fa5bc070720 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80096c0 tx=0x7fa5b8000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:05.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.102+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa5c0014030 con 0x7fa5d0102410 2024-09-16T09:43:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:04 smithi114 ceph-mon[35635]: from='client.14526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:05.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.275+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fa5d0105600 con 0x7fa5bc06e260 2024-09-16T09:43:05.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.280+0000 7fa5cdffb640 1 -- 172.21.15.111:0/1598150298 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1310 (secure 0 0 0) 0x7fa5d0105600 con 0x7fa5bc06e260 2024-09-16T09:43:05.284 INFO:teuthology.orchestra.run.smithi111.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-16T09:43:05.284 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager ?:9093,9094 1/1 118s ago 5m count:1 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter 2/2 118s ago 5m * 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:crash 2/2 118s ago 5m * 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:grafana ?:3000 1/1 118s ago 5m count:1 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:mgr 2/2 118s ago 5m count:2 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:mon 2/2 118s ago 5m smithi111:172.21.15.111=smithi111;smithi114:172.21.15.114=smithi114;count:2 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter ?:9100 2/2 118s ago 5m * 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:osd 6 118s ago - 2024-09-16T09:43:05.285 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus ?:9095 1/1 118s ago 5m count:1 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa5bc06e260 msgr2=0x7fa5bc070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa5bc06e260 0x7fa5bc070720 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80096c0 tx=0x7fa5b8000bc0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 msgr2=0x7fa5d01974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 0x7fa5d01974f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000c8f0 tx=0x7fa5c000cdb0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 shutdown_connections 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa5bc06e260 0x7fa5bc070720 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa5d0104d40 0x7fa5d0197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 --2- 172.21.15.111:0/1598150298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa5d0102410 0x7fa5d01974f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 >> 172.21.15.111:0/1598150298 conn(0x7fa5d00fc010 msgr2=0x7fa5d00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 shutdown_connections 2024-09-16T09:43:05.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:05.283+0000 7fa5d63f3640 1 -- 172.21.15.111:0/1598150298 wait complete. 2024-09-16T09:43:05.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-16T09:43:06.251 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:06.371 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:05 smithi111 ceph-mon[27997]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:06.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:05 smithi114 ceph-mon[35635]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:06.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.703+0000 7ff869aea640 1 -- 172.21.15.111:0/533737625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864101990 msgr2=0x7ff864101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:06.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.703+0000 7ff869aea640 1 --2- 172.21.15.111:0/533737625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864101990 0x7ff864101d90 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff854009880 tx=0x7ff85402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.703+0000 7ff869aea640 1 -- 172.21.15.111:0/533737625 shutdown_connections 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.703+0000 7ff869aea640 1 --2- 172.21.15.111:0/533737625 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff864102b90 0x7ff864103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.703+0000 7ff869aea640 1 --2- 172.21.15.111:0/533737625 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864101990 0x7ff864101d90 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.703+0000 7ff869aea640 1 -- 172.21.15.111:0/533737625 >> 172.21.15.111:0/533737625 conn(0x7ff8640fd140 msgr2=0x7ff8640ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 -- 172.21.15.111:0/533737625 shutdown_connections 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 -- 172.21.15.111:0/533737625 wait complete. 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 Processor -- start 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 -- start start 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff864101990 0x7ff864075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 0x7ff8640745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410a830 con 0x7ff864102b90 2024-09-16T09:43:06.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff869aea640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff86410a6b0 con 0x7ff864101990 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 0x7ff8640745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff85bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 0x7ff8640745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59534/0 (socket says 172.21.15.111:59534) 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.704+0000 7ff85bfff640 1 -- 172.21.15.111:0/2754937270 learned_addr learned my addr 172.21.15.111:0/2754937270 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff85bfff640 1 -- 172.21.15.111:0/2754937270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff864101990 msgr2=0x7ff864075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff85bfff640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff864101990 0x7ff864075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff85bfff640 1 -- 172.21.15.111:0/2754937270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff864074b20 con 0x7ff864102b90 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff85bfff640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 0x7ff8640745e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00b420 tx=0x7ff84c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff84c011630 con 0x7ff864102b90 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff864074e10 con 0x7ff864102b90 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff84c016070 con 0x7ff864102b90 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff84c010d40 con 0x7ff864102b90 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.705+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff864075420 con 0x7ff864102b90 2024-09-16T09:43:06.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.706+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff864101d90 con 0x7ff864102b90 2024-09-16T09:43:06.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.707+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7ff84c01b460 con 0x7ff864102b90 2024-09-16T09:43:06.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.707+0000 7ff8617fa640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff85006e2b0 0x7ff850070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:06.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.707+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7ff84c08d6a0 con 0x7ff864102b90 2024-09-16T09:43:06.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.707+0000 7ff8637fe640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff85006e2b0 0x7ff850070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:06.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.707+0000 7ff8637fe640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff85006e2b0 0x7ff850070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff8540096c0 tx=0x7ff854000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:06.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.711+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff84c05b340 con 0x7ff864102b90 2024-09-16T09:43:06.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.882+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff864062630 con 0x7ff85006e2b0 2024-09-16T09:43:06.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.883+0000 7ff8617fa640 1 -- 172.21.15.111:0/2754937270 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7ff864062630 con 0x7ff85006e2b0 2024-09-16T09:43:06.885 INFO:teuthology.orchestra.run.smithi111.stdout:HOST ADDR LABELS STATUS 2024-09-16T09:43:06.885 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111 172.21.15.111 2024-09-16T09:43:06.885 INFO:teuthology.orchestra.run.smithi111.stdout:smithi114 172.21.15.114 2024-09-16T09:43:06.885 INFO:teuthology.orchestra.run.smithi111.stdout:2 hosts in cluster 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff85006e2b0 msgr2=0x7ff850070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff85006e2b0 0x7ff850070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff8540096c0 tx=0x7ff854000bc0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 msgr2=0x7ff8640745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 0x7ff8640745e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00b420 tx=0x7ff84c00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 shutdown_connections 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7ff85006e2b0 0x7ff850070770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff864102b90 0x7ff8640745e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 --2- 172.21.15.111:0/2754937270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff864101990 0x7ff864075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:06.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 >> 172.21.15.111:0/2754937270 conn(0x7ff8640fd140 msgr2=0x7ff8641060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:06.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 shutdown_connections 2024-09-16T09:43:06.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:06.885+0000 7ff869aea640 1 -- 172.21.15.111:0/2754937270 wait complete. 2024-09-16T09:43:07.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:06 smithi111 ceph-mon[27997]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:07.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:06 smithi114 ceph-mon[35635]: from='client.14530 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:07.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-16T09:43:07.823 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:08.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:07 smithi111 ceph-mon[27997]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:08.200 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:07 smithi111 ceph-mon[27997]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 -- 172.21.15.111:0/3017322988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398100880 msgr2=0x7f2398100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 --2- 172.21.15.111:0/3017322988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398100880 0x7f2398100c80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2388009880 tx=0x7f238802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 -- 172.21.15.111:0/3017322988 shutdown_connections 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 --2- 172.21.15.111:0/3017322988 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2398101a80 0x7f2398101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 --2- 172.21.15.111:0/3017322988 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398100880 0x7f2398100c80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 -- 172.21.15.111:0/3017322988 >> 172.21.15.111:0/3017322988 conn(0x7f23980fc010 msgr2=0x7f23980fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:08.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 -- 172.21.15.111:0/3017322988 shutdown_connections 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 -- 172.21.15.111:0/3017322988 wait complete. 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 Processor -- start 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.279+0000 7f239e61c640 1 -- start start 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f239e61c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2398100880 0x7f23981047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f239e61c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 0x7f2398102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f239e61c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2398109720 con 0x7f2398101a80 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f239e61c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f23981095a0 con 0x7f2398100880 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 0x7f2398102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 0x7f2398102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59558/0 (socket says 172.21.15.111:59558) 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 -- 172.21.15.111:0/3203614160 learned_addr learned my addr 172.21.15.111:0/3203614160 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f2397fff640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2398100880 0x7f23981047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 -- 172.21.15.111:0/3203614160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2398100880 msgr2=0x7f23981047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2398100880 0x7f23981047a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 -- 172.21.15.111:0/3203614160 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23981033a0 con 0x7f2398101a80 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23977fe640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 0x7f2398102e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f238c00b420 tx=0x7f238c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.280+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f238c011630 con 0x7f2398101a80 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.281+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2398103690 con 0x7f2398101a80 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.281+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f238c016070 con 0x7f2398101a80 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.281+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f238c010d40 con 0x7f2398101a80 2024-09-16T09:43:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.281+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2398103ca0 con 0x7f2398101a80 2024-09-16T09:43:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.282+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2398100c80 con 0x7f2398101a80 2024-09-16T09:43:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.282+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f238c01b460 con 0x7f2398101a80 2024-09-16T09:43:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.282+0000 7f23957fa640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f238006e2b0 0x7f2380070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.282+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f238c08d680 con 0x7f2398101a80 2024-09-16T09:43:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.282+0000 7f2397fff640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f238006e2b0 0x7f2380070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.283+0000 7f2397fff640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f238006e2b0 0x7f2380070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2388006010 tx=0x7f2388000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.287+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f238c05b320 con 0x7f2398101a80 2024-09-16T09:43:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:07 smithi114 ceph-mon[35635]: from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:07 smithi114 ceph-mon[35635]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:08.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.459+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f239819f690 con 0x7f238006e2b0 2024-09-16T09:43:08.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.461+0000 7f23957fa640 1 -- 172.21.15.111:0/3203614160 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f239819f690 con 0x7f238006e2b0 2024-09-16T09:43:08.463 INFO:teuthology.orchestra.run.smithi111.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-16T09:43:08.463 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VZ400BGN 372G No 118s ago Has a FileSystem, LVM detected 2024-09-16T09:43:08.463 INFO:teuthology.orchestra.run.smithi111.stdout:smithi114 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WB400BGN 372G No 43s ago Has a FileSystem, LVM detected 2024-09-16T09:43:08.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f238006e2b0 msgr2=0x7f2380070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f238006e2b0 0x7f2380070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2388006010 tx=0x7f2388000bc0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 msgr2=0x7f2398102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 0x7f2398102e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f238c00b420 tx=0x7f238c00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 shutdown_connections 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f238006e2b0 0x7f2380070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2398101a80 0x7f2398102e60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 --2- 172.21.15.111:0/3203614160 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2398100880 0x7f23981047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 >> 172.21.15.111:0/3203614160 conn(0x7f23980fc010 msgr2=0x7f239806a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 shutdown_connections 2024-09-16T09:43:08.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:08.463+0000 7f239e61c640 1 -- 172.21.15.111:0/3203614160 wait complete. 2024-09-16T09:43:09.056 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:43:09.066 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:09.067 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-16T09:43:09.315 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:09.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 -- 172.21.15.111:0/506210279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4102470 msgr2=0x7f9ab4104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:09.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 --2- 172.21.15.111:0/506210279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4102470 0x7f9ab4104860 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009880 tx=0x7f9aac02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:09.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 -- 172.21.15.111:0/506210279 shutdown_connections 2024-09-16T09:43:09.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 --2- 172.21.15.111:0/506210279 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ab4104da0 0x7f9ab4107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:09.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 --2- 172.21.15.111:0/506210279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4102470 0x7f9ab4104860 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:09.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 -- 172.21.15.111:0/506210279 >> 172.21.15.111:0/506210279 conn(0x7f9ab40fbff0 msgr2=0x7f9ab40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 -- 172.21.15.111:0/506210279 shutdown_connections 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.780+0000 7f9abc47c640 1 -- 172.21.15.111:0/506210279 wait complete. 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9abc47c640 1 Processor -- start 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9abc47c640 1 -- start start 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9abc47c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ab4102470 0x7f9ab4197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9abc47c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 0x7f9ab4197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9abc47c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab410a800 con 0x7f9ab4104da0 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9abc47c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ab410a680 con 0x7f9ab4102470 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9ab9a17640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 0x7f9ab4197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9ab9a17640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 0x7f9ab4197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59588/0 (socket says 172.21.15.111:59588) 2024-09-16T09:43:09.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.781+0000 7f9ab9a17640 1 -- 172.21.15.111:0/2971598008 learned_addr learned my addr 172.21.15.111:0/2971598008 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9aba218640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ab4102470 0x7f9ab4197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab9a17640 1 -- 172.21.15.111:0/2971598008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ab4102470 msgr2=0x7f9ab4197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab9a17640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ab4102470 0x7f9ab4197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab9a17640 1 -- 172.21.15.111:0/2971598008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ab41980c0 con 0x7f9ab4104da0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab9a17640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 0x7f9ab4197a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b3d0 tx=0x7f9aa800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aa8015020 con 0x7f9ab4104da0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9aa8011af0 con 0x7f9ab4104da0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ab419cb00 con 0x7f9ab4104da0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9aa8010d30 con 0x7f9ab4104da0 2024-09-16T09:43:09.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.782+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ab419d110 con 0x7f9ab4104da0 2024-09-16T09:43:09.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.783+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ab4102850 con 0x7f9ab4104da0 2024-09-16T09:43:09.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.784+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9aa8018020 con 0x7f9ab4104da0 2024-09-16T09:43:09.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.784+0000 7f9ab37fe640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9a9c06e310 0x7f9a9c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:09.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.784+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4638+0+0 (secure 0 0 0) 0x7f9aa808d830 con 0x7f9ab4104da0 2024-09-16T09:43:09.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.784+0000 7f9aba218640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9a9c06e310 0x7f9a9c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:09.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.784+0000 7f9aba218640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9a9c06e310 0x7f9a9c0707d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005ab0 tx=0x7f9aac005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:09.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.788+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9aa801f020 con 0x7f9ab4104da0 2024-09-16T09:43:09.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:09.977+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f9ab4105820 con 0x7f9a9c06e310 2024-09-16T09:43:10.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:09 smithi114 ceph-mon[35635]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:10.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:09 smithi114 ceph-mon[35635]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:10.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:09 smithi111 ceph-mon[27997]: from='client.14538 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:10.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:09 smithi111 ceph-mon[27997]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:11.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:10 smithi111 ceph-mon[27997]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:11.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:10 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-16T09:43:11.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:10 smithi114 ceph-mon[35635]: from='client.14542 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:11.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:10 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-16T09:43:11.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.995+0000 7f9ab37fe640 1 -- 172.21.15.111:0/2971598008 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9ab4105820 con 0x7f9a9c06e310 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9a9c06e310 msgr2=0x7f9a9c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9a9c06e310 0x7f9a9c0707d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005ab0 tx=0x7f9aac005a20 comp rx=0 tx=0).stop 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 msgr2=0x7f9ab4197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 0x7f9ab4197a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b3d0 tx=0x7f9aa800b890 comp rx=0 tx=0).stop 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 shutdown_connections 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9a9c06e310 0x7f9a9c0707d0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9aac005ab0 tx=0x7f9aac005a20 comp rx=0 tx=0).stop 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ab4104da0 0x7f9ab4197a40 secure :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9aa800b3d0 tx=0x7f9aa800b890 comp rx=0 tx=0).stop 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 --2- 172.21.15.111:0/2971598008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ab4102470 0x7f9ab4197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 >> 172.21.15.111:0/2971598008 conn(0x7f9ab40fbff0 msgr2=0x7f9ab40fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 shutdown_connections 2024-09-16T09:43:12.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:11.999+0000 7f9abc47c640 1 -- 172.21.15.111:0/2971598008 wait complete. 2024-09-16T09:43:12.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:11 smithi111 ceph-mon[27997]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:12.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-16T09:43:12.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:11 smithi111 ceph-mon[27997]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T09:43:12.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:11 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-16T09:43:12.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:11 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[27993]: 2024-09-16T09:43:11.977+0000 7f6271da2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:43:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:11 smithi114 ceph-mon[35635]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-16T09:43:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:11 smithi114 ceph-mon[35635]: osdmap e39: 6 total, 6 up, 6 in 2024-09-16T09:43:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:11 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-16T09:43:12.605 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T09:43:13.126 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-16T09:43:13.126 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: osdmap e40: 6 total, 6 up, 6 in 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: osdmap e41: 6 total, 6 up, 6 in 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: fsmap cephfs:0 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: Saving service mds.cephfs spec with placement count:4 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:13.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.jnzoej", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:13.128 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.jnzoej", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:13.128 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:13.128 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:12 smithi111 ceph-mon[27997]: Deploying daemon mds.cephfs.smithi111.jnzoej on smithi111 2024-09-16T09:43:13.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-16T09:43:13.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: osdmap e40: 6 total, 6 up, 6 in 2024-09-16T09:43:13.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: osdmap e41: 6 total, 6 up, 6 in 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: fsmap cephfs:0 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: Saving service mds.cephfs spec with placement count:4 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.jnzoej", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:13.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.jnzoej", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:13.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:13.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:12 smithi114 ceph-mon[35635]: Deploying daemon mds.cephfs.smithi111.jnzoej on smithi111 2024-09-16T09:43:13.744 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:14.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 -- 172.21.15.111:0/1110603716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60101970 msgr2=0x7fed60101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:14.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 --2- 172.21.15.111:0/1110603716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60101970 0x7fed60101d70 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009880 tx=0x7fed5c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 -- 172.21.15.111:0/1110603716 shutdown_connections 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 --2- 172.21.15.111:0/1110603716 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed60102b70 0x7fed60102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 --2- 172.21.15.111:0/1110603716 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60101970 0x7fed60101d70 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 -- 172.21.15.111:0/1110603716 >> 172.21.15.111:0/1110603716 conn(0x7fed600fd140 msgr2=0x7fed600ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 -- 172.21.15.111:0/1110603716 shutdown_connections 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.232+0000 7fed6755a640 1 -- 172.21.15.111:0/1110603716 wait complete. 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed6755a640 1 Processor -- start 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed6755a640 1 -- start start 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed6755a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed60101970 0x7fed601974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed6755a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 0x7fed601979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed6755a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fed6010a7b0 con 0x7fed60102b70 2024-09-16T09:43:14.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed6755a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fed6010a630 con 0x7fed60101970 2024-09-16T09:43:14.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed64af5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 0x7fed601979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:14.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed64af5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 0x7fed601979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34698/0 (socket says 172.21.15.111:34698) 2024-09-16T09:43:14.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed64af5640 1 -- 172.21.15.111:0/2417098602 learned_addr learned my addr 172.21.15.111:0/2417098602 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:14.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed652f6640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed60101970 0x7fed601974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:14.237 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:13 smithi111 ceph-mon[27997]: pgmap v168: 65 pgs: 11 creating+peering, 53 unknown, 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:14.237 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:13 smithi111 ceph-mon[27997]: osdmap e42: 6 total, 6 up, 6 in 2024-09-16T09:43:14.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed64af5640 1 -- 172.21.15.111:0/2417098602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed60101970 msgr2=0x7fed601974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed64af5640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed60101970 0x7fed601974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.233+0000 7fed64af5640 1 -- 172.21.15.111:0/2417098602 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed60198060 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.234+0000 7fed64af5640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 0x7fed601979e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed5000c8f0 tx=0x7fed5000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.234+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed500079b0 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.234+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed500054e0 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.234+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6019caa0 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.234+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed50004dd0 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.234+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed60074700 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.235+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed60101d70 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.236+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fed50005020 con 0x7fed60102b70 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.236+0000 7fed567fc640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed4c06e260 0x7fed4c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:14.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.237+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fed5008e0e0 con 0x7fed60102b70 2024-09-16T09:43:14.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.237+0000 7fed652f6640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed4c06e260 0x7fed4c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:14.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.237+0000 7fed652f6640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed4c06e260 0x7fed4c070720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009230 tx=0x7fed5c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:14.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.241+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed50014030 con 0x7fed60102b70 2024-09-16T09:43:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:13 smithi114 ceph-mon[35635]: pgmap v168: 65 pgs: 11 creating+peering, 53 unknown, 1 active+clean; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:13 smithi114 ceph-mon[35635]: osdmap e42: 6 total, 6 up, 6 in 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.466+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fed600751c0 con 0x7fed60102b70 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.466+0000 7fed567fc640 1 -- 172.21.15.111:0/2417098602 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7fed5005f6f0 con 0x7fed60102b70 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 2 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stdout:e2 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:11:978282+0000 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:43:14.469 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 2 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:11.978216+0000 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:43:14.470 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:in 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:up {} 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:43:14.471 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data disabled 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 0 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 0 members: 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:14.472 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:14.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed4c06e260 msgr2=0x7fed4c070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:14.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed4c06e260 0x7fed4c070720 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009230 tx=0x7fed5c0058d0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 msgr2=0x7fed601979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:14.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 0x7fed601979e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fed5000c8f0 tx=0x7fed5000cdb0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 shutdown_connections 2024-09-16T09:43:14.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed4c06e260 0x7fed4c070720 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed60102b70 0x7fed601979e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 --2- 172.21.15.111:0/2417098602 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fed60101970 0x7fed601974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:14.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 >> 172.21.15.111:0/2417098602 conn(0x7fed600fd140 msgr2=0x7fed600ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:14.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 shutdown_connections 2024-09-16T09:43:14.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:14.468+0000 7fed6755a640 1 -- 172.21.15.111:0/2417098602 wait complete. 2024-09-16T09:43:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:14 smithi114 ceph-mon[35635]: osdmap e43: 6 total, 6 up, 6 in 2024-09-16T09:43:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:14 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2417098602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T09:43:15.254 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:14 smithi111 ceph-mon[27997]: osdmap e43: 6 total, 6 up, 6 in 2024-09-16T09:43:15.254 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:14 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2417098602' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T09:43:15.555 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:43:15.568 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:15.568 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-16T09:43:15.820 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:16.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: pgmap v171: 65 pgs: 25 active+clean, 11 creating+peering, 29 unknown; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:16.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] up:boot 2024-09-16T09:43:16.223 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: daemon mds.cephfs.smithi111.jnzoej assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: Cluster is now healthy 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: fsmap cephfs:0 1 up:standby 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"}]: dispatch 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:creating} 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: daemon mds.cephfs.smithi111.jnzoej is now active in filesystem cephfs as rank 0 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.bdhdtm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:16.224 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.bdhdtm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:16.225 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:16.225 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:15 smithi111 ceph-mon[27997]: Deploying daemon mds.cephfs.smithi114.bdhdtm on smithi114 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 -- 172.21.15.111:0/3186066858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34100880 msgr2=0x7f0f34100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 --2- 172.21.15.111:0/3186066858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34100880 0x7f0f34100c80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009880 tx=0x7f0f2402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 -- 172.21.15.111:0/3186066858 shutdown_connections 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 --2- 172.21.15.111:0/3186066858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34101a80 0x7f0f34101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 --2- 172.21.15.111:0/3186066858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34100880 0x7f0f34100c80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 -- 172.21.15.111:0/3186066858 >> 172.21.15.111:0/3186066858 conn(0x7f0f340fc010 msgr2=0x7f0f340fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 -- 172.21.15.111:0/3186066858 shutdown_connections 2024-09-16T09:43:16.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.305+0000 7f0f38984640 1 -- 172.21.15.111:0/3186066858 wait complete. 2024-09-16T09:43:16.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f38984640 1 Processor -- start 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f38984640 1 -- start start 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f38984640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34100880 0x7f0f341996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f38984640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 0x7f0f34199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f38984640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0f341096c0 con 0x7f0f34101a80 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f38984640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f34109540 con 0x7f0f34100880 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f31d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 0x7f0f34199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f31d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 0x7f0f34199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34740/0 (socket says 172.21.15.111:34740) 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f31d9b640 1 -- 172.21.15.111:0/1454624239 learned_addr learned my addr 172.21.15.111:0/1454624239 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.306+0000 7f0f3259c640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34100880 0x7f0f341996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f31d9b640 1 -- 172.21.15.111:0/1454624239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34100880 msgr2=0x7f0f341996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f31d9b640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34100880 0x7f0f341996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:16.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f31d9b640 1 -- 172.21.15.111:0/1454624239 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f3419a270 con 0x7f0f34101a80 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f3259c640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34100880 0x7f0f341996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f31d9b640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 0x7f0f34199bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c8f0 tx=0x7f0f1c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f1c0079b0 con 0x7f0f34101a80 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f1c0054e0 con 0x7f0f34101a80 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f3419ecb0 con 0x7f0f34101a80 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f1c004dd0 con 0x7f0f34101a80 2024-09-16T09:43:16.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.307+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f3419f1e0 con 0x7f0f34101a80 2024-09-16T09:43:16.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.308+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f34100c80 con 0x7f0f34101a80 2024-09-16T09:43:16.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.309+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f0f1c005020 con 0x7f0f34101a80 2024-09-16T09:43:16.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.309+0000 7f0f2b7fe640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0f2006e260 0x7f0f20070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:16.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.309+0000 7f0f3259c640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0f2006e260 0x7f0f20070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:16.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.309+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f0f1c08e160 con 0x7f0f34101a80 2024-09-16T09:43:16.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.310+0000 7f0f3259c640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0f2006e260 0x7f0f20070720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f24000c00 tx=0x7f0f24005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:16.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.314+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0f1c014030 con 0x7f0f34101a80 2024-09-16T09:43:16.325 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: pgmap v171: 65 pgs: 25 active+clean, 11 creating+peering, 29 unknown; 577 KiB data, 174 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:16.325 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] up:boot 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: daemon mds.cephfs.smithi111.jnzoej assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: Cluster is now healthy 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: fsmap cephfs:0 1 up:standby 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"}]: dispatch 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:creating} 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: daemon mds.cephfs.smithi111.jnzoej is now active in filesystem cephfs as rank 0 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.bdhdtm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.bdhdtm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:16.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:16.327 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:15 smithi114 ceph-mon[35635]: Deploying daemon mds.cephfs.smithi114.bdhdtm on smithi114 2024-09-16T09:43:16.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:16.514+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f0f34062df0 con 0x7f0f34101a80 2024-09-16T09:43:17.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.004+0000 7f0f2b7fe640 1 -- 172.21.15.111:0/1454624239 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v6) ==== 105+0+0 (secure 0 0 0) 0x7f0f1c05bac0 con 0x7f0f34101a80 2024-09-16T09:43:17.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0f2006e260 msgr2=0x7f0f20070720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:17.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0f2006e260 0x7f0f20070720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0f24000c00 tx=0x7f0f24005a20 comp rx=0 tx=0).stop 2024-09-16T09:43:17.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 msgr2=0x7f0f34199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:17.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 0x7f0f34199bf0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00c8f0 tx=0x7f0f1c00cdb0 comp rx=0 tx=0).stop 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 shutdown_connections 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f0f2006e260 0x7f0f20070720 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.006+0000 7f0f38984640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f34101a80 0x7f0f34199bf0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.007+0000 7f0f38984640 1 --2- 172.21.15.111:0/1454624239 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f34100880 0x7f0f341996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.007+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 >> 172.21.15.111:0/1454624239 conn(0x7f0f340fc010 msgr2=0x7f0f340fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.007+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 shutdown_connections 2024-09-16T09:43:17.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:17.007+0000 7f0f38984640 1 -- 172.21.15.111:0/1454624239 wait complete. 2024-09-16T09:43:17.297 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:17 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] up:active 2024-09-16T09:43:17.297 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:17 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2024-09-16T09:43:17.297 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:17 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1454624239' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T09:43:17.352 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:17 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] up:active 2024-09-16T09:43:17.352 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:17 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2024-09-16T09:43:17.352 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:17 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1454624239' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-16T09:43:17.756 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:43:17.766 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:17.766 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: pgmap v172: 65 pgs: 65 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1454624239' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.yvusja", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.yvusja", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:18.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:18 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: pgmap v172: 65 pgs: 65 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s wr, 3 op/s 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1454624239' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.yvusja", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.yvusja", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:18 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:18.910 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:19.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:19 smithi111 ceph-mon[27997]: Deploying daemon mds.cephfs.smithi111.yvusja on smithi111 2024-09-16T09:43:19.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:19 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:boot 2024-09-16T09:43:19.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:19 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 1 up:standby 2024-09-16T09:43:19.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:19 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"}]: dispatch 2024-09-16T09:43:19.034 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:19 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 1 up:standby 2024-09-16T09:43:19.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:19 smithi114 ceph-mon[35635]: Deploying daemon mds.cephfs.smithi111.yvusja on smithi111 2024-09-16T09:43:19.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:19 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:boot 2024-09-16T09:43:19.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:19 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 1 up:standby 2024-09-16T09:43:19.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:19 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"}]: dispatch 2024-09-16T09:43:19.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:19 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 1 up:standby 2024-09-16T09:43:19.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/1201923670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78101970 msgr2=0x7fdb78101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:19.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/1201923670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78101970 0x7fdb78101d70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009880 tx=0x7fdb6802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/1201923670 shutdown_connections 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/1201923670 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb78102b70 0x7fdb78102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/1201923670 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78101970 0x7fdb78101d70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/1201923670 >> 172.21.15.111:0/1201923670 conn(0x7fdb780fd140 msgr2=0x7fdb780ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/1201923670 shutdown_connections 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.492+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/1201923670 wait complete. 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb7d7fa640 1 Processor -- start 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb7d7fa640 1 -- start start 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb7d7fa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb78101970 0x7fdb78197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb7d7fa640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 0x7fdb781979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb7d7fa640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7810a790 con 0x7fdb78102b70 2024-09-16T09:43:19.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb7d7fa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7810a610 con 0x7fdb78101970 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 0x7fdb781979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 0x7fdb781979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34752/0 (socket says 172.21.15.111:34752) 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 -- 172.21.15.111:0/2889895121 learned_addr learned my addr 172.21.15.111:0/2889895121 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb76ffd640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb78101970 0x7fdb78197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 -- 172.21.15.111:0/2889895121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb78101970 msgr2=0x7fdb78197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb78101970 0x7fdb78197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 -- 172.21.15.111:0/2889895121 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb78198040 con 0x7fdb78102b70 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.493+0000 7fdb6ffff640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 0x7fdb781979c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000d8d0 tx=0x7fdb6000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.494+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb60017030 con 0x7fdb78102b70 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.494+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7819ca80 con 0x7fdb78102b70 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.494+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb60004020 con 0x7fdb78102b70 2024-09-16T09:43:19.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.494+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb600047a0 con 0x7fdb78102b70 2024-09-16T09:43:19.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.494+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7819d010 con 0x7fdb78102b70 2024-09-16T09:43:19.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.495+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb78101d70 con 0x7fdb78102b70 2024-09-16T09:43:19.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.495+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fdb60009a30 con 0x7fdb78102b70 2024-09-16T09:43:19.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.496+0000 7fdb74ff9640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdb6406e2b0 0x7fdb64070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:19.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.496+0000 7fdb76ffd640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdb6406e2b0 0x7fdb64070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:19.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.496+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fdb60018070 con 0x7fdb78102b70 2024-09-16T09:43:19.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.496+0000 7fdb76ffd640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdb6406e2b0 0x7fdb64070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009230 tx=0x7fdb680058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:19.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.501+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdb6005b930 con 0x7fdb78102b70 2024-09-16T09:43:19.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:19.717+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fdb7819d300 con 0x7fdb78102b70 2024-09-16T09:43:20.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.019+0000 7fdb74ff9640 1 -- 172.21.15.111:0/2889895121 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fdb6005f5e0 con 0x7fdb78102b70 2024-09-16T09:43:20.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdb6406e2b0 msgr2=0x7fdb64070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:20.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdb6406e2b0 0x7fdb64070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009230 tx=0x7fdb680058d0 comp rx=0 tx=0).stop 2024-09-16T09:43:20.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 msgr2=0x7fdb781979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:20.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 0x7fdb781979c0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000d8d0 tx=0x7fdb6000dd90 comp rx=0 tx=0).stop 2024-09-16T09:43:20.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 shutdown_connections 2024-09-16T09:43:20.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fdb6406e2b0 0x7fdb64070770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:20.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb78102b70 0x7fdb781979c0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:20.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 --2- 172.21.15.111:0/2889895121 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fdb78101970 0x7fdb78197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:20.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.021+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 >> 172.21.15.111:0/2889895121 conn(0x7fdb780fd140 msgr2=0x7fdb780ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:20.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.022+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 shutdown_connections 2024-09-16T09:43:20.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:20.022+0000 7fdb7d7fa640 1 -- 172.21.15.111:0/2889895121 wait complete. 2024-09-16T09:43:20.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:20 smithi111 ceph-mon[27997]: pgmap v173: 65 pgs: 65 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-16T09:43:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:20 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2889895121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-16T09:43:20.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:20.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:20 smithi114 ceph-mon[35635]: pgmap v173: 65 pgs: 65 active+clean; 577 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s wr, 2 op/s 2024-09-16T09:43:20.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:20 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2889895121' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-16T09:43:20.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:20.659 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:43:20.670 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:20.670 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-16T09:43:20.918 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:21.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2889895121' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-16T09:43:21.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:boot 2024-09-16T09:43:21.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2 up:standby 2024-09-16T09:43:21.310 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"}]: dispatch 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.sreoiu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.sreoiu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:21.311 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:21 smithi111 ceph-mon[27997]: Deploying daemon mds.cephfs.smithi114.sreoiu on smithi114 2024-09-16T09:43:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 -- 172.21.15.111:0/1982648549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 msgr2=0x7f84dc101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/1982648549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc101f00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f84d0009880 tx=0x7f84d002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 -- 172.21.15.111:0/1982648549 shutdown_connections 2024-09-16T09:43:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/1982648549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc101f00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/1982648549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 0x7f84dc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 -- 172.21.15.111:0/1982648549 >> 172.21.15.111:0/1982648549 conn(0x7f84dc0fc010 msgr2=0x7f84dc0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 -- 172.21.15.111:0/1982648549 shutdown_connections 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.394+0000 7f84e3e6e640 1 -- 172.21.15.111:0/1982648549 wait complete. 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e3e6e640 1 Processor -- start 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e3e6e640 1 -- start start 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e3e6e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 0x7f84dc06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e3e6e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e3e6e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc109740 con 0x7f84dc101a80 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e3e6e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f84dc1095c0 con 0x7f84dc100880 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc19c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:34768/0 (socket says 172.21.15.111:34768) 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 -- 172.21.15.111:0/2861694388 learned_addr learned my addr 172.21.15.111:0/2861694388 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1c0a640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 0x7f84dc06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 -- 172.21.15.111:0/2861694388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 msgr2=0x7f84dc06ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 0x7f84dc06ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 -- 172.21.15.111:0/2861694388 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84dc19c840 con 0x7f84dc101a80 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1c0a640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 0x7f84dc06ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.395+0000 7f84e1409640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc19c250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f84d0006010 tx=0x7f84d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:21.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.396+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84d003f070 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.396+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84d00044d0 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.396+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84dc19cad0 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.396+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84d0035030 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.396+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84dc19d080 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.396+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84dc100c60 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.397+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f84d0042070 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.397+0000 7f84daffd640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f84c406e2b0 0x7f84c4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.397+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f84d00aef70 con 0x7f84dc101a80 2024-09-16T09:43:21.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.398+0000 7f84e1c0a640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f84c406e2b0 0x7f84c4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:21.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.398+0000 7f84e1c0a640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f84c406e2b0 0x7f84c4070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f84dc1018e0 tx=0x7f84cc0073c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:21.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.402+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f84d007c840 con 0x7f84dc101a80 2024-09-16T09:43:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2889895121' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-16T09:43:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:boot 2024-09-16T09:43:21.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2 up:standby 2024-09-16T09:43:21.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"}]: dispatch 2024-09-16T09:43:21.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:21.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:21.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:21.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.sreoiu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-16T09:43:21.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.sreoiu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-16T09:43:21.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:21.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:21 smithi114 ceph-mon[35635]: Deploying daemon mds.cephfs.smithi114.sreoiu on smithi114 2024-09-16T09:43:21.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:21.603+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f84dc190550 con 0x7f84dc101a80 2024-09-16T09:43:22.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.076+0000 7f84daffd640 1 -- 172.21.15.111:0/2861694388 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v10) ==== 168+0+0 (secure 0 0 0) 0x7f84dc190550 con 0x7f84dc101a80 2024-09-16T09:43:22.078 INFO:teuthology.orchestra.run.smithi111.stderr:inline data enabled 2024-09-16T09:43:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f84c406e2b0 msgr2=0x7f84c4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f84c406e2b0 0x7f84c4070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f84dc1018e0 tx=0x7f84cc0073c0 comp rx=0 tx=0).stop 2024-09-16T09:43:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 msgr2=0x7f84dc19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc19c250 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f84d0006010 tx=0x7f84d00048f0 comp rx=0 tx=0).stop 2024-09-16T09:43:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 shutdown_connections 2024-09-16T09:43:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f84c406e2b0 0x7f84c4070770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f84dc101a80 0x7f84dc19c250 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 --2- 172.21.15.111:0/2861694388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f84dc100880 0x7f84dc06ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.078+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 >> 172.21.15.111:0/2861694388 conn(0x7f84dc0fc010 msgr2=0x7f84dc104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.079+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 shutdown_connections 2024-09-16T09:43:22.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:22.079+0000 7f84e3e6e640 1 -- 172.21.15.111:0/2861694388 wait complete. 2024-09-16T09:43:22.359 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:22 smithi111 ceph-mon[27997]: pgmap v174: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-16T09:43:22.359 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:22 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2861694388' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T09:43:22.391 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:22 smithi114 ceph-mon[35635]: pgmap v174: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-16T09:43:22.391 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:22 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2861694388' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-16T09:43:22.831 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:43:22.841 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:22.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2861694388' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2 up:standby 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.368 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.369 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:23 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:23.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2861694388' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2 up:standby 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:23 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:23.772 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:24 smithi114 ceph-mon[35635]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-16T09:43:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:24 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:boot 2024-09-16T09:43:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:24 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] up:active 2024-09-16T09:43:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:24 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"}]: dispatch 2024-09-16T09:43:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:24.207 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:24 smithi111 ceph-mon[27997]: pgmap v175: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-16T09:43:24.207 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:24 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:boot 2024-09-16T09:43:24.207 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:24 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] up:active 2024-09-16T09:43:24.208 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:24 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:24.208 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"}]: dispatch 2024-09-16T09:43:24.208 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 -- 172.21.15.111:0/3207776715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100102b60 msgr2=0x7f6100102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 --2- 172.21.15.111:0/3207776715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100102b60 0x7f6100102fe0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009880 tx=0x7f60f402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 -- 172.21.15.111:0/3207776715 shutdown_connections 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 --2- 172.21.15.111:0/3207776715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100102b60 0x7f6100102fe0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 --2- 172.21.15.111:0/3207776715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6100101960 0x7f6100101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 -- 172.21.15.111:0/3207776715 >> 172.21.15.111:0/3207776715 conn(0x7f61000fd0f0 msgr2=0x7f61000ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 -- 172.21.15.111:0/3207776715 shutdown_connections 2024-09-16T09:43:24.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.205+0000 7f610698a640 1 -- 172.21.15.111:0/3207776715 wait complete. 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.206+0000 7f610698a640 1 Processor -- start 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.206+0000 7f610698a640 1 -- start start 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f610698a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 0x7f6100197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f610698a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6100102b60 0x7f61001979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f610698a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f610010a7a0 con 0x7f6100101960 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f610698a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f610010a620 con 0x7f6100102b60 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 0x7f6100197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 0x7f6100197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57858/0 (socket says 172.21.15.111:57858) 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 -- 172.21.15.111:0/477724280 learned_addr learned my addr 172.21.15.111:0/477724280 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60ff7fe640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6100102b60 0x7f61001979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 -- 172.21.15.111:0/477724280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6100102b60 msgr2=0x7f61001979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6100102b60 0x7f61001979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 -- 172.21.15.111:0/477724280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6100198040 con 0x7f6100101960 2024-09-16T09:43:24.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fffff640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 0x7f6100197480 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e940 tx=0x7f60f000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60f000cac0 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610019ca80 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60f000cc60 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60f0003e30 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.207+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610019cfe0 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.208+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6100101d60 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.209+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f60f0004000 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.209+0000 7f60fd7fa640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f60e806e2b0 0x7f60e8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.209+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f60f008e700 con 0x7f6100101960 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.209+0000 7f60ff7fe640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f60e806e2b0 0x7f60e8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:24.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.210+0000 7f60ff7fe640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f60e806e2b0 0x7f60e8070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60f4000c00 tx=0x7f60f40058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:24.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.214+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f60f005c060 con 0x7f6100101960 2024-09-16T09:43:24.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.430+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f6100062df0 con 0x7f6100101960 2024-09-16T09:43:24.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.430+0000 7f60fd7fa640 1 -- 172.21.15.111:0/477724280 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) ==== 76+0+1984 (secure 0 0 0) 0x7f60f005fd10 con 0x7f6100101960 2024-09-16T09:43:24.432 INFO:teuthology.orchestra.run.smithi111.stdout:e11 2024-09-16T09:43:24.432 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:23:077294+0000 2024-09-16T09:43:24.432 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:43:24.432 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:43:24.433 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:43:24.434 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:43:24.435 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f60e806e2b0 msgr2=0x7f60e8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f60e806e2b0 0x7f60e8070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f60f4000c00 tx=0x7f60f40058d0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 msgr2=0x7f6100197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 0x7f6100197480 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e940 tx=0x7f60f000ee00 comp rx=0 tx=0).stop 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 shutdown_connections 2024-09-16T09:43:24.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f60e806e2b0 0x7f60e8070770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6100102b60 0x7f61001979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 --2- 172.21.15.111:0/477724280 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6100101960 0x7f6100197480 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:24.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 >> 172.21.15.111:0/477724280 conn(0x7f61000fd0f0 msgr2=0x7f6100106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:24.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 shutdown_connections 2024-09-16T09:43:24.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:24.432+0000 7f610698a640 1 -- 172.21.15.111:0/477724280 wait complete. 2024-09-16T09:43:25.130 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-16T09:43:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:25 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/477724280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T09:43:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:25 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:standby 2024-09-16T09:43:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:25 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:25.153 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:25 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:25 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/477724280' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T09:43:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:25 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:standby 2024-09-16T09:43:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:25 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:25 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:26.292 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:26 smithi111 ceph-mon[27997]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-16T09:43:26.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:26 smithi114 ceph-mon[35635]: pgmap v176: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-09-16T09:43:26.448 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.882+0000 7fcac5ce8640 1 -- 172.21.15.111:0/2078237641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0102b90 msgr2=0x7fcac0103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.882+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/2078237641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0102b90 0x7fcac0103010 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8009880 tx=0x7fcaa802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.882+0000 7fcac5ce8640 1 -- 172.21.15.111:0/2078237641 shutdown_connections 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.882+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/2078237641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0102b90 0x7fcac0103010 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.882+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/2078237641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0101990 0x7fcac0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.882+0000 7fcac5ce8640 1 -- 172.21.15.111:0/2078237641 >> 172.21.15.111:0/2078237641 conn(0x7fcac00fd140 msgr2=0x7fcac00ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 -- 172.21.15.111:0/2078237641 shutdown_connections 2024-09-16T09:43:26.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 -- 172.21.15.111:0/2078237641 wait complete. 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 Processor -- start 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 -- start start 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 0x7fcac0197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0102b90 0x7fcac0197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcac010a850 con 0x7fcac0101990 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcac5ce8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcac010a6d0 con 0x7fcac0102b90 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcabf7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 0x7fcac0197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.883+0000 7fcabf7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 0x7fcac0197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57872/0 (socket says 172.21.15.111:57872) 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabf7fe640 1 -- 172.21.15.111:0/78197493 learned_addr learned my addr 172.21.15.111:0/78197493 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcab7fff640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0102b90 0x7fcac0197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabf7fe640 1 -- 172.21.15.111:0/78197493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0102b90 msgr2=0x7fcac0197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:26.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabf7fe640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0102b90 0x7fcac0197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabf7fe640 1 -- 172.21.15.111:0/78197493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac01980f0 con 0x7fcac0101990 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcab7fff640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0102b90 0x7fcac0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabf7fe640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 0x7fcac0197530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b3d0 tx=0x7fcab000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcab0015020 con 0x7fcac0101990 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcab0011af0 con 0x7fcac0101990 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac019cb30 con 0x7fcac0101990 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcab0010da0 con 0x7fcac0101990 2024-09-16T09:43:26.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.884+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac019d0c0 con 0x7fcac0101990 2024-09-16T09:43:26.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.885+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac0101d90 con 0x7fcac0101990 2024-09-16T09:43:26.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.886+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fcab0018020 con 0x7fcac0101990 2024-09-16T09:43:26.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.886+0000 7fcabd7fa640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fcaac06e310 0x7fcaac0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:26.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.886+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fcab008dcc0 con 0x7fcac0101990 2024-09-16T09:43:26.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.886+0000 7fcab7fff640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fcaac06e310 0x7fcaac0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:26.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.887+0000 7fcab7fff640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fcaac06e310 0x7fcaac0707d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80096c0 tx=0x7fcaa8009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:26.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:26.891+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcab001f020 con 0x7fcac0101990 2024-09-16T09:43:27.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.098+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcac002d7c0 con 0x7fcac0101990 2024-09-16T09:43:27.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.099+0000 7fcabd7fa640 1 -- 172.21.15.111:0/78197493 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5326 (secure 0 0 0) 0x7fcab005b6a0 con 0x7fcac0101990 2024-09-16T09:43:27.101 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fcaac06e310 msgr2=0x7fcaac0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fcaac06e310 0x7fcaac0707d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcaa80096c0 tx=0x7fcaa8009650 comp rx=0 tx=0).stop 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 msgr2=0x7fcac0197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 0x7fcac0197530 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b3d0 tx=0x7fcab000b890 comp rx=0 tx=0).stop 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 shutdown_connections 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fcaac06e310 0x7fcaac0707d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcac0102b90 0x7fcac0197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:27.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 --2- 172.21.15.111:0/78197493 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcac0101990 0x7fcac0197530 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:27.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 >> 172.21.15.111:0/78197493 conn(0x7fcac00fd140 msgr2=0x7fcac0106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:27.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 shutdown_connections 2024-09-16T09:43:27.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:27.102+0000 7fcac5ce8640 1 -- 172.21.15.111:0/78197493 wait complete. 2024-09-16T09:43:27.116 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:43:27.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:27 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:standby 2024-09-16T09:43:27.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:27 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:27.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:27 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:standby 2024-09-16T09:43:27.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:27 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:27.837 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-16T09:43:28.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:28 smithi111 ceph-mon[27997]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-16T09:43:28.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:28 smithi111 ceph-mon[27997]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:standby 2024-09-16T09:43:28.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:28 smithi111 ceph-mon[27997]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:28.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:28 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/78197493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T09:43:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:28 smithi114 ceph-mon[35635]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-16T09:43:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:28 smithi114 ceph-mon[35635]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:standby 2024-09-16T09:43:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:28 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:43:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:28 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/78197493' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T09:43:29.043 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:29.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 -- 172.21.15.111:0/3020066052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 msgr2=0x7fedb0107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:29.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/3020066052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0107170 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fed98009880 tx=0x7fed9802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 -- 172.21.15.111:0/3020066052 shutdown_connections 2024-09-16T09:43:29.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/3020066052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0107170 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/3020066052 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb0102450 0x7fedb0104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 -- 172.21.15.111:0/3020066052 >> 172.21.15.111:0/3020066052 conn(0x7fedb00fbff0 msgr2=0x7fedb00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:29.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.489+0000 7fedb5c2c640 1 -- 172.21.15.111:0/3020066052 shutdown_connections 2024-09-16T09:43:29.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.490+0000 7fedb5c2c640 1 -- 172.21.15.111:0/3020066052 wait complete. 2024-09-16T09:43:29.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.490+0000 7fedb5c2c640 1 Processor -- start 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.490+0000 7fedb5c2c640 1 -- start start 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedb5c2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb0102450 0x7fedb0101d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedb5c2c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedb5c2c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fedb010a760 con 0x7fedb0104d80 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedb5c2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fedb010a5e0 con 0x7fedb0102450 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0100400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57888/0 (socket says 172.21.15.111:57888) 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 -- 172.21.15.111:0/2682895753 learned_addr learned my addr 172.21.15.111:0/2682895753 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaf7fe640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb0102450 0x7fedb0101d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 -- 172.21.15.111:0/2682895753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb0102450 msgr2=0x7fedb0101d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:29.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb0102450 0x7fedb0101d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 -- 172.21.15.111:0/2682895753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb0100940 con 0x7fedb0104d80 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedaeffd640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0100400 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fed98006010 tx=0x7fed980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed9803f070 con 0x7fedb0104d80 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed980044d0 con 0x7fedb0104d80 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb0100bd0 con 0x7fedb0104d80 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed98035030 con 0x7fedb0104d80 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.491+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb0101100 con 0x7fedb0104d80 2024-09-16T09:43:29.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.492+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb0102830 con 0x7fedb0104d80 2024-09-16T09:43:29.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.493+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fed98042070 con 0x7fedb0104d80 2024-09-16T09:43:29.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.493+0000 7fedacff9640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed9c06e2b0 0x7fed9c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:29.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.494+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fed980aee00 con 0x7fedb0104d80 2024-09-16T09:43:29.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.494+0000 7fedaf7fe640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed9c06e2b0 0x7fed9c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:29.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.494+0000 7fedaf7fe640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed9c06e2b0 0x7fed9c070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feda0005e10 tx=0x7feda0005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:29.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.498+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed9807c760 con 0x7fedb0104d80 2024-09-16T09:43:29.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.750+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7fedb019f6e0 con 0x7fedb0104d80 2024-09-16T09:43:29.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.750+0000 7fedacff9640 1 -- 172.21.15.111:0/2682895753 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v14) ==== 78+0+98 (secure 0 0 0) 0x7fedb019f6e0 con 0x7fedb0104d80 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed9c06e2b0 msgr2=0x7fed9c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed9c06e2b0 0x7fed9c070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feda0005e10 tx=0x7feda0005da0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 msgr2=0x7fedb0100400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0100400 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fed98006010 tx=0x7fed980048f0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 shutdown_connections 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fed9c06e2b0 0x7fed9c070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fedb0104d80 0x7fedb0100400 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 --2- 172.21.15.111:0/2682895753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fedb0102450 0x7fedb0101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:29.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 >> 172.21.15.111:0/2682895753 conn(0x7fedb00fbff0 msgr2=0x7fedb00fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:29.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.752+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 shutdown_connections 2024-09-16T09:43:29.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:29.753+0000 7fedb5c2c640 1 -- 172.21.15.111:0/2682895753 wait complete. 2024-09-16T09:43:29.763 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:43:30.357 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-09-16T09:43:30.357 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:30.357 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:30.358 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2682895753' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-16T09:43:30.358 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:30.358 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:30.358 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:30 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:30.386 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-16T09:43:30.418 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: pgmap v178: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2682895753' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:30 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:31.323 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:31.376 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:31 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:31.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:31 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.792+0000 7f2264c91640 1 -- 172.21.15.111:0/382040767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260106820 msgr2=0x7f2260106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.792+0000 7f2264c91640 1 --2- 172.21.15.111:0/382040767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260106820 0x7f2260106c00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2250009880 tx=0x7f225002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 -- 172.21.15.111:0/382040767 shutdown_connections 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 --2- 172.21.15.111:0/382040767 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2260100820 0x7f2260100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 --2- 172.21.15.111:0/382040767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260106820 0x7f2260106c00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 -- 172.21.15.111:0/382040767 >> 172.21.15.111:0/382040767 conn(0x7f22600fc520 msgr2=0x7f22600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:31.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 -- 172.21.15.111:0/382040767 shutdown_connections 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 -- 172.21.15.111:0/382040767 wait complete. 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 Processor -- start 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.793+0000 7f2264c91640 1 -- start start 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f2264c91640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 0x7f22601987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f2264c91640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2260106820 0x7f2260198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f2264c91640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f226010dcd0 con 0x7f2260100820 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f2264c91640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f226010db50 con 0x7f2260106820 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 0x7f22601987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 0x7f22601987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57910/0 (socket says 172.21.15.111:57910) 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 -- 172.21.15.111:0/38232586 learned_addr learned my addr 172.21.15.111:0/38232586 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225dd9b640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2260106820 0x7f2260198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 -- 172.21.15.111:0/38232586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2260106820 msgr2=0x7f2260198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:31.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2260106820 0x7f2260198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 -- 172.21.15.111:0/38232586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2260199320 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f225e59c640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 0x7f22601987e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2250031460 tx=0x7f22500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f225003f070 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22601995b0 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2250004cf0 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2250035030 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.794+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22601a1b60 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.796+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2260101f60 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.796+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f2250042070 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.796+0000 7f224f7fe640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f224806e2b0 0x7f2248070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.797+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f22500aeb30 con 0x7f2260100820 2024-09-16T09:43:31.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.797+0000 7f225dd9b640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f224806e2b0 0x7f2248070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:31.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.797+0000 7f225dd9b640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f224806e2b0 0x7f2248070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f226006ae50 tx=0x7f225400a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:31.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:31.801+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2250080140 con 0x7f2260100820 2024-09-16T09:43:32.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.007+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2260103a30 con 0x7f2260100820 2024-09-16T09:43:32.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.007+0000 7f224f7fe640 1 -- 172.21.15.111:0/38232586 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5326 (secure 0 0 0) 0x7f2250084970 con 0x7f2260100820 2024-09-16T09:43:32.009 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:43:32.009 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":14,"btime":"2024-09-16T09:43:27:090244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:43:23.011624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14550":{"gid":14550,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6827/4028227545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4028227545},{"type":"v1","addr":"172.21.15.111:6827","nonce":4028227545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14550,"qdb_cluster":[14550]},"id":1}]} 2024-09-16T09:43:32.009 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.009+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f224806e2b0 msgr2=0x7f2248070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.009+0000 7f2264c91640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f224806e2b0 0x7f2248070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f226006ae50 tx=0x7f225400a2d0 comp rx=0 tx=0).stop 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 msgr2=0x7f22601987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 0x7f22601987e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2250031460 tx=0x7f22500048f0 comp rx=0 tx=0).stop 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 shutdown_connections 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f224806e2b0 0x7f2248070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:32.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2260106820 0x7f2260198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:32.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 --2- 172.21.15.111:0/38232586 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2260100820 0x7f22601987e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:32.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 >> 172.21.15.111:0/38232586 conn(0x7f22600fc520 msgr2=0x7f22600fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:32.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 shutdown_connections 2024-09-16T09:43:32.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:32.010+0000 7f2264c91640 1 -- 172.21.15.111:0/38232586 wait complete. 2024-09-16T09:43:32.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:32 smithi111 ceph-mon[27997]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-09-16T09:43:32.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:32 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/38232586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T09:43:32.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:32 smithi114 ceph-mon[35635]: pgmap v179: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 2 op/s 2024-09-16T09:43:32.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:32 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/38232586' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-16T09:43:33.065 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 18} 2024-09-16T09:43:33.066 INFO:teuthology.run_tasks:Running task kclient... 2024-09-16T09:43:33.117 INFO:tasks.kclient:Mounting kernel clients... 2024-09-16T09:43:33.117 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-16T09:43:33.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:33.117 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2024-09-16T09:43:33.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:33.134 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link delete ceph-brx 2024-09-16T09:43:33.204 INFO:teuthology.orchestra.run.smithi111.stderr:Cannot find device "ceph-brx" 2024-09-16T09:43:33.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T09:43:33.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:33.205 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T09:43:33.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:33.225 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-16T09:43:33.299 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-09-16T09:43:33.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T09:43:33.301 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-16T09:43:33.301 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T09:43:33.301 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:33.302 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T09:43:33.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:33.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:33 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:33.323 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:33 smithi111 ceph-mon[27997]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-16T09:43:33.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:33.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:33 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:33.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:33 smithi114 ceph-mon[35635]: pgmap v180: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-09-16T09:43:33.815 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:35.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 -- 172.21.15.111:0/3968716571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 msgr2=0x7f5ed8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:35.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/3968716571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed8101d90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009c20 tx=0x7f5ed402a970 comp rx=0 tx=0).stop 2024-09-16T09:43:35.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 -- 172.21.15.111:0/3968716571 shutdown_connections 2024-09-16T09:43:35.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/3968716571 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed8101d90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/3968716571 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed8107930 0x7f5ed8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 -- 172.21.15.111:0/3968716571 >> 172.21.15.111:0/3968716571 conn(0x7f5ed80fd630 msgr2=0x7f5ed80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 -- 172.21.15.111:0/3968716571 shutdown_connections 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.632+0000 7f5edf9bd640 1 -- 172.21.15.111:0/3968716571 wait complete. 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edf9bd640 1 Processor -- start 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edf9bd640 1 -- start start 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edf9bd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edf9bd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed8107930 0x7f5ed819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edf9bd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed810ee00 con 0x7f5ed8101930 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edf9bd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed810ec80 con 0x7f5ed8107930 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59552/0 (socket says 172.21.15.111:59552) 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 -- 172.21.15.111:0/2666181080 learned_addr learned my addr 172.21.15.111:0/2666181080 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edcf58640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed8107930 0x7f5ed819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:35.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 -- 172.21.15.111:0/2666181080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed8107930 msgr2=0x7f5ed819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed8107930 0x7f5ed819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 -- 172.21.15.111:0/2666181080 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed8197810 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.633+0000 7f5edd759640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed819d690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d6f0 tx=0x7f5ed000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.634+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0017070 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.634+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed8197b00 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.634+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ed000de00 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.634+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0004bb0 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.634+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed8198090 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.635+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed8103070 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.635+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f5ed0004e60 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.636+0000 7f5ece7fc640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5ec006e2b0 0x7f5ec0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.636+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f5ed008dd60 con 0x7f5ed8101930 2024-09-16T09:43:35.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.636+0000 7f5edcf58640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5ec006e2b0 0x7f5ec0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.636+0000 7f5edcf58640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5ec006e2b0 0x7f5ec0070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80ffbf0 tx=0x7f5ed4005f30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.640+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5ed005b6c0 con 0x7f5ed8101930 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.845+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5ed8109ea0 con 0x7f5ed8101930 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.846+0000 7f5ece7fc640 1 -- 172.21.15.111:0/2666181080 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+83 (secure 0 0 0) 0x7f5ed005f370 con 0x7f5ed8101930 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5ec006e2b0 msgr2=0x7f5ec0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:35.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5ec006e2b0 0x7f5ec0070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80ffbf0 tx=0x7f5ed4005f30 comp rx=0 tx=0).stop 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 msgr2=0x7f5ed819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed819d690 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d6f0 tx=0x7f5ed000dbb0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 shutdown_connections 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f5ec006e2b0 0x7f5ec0070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5ed8107930 0x7f5ed819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 --2- 172.21.15.111:0/2666181080 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5ed8101930 0x7f5ed819d690 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.848+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 >> 172.21.15.111:0/2666181080 conn(0x7f5ed80fd630 msgr2=0x7f5ed80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.849+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 shutdown_connections 2024-09-16T09:43:35.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:34.849+0000 7f5edf9bd640 1 -- 172.21.15.111:0/2666181080 wait complete. 2024-09-16T09:43:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:34 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2666181080' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T09:43:35.285 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:34 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2666181080' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T09:43:35.565 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T09:43:35.565 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T09:43:35.565 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi111.front.sepia.ceph.com 2024-09-16T09:43:35.565 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-16T09:43:35.565 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:35.565 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T09:43:35.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T09:43:35.566 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T09:43:35.566 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-16T09:43:35.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:35.566 DEBUG:teuthology.orchestra.run.smithi111:> ip addr 2024-09-16T09:43:35.622 INFO:teuthology.orchestra.run.smithi111.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T09:43:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T09:43:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T09:43:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2024-09-16T09:43:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: inet6 ::1/128 scope host 2024-09-16T09:43:35.622 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:d8:a1:24 brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: altname enp7s0f0 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:d8:a1:25 brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: altname enp7s0f1 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:8f:cc:2e brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: link/ether 0c:c4:7a:8f:cc:2f brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:35.623 INFO:teuthology.orchestra.run.smithi111.stdout: inet 172.21.15.111/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T09:43:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft 42353sec preferred_lft 42353sec 2024-09-16T09:43:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: inet6 fe80::ec4:7aff:fe8f:cc2f/64 scope link noprefixroute 2024-09-16T09:43:35.624 INFO:teuthology.orchestra.run.smithi111.stdout: valid_lft forever preferred_lft forever 2024-09-16T09:43:35.624 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T09:43:35.624 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:35.624 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-16T09:43:35.624 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link add name ceph-brx type bridge 2024-09-16T09:43:35.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip addr flush dev ceph-brx 2024-09-16T09:43:35.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set ceph-brx up 2024-09-16T09:43:35.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T09:43:35.625 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-16T09:43:35.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:35.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:35.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:35.868 DEBUG:teuthology.orchestra.run.smithi111:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T09:43:35.892 INFO:teuthology.orchestra.run.smithi111.stdout:1 2024-09-16T09:43:35.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:35.894 DEBUG:teuthology.orchestra.run.smithi111:> route 2024-09-16T09:43:35.983 INFO:teuthology.orchestra.run.smithi111.stdout:Kernel IP routing table 2024-09-16T09:43:35.983 INFO:teuthology.orchestra.run.smithi111.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T09:43:35.983 INFO:teuthology.orchestra.run.smithi111.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T09:43:35.983 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T09:43:35.983 INFO:teuthology.orchestra.run.smithi111.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T09:43:35.984 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:35.984 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-16T09:43:35.984 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T09:43:35.984 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T09:43:35.984 DEBUG:teuthology.orchestra.run.smithi111:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T09:43:35.984 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-16T09:43:36.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:36.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:35 smithi111 ceph-mon[27997]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:36.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:36.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:35 smithi114 ceph-mon[35635]: pgmap v181: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:36.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:36.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:36.439 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2024-09-16T09:43:36.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:36.456 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list-id 2024-09-16T09:43:36.513 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:36.513 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-16T09:43:36.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T09:43:36.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-16T09:43:36.513 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-16T09:43:36.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:36.637 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-16T09:43:36.638 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-16T09:43:36.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:36.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:36.779 DEBUG:teuthology.orchestra.run.smithi111:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:36.779 DEBUG:teuthology.orchestra.run.smithi111:> set -e 2024-09-16T09:43:36.779 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set brx.0 up 2024-09-16T09:43:36.779 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T09:43:36.779 DEBUG:teuthology.orchestra.run.smithi111:> ') 2024-09-16T09:43:36.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:36.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:36.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T09:43:36.856 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:36.870 INFO:teuthology.orchestra.run.smithi111.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-16T09:43:36.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T09:43:36.871 DEBUG:teuthology.orchestra.run.smithi111:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:36.926 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T09:43:36.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:36.926 DEBUG:teuthology.orchestra.run.smithi111:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T09:43:37.035 INFO:teuthology.orchestra.run.smithi111.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T09:43:37.036 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T09:43:37.036 INFO:teuthology.orchestra.run.smithi111.stdout:invalid new device string format 2024-09-16T09:43:37.176 INFO:teuthology.orchestra.run.smithi111.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T09:43:37.176 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T09:43:37.176 INFO:teuthology.orchestra.run.smithi111.stdout:invalid new device string format 2024-09-16T09:43:37.176 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: resolved to: "172.21.15.111:3300,172.21.15.114:3300" 2024-09-16T09:43:37.176 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T09:43:37.181 INFO:teuthology.orchestra.run.smithi111.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-16T09:43:37.181 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:invalid new device string format 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: resolved to: "172.21.15.111:3300,172.21.15.114:3300" 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: resolved to: "172.21.15.111:6789,172.21.15.114:6789" 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.111:6789,172.21.15.114:6789:/ 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=0ada01d2-740f-11ef-bceb-c7b262605968" will pass to kernel 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: You just mounted a file system that supports labels which does not 2024-09-16T09:43:37.182 INFO:teuthology.orchestra.run.smithi111.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T09:43:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T09:43:37.183 INFO:teuthology.orchestra.run.smithi111.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T09:43:37.184 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T09:43:37.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:37.184 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:37.209 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T09:43:37.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T09:43:37.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:37.308 INFO:teuthology.orchestra.run.smithi111.stdout:client14596 2024-09-16T09:43:37.309 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:43:37.309 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T09:43:37.326 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T09:43:37.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T09:43:37.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:37.426 INFO:teuthology.orchestra.run.smithi111.stdout:client14596 2024-09-16T09:43:37.426 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T09:43:37.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T09:43:37.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:37.487 INFO:teuthology.orchestra.run.smithi111.stdout:client14596 2024-09-16T09:43:37.487 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0ada01d2-740f-11ef-bceb-c7b262605968.client14596/status') 2024-09-16T09:43:37.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:37.548 INFO:teuthology.orchestra.run.smithi111.stdout:instance: client.14596 (3)192.168.0.1:0/364902094 2024-09-16T09:43:37.549 INFO:teuthology.orchestra.run.smithi111.stdout:blocklisted: false 2024-09-16T09:43:37.549 INFO:teuthology.orchestra.run.smithi111.stderr:0+1 records in 2024-09-16T09:43:37.549 INFO:teuthology.orchestra.run.smithi111.stderr:0+1 records out 2024-09-16T09:43:37.549 INFO:teuthology.orchestra.run.smithi111.stderr:69 bytes copied, 3.9559e-05 s, 1.7 MB/s 2024-09-16T09:43:37.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:37.557 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-16T09:43:37.557 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-16T09:43:37.557 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:37.557 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-16T09:43:37.805 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:37.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:37.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:37.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:37.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:37.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:37.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:37 smithi111 ceph-mon[27997]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:43:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:43:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:43:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:37 smithi114 ceph-mon[35635]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 -- 172.21.15.111:0/1918166385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc106810 msgr2=0x7f50bc106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/1918166385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc106810 0x7f50bc106bf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009880 tx=0x7f50b002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 -- 172.21.15.111:0/1918166385 shutdown_connections 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/1918166385 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc100810 0x7f50bc100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/1918166385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc106810 0x7f50bc106bf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 -- 172.21.15.111:0/1918166385 >> 172.21.15.111:0/1918166385 conn(0x7f50bc0fc510 msgr2=0x7f50bc0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 -- 172.21.15.111:0/1918166385 shutdown_connections 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.231+0000 7f50c2e4c640 1 -- 172.21.15.111:0/1918166385 wait complete. 2024-09-16T09:43:38.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c2e4c640 1 Processor -- start 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c2e4c640 1 -- start start 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c2e4c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 0x7f50bc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c2e4c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc106810 0x7f50bc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c2e4c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc10dd40 con 0x7f50bc100810 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c2e4c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f50bc10dbc0 con 0x7f50bc106810 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c0be8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 0x7f50bc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c0be8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 0x7f50bc19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59564/0 (socket says 172.21.15.111:59564) 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.232+0000 7f50c0be8640 1 -- 172.21.15.111:0/155413171 learned_addr learned my addr 172.21.15.111:0/155413171 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50bbfff640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc106810 0x7f50bc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50c0be8640 1 -- 172.21.15.111:0/155413171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc106810 msgr2=0x7f50bc19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:38.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50c0be8640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc106810 0x7f50bc19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50c0be8640 1 -- 172.21.15.111:0/155413171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50bc197830 con 0x7f50bc100810 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50c0be8640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 0x7f50bc19d6b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50b0031460 tx=0x7f50b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50b003f070 con 0x7f50bc100810 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50bc197ac0 con 0x7f50bc100810 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f50b0004cf0 con 0x7f50bc100810 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f50b0035030 con 0x7f50bc100810 2024-09-16T09:43:38.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.233+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50bc197ff0 con 0x7f50bc100810 2024-09-16T09:43:38.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.234+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50bc101f50 con 0x7f50bc100810 2024-09-16T09:43:38.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.235+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f50b0042070 con 0x7f50bc100810 2024-09-16T09:43:38.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.235+0000 7f50b9ffb640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f50ac06e2b0 0x7f50ac070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:38.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.235+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f50b00aec50 con 0x7f50bc100810 2024-09-16T09:43:38.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.235+0000 7f50bbfff640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f50ac06e2b0 0x7f50ac070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:38.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.236+0000 7f50bbfff640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f50ac06e2b0 0x7f50ac070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50bc06b350 tx=0x7f50a8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:38.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.240+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f50b007c5b0 con 0x7f50bc100810 2024-09-16T09:43:38.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.440+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f50bc198d60 con 0x7f50bc100810 2024-09-16T09:43:38.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.441+0000 7f50b9ffb640 1 -- 172.21.15.111:0/155413171 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+83 (secure 0 0 0) 0x7f50b0080260 con 0x7f50bc100810 2024-09-16T09:43:38.443 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f50ac06e2b0 msgr2=0x7f50ac070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f50ac06e2b0 0x7f50ac070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50bc06b350 tx=0x7f50a8008040 comp rx=0 tx=0).stop 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 msgr2=0x7f50bc19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 0x7f50bc19d6b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f50b0031460 tx=0x7f50b00048f0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 shutdown_connections 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f50ac06e2b0 0x7f50ac070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f50bc106810 0x7f50bc19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 --2- 172.21.15.111:0/155413171 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50bc100810 0x7f50bc19d6b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 >> 172.21.15.111:0/155413171 conn(0x7f50bc0fc510 msgr2=0x7f50bc1045e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:38.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 shutdown_connections 2024-09-16T09:43:38.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:38.443+0000 7f50c2e4c640 1 -- 172.21.15.111:0/155413171 wait complete. 2024-09-16T09:43:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:38 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/155413171' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T09:43:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:38 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/155413171' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-16T09:43:39.218 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-16T09:43:39.218 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-16T09:43:39.219 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-16T09:43:39.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:39.219 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-09-16T09:43:39.239 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-16T09:43:39.239 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-16T09:43:39.239 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-09-16T09:43:39.239 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T09:43:39.239 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-09-16T09:43:39.239 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42330sec preferred_lft 42330sec 2024-09-16T09:43:39.240 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link noprefixroute 2024-09-16T09:43:39.241 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-09-16T09:43:39.241 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-16T09:43:39.241 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T09:43:39.336 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:39.450 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:39.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:39.458 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-16T09:43:39.482 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-09-16T09:43:39.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:39.484 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-09-16T09:43:39.557 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-09-16T09:43:39.557 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-16T09:43:39.558 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-16T09:43:39.558 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-16T09:43:39.558 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-16T09:43:39.558 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:39.558 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T09:43:39.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-16T09:43:39.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-16T09:43:39.558 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-16T09:43:39.558 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T09:43:39.645 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:39.874 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:39.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:39.880 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T09:43:39.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:39.895 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-09-16T09:43:39.936 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:39 smithi114 ceph-mon[35635]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:39.952 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:39.953 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T09:43:39.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T09:43:39.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-16T09:43:39.953 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T09:43:40.040 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:40.063 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.069 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-16T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T09:43:40.069 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-16T09:43:40.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-16T09:43:40.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-16T09:43:40.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-16T09:43:40.070 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-16T09:43:40.070 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T09:43:40.118 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:40.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:39 smithi111 ceph-mon[27997]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:43:40.183 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.189 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-16T09:43:40.190 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-09-16T09:43:40.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-09-16T09:43:40.190 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-09-16T09:43:40.190 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-09-16T09:43:40.238 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:40.260 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T09:43:40.267 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:40.282 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-16T09:43:40.282 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-16T09:43:40.282 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:40.337 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-16T09:43:40.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:40.337 DEBUG:teuthology.orchestra.run.smithi114:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T09:43:40.442 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T09:43:40.442 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T09:43:40.442 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T09:43:40.576 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T09:43:40.576 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T09:43:40.576 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T09:43:40.576 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.111:3300,172.21.15.114:3300" 2024-09-16T09:43:40.576 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T09:43:40.580 INFO:teuthology.orchestra.run.smithi114.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-16T09:43:40.580 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-16T09:43:40.580 INFO:teuthology.orchestra.run.smithi114.stdout:invalid new device string format 2024-09-16T09:43:40.580 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.111:3300,172.21.15.114:3300" 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: resolved to: "172.21.15.111:6789,172.21.15.114:6789" 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.111:6789,172.21.15.114:6789:/ 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=0ada01d2-740f-11ef-bceb-c7b262605968" will pass to kernel 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout: You just mounted a file system that supports labels which does not 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-16T09:43:40.581 INFO:teuthology.orchestra.run.smithi114.stdout: applications will generate AVC messages and not be allowed access to 2024-09-16T09:43:40.582 INFO:teuthology.orchestra.run.smithi114.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-16T09:43:40.583 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-16T09:43:40.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:43:40.584 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:40.608 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T09:43:40.698 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T09:43:40.700 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.706 INFO:teuthology.orchestra.run.smithi114.stdout:client14602 2024-09-16T09:43:40.706 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:43:40.706 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T09:43:40.723 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T09:43:40.811 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T09:43:40.813 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.819 INFO:teuthology.orchestra.run.smithi114.stdout:client14602 2024-09-16T09:43:40.819 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-16T09:43:40.867 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-16T09:43:40.869 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.874 INFO:teuthology.orchestra.run.smithi114.stdout:client14602 2024-09-16T09:43:40.875 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/0ada01d2-740f-11ef-bceb-c7b262605968.client14602/status') 2024-09-16T09:43:40.923 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-16T09:43:40.933 INFO:teuthology.orchestra.run.smithi114.stdout:instance: client.14602 (3)172.21.15.114:0/1127282170 2024-09-16T09:43:40.933 INFO:teuthology.orchestra.run.smithi114.stdout:blocklisted: false 2024-09-16T09:43:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records in 2024-09-16T09:43:40.933 INFO:teuthology.orchestra.run.smithi114.stderr:0+1 records out 2024-09-16T09:43:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:72 bytes copied, 3.9481e-05 s, 1.8 MB/s 2024-09-16T09:43:40.934 INFO:teuthology.orchestra.run.smithi114.stderr:2024-09-16T09:43:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-16T09:43:40.940 INFO:teuthology.run_tasks:Running task print... 2024-09-16T09:43:40.950 INFO:teuthology.task.print:**** done client 2024-09-16T09:43:40.951 INFO:teuthology.run_tasks:Running task parallel... 2024-09-16T09:43:40.961 INFO:teuthology.task.parallel:starting parallel... 2024-09-16T09:43:40.961 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-16T09:43:40.962 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T09:43:40.962 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:43:40.962 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-16T09:43:40.963 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-16T09:43:40.963 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-16T09:43:40.968 INFO:tasks.workunit:Pulling workunits from ref 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:43:40.968 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-16T09:43:40.968 INFO:tasks.workunit:timeout=3h 2024-09-16T09:43:40.968 INFO:tasks.workunit:cleanup=True 2024-09-16T09:43:40.972 DEBUG:teuthology.orchestra.run.smithi111:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:40.994 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 89h/137d Inode: 1 Links: 2 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-09-16 09:43:15.000014357 +0000 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-09-16 09:43:37.206120745 +0000 2024-09-16T09:43:40.995 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: 2024-09-16 09:43:15.000014357 +0000 2024-09-16T09:43:40.995 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-16T09:43:40.995 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-16T09:43:41.066 DEBUG:teuthology.orchestra.run.smithi114:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-09-16 09:43:41.060047722 +0000 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-09-16 09:43:41.060047722 +0000 2024-09-16T09:43:41.083 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: 2024-09-16 09:43:15.000014357 +0000 2024-09-16T09:43:41.084 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-16T09:43:41.084 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-16T09:43:41.152 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:43:41.153 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:43:41.169 INFO:tasks.workunit.client.0.smithi111.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-16T09:43:41.208 INFO:tasks.workunit.client.1.smithi114.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-16T09:43:41.245 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:41.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 -- 172.21.15.111:0/3371357316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 msgr2=0x7f3a0c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3371357316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c101ec0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3a00009c20 tx=0x7f3a0002a970 comp rx=0 tx=0).stop 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 -- 172.21.15.111:0/3371357316 shutdown_connections 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3371357316 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c101ec0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3371357316 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c100840 0x7f3a0c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 -- 172.21.15.111:0/3371357316 >> 172.21.15.111:0/3371357316 conn(0x7f3a0c0fbff0 msgr2=0x7f3a0c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 -- 172.21.15.111:0/3371357316 shutdown_connections 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 -- 172.21.15.111:0/3371357316 wait complete. 2024-09-16T09:43:41.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 Processor -- start 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.879+0000 7f3a121bc640 1 -- start start 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a121bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c100840 0x7f3a0c196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a121bc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c1968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a121bc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c109660 con 0x7f3a0c101a40 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a121bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1094e0 con 0x7f3a0c100840 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c1968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c1968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59578/0 (socket says 172.21.15.111:59578) 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 -- 172.21.15.111:0/3653997540 learned_addr learned my addr 172.21.15.111:0/3653997540 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0b7fe640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c100840 0x7f3a0c196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:41.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 -- 172.21.15.111:0/3653997540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c100840 msgr2=0x7f3a0c196370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c100840 0x7f3a0c196370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 -- 172.21.15.111:0/3653997540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c196f30 con 0x7f3a0c101a40 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a0affd640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c1968b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a0002f900 tx=0x7f3a0002f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a00047070 con 0x7f3a0c101a40 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a00003e30 con 0x7f3a0c101a40 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0c19b910 con 0x7f3a0c101a40 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a00034070 con 0x7f3a0c101a40 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.880+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0c19bf20 con 0x7f3a0c101a40 2024-09-16T09:43:41.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.882+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0c100c40 con 0x7f3a0c101a40 2024-09-16T09:43:41.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.882+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f3a0004a070 con 0x7f3a0c101a40 2024-09-16T09:43:41.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.882+0000 7f3a08ff9640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f39f406e2b0 0x7f39f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:41.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.883+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f3a000aef70 con 0x7f3a0c101a40 2024-09-16T09:43:41.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.883+0000 7f3a0b7fe640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f39f406e2b0 0x7f39f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:41.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.883+0000 7f3a0b7fe640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f39f406e2b0 0x7f39f4070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c1018a0 tx=0x7f39fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:41.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:41.887+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3a0003f070 con 0x7f3a0c101a40 2024-09-16T09:43:42.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.055+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f3a0c190470 con 0x7f3a0c101a40 2024-09-16T09:43:42.057 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:41 smithi111 ceph-mon[27997]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-16T09:43:42.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.056+0000 7f3a08ff9640 1 -- 172.21.15.111:0/3653997540 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v42)=0 v42) ==== 155+0+0 (secure 0 0 0) 0x7f3a0002fe40 con 0x7f3a0c101a40 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f39f406e2b0 msgr2=0x7f39f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f39f406e2b0 0x7f39f4070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c1018a0 tx=0x7f39fc00a2d0 comp rx=0 tx=0).stop 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 msgr2=0x7f3a0c1968b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c1968b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a0002f900 tx=0x7f3a0002f730 comp rx=0 tx=0).stop 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 shutdown_connections 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f39f406e2b0 0x7f39f4070770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a0c101a40 0x7f3a0c1968b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 --2- 172.21.15.111:0/3653997540 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a0c100840 0x7f3a0c196370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:42.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 >> 172.21.15.111:0/3653997540 conn(0x7f3a0c0fbff0 msgr2=0x7f3a0c104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:42.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 shutdown_connections 2024-09-16T09:43:42.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:42.058+0000 7f3a121bc640 1 -- 172.21.15.111:0/3653997540 wait complete. 2024-09-16T09:43:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:41 smithi114 ceph-mon[35635]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-16T09:43:42.611 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-16T09:43:42.898 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:43.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 -- 172.21.15.111:0/3037661969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c101a40 msgr2=0x7fe56c101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:43.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 --2- 172.21.15.111:0/3037661969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c101a40 0x7fe56c101ec0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe554009880 tx=0x7fe55402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 -- 172.21.15.111:0/3037661969 shutdown_connections 2024-09-16T09:43:43.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 --2- 172.21.15.111:0/3037661969 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c101a40 0x7fe56c101ec0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 --2- 172.21.15.111:0/3037661969 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56c100840 0x7fe56c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 -- 172.21.15.111:0/3037661969 >> 172.21.15.111:0/3037661969 conn(0x7fe56c0fbff0 msgr2=0x7fe56c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:43.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 -- 172.21.15.111:0/3037661969 shutdown_connections 2024-09-16T09:43:43.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.343+0000 7fe57208a640 1 -- 172.21.15.111:0/3037661969 wait complete. 2024-09-16T09:43:43.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe57208a640 1 Processor -- start 2024-09-16T09:43:43.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe57208a640 1 -- start start 2024-09-16T09:43:43.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe57208a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 0x7fe56c06a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe57208a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56c101a40 0x7fe56c19c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe57208a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c109680 con 0x7fe56c100840 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe57208a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c109500 con 0x7fe56c101a40 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 0x7fe56c06a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 0x7fe56c06a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:59596/0 (socket says 172.21.15.111:59596) 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe56b7fe640 1 -- 172.21.15.111:0/752920538 learned_addr learned my addr 172.21.15.111:0/752920538 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe563fff640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56c101a40 0x7fe56c19c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe56b7fe640 1 -- 172.21.15.111:0/752920538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56c101a40 msgr2=0x7fe56c19c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe56b7fe640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56c101a40 0x7fe56c19c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.344+0000 7fe56b7fe640 1 -- 172.21.15.111:0/752920538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c19c7a0 con 0x7fe56c100840 2024-09-16T09:43:43.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.345+0000 7fe56b7fe640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 0x7fe56c06a660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c8f0 tx=0x7fe55c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.345+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe55c004020 con 0x7fe56c100840 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.345+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c19ca90 con 0x7fe56c100840 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.345+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe55c0041c0 con 0x7fe56c100840 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.345+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe55c0047a0 con 0x7fe56c100840 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.345+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c19d020 con 0x7fe56c100840 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.346+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c100c40 con 0x7fe56c100840 2024-09-16T09:43:43.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.346+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fe55c004370 con 0x7fe56c100840 2024-09-16T09:43:43.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.347+0000 7fe5697fa640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe55806e2b0 0x7fe558070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:43.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.347+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fe55c08e080 con 0x7fe56c100840 2024-09-16T09:43:43.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.347+0000 7fe563fff640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe55806e2b0 0x7fe558070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:43.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.347+0000 7fe563fff640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe55806e2b0 0x7fe558070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06a3e0 tx=0x7fe554005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:43.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.351+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe55c014030 con 0x7fe56c100840 2024-09-16T09:43:43.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.516+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fe56c062df0 con 0x7fe56c100840 2024-09-16T09:43:43.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.517+0000 7fe5697fa640 1 -- 172.21.15.111:0/752920538 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v42)=0 v42) ==== 163+0+0 (secure 0 0 0) 0x7fe55c05b950 con 0x7fe56c100840 2024-09-16T09:43:43.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe55806e2b0 msgr2=0x7fe558070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:43.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe55806e2b0 0x7fe558070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06a3e0 tx=0x7fe554005a20 comp rx=0 tx=0).stop 2024-09-16T09:43:43.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 msgr2=0x7fe56c06a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:43.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 0x7fe56c06a660 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c8f0 tx=0x7fe55c00cdb0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 shutdown_connections 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fe55806e2b0 0x7fe558070770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe56c101a40 0x7fe56c19c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 --2- 172.21.15.111:0/752920538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe56c100840 0x7fe56c06a660 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 >> 172.21.15.111:0/752920538 conn(0x7fe56c0fbff0 msgr2=0x7fe56c104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 shutdown_connections 2024-09-16T09:43:43.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:43.519+0000 7fe57208a640 1 -- 172.21.15.111:0/752920538 wait complete. 2024-09-16T09:43:44.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:43 smithi111 ceph-mon[27997]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-16T09:43:44.082 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-16T09:43:44.329 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:43 smithi114 ceph-mon[35635]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-16T09:43:44.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 -- 172.21.15.111:0/4169702844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4102b60 msgr2=0x7f12f4102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 --2- 172.21.15.111:0/4169702844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4102b60 0x7f12f4102fe0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f12e4009880 tx=0x7f12e402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 -- 172.21.15.111:0/4169702844 shutdown_connections 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 --2- 172.21.15.111:0/4169702844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4102b60 0x7f12f4102fe0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 --2- 172.21.15.111:0/4169702844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4101960 0x7f12f4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 -- 172.21.15.111:0/4169702844 >> 172.21.15.111:0/4169702844 conn(0x7f12f40fd0f0 msgr2=0x7f12f40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 -- 172.21.15.111:0/4169702844 shutdown_connections 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.815+0000 7f12fbe60640 1 -- 172.21.15.111:0/4169702844 wait complete. 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12fbe60640 1 Processor -- start 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12fbe60640 1 -- start start 2024-09-16T09:43:44.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12fbe60640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 0x7f12f4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12fbe60640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4102b60 0x7f12f4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12fbe60640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f12f410a820 con 0x7f12f4101960 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12fbe60640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f12f410a6a0 con 0x7f12f4102b60 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f9bfc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 0x7f12f4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f9bfc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 0x7f12f4197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56718/0 (socket says 172.21.15.111:56718) 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f9bfc640 1 -- 172.21.15.111:0/3455148979 learned_addr learned my addr 172.21.15.111:0/3455148979 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f93fb640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4102b60 0x7f12f4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f9bfc640 1 -- 172.21.15.111:0/3455148979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4102b60 msgr2=0x7f12f4197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f9bfc640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4102b60 0x7f12f4197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f9bfc640 1 -- 172.21.15.111:0/3455148979 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f41980d0 con 0x7f12f4101960 2024-09-16T09:43:44.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.816+0000 7f12f93fb640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4102b60 0x7f12f4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:43:44.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.817+0000 7f12f9bfc640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 0x7f12f4197510 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f12f000b9c0 tx=0x7f12f000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:44.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.817+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12f0019070 con 0x7f12f4101960 2024-09-16T09:43:44.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.817+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12f000cde0 con 0x7f12f4101960 2024-09-16T09:43:44.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.817+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f419cb10 con 0x7f12f4101960 2024-09-16T09:43:44.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.817+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f12f0012570 con 0x7f12f4101960 2024-09-16T09:43:44.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.817+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f419d0a0 con 0x7f12f4101960 2024-09-16T09:43:44.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.818+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f4101d60 con 0x7f12f4101960 2024-09-16T09:43:44.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.818+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f12f001c070 con 0x7f12f4101960 2024-09-16T09:43:44.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.819+0000 7f12eaffd640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f12e006e2b0 0x7f12e0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:44.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.819+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f12f008dae0 con 0x7f12f4101960 2024-09-16T09:43:44.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.819+0000 7f12f93fb640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f12e006e2b0 0x7f12e0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:44.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.819+0000 7f12f93fb640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f12e006e2b0 0x7f12e0070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12e40096c0 tx=0x7f12e4009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:44.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.823+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f12f005b440 con 0x7f12f4101960 2024-09-16T09:43:44.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.993+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f12f419d3c0 con 0x7f12f4101960 2024-09-16T09:43:44.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.994+0000 7f12eaffd640 1 -- 172.21.15.111:0/3455148979 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v42)=0 v42) ==== 135+0+0 (secure 0 0 0) 0x7f12f005f0f0 con 0x7f12f4101960 2024-09-16T09:43:44.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f12e006e2b0 msgr2=0x7f12e0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:44.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f12e006e2b0 0x7f12e0070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f12e40096c0 tx=0x7f12e4009650 comp rx=0 tx=0).stop 2024-09-16T09:43:44.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 msgr2=0x7f12f4197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:44.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 0x7f12f4197510 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f12f000b9c0 tx=0x7f12f000be80 comp rx=0 tx=0).stop 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 shutdown_connections 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f12e006e2b0 0x7f12e0070770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f12f4102b60 0x7f12f4197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 --2- 172.21.15.111:0/3455148979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f12f4101960 0x7f12f4197510 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 >> 172.21.15.111:0/3455148979 conn(0x7f12f40fd0f0 msgr2=0x7f12f40ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.996+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 shutdown_connections 2024-09-16T09:43:45.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:44.997+0000 7f12fbe60640 1 -- 172.21.15.111:0/3455148979 wait complete. 2024-09-16T09:43:45.600 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-16T09:43:45.849 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:43:46.208 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:45 smithi111 ceph-mon[27997]: pgmap v186: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 -- 172.21.15.111:0/1392263621 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 msgr2=0x7f46e4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 --2- 172.21.15.111:0/1392263621 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e4101d60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009880 tx=0x7f46e002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 -- 172.21.15.111:0/1392263621 shutdown_connections 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 --2- 172.21.15.111:0/1392263621 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 0x7f46e4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 --2- 172.21.15.111:0/1392263621 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e4101d60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 -- 172.21.15.111:0/1392263621 >> 172.21.15.111:0/1392263621 conn(0x7f46e40fd0f0 msgr2=0x7f46e40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.291+0000 7f46ebd21640 1 -- 172.21.15.111:0/1392263621 shutdown_connections 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 -- 172.21.15.111:0/1392263621 wait complete. 2024-09-16T09:43:46.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 Processor -- start 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 -- start start 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 0x7f46e4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f46e410a7a0 con 0x7f46e4101960 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46ebd21640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f46e410a620 con 0x7f46e4102b60 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46e9abd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46e9abd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e41974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56726/0 (socket says 172.21.15.111:56726) 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.292+0000 7f46e9abd640 1 -- 172.21.15.111:0/2176832297 learned_addr learned my addr 172.21.15.111:0/2176832297 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46e92bc640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 0x7f46e4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46e9abd640 1 -- 172.21.15.111:0/2176832297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 msgr2=0x7f46e4197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46e9abd640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 0x7f46e4197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46e9abd640 1 -- 172.21.15.111:0/2176832297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4198080 con 0x7f46e4101960 2024-09-16T09:43:46.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46e92bc640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 0x7f46e4197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46e9abd640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e41974c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009230 tx=0x7f46e00045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46e003f070 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46e0004a50 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46e0035030 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e419ca60 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.293+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e419cff0 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.294+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e4101d60 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.295+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f46e0042070 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.295+0000 7f46daffd640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f46d006e300 0x7f46d00707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.295+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f46e00aec90 con 0x7f46e4101960 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.295+0000 7f46e92bc640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f46d006e300 0x7f46d00707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:43:46.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.295+0000 7f46e92bc640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f46d006e300 0x7f46d00707c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f46d40058c0 tx=0x7f46d4005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:43:46.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.299+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f46e007c670 con 0x7f46e4101960 2024-09-16T09:43:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:45 smithi114 ceph-mon[35635]: pgmap v186: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-09-16T09:43:46.486 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:43:46.484+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f46e40627a0 con 0x7f46d006e300 2024-09-16T09:43:48.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:47 smithi111 ceph-mon[27997]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:47 smithi111 ceph-mon[27997]: pgmap v187: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-16T09:43:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:47 smithi114 ceph-mon[35635]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:43:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:47 smithi114 ceph-mon[35635]: pgmap v187: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-16T09:43:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:49 smithi114 ceph-mon[35635]: pgmap v188: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-16T09:43:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:49 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:50.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:49 smithi111 ceph-mon[27997]: pgmap v188: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-16T09:43:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:49 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:43:52.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:51 smithi111 ceph-mon[27997]: pgmap v189: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-16T09:43:52.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:51 smithi114 ceph-mon[35635]: pgmap v189: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-09-16T09:43:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:53 smithi111 ceph-mon[27997]: pgmap v190: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-16T09:43:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:53 smithi114 ceph-mon[35635]: pgmap v190: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-16T09:43:56.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:55 smithi111 ceph-mon[27997]: pgmap v191: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-16T09:43:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:55 smithi114 ceph-mon[35635]: pgmap v191: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-16T09:43:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:57 smithi111 ceph-mon[27997]: pgmap v192: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-16T09:43:58.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:57 smithi114 ceph-mon[35635]: pgmap v192: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-16T09:44:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:43:59 smithi114 ceph-mon[35635]: pgmap v193: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:00.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:43:59 smithi111 ceph-mon[27997]: pgmap v193: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:02.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:01 smithi111 ceph-mon[27997]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:01 smithi114 ceph-mon[35635]: pgmap v194: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:04.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:03 smithi111 ceph-mon[27997]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:03 smithi114 ceph-mon[35635]: pgmap v195: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:04 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:05.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:04 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:06.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:05 smithi111 ceph-mon[27997]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:06.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:05 smithi114 ceph-mon[35635]: pgmap v196: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:08.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:07 smithi111 ceph-mon[27997]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:07 smithi114 ceph-mon[35635]: pgmap v197: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:10.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:09 smithi114 ceph-mon[35635]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:10.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:09 smithi111 ceph-mon[27997]: pgmap v198: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:11 smithi111 ceph-mon[27997]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:11 smithi114 ceph-mon[35635]: pgmap v199: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:14.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:13 smithi111 ceph-mon[27997]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:13 smithi114 ceph-mon[35635]: pgmap v200: 65 pgs: 65 active+clean; 584 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:16.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:15 smithi111 ceph-mon[27997]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:44:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:15 smithi114 ceph-mon[35635]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:44:18.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:17 smithi111 ceph-mon[27997]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:17 smithi114 ceph-mon[35635]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:19 smithi114 ceph-mon[35635]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:19 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:20.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:19 smithi111 ceph-mon[27997]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:20.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:19 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:22.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:21 smithi114 ceph-mon[35635]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-16T09:44:22.358 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:21 smithi111 ceph-mon[27997]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-09-16T09:44:24.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:24 smithi111 ceph-mon[27997]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-16T09:44:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:24 smithi114 ceph-mon[35635]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-16T09:44:26.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:26 smithi111 ceph-mon[27997]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-16T09:44:26.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:26 smithi114 ceph-mon[35635]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-16T09:44:28.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:28 smithi111 ceph-mon[27997]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-16T09:44:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:28 smithi114 ceph-mon[35635]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-16T09:44:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:30 smithi114 ceph-mon[35635]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:30.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:30 smithi111 ceph-mon[27997]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:32.333 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:32 smithi114 ceph-mon[35635]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:32.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:32 smithi111 ceph-mon[27997]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-16T09:44:34.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:34 smithi111 ceph-mon[27997]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-16T09:44:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:34 smithi114 ceph-mon[35635]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-16T09:44:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:35 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:35.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:35 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:36.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:36 smithi111 ceph-mon[27997]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-16T09:44:36.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:36 smithi114 ceph-mon[35635]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-16T09:44:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:37 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:44:37.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:37 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:44:38.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:38 smithi111 ceph-mon[27997]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-16T09:44:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:38 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:44:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:38 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:44:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:38 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:44:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:38 smithi114 ceph-mon[35635]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 85 B/s wr, 0 op/s 2024-09-16T09:44:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:38 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:44:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:38 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:44:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:38 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:44:40.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:40 smithi111 ceph-mon[27997]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:40.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:40 smithi114 ceph-mon[35635]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:42.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:42 smithi111 ceph-mon[27997]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:Note: switching to '66e33d6af1496291b0602ee0a859e68145f17dad'. 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr: git switch -c 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.397 INFO:tasks.workunit.client.1.smithi114.stderr:Or undo this operation with: 2024-09-16T09:44:42.398 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.398 INFO:tasks.workunit.client.1.smithi114.stderr: git switch - 2024-09-16T09:44:42.398 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.398 INFO:tasks.workunit.client.1.smithi114.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T09:44:42.398 INFO:tasks.workunit.client.1.smithi114.stderr: 2024-09-16T09:44:42.398 INFO:tasks.workunit.client.1.smithi114.stderr:HEAD is now at 66e33d6af14 Merge branch 'nfs-export-apply-fix' of https://github.com/rhcs-dashboard/ceph into wip-athakkar-testing-2024-09-12-1857 2024-09-16T09:44:42.402 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-16T09:44:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:42 smithi114 ceph-mon[35635]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:42.504 INFO:tasks.workunit.client.1.smithi114.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T09:44:42.506 INFO:tasks.workunit.client.1.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-16T09:44:42.506 INFO:tasks.workunit.client.1.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T09:44:43.212 INFO:tasks.workunit.client.1.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T09:44:43.288 INFO:tasks.workunit.client.1.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T09:44:43.329 INFO:tasks.workunit.client.1.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-16T09:44:43.331 INFO:tasks.workunit.client.1.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-16T09:44:43.331 INFO:tasks.workunit.client.1.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T09:44:43.370 INFO:tasks.workunit.client.1.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-16T09:44:43.373 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:44:43.374 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-16T09:44:43.389 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-16T09:44:43.391 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T09:44:43.391 DEBUG:teuthology.orchestra.run.smithi114:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66e33d6af1496291b0602ee0a859e68145f17dad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-16T09:44:43.451 INFO:tasks.workunit.client.1.smithi114.stderr:+ mkdir -p fsstress 2024-09-16T09:44:43.453 INFO:tasks.workunit.client.1.smithi114.stderr:+ pushd fsstress 2024-09-16T09:44:43.453 INFO:tasks.workunit.client.1.smithi114.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T09:44:43.454 INFO:tasks.workunit.client.1.smithi114.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T09:44:44.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:44 smithi111 ceph-mon[27997]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:44 smithi114 ceph-mon[35635]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 175 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:44:44.438 INFO:tasks.workunit.client.1.smithi114.stderr:+ tar xzf ltp-full.tgz 2024-09-16T09:44:46.295 INFO:tasks.workunit.client.0.smithi111.stderr:Updating files: 84% (10697/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-16T09:44:46.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:46 smithi111 ceph-mon[27997]: pgmap v216: 65 pgs: 65 active+clean; 599 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-16T09:44:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:46 smithi114 ceph-mon[35635]: pgmap v216: 65 pgs: 65 active+clean; 599 KiB data, 175 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 0 op/s 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:Note: switching to '66e33d6af1496291b0602ee0a859e68145f17dad'. 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:state without impacting any branches by switching back to a branch. 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-16T09:44:46.894 INFO:tasks.workunit.client.0.smithi111.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: git switch -c 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr:Or undo this operation with: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: git switch - 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr: 2024-09-16T09:44:46.895 INFO:tasks.workunit.client.0.smithi111.stderr:HEAD is now at 66e33d6af14 Merge branch 'nfs-export-apply-fix' of https://github.com/rhcs-dashboard/ceph into wip-athakkar-testing-2024-09-12-1857 2024-09-16T09:44:46.899 DEBUG:teuthology.orchestra.run.smithi111:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-16T09:44:46.924 INFO:tasks.workunit.client.0.smithi111.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-16T09:44:46.927 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T09:44:46.927 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-16T09:44:47.615 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-16T09:44:47.690 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-16T09:44:47.730 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-16T09:44:47.732 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T09:44:47.732 INFO:tasks.workunit.client.0.smithi111.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-16T09:44:47.776 INFO:tasks.workunit.client.0.smithi111.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-16T09:44:47.780 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:44:47.780 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-16T09:44:47.836 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-16T09:44:47.837 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-16T09:44:47.837 DEBUG:teuthology.orchestra.run.smithi111:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=66e33d6af1496291b0602ee0a859e68145f17dad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-16T09:44:47.897 INFO:tasks.workunit.client.0.smithi111.stderr:+ mkdir -p fsstress 2024-09-16T09:44:47.899 INFO:tasks.workunit.client.0.smithi111.stderr:+ pushd fsstress 2024-09-16T09:44:47.899 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T09:44:47.899 INFO:tasks.workunit.client.0.smithi111.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-16T09:44:48.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:48 smithi111 ceph-mon[27997]: pgmap v217: 65 pgs: 65 active+clean; 599 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s wr, 0 op/s 2024-09-16T09:44:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:48 smithi114 ceph-mon[35635]: pgmap v217: 65 pgs: 65 active+clean; 599 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s wr, 0 op/s 2024-09-16T09:44:49.040 INFO:tasks.workunit.client.0.smithi111.stderr:+ tar xzf ltp-full.tgz 2024-09-16T09:44:50.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:50 smithi111 ceph-mon[27997]: pgmap v218: 65 pgs: 65 active+clean; 599 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s wr, 0 op/s 2024-09-16T09:44:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:50 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:50.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:50 smithi114 ceph-mon[35635]: pgmap v218: 65 pgs: 65 active+clean; 599 KiB data, 180 MiB used, 536 GiB / 536 GiB avail; 3.9 KiB/s wr, 0 op/s 2024-09-16T09:44:50.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:50 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:44:52.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:52 smithi111 ceph-mon[27997]: pgmap v219: 65 pgs: 65 active+clean; 6.8 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 568 KiB/s wr, 57 op/s 2024-09-16T09:44:52.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:52 smithi114 ceph-mon[35635]: pgmap v219: 65 pgs: 65 active+clean; 6.8 MiB data, 188 MiB used, 536 GiB / 536 GiB avail; 568 KiB/s wr, 57 op/s 2024-09-16T09:44:54.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:54 smithi111 ceph-mon[27997]: pgmap v220: 65 pgs: 65 active+clean; 32 MiB data, 277 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 238 op/s 2024-09-16T09:44:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:54 smithi114 ceph-mon[35635]: pgmap v220: 65 pgs: 65 active+clean; 32 MiB data, 277 MiB used, 536 GiB / 536 GiB avail; 2.8 MiB/s wr, 238 op/s 2024-09-16T09:44:56.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:56 smithi111 ceph-mon[27997]: pgmap v221: 65 pgs: 65 active+clean; 45 MiB data, 332 MiB used, 536 GiB / 536 GiB avail; 3.9 MiB/s wr, 306 op/s 2024-09-16T09:44:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:56 smithi114 ceph-mon[35635]: pgmap v221: 65 pgs: 65 active+clean; 45 MiB data, 332 MiB used, 536 GiB / 536 GiB avail; 3.9 MiB/s wr, 306 op/s 2024-09-16T09:44:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:44:58 smithi111 ceph-mon[27997]: pgmap v222: 65 pgs: 65 active+clean; 59 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s wr, 406 op/s 2024-09-16T09:44:58.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:44:58 smithi114 ceph-mon[35635]: pgmap v222: 65 pgs: 65 active+clean; 59 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s wr, 406 op/s 2024-09-16T09:45:00.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:00 smithi111 ceph-mon[27997]: pgmap v223: 65 pgs: 65 active+clean; 59 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s wr, 406 op/s 2024-09-16T09:45:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:00 smithi114 ceph-mon[35635]: pgmap v223: 65 pgs: 65 active+clean; 59 MiB data, 410 MiB used, 536 GiB / 536 GiB avail; 5.1 MiB/s wr, 406 op/s 2024-09-16T09:45:02.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:02 smithi111 ceph-mon[27997]: pgmap v224: 65 pgs: 65 active+clean; 69 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s wr, 415 op/s 2024-09-16T09:45:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:02 smithi114 ceph-mon[35635]: pgmap v224: 65 pgs: 65 active+clean; 69 MiB data, 422 MiB used, 536 GiB / 536 GiB avail; 5.9 MiB/s wr, 415 op/s 2024-09-16T09:45:04.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:04 smithi111 ceph-mon[27997]: pgmap v225: 65 pgs: 65 active+clean; 69 MiB data, 438 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s wr, 359 op/s 2024-09-16T09:45:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:04 smithi114 ceph-mon[35635]: pgmap v225: 65 pgs: 65 active+clean; 69 MiB data, 438 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s wr, 359 op/s 2024-09-16T09:45:05.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:05.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:06.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:06 smithi111 ceph-mon[27997]: pgmap v226: 65 pgs: 65 active+clean; 75 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s wr, 193 op/s 2024-09-16T09:45:06.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:06 smithi114 ceph-mon[35635]: pgmap v226: 65 pgs: 65 active+clean; 75 MiB data, 446 MiB used, 536 GiB / 536 GiB avail; 3.8 MiB/s wr, 193 op/s 2024-09-16T09:45:08.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:08 smithi111 ceph-mon[27997]: pgmap v227: 65 pgs: 65 active+clean; 113 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s wr, 593 op/s 2024-09-16T09:45:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:08 smithi114 ceph-mon[35635]: pgmap v227: 65 pgs: 65 active+clean; 113 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s wr, 593 op/s 2024-09-16T09:45:10.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:10 smithi111 ceph-mon[27997]: pgmap v228: 65 pgs: 65 active+clean; 113 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 493 op/s 2024-09-16T09:45:10.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:10 smithi114 ceph-mon[35635]: pgmap v228: 65 pgs: 65 active+clean; 113 MiB data, 598 MiB used, 536 GiB / 536 GiB avail; 4.8 MiB/s wr, 493 op/s 2024-09-16T09:45:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:12 smithi111 ceph-mon[27997]: pgmap v229: 65 pgs: 65 active+clean; 130 MiB data, 661 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 698 op/s 2024-09-16T09:45:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:12 smithi114 ceph-mon[35635]: pgmap v229: 65 pgs: 65 active+clean; 130 MiB data, 661 MiB used, 536 GiB / 536 GiB avail; 6.3 MiB/s wr, 698 op/s 2024-09-16T09:45:14.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:14 smithi111 ceph-mon[27997]: pgmap v230: 65 pgs: 65 active+clean; 138 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s wr, 692 op/s 2024-09-16T09:45:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:14 smithi114 ceph-mon[35635]: pgmap v230: 65 pgs: 65 active+clean; 138 MiB data, 703 MiB used, 536 GiB / 536 GiB avail; 6.2 MiB/s wr, 692 op/s 2024-09-16T09:45:16.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:16 smithi111 ceph-mon[27997]: pgmap v231: 65 pgs: 65 active+clean; 142 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 703 op/s 2024-09-16T09:45:16.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:16 smithi114 ceph-mon[35635]: pgmap v231: 65 pgs: 65 active+clean; 142 MiB data, 715 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 703 op/s 2024-09-16T09:45:18.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:18 smithi111 ceph-mon[27997]: pgmap v232: 65 pgs: 65 active+clean; 148 MiB data, 728 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 693 op/s 2024-09-16T09:45:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:18 smithi114 ceph-mon[35635]: pgmap v232: 65 pgs: 65 active+clean; 148 MiB data, 728 MiB used, 536 GiB / 536 GiB avail; 6.5 MiB/s wr, 693 op/s 2024-09-16T09:45:18.482 INFO:tasks.workunit.client.1.smithi114.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T09:45:18.482 INFO:tasks.workunit.client.1.smithi114.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T09:45:18.483 INFO:tasks.workunit.client.1.smithi114.stderr:+ make 2024-09-16T09:45:19.015 INFO:tasks.workunit.client.1.smithi114.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T09:45:19.367 INFO:tasks.workunit.client.1.smithi114.stderr:++ readlink -f fsstress 2024-09-16T09:45:19.368 INFO:tasks.workunit.client.1.smithi114.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-16T09:45:19.368 INFO:tasks.workunit.client.1.smithi114.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-16T09:45:19.369 INFO:tasks.workunit.client.1.smithi114.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T09:45:19.369 INFO:tasks.workunit.client.1.smithi114.stderr:+ popd 2024-09-16T09:45:19.369 INFO:tasks.workunit.client.1.smithi114.stderr:+ popd 2024-09-16T09:45:19.369 INFO:tasks.workunit.client.1.smithi114.stderr:++ mktemp -d -p . 2024-09-16T09:45:19.383 INFO:tasks.workunit.client.1.smithi114.stderr:+ T=./tmp.5kwPSC59Rj 2024-09-16T09:45:19.383 INFO:tasks.workunit.client.1.smithi114.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.5kwPSC59Rj -l 1 -n 1000 -p 10 -v 2024-09-16T09:45:19.387 INFO:tasks.workunit.client.1.smithi114.stdout:seed = 1726093449 2024-09-16T09:45:19.394 INFO:tasks.workunit.client.1.smithi114.stdout:1/0: read - no filename 2024-09-16T09:45:19.394 INFO:tasks.workunit.client.1.smithi114.stdout:1/1: dwrite - no filename 2024-09-16T09:45:19.394 INFO:tasks.workunit.client.1.smithi114.stdout:1/2: dwrite - no filename 2024-09-16T09:45:19.394 INFO:tasks.workunit.client.1.smithi114.stdout:1/3: getdents . 0 2024-09-16T09:45:19.395 INFO:tasks.workunit.client.1.smithi114.stdout:1/4: getdents . 0 2024-09-16T09:45:19.396 INFO:tasks.workunit.client.1.smithi114.stdout:2/0: readlink - no filename 2024-09-16T09:45:19.396 INFO:tasks.workunit.client.1.smithi114.stdout:1/5: mknod c0 0 2024-09-16T09:45:19.398 INFO:tasks.workunit.client.1.smithi114.stdout:2/1: creat f0 x:0 0 0 2024-09-16T09:45:19.400 INFO:tasks.workunit.client.1.smithi114.stdout:1/6: rename c0 to c1 0 2024-09-16T09:45:19.402 INFO:tasks.workunit.client.1.smithi114.stdout:4/0: write - no filename 2024-09-16T09:45:19.402 INFO:tasks.workunit.client.1.smithi114.stdout:2/2: mkdir d1 0 2024-09-16T09:45:19.402 INFO:tasks.workunit.client.1.smithi114.stdout:2/3: write f0 [887495,108160] 0 2024-09-16T09:45:19.404 INFO:tasks.workunit.client.1.smithi114.stdout:1/7: stat c1 0 2024-09-16T09:45:19.408 INFO:tasks.workunit.client.1.smithi114.stdout:4/1: mkdir d0 0 2024-09-16T09:45:19.408 INFO:tasks.workunit.client.1.smithi114.stdout:4/2: truncate - no filename 2024-09-16T09:45:19.408 INFO:tasks.workunit.client.1.smithi114.stdout:4/3: fsync - no filename 2024-09-16T09:45:19.409 INFO:tasks.workunit.client.1.smithi114.stdout:2/4: symlink d1/l2 0 2024-09-16T09:45:19.409 INFO:tasks.workunit.client.1.smithi114.stdout:2/5: rename d1 to d1/d3 22 2024-09-16T09:45:19.411 INFO:tasks.workunit.client.1.smithi114.stdout:6/0: dread - no filename 2024-09-16T09:45:19.418 INFO:tasks.workunit.client.1.smithi114.stdout:6/1: symlink l0 0 2024-09-16T09:45:19.418 INFO:tasks.workunit.client.1.smithi114.stdout:9/0: dread - no filename 2024-09-16T09:45:19.418 INFO:tasks.workunit.client.1.smithi114.stdout:9/1: getdents . 0 2024-09-16T09:45:19.419 INFO:tasks.workunit.client.1.smithi114.stdout:4/4: mknod d0/c1 0 2024-09-16T09:45:19.422 INFO:tasks.workunit.client.1.smithi114.stdout:6/2: link l0 l1 0 2024-09-16T09:45:19.422 INFO:tasks.workunit.client.1.smithi114.stdout:6/3: rmdir - no directory 2024-09-16T09:45:19.423 INFO:tasks.workunit.client.1.smithi114.stdout:0/0: dwrite - no filename 2024-09-16T09:45:19.424 INFO:tasks.workunit.client.1.smithi114.stdout:9/2: mknod c0 0 2024-09-16T09:45:19.424 INFO:tasks.workunit.client.1.smithi114.stdout:9/3: read - no filename 2024-09-16T09:45:19.424 INFO:tasks.workunit.client.1.smithi114.stdout:9/4: read - no filename 2024-09-16T09:45:19.424 INFO:tasks.workunit.client.1.smithi114.stdout:9/5: dwrite - no filename 2024-09-16T09:45:19.424 INFO:tasks.workunit.client.1.smithi114.stdout:9/6: chown c0 1242 1 2024-09-16T09:45:19.424 INFO:tasks.workunit.client.1.smithi114.stdout:9/7: dread - no filename 2024-09-16T09:45:19.427 INFO:tasks.workunit.client.1.smithi114.stdout:4/5: creat d0/f2 x:0 0 0 2024-09-16T09:45:19.427 INFO:tasks.workunit.client.1.smithi114.stdout:4/6: rename d0 to d0/d3 22 2024-09-16T09:45:19.428 INFO:tasks.workunit.client.1.smithi114.stdout:0/1: creat f0 x:0 0 0 2024-09-16T09:45:19.428 INFO:tasks.workunit.client.1.smithi114.stdout:0/2: write f0 [968267,62880] 0 2024-09-16T09:45:19.428 INFO:tasks.workunit.client.1.smithi114.stdout:6/4: mknod c2 0 2024-09-16T09:45:19.428 INFO:tasks.workunit.client.1.smithi114.stdout:6/5: chown l1 482040 1 2024-09-16T09:45:19.429 INFO:tasks.workunit.client.1.smithi114.stdout:9/8: rename c0 to c1 0 2024-09-16T09:45:19.429 INFO:tasks.workunit.client.1.smithi114.stdout:9/9: dwrite - no filename 2024-09-16T09:45:19.429 INFO:tasks.workunit.client.1.smithi114.stdout:9/10: readlink - no filename 2024-09-16T09:45:19.432 INFO:tasks.workunit.client.1.smithi114.stdout:7/0: chown . 229892 1 2024-09-16T09:45:19.432 INFO:tasks.workunit.client.1.smithi114.stdout:7/1: stat - no entries 2024-09-16T09:45:19.433 INFO:tasks.workunit.client.1.smithi114.stdout:7/2: rename - no filename 2024-09-16T09:45:19.433 INFO:tasks.workunit.client.1.smithi114.stdout:7/3: write - no filename 2024-09-16T09:45:19.433 INFO:tasks.workunit.client.1.smithi114.stdout:7/4: dread - no filename 2024-09-16T09:45:19.434 INFO:tasks.workunit.client.1.smithi114.stdout:6/6: rename c2 to c3 0 2024-09-16T09:45:19.436 INFO:tasks.workunit.client.1.smithi114.stdout:9/11: mknod c2 0 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/12: write - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/13: write - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/14: write - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/15: chown c2 20586830 1 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/16: dwrite - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/17: readlink - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/18: write - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/19: dwrite - no filename 2024-09-16T09:45:19.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/20: truncate - no filename 2024-09-16T09:45:19.464 INFO:tasks.workunit.client.1.smithi114.stdout:7/5: creat f0 x:0 0 0 2024-09-16T09:45:19.464 INFO:tasks.workunit.client.1.smithi114.stdout:6/7: creat f4 x:0 0 0 2024-09-16T09:45:19.464 INFO:tasks.workunit.client.1.smithi114.stdout:6/8: dread - f4 zero size 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:6/9: read - f4 zero size 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/0: dwrite - no filename 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:6/10: truncate f4 947464 0 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/1: dread - no filename 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/2: chown . 7 1 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/3: dread - no filename 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/4: rename - no filename 2024-09-16T09:45:19.465 INFO:tasks.workunit.client.1.smithi114.stdout:7/6: chown f0 1 1 2024-09-16T09:45:19.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/5: creat f0 x:0 0 0 2024-09-16T09:45:19.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/6: fdatasync f0 0 2024-09-16T09:45:19.468 INFO:tasks.workunit.client.1.smithi114.stdout:5/0: write - no filename 2024-09-16T09:45:19.471 INFO:tasks.workunit.client.1.smithi114.stdout:7/7: creat f1 x:0 0 0 2024-09-16T09:45:19.471 INFO:tasks.workunit.client.1.smithi114.stdout:7/8: truncate f0 599739 0 2024-09-16T09:45:19.471 INFO:tasks.workunit.client.1.smithi114.stdout:7/9: readlink - no filename 2024-09-16T09:45:19.471 INFO:tasks.workunit.client.1.smithi114.stdout:8/7: rename f0 to f1 0 2024-09-16T09:45:19.473 INFO:tasks.workunit.client.1.smithi114.stdout:5/1: creat f0 x:0 0 0 2024-09-16T09:45:19.477 INFO:tasks.workunit.client.1.smithi114.stdout:8/8: mknod c2 0 2024-09-16T09:45:19.499 INFO:tasks.workunit.client.1.smithi114.stdout:0/3: write f0 [198132,39947] 0 2024-09-16T09:45:19.499 INFO:tasks.workunit.client.1.smithi114.stdout:0/4: truncate f0 1767782 0 2024-09-16T09:45:20.109 INFO:teuthology.orchestra.run.smithi111.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:45:20.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.106+0000 7f46daffd640 1 -- 172.21.15.111:0/2176832297 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f46e40627a0 con 0x7f46d006e300 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f46d006e300 msgr2=0x7f46d00707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f46d006e300 0x7f46d00707c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f46d40058c0 tx=0x7f46d4005850 comp rx=0 tx=0).stop 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 msgr2=0x7f46e41974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e41974c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009230 tx=0x7f46e00045c0 comp rx=0 tx=0).stop 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 shutdown_connections 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f46d006e300 0x7f46d00707c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f46e4102b60 0x7f46e4197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 --2- 172.21.15.111:0/2176832297 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e4101960 0x7f46e41974c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:20.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 >> 172.21.15.111:0/2176832297 conn(0x7f46e40fd0f0 msgr2=0x7f46e4106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:20.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 shutdown_connections 2024-09-16T09:45:20.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:20.110+0000 7f46ebd21640 1 -- 172.21.15.111:0/2176832297 wait complete. 2024-09-16T09:45:20.205 INFO:tasks.workunit.client.1.smithi114.stdout:2/6: dwrite f0 [0,4194304] 0 2024-09-16T09:45:20.205 INFO:tasks.workunit.client.1.smithi114.stdout:2/7: rename d1 to d1/d4 22 2024-09-16T09:45:20.205 INFO:tasks.workunit.client.1.smithi114.stdout:2/8: chown f0 30905 1 2024-09-16T09:45:20.378 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:20 smithi111 ceph-mon[27997]: pgmap v233: 65 pgs: 65 active+clean; 148 MiB data, 728 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 225 op/s 2024-09-16T09:45:20.378 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:20.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:20 smithi114 ceph-mon[35635]: pgmap v233: 65 pgs: 65 active+clean; 148 MiB data, 728 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 225 op/s 2024-09-16T09:45:20.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:3/0: readlink - no filename 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:5/2: dread - f0 zero size 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:5/3: dread - f0 zero size 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:5/4: fdatasync f0 0 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:5/5: stat f0 0 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:4/7: fsync d0/f2 0 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:1/8: rename c1 to c2 0 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:1/9: write - no filename 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:1/10: readlink - no filename 2024-09-16T09:45:20.559 INFO:tasks.workunit.client.1.smithi114.stdout:1/11: fdatasync - no filename 2024-09-16T09:45:20.682 INFO:tasks.workunit.client.1.smithi114.stdout:7/10: dwrite f0 [0,4194304] 0 2024-09-16T09:45:20.682 INFO:tasks.workunit.client.1.smithi114.stdout:7/11: chown f0 16343995 1 2024-09-16T09:45:20.682 INFO:tasks.workunit.client.1.smithi114.stdout:7/12: chown f1 115998 1 2024-09-16T09:45:20.774 INFO:tasks.workunit.client.1.smithi114.stdout:6/11: read f4 [194964,56623] 0 2024-09-16T09:45:20.774 INFO:tasks.workunit.client.1.smithi114.stdout:8/9: unlink f1 0 2024-09-16T09:45:20.774 INFO:tasks.workunit.client.1.smithi114.stdout:0/5: truncate f0 1527659 0 2024-09-16T09:45:20.775 INFO:tasks.workunit.client.1.smithi114.stdout:0/6: rmdir - no directory 2024-09-16T09:45:20.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-16T09:45:20.958 INFO:tasks.workunit.client.1.smithi114.stdout:6/12: dwrite f4 [0,4194304] 0 2024-09-16T09:45:20.969 INFO:tasks.workunit.client.1.smithi114.stdout:6/13: dread f4 [0,4194304] 0 2024-09-16T09:45:21.214 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:45:21.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:21 smithi111 ceph-mon[27997]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:45:21.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:45:21.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:21.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:45:21.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:45:21.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:21 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:45:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:21 smithi114 ceph-mon[35635]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:45:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:45:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:45:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:45:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:21 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.902+0000 7f4b4ba12640 1 -- 172.21.15.111:0/2260847403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 msgr2=0x7f4b441070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.902+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/2260847403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b441070f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4b340098b0 tx=0x7f4b3402a4d0 comp rx=0 tx=0).stop 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.902+0000 7f4b4ba12640 1 -- 172.21.15.111:0/2260847403 shutdown_connections 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.902+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/2260847403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b441070f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.902+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/2260847403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 0x7f4b441047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.902+0000 7f4b4ba12640 1 -- 172.21.15.111:0/2260847403 >> 172.21.15.111:0/2260847403 conn(0x7f4b440fbff0 msgr2=0x7f4b440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 -- 172.21.15.111:0/2260847403 shutdown_connections 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 -- 172.21.15.111:0/2260847403 wait complete. 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 Processor -- start 2024-09-16T09:45:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 -- start start 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 0x7f4b44197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b44197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4410a790 con 0x7f4b44104d00 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.903+0000 7f4b4ba12640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4410a610 con 0x7f4b441023d0 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b48fad640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b44197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b497ae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 0x7f4b44197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b48fad640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b44197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48414/0 (socket says 172.21.15.111:48414) 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b48fad640 1 -- 172.21.15.111:0/3863633663 learned_addr learned my addr 172.21.15.111:0/3863633663 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b497ae640 1 -- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 msgr2=0x7f4b44197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b497ae640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b44197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b497ae640 1 -- 172.21.15.111:0/3863633663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b441980e0 con 0x7f4b441023d0 2024-09-16T09:45:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b497ae640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 0x7f4b44197520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000e970 tx=0x7f4b4000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b4000cac0 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4419cb20 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b4000cc60 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b400047a0 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.904+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4419d0b0 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.905+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b441027b0 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.906+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f4b40004a50 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.907+0000 7f4b3a7fc640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4b3006e2b0 0x7f4b30070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.907+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f4b4008e670 con 0x7f4b441023d0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.907+0000 7f4b48fad640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4b3006e2b0 0x7f4b30070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.907+0000 7f4b48fad640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4b3006e2b0 0x7f4b30070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4b441989d0 tx=0x7f4b340058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:21.913 INFO:tasks.workunit.client.1.smithi114.stdout:2/9: symlink d1/l5 0 2024-09-16T09:45:21.913 INFO:tasks.workunit.client.1.smithi114.stdout:2/10: fdatasync f0 0 2024-09-16T09:45:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:21.911+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4b4005bf70 con 0x7f4b441023d0 2024-09-16T09:45:21.916 INFO:tasks.workunit.client.1.smithi114.stdout:2/11: write f0 [1540756,92272] 0 2024-09-16T09:45:21.940 INFO:tasks.workunit.client.1.smithi114.stdout:2/12: dwrite f0 [0,4194304] 0 2024-09-16T09:45:22.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.193+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4b441056e0 con 0x7f4b3006e2b0 2024-09-16T09:45:22.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.195+0000 7f4b3a7fc640 1 -- 172.21.15.111:0/3863633663 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f4b441056e0 con 0x7f4b3006e2b0 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4b3006e2b0 msgr2=0x7f4b30070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4b3006e2b0 0x7f4b30070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4b441989d0 tx=0x7f4b340058d0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 msgr2=0x7f4b44197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 0x7f4b44197520 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000e970 tx=0x7f4b4000ee30 comp rx=0 tx=0).stop 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 shutdown_connections 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f4b3006e2b0 0x7f4b30070770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4b44104d00 0x7f4b44197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 --2- 172.21.15.111:0/3863633663 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4b441023d0 0x7f4b44197520 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.197+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 >> 172.21.15.111:0/3863633663 conn(0x7f4b440fbff0 msgr2=0x7f4b440fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:22.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.198+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 shutdown_connections 2024-09-16T09:45:22.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.198+0000 7f4b4ba12640 1 -- 172.21.15.111:0/3863633663 wait complete. 2024-09-16T09:45:22.212 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:45:22.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 -- 172.21.15.111:0/3420570888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec104da0 msgr2=0x7fd2ec107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/3420570888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec104da0 0x7fd2ec107190 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009880 tx=0x7fd2e002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 -- 172.21.15.111:0/3420570888 shutdown_connections 2024-09-16T09:45:22.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/3420570888 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec104da0 0x7fd2ec107190 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/3420570888 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2ec102470 0x7fd2ec104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 -- 172.21.15.111:0/3420570888 >> 172.21.15.111:0/3420570888 conn(0x7fd2ec0fbff0 msgr2=0x7fd2ec0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:22.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 -- 172.21.15.111:0/3420570888 shutdown_connections 2024-09-16T09:45:22.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.302+0000 7fd2f0c70640 1 -- 172.21.15.111:0/3420570888 wait complete. 2024-09-16T09:45:22.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2f0c70640 1 Processor -- start 2024-09-16T09:45:22.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2f0c70640 1 -- start start 2024-09-16T09:45:22.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2f0c70640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 0x7fd2ec199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:22.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2f0c70640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2ec104da0 0x7fd2ec199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2f0c70640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec10a780 con 0x7fd2ec102470 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2f0c70640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec10a600 con 0x7fd2ec104da0 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2ea59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 0x7fd2ec199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2ea59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 0x7fd2ec199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48436/0 (socket says 172.21.15.111:48436) 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.303+0000 7fd2ea59c640 1 -- 172.21.15.111:0/825834134 learned_addr learned my addr 172.21.15.111:0/825834134 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2e9d9b640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2ec104da0 0x7fd2ec199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2ea59c640 1 -- 172.21.15.111:0/825834134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2ec104da0 msgr2=0x7fd2ec199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2ea59c640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2ec104da0 0x7fd2ec199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2ea59c640 1 -- 172.21.15.111:0/825834134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec19a2f0 con 0x7fd2ec102470 2024-09-16T09:45:22.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2ea59c640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 0x7fd2ec199730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c8f0 tx=0x7fd2dc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:22.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2dc0079b0 con 0x7fd2ec102470 2024-09-16T09:45:22.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec19ed30 con 0x7fd2ec102470 2024-09-16T09:45:22.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec19f1d0 con 0x7fd2ec102470 2024-09-16T09:45:22.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2dc0054e0 con 0x7fd2ec102470 2024-09-16T09:45:22.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.304+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2dc004dd0 con 0x7fd2ec102470 2024-09-16T09:45:22.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.305+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc005290 con 0x7fd2ec102470 2024-09-16T09:45:22.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.306+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fd2dc005020 con 0x7fd2ec102470 2024-09-16T09:45:22.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.307+0000 7fd2db7fe640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd2d406e2b0 0x7fd2d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:22.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.307+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fd2dc08e070 con 0x7fd2ec102470 2024-09-16T09:45:22.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.307+0000 7fd2e9d9b640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd2d406e2b0 0x7fd2d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:22.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.308+0000 7fd2e9d9b640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd2d406e2b0 0x7fd2d4070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0000c00 tx=0x7fd2e0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:22.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.314+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd2dc014030 con 0x7fd2ec102470 2024-09-16T09:45:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:22 smithi111 ceph-mon[27997]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:45:22.316 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:22 smithi111 ceph-mon[27997]: pgmap v234: 65 pgs: 65 active+clean; 148 MiB data, 738 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 225 op/s 2024-09-16T09:45:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:22 smithi114 ceph-mon[35635]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:45:22.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:22 smithi114 ceph-mon[35635]: pgmap v234: 65 pgs: 65 active+clean; 148 MiB data, 738 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s wr, 225 op/s 2024-09-16T09:45:22.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.648+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd2cc000bc0 con 0x7fd2d406e2b0 2024-09-16T09:45:22.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.649+0000 7fd2db7fe640 1 -- 172.21.15.111:0/825834134 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fd2cc000bc0 con 0x7fd2d406e2b0 2024-09-16T09:45:22.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd2d406e2b0 msgr2=0x7fd2d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd2d406e2b0 0x7fd2d4070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0000c00 tx=0x7fd2e0005a20 comp rx=0 tx=0).stop 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 msgr2=0x7fd2ec199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 0x7fd2ec199730 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c8f0 tx=0x7fd2dc00cdb0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 shutdown_connections 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fd2d406e2b0 0x7fd2d4070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd2ec104da0 0x7fd2ec199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 --2- 172.21.15.111:0/825834134 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd2ec102470 0x7fd2ec199730 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 >> 172.21.15.111:0/825834134 conn(0x7fd2ec0fbff0 msgr2=0x7fd2ec1006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 shutdown_connections 2024-09-16T09:45:22.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.652+0000 7fd2f0c70640 1 -- 172.21.15.111:0/825834134 wait complete. 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.739+0000 7fae6b1d9640 1 -- 172.21.15.111:0/2782561086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae64104d00 msgr2=0x7fae641070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.739+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/2782561086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae64104d00 0x7fae641070f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fae500098b0 tx=0x7fae5002a4d0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 -- 172.21.15.111:0/2782561086 shutdown_connections 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/2782561086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae64104d00 0x7fae641070f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/2782561086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae641023d0 0x7fae641047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 -- 172.21.15.111:0/2782561086 >> 172.21.15.111:0/2782561086 conn(0x7fae640fbff0 msgr2=0x7fae640fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 -- 172.21.15.111:0/2782561086 shutdown_connections 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 -- 172.21.15.111:0/2782561086 wait complete. 2024-09-16T09:45:22.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 Processor -- start 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.740+0000 7fae6b1d9640 1 -- start start 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae6b1d9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 0x7fae64101cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae6b1d9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae64104d00 0x7fae64100380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae6b1d9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fae6410a7f0 con 0x7fae641023d0 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae6b1d9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fae6410a670 con 0x7fae64104d00 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 0x7fae64101cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 0x7fae64101cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48458/0 (socket says 172.21.15.111:48458) 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 -- 172.21.15.111:0/1294359302 learned_addr learned my addr 172.21.15.111:0/1294359302 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae63fff640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae64104d00 0x7fae64100380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 -- 172.21.15.111:0/1294359302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae64104d00 msgr2=0x7fae64100380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae64104d00 0x7fae64100380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 -- 172.21.15.111:0/1294359302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae641008c0 con 0x7fae641023d0 2024-09-16T09:45:22.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae68f75640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 0x7fae64101cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae5800b420 tx=0x7fae5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:22.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae58011630 con 0x7fae641023d0 2024-09-16T09:45:22.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae58016070 con 0x7fae641023d0 2024-09-16T09:45:22.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.741+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae64100bb0 con 0x7fae641023d0 2024-09-16T09:45:22.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.742+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae58010d40 con 0x7fae641023d0 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.742+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae64101190 con 0x7fae641023d0 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.743+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae641027b0 con 0x7fae641023d0 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.743+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fae5801b460 con 0x7fae641023d0 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.744+0000 7fae61ffb640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fae5406e310 0x7fae540707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.744+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fae5808d890 con 0x7fae641023d0 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.744+0000 7fae63fff640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fae5406e310 0x7fae540707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:22.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.744+0000 7fae63fff640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fae5406e310 0x7fae540707d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae50009880 tx=0x7fae500058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:22.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.748+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fae5805b270 con 0x7fae641023d0 2024-09-16T09:45:22.786 INFO:tasks.workunit.client.1.smithi114.stdout:3/1: mknod c0 0 2024-09-16T09:45:22.786 INFO:tasks.workunit.client.1.smithi114.stdout:3/2: write - no filename 2024-09-16T09:45:22.787 INFO:tasks.workunit.client.1.smithi114.stdout:5/6: mknod c1 0 2024-09-16T09:45:22.790 INFO:tasks.workunit.client.1.smithi114.stdout:4/8: rename d0/c1 to d0/c4 0 2024-09-16T09:45:22.792 INFO:tasks.workunit.client.1.smithi114.stdout:1/12: link c2 c3 0 2024-09-16T09:45:22.792 INFO:tasks.workunit.client.1.smithi114.stdout:1/13: fdatasync - no filename 2024-09-16T09:45:22.806 INFO:tasks.workunit.client.1.smithi114.stdout:4/9: dwrite d0/f2 [0,4194304] 0 2024-09-16T09:45:22.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.941+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fae6419f6d0 con 0x7fae5406e310 2024-09-16T09:45:22.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.956+0000 7fae61ffb640 1 -- 172.21.15.111:0/1294359302 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3768 (secure 0 0 0) 0x7fae6419f6d0 con 0x7fae5406e310 2024-09-16T09:45:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:45:22.958 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (5m) 106s ago 7m 26.4M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (7m) 106s ago 7m 8166k - 19.1.1-328-gad35db06 b5388489f99e 8786fd2f4c05 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (6m) 110s ago 6m 5263k - 19.1.1-328-gad35db06 b5388489f99e 7fe7397f669d 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (7m) 106s ago 7m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (6m) 110s ago 6m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (5m) 106s ago 7m 78.2M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (2m) 106s ago 2m 16.9M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (2m) 106s ago 2m 13.6M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (2m) 110s ago 2m 14.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (2m) 110s ago 2m 14.5M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:9283,8765,8443 running (8m) 106s ago 8m 498M - 19.1.1-328-gad35db06 b5388489f99e f32e13ae383f 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (6m) 110s ago 6m 443M - 19.1.1-328-gad35db06 b5388489f99e 6d8deba4ede4 2024-09-16T09:45:22.959 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (8m) 106s ago 8m 46.8M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (6m) 110s ago 6m 35.0M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (7m) 106s ago 7m 14.0M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (6m) 110s ago 6m 16.6M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (5m) 106s ago 5m 47.4M 3946M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (4m) 106s ago 4m 54.0M 3946M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (4m) 106s ago 4m 52.0M 3946M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (3m) 110s ago 3m 53.1M 4970M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (3m) 110s ago 3m 41.1M 4970M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (3m) 110s ago 3m 41.4M 4970M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:45:22.960 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (5m) 106s ago 6m 60.1M - 2.43.0 a07b618ecd1d ef0faa2f353d 2024-09-16T09:45:22.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fae5406e310 msgr2=0x7fae540707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fae5406e310 0x7fae540707d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fae50009880 tx=0x7fae500058d0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 msgr2=0x7fae64101cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:22.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 0x7fae64101cc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae5800b420 tx=0x7fae5800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 shutdown_connections 2024-09-16T09:45:22.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fae5406e310 0x7fae540707d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fae64104d00 0x7fae64100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 --2- 172.21.15.111:0/1294359302 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fae641023d0 0x7fae64101cc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:22.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 >> 172.21.15.111:0/1294359302 conn(0x7fae640fbff0 msgr2=0x7fae640fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:22.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 shutdown_connections 2024-09-16T09:45:22.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:22.959+0000 7fae6b1d9640 1 -- 172.21.15.111:0/1294359302 wait complete. 2024-09-16T09:45:23.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.051+0000 7fb570c23640 1 -- 172.21.15.111:0/4060949762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 msgr2=0x7fb56c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.051+0000 7fb570c23640 1 --2- 172.21.15.111:0/4060949762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c102fe0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb554009880 tx=0x7fb55402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.051+0000 7fb570c23640 1 -- 172.21.15.111:0/4060949762 shutdown_connections 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.051+0000 7fb570c23640 1 --2- 172.21.15.111:0/4060949762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c102fe0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.051+0000 7fb570c23640 1 --2- 172.21.15.111:0/4060949762 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c101960 0x7fb56c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.051+0000 7fb570c23640 1 -- 172.21.15.111:0/4060949762 >> 172.21.15.111:0/4060949762 conn(0x7fb56c0fd0f0 msgr2=0x7fb56c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.052+0000 7fb570c23640 1 -- 172.21.15.111:0/4060949762 shutdown_connections 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.052+0000 7fb570c23640 1 -- 172.21.15.111:0/4060949762 wait complete. 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.052+0000 7fb570c23640 1 Processor -- start 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.052+0000 7fb570c23640 1 -- start start 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb570c23640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c101960 0x7fb56c1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:23.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb570c23640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb570c23640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c10a7a0 con 0x7fb56c102b60 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb570c23640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c10a620 con 0x7fb56c101960 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c1979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48470/0 (socket says 172.21.15.111:48470) 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 -- 172.21.15.111:0/2719980531 learned_addr learned my addr 172.21.15.111:0/2719980531 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb56a59c640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c101960 0x7fb56c1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 -- 172.21.15.111:0/2719980531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c101960 msgr2=0x7fb56c1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c101960 0x7fb56c1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 -- 172.21.15.111:0/2719980531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c198070 con 0x7fb56c102b60 2024-09-16T09:45:23.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb563fff640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c1979f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb554006010 tx=0x7fb554004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.053+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb55403f070 con 0x7fb56c102b60 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.054+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5540049d0 con 0x7fb56c102b60 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.054+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c19ca50 con 0x7fb56c102b60 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.054+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb554035030 con 0x7fb56c102b60 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.054+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c19cfe0 con 0x7fb56c102b60 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.055+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c101d60 con 0x7fb56c102b60 2024-09-16T09:45:23.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.055+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb554042070 con 0x7fb56c102b60 2024-09-16T09:45:23.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.056+0000 7fb5637fe640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb55806e2b0 0x7fb558070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:23.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.056+0000 7fb56a59c640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb55806e2b0 0x7fb558070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:23.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.056+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fb5540aed70 con 0x7fb56c102b60 2024-09-16T09:45:23.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.057+0000 7fb56a59c640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb55806e2b0 0x7fb558070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb56c1029c0 tx=0x7fb55c005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:23.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.060+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb5540802e0 con 0x7fb56c102b60 2024-09-16T09:45:23.211 INFO:tasks.workunit.client.1.smithi114.stdout:7/13: mkdir d2 0 2024-09-16T09:45:23.230 INFO:tasks.workunit.client.1.smithi114.stdout:7/14: dwrite f1 [0,4194304] 0 2024-09-16T09:45:23.388 INFO:tasks.workunit.client.1.smithi114.stdout:8/10: creat f3 x:0 0 0 2024-09-16T09:45:23.388 INFO:tasks.workunit.client.1.smithi114.stdout:8/11: dread - f3 zero size 2024-09-16T09:45:23.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.418+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb56c062df0 con 0x7fb56c102b60 2024-09-16T09:45:23.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.419+0000 7fb5637fe640 1 -- 172.21.15.111:0/2719980531 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fb554084b10 con 0x7fb56c102b60 2024-09-16T09:45:23.421 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:45:23.421 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:45:23.422 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:45:23.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:23.422 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:45:23.422 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:45:23.422 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:23.422 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 14 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:45:23.423 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.421+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb55806e2b0 msgr2=0x7fb558070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.421+0000 7fb570c23640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb55806e2b0 0x7fb558070770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb56c1029c0 tx=0x7fb55c005f90 comp rx=0 tx=0).stop 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.421+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 msgr2=0x7fb56c1979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.421+0000 7fb570c23640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c1979f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb554006010 tx=0x7fb554004570 comp rx=0 tx=0).stop 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.421+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 shutdown_connections 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.422+0000 7fb570c23640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb55806e2b0 0x7fb558070770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.422+0000 7fb570c23640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56c102b60 0x7fb56c1979f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.422+0000 7fb570c23640 1 --2- 172.21.15.111:0/2719980531 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb56c101960 0x7fb56c1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.422+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 >> 172.21.15.111:0/2719980531 conn(0x7fb56c0fd0f0 msgr2=0x7fb56c106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:23.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.422+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 shutdown_connections 2024-09-16T09:45:23.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.422+0000 7fb570c23640 1 -- 172.21.15.111:0/2719980531 wait complete. 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 -- 172.21.15.111:0/2505674333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 msgr2=0x7f1414100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 --2- 172.21.15.111:0/2505674333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414100c40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1408009880 tx=0x7f140802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 -- 172.21.15.111:0/2505674333 shutdown_connections 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 --2- 172.21.15.111:0/2505674333 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 0x7f1414101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 --2- 172.21.15.111:0/2505674333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414100c40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 -- 172.21.15.111:0/2505674333 >> 172.21.15.111:0/2505674333 conn(0x7f14140fbff0 msgr2=0x7f14140fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 -- 172.21.15.111:0/2505674333 shutdown_connections 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.521+0000 7f141ad97640 1 -- 172.21.15.111:0/2505674333 wait complete. 2024-09-16T09:45:23.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f141ad97640 1 Processor -- start 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f141ad97640 1 -- start start 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f141ad97640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f141ad97640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 0x7f14141979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f141ad97640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1414109660 con 0x7f1414100840 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f141ad97640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f14141094e0 con 0x7f1414101a40 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1418b33640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1418b33640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55512/0 (socket says 172.21.15.111:55512) 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1418b33640 1 -- 172.21.15.111:0/3082656967 learned_addr learned my addr 172.21.15.111:0/3082656967 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1413fff640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 0x7f14141979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1413fff640 1 -- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 msgr2=0x7f1414197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1413fff640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1413fff640 1 -- 172.21.15.111:0/3082656967 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1414198050 con 0x7f1414101a40 2024-09-16T09:45:23.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.522+0000 7f1418b33640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:45:23.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.523+0000 7f1413fff640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 0x7f14141979d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f140000e970 tx=0x7f140000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.523+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f140000cac0 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.523+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f140000cc60 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.523+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1400018720 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.523+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141419ca90 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.523+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141419cfc0 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.524+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1414100c40 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.524+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f1400010430 con 0x7f1414101a40 2024-09-16T09:45:23.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.525+0000 7f1411ffb640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f140406e310 0x7f14040707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:23.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.525+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f140008e5c0 con 0x7f1414101a40 2024-09-16T09:45:23.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.525+0000 7f1418b33640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f140406e310 0x7f14040707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:23.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.525+0000 7f1418b33640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f140406e310 0x7f14040707d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14080096c0 tx=0x7f14080058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:23.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.529+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f140005fbb0 con 0x7f1414101a40 2024-09-16T09:45:23.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.754+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1414062630 con 0x7f140406e310 2024-09-16T09:45:23.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.760+0000 7f1411ffb640 1 -- 172.21.15.111:0/3082656967 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f1414062630 con 0x7f140406e310 2024-09-16T09:45:23.761 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:45:23.761 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:45:23.761 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:45:23.761 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:45:23.762 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-16T09:45:23.762 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "0/2 daemons upgraded", 2024-09-16T09:45:23.762 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f image on host smithi114", 2024-09-16T09:45:23.762 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:45:23.762 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f140406e310 msgr2=0x7f14040707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f140406e310 0x7f14040707d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f14080096c0 tx=0x7f14080058d0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 msgr2=0x7f14141979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 0x7f14141979d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f140000e970 tx=0x7f140000ee30 comp rx=0 tx=0).stop 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 shutdown_connections 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f140406e310 0x7f14040707d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1414101a40 0x7f14141979d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 --2- 172.21.15.111:0/3082656967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1414100840 0x7f1414197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 >> 172.21.15.111:0/3082656967 conn(0x7f14140fbff0 msgr2=0x7f14140fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:23.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 shutdown_connections 2024-09-16T09:45:23.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:23.763+0000 7f141ad97640 1 -- 172.21.15.111:0/3082656967 wait complete. 2024-09-16T09:45:24.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 870 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s rd, 5.6 MiB/s wr, 412 op/s 2024-09-16T09:45:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:45:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:24 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2719980531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:45:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: pgmap v235: 65 pgs: 65 active+clean; 194 MiB data, 870 MiB used, 536 GiB / 536 GiB avail; 341 KiB/s rd, 5.6 MiB/s wr, 412 op/s 2024-09-16T09:45:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:45:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:45:24.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:24 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2719980531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:45:24.836 INFO:tasks.workunit.client.1.smithi114.stdout:6/14: creat f5 x:0 0 0 2024-09-16T09:45:24.839 INFO:tasks.workunit.client.1.smithi114.stdout:2/13: mknod d1/c6 0 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/3: rename c0 to c1 0 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/4: dwrite - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/5: dread - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/6: write - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/7: dread - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/8: dread - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/9: dwrite - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/10: read - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/11: write - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/12: write - no filename 2024-09-16T09:45:24.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/13: dread - no filename 2024-09-16T09:45:24.841 INFO:tasks.workunit.client.1.smithi114.stdout:5/7: getdents . 0 2024-09-16T09:45:24.841 INFO:tasks.workunit.client.1.smithi114.stdout:6/15: write f4 [3701071,27041] 0 2024-09-16T09:45:24.841 INFO:tasks.workunit.client.1.smithi114.stdout:1/14: mkdir d4 0 2024-09-16T09:45:24.846 INFO:tasks.workunit.client.1.smithi114.stdout:4/10: mknod d0/c5 0 2024-09-16T09:45:24.849 INFO:tasks.workunit.client.1.smithi114.stdout:7/15: symlink d2/l3 0 2024-09-16T09:45:24.851 INFO:tasks.workunit.client.1.smithi114.stdout:0/7: unlink f0 0 2024-09-16T09:45:24.851 INFO:tasks.workunit.client.1.smithi114.stdout:0/8: dwrite - no filename 2024-09-16T09:45:24.852 INFO:tasks.workunit.client.1.smithi114.stdout:8/12: mkdir d4 0 2024-09-16T09:45:24.854 INFO:tasks.workunit.client.1.smithi114.stdout:2/14: mknod d1/c7 0 2024-09-16T09:45:24.855 INFO:tasks.workunit.client.1.smithi114.stdout:3/14: mkdir d2 0 2024-09-16T09:45:24.855 INFO:tasks.workunit.client.1.smithi114.stdout:3/15: chown d2 5 1 2024-09-16T09:45:24.855 INFO:tasks.workunit.client.1.smithi114.stdout:3/16: chown d2 1895593 1 2024-09-16T09:45:24.855 INFO:tasks.workunit.client.1.smithi114.stdout:3/17: write - no filename 2024-09-16T09:45:24.855 INFO:tasks.workunit.client.1.smithi114.stdout:3/18: chown d2 307953 1 2024-09-16T09:45:24.855 INFO:tasks.workunit.client.1.smithi114.stdout:3/19: read - no filename 2024-09-16T09:45:24.856 INFO:tasks.workunit.client.1.smithi114.stdout:3/20: dwrite - no filename 2024-09-16T09:45:24.856 INFO:tasks.workunit.client.1.smithi114.stdout:3/21: readlink - no filename 2024-09-16T09:45:24.856 INFO:tasks.workunit.client.1.smithi114.stdout:7/16: read f1 [3195753,117158] 0 2024-09-16T09:45:24.857 INFO:tasks.workunit.client.1.smithi114.stdout:5/8: creat f2 x:0 0 0 2024-09-16T09:45:24.857 INFO:tasks.workunit.client.1.smithi114.stdout:5/9: truncate f2 300177 0 2024-09-16T09:45:24.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/15: rename c3 to d4/c5 0 2024-09-16T09:45:24.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/16: dread - no filename 2024-09-16T09:45:24.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/17: dwrite - no filename 2024-09-16T09:45:24.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/18: fsync - no filename 2024-09-16T09:45:24.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/19: write - no filename 2024-09-16T09:45:24.858 INFO:tasks.workunit.client.1.smithi114.stdout:5/10: dread f2 [0,4194304] 0 2024-09-16T09:45:24.859 INFO:tasks.workunit.client.1.smithi114.stdout:0/9: creat f1 x:0 0 0 2024-09-16T09:45:24.861 INFO:tasks.workunit.client.1.smithi114.stdout:8/13: mkdir d4/d5 0 2024-09-16T09:45:24.861 INFO:tasks.workunit.client.1.smithi114.stdout:8/14: write f3 [354227,64066] 0 2024-09-16T09:45:24.861 INFO:tasks.workunit.client.1.smithi114.stdout:8/15: chown f3 356 1 2024-09-16T09:45:24.861 INFO:tasks.workunit.client.1.smithi114.stdout:8/16: write f3 [685827,69654] 0 2024-09-16T09:45:24.861 INFO:tasks.workunit.client.1.smithi114.stdout:8/17: write f3 [6500,99504] 0 2024-09-16T09:45:24.862 INFO:tasks.workunit.client.1.smithi114.stdout:8/18: read f3 [261201,40422] 0 2024-09-16T09:45:24.862 INFO:tasks.workunit.client.1.smithi114.stdout:8/19: write f3 [1045984,102340] 0 2024-09-16T09:45:24.862 INFO:tasks.workunit.client.1.smithi114.stdout:2/15: mkdir d1/d8 0 2024-09-16T09:45:24.863 INFO:tasks.workunit.client.1.smithi114.stdout:3/22: rmdir d2 0 2024-09-16T09:45:24.864 INFO:tasks.workunit.client.1.smithi114.stdout:3/23: write - no filename 2024-09-16T09:45:24.864 INFO:tasks.workunit.client.1.smithi114.stdout:7/17: dread f0 [0,4194304] 0 2024-09-16T09:45:24.866 INFO:tasks.workunit.client.1.smithi114.stdout:1/20: rename c2 to d4/c6 0 2024-09-16T09:45:24.866 INFO:tasks.workunit.client.1.smithi114.stdout:4/11: rename d0 to d0/d6 22 2024-09-16T09:45:24.867 INFO:tasks.workunit.client.1.smithi114.stdout:4/12: chown d0/c4 673503393 1 2024-09-16T09:45:24.868 INFO:tasks.workunit.client.1.smithi114.stdout:0/10: creat f2 x:0 0 0 2024-09-16T09:45:24.869 INFO:tasks.workunit.client.1.smithi114.stdout:2/16: symlink d1/d8/l9 0 2024-09-16T09:45:24.872 INFO:tasks.workunit.client.1.smithi114.stdout:6/16: dwrite f4 [0,4194304] 0 2024-09-16T09:45:24.872 INFO:tasks.workunit.client.1.smithi114.stdout:6/17: write f5 [164326,23235] 0 2024-09-16T09:45:24.873 INFO:tasks.workunit.client.1.smithi114.stdout:1/21: stat d4/c6 0 2024-09-16T09:45:24.873 INFO:tasks.workunit.client.1.smithi114.stdout:1/22: write - no filename 2024-09-16T09:45:24.873 INFO:tasks.workunit.client.1.smithi114.stdout:7/18: unlink f0 0 2024-09-16T09:45:24.875 INFO:tasks.workunit.client.1.smithi114.stdout:5/11: mkdir d3 0 2024-09-16T09:45:24.875 INFO:tasks.workunit.client.1.smithi114.stdout:4/13: dread d0/f2 [0,4194304] 0 2024-09-16T09:45:24.876 INFO:tasks.workunit.client.1.smithi114.stdout:0/11: creat f3 x:0 0 0 2024-09-16T09:45:24.878 INFO:tasks.workunit.client.1.smithi114.stdout:7/19: dread f1 [0,4194304] 0 2024-09-16T09:45:24.880 INFO:tasks.workunit.client.1.smithi114.stdout:4/14: read d0/f2 [378827,121426] 0 2024-09-16T09:45:24.880 INFO:tasks.workunit.client.1.smithi114.stdout:4/15: write d0/f2 [3148052,119104] 0 2024-09-16T09:45:24.880 INFO:tasks.workunit.client.1.smithi114.stdout:6/18: mkdir d6 0 2024-09-16T09:45:24.881 INFO:tasks.workunit.client.1.smithi114.stdout:1/23: mknod d4/c7 0 2024-09-16T09:45:24.881 INFO:tasks.workunit.client.1.smithi114.stdout:1/24: dread - no filename 2024-09-16T09:45:24.881 INFO:tasks.workunit.client.1.smithi114.stdout:5/12: dread - f0 zero size 2024-09-16T09:45:24.882 INFO:tasks.workunit.client.1.smithi114.stdout:5/13: write f0 [775747,34695] 0 2024-09-16T09:45:24.884 INFO:tasks.workunit.client.1.smithi114.stdout:0/12: mknod c4 0 2024-09-16T09:45:24.884 INFO:tasks.workunit.client.1.smithi114.stdout:0/13: truncate f3 459249 0 2024-09-16T09:45:24.885 INFO:tasks.workunit.client.1.smithi114.stdout:7/20: mknod d2/c4 0 2024-09-16T09:45:24.888 INFO:tasks.workunit.client.1.smithi114.stdout:6/19: creat d6/f7 x:0 0 0 2024-09-16T09:45:24.890 INFO:tasks.workunit.client.1.smithi114.stdout:1/25: mkdir d4/d8 0 2024-09-16T09:45:24.890 INFO:tasks.workunit.client.1.smithi114.stdout:1/26: readlink - no filename 2024-09-16T09:45:24.891 INFO:tasks.workunit.client.1.smithi114.stdout:5/14: stat c1 0 2024-09-16T09:45:24.891 INFO:tasks.workunit.client.1.smithi114.stdout:5/15: stat d3 0 2024-09-16T09:45:24.892 INFO:tasks.workunit.client.1.smithi114.stdout:5/16: dread f2 [0,4194304] 0 2024-09-16T09:45:24.893 INFO:tasks.workunit.client.1.smithi114.stdout:6/20: creat d6/f8 x:0 0 0 2024-09-16T09:45:24.898 INFO:tasks.workunit.client.1.smithi114.stdout:1/27: creat d4/d8/f9 x:0 0 0 2024-09-16T09:45:24.901 INFO:tasks.workunit.client.1.smithi114.stdout:5/17: link f0 d3/f4 0 2024-09-16T09:45:24.909 INFO:tasks.workunit.client.1.smithi114.stdout:8/20: dwrite f3 [0,4194304] 0 2024-09-16T09:45:24.911 INFO:tasks.workunit.client.1.smithi114.stdout:0/14: dwrite f2 [0,4194304] 0 2024-09-16T09:45:24.911 INFO:tasks.workunit.client.1.smithi114.stdout:8/21: symlink d4/l6 0 2024-09-16T09:45:24.914 INFO:tasks.workunit.client.1.smithi114.stdout:0/15: creat f5 x:0 0 0 2024-09-16T09:45:24.915 INFO:tasks.workunit.client.1.smithi114.stdout:8/22: mknod d4/c7 0 2024-09-16T09:45:24.915 INFO:tasks.workunit.client.1.smithi114.stdout:0/16: dread f3 [0,4194304] 0 2024-09-16T09:45:24.917 INFO:tasks.workunit.client.1.smithi114.stdout:8/23: unlink d4/l6 0 2024-09-16T09:45:24.918 INFO:tasks.workunit.client.1.smithi114.stdout:6/21: dwrite d6/f7 [0,4194304] 0 2024-09-16T09:45:24.918 INFO:tasks.workunit.client.1.smithi114.stdout:5/18: dwrite d3/f4 [0,4194304] 0 2024-09-16T09:45:24.920 INFO:tasks.workunit.client.1.smithi114.stdout:8/24: rename c2 to d4/c8 0 2024-09-16T09:45:24.920 INFO:tasks.workunit.client.1.smithi114.stdout:8/25: chown d4/d5 4 1 2024-09-16T09:45:24.922 INFO:tasks.workunit.client.1.smithi114.stdout:6/22: symlink d6/l9 0 2024-09-16T09:45:24.924 INFO:tasks.workunit.client.1.smithi114.stdout:5/19: creat d3/f5 x:0 0 0 2024-09-16T09:45:24.925 INFO:tasks.workunit.client.1.smithi114.stdout:8/26: rmdir d4/d5 0 2024-09-16T09:45:24.925 INFO:tasks.workunit.client.1.smithi114.stdout:0/17: dread f2 [0,4194304] 0 2024-09-16T09:45:24.927 INFO:tasks.workunit.client.1.smithi114.stdout:6/23: unlink d6/f8 0 2024-09-16T09:45:24.928 INFO:tasks.workunit.client.1.smithi114.stdout:5/20: mknod d3/c6 0 2024-09-16T09:45:24.928 INFO:tasks.workunit.client.1.smithi114.stdout:5/21: dread - d3/f5 zero size 2024-09-16T09:45:24.928 INFO:tasks.workunit.client.1.smithi114.stdout:5/22: fdatasync d3/f5 0 2024-09-16T09:45:24.930 INFO:tasks.workunit.client.1.smithi114.stdout:0/18: creat f6 x:0 0 0 2024-09-16T09:45:24.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/19: mknod c7 0 2024-09-16T09:45:24.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/20: write f6 [521971,76711] 0 2024-09-16T09:45:24.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/21: truncate f1 615479 0 2024-09-16T09:45:24.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/22: write f1 [1259689,115750] 0 2024-09-16T09:45:24.935 INFO:tasks.workunit.client.1.smithi114.stdout:0/23: rename f1 to f8 0 2024-09-16T09:45:24.935 INFO:tasks.workunit.client.1.smithi114.stdout:0/24: truncate f5 264397 0 2024-09-16T09:45:24.940 INFO:tasks.workunit.client.1.smithi114.stdout:6/24: dread f4 [0,4194304] 0 2024-09-16T09:45:24.940 INFO:tasks.workunit.client.1.smithi114.stdout:0/25: dread f2 [0,4194304] 0 2024-09-16T09:45:24.942 INFO:tasks.workunit.client.1.smithi114.stdout:0/26: creat f9 x:0 0 0 2024-09-16T09:45:24.943 INFO:tasks.workunit.client.1.smithi114.stdout:0/27: chown f8 1 1 2024-09-16T09:45:24.946 INFO:tasks.workunit.client.1.smithi114.stdout:6/25: dread f4 [0,4194304] 0 2024-09-16T09:45:24.947 INFO:tasks.workunit.client.1.smithi114.stdout:6/26: mkdir d6/da 0 2024-09-16T09:45:24.950 INFO:tasks.workunit.client.1.smithi114.stdout:6/27: dread f5 [0,4194304] 0 2024-09-16T09:45:24.950 INFO:tasks.workunit.client.1.smithi114.stdout:8/27: dwrite f3 [0,4194304] 0 2024-09-16T09:45:24.951 INFO:tasks.workunit.client.1.smithi114.stdout:5/23: dwrite d3/f4 [0,4194304] 0 2024-09-16T09:45:24.965 INFO:tasks.workunit.client.1.smithi114.stdout:6/28: dwrite f5 [0,4194304] 0 2024-09-16T09:45:24.972 INFO:tasks.workunit.client.1.smithi114.stdout:8/28: mknod d4/c9 0 2024-09-16T09:45:24.976 INFO:tasks.workunit.client.1.smithi114.stdout:5/24: symlink d3/l7 0 2024-09-16T09:45:24.977 INFO:tasks.workunit.client.1.smithi114.stdout:5/25: dread f2 [0,4194304] 0 2024-09-16T09:45:24.983 INFO:tasks.workunit.client.1.smithi114.stdout:6/29: dread d6/f7 [0,4194304] 0 2024-09-16T09:45:24.983 INFO:tasks.workunit.client.1.smithi114.stdout:6/30: rename d6 to d6/da/db 22 2024-09-16T09:45:24.992 INFO:tasks.workunit.client.1.smithi114.stdout:8/29: write f3 [2571461,34505] 0 2024-09-16T09:45:24.992 INFO:tasks.workunit.client.1.smithi114.stdout:8/30: chown d4/c7 608 1 2024-09-16T09:45:24.992 INFO:tasks.workunit.client.1.smithi114.stdout:5/26: dwrite d3/f4 [0,4194304] 0 2024-09-16T09:45:24.993 INFO:tasks.workunit.client.1.smithi114.stdout:8/31: creat d4/fa x:0 0 0 2024-09-16T09:45:24.994 INFO:tasks.workunit.client.1.smithi114.stdout:5/27: creat d3/f8 x:0 0 0 2024-09-16T09:45:24.994 INFO:tasks.workunit.client.1.smithi114.stdout:5/28: chown d3/f5 53 1 2024-09-16T09:45:24.994 INFO:tasks.workunit.client.1.smithi114.stdout:5/29: write d3/f8 [153097,61336] 0 2024-09-16T09:45:24.994 INFO:tasks.workunit.client.1.smithi114.stdout:5/30: chown d3/l7 26667 1 2024-09-16T09:45:24.994 INFO:tasks.workunit.client.1.smithi114.stdout:5/31: write f2 [1269478,12714] 0 2024-09-16T09:45:24.995 INFO:tasks.workunit.client.1.smithi114.stdout:5/32: creat d3/f9 x:0 0 0 2024-09-16T09:45:24.996 INFO:tasks.workunit.client.1.smithi114.stdout:6/31: write d6/f7 [2395156,13146] 0 2024-09-16T09:45:24.997 INFO:tasks.workunit.client.1.smithi114.stdout:5/33: symlink d3/la 0 2024-09-16T09:45:24.997 INFO:tasks.workunit.client.1.smithi114.stdout:5/34: chown d3/f5 2068707 1 2024-09-16T09:45:25.001 INFO:tasks.workunit.client.1.smithi114.stdout:6/32: dread f4 [0,4194304] 0 2024-09-16T09:45:25.002 INFO:tasks.workunit.client.1.smithi114.stdout:6/33: rename f4 to d6/fc 0 2024-09-16T09:45:25.003 INFO:tasks.workunit.client.1.smithi114.stdout:6/34: mknod d6/cd 0 2024-09-16T09:45:25.004 INFO:tasks.workunit.client.1.smithi114.stdout:6/35: mkdir d6/da/de 0 2024-09-16T09:45:25.005 INFO:tasks.workunit.client.1.smithi114.stdout:6/36: mkdir d6/da/de/df 0 2024-09-16T09:45:25.011 INFO:tasks.workunit.client.1.smithi114.stdout:5/35: dwrite f0 [0,4194304] 0 2024-09-16T09:45:25.021 INFO:tasks.workunit.client.1.smithi114.stdout:6/37: dwrite f5 [0,4194304] 0 2024-09-16T09:45:25.044 INFO:tasks.workunit.client.1.smithi114.stdout:5/36: dwrite f2 [0,4194304] 0 2024-09-16T09:45:25.069 INFO:tasks.workunit.client.1.smithi114.stdout:5/37: dwrite d3/f9 [0,4194304] 0 2024-09-16T09:45:25.072 INFO:tasks.workunit.client.1.smithi114.stdout:5/38: creat d3/fb x:0 0 0 2024-09-16T09:45:25.073 INFO:tasks.workunit.client.1.smithi114.stdout:5/39: rename c1 to d3/cc 0 2024-09-16T09:45:25.368 INFO:tasks.workunit.client.1.smithi114.stdout:3/24: rename c1 to c3 0 2024-09-16T09:45:25.371 INFO:tasks.workunit.client.1.smithi114.stdout:4/16: getdents d0 0 2024-09-16T09:45:25.373 INFO:tasks.workunit.client.1.smithi114.stdout:9/21: sync 2024-09-16T09:45:25.378 INFO:tasks.workunit.client.1.smithi114.stdout:2/17: getdents d1 0 2024-09-16T09:45:25.379 INFO:tasks.workunit.client.1.smithi114.stdout:2/18: symlink d1/d8/la 0 2024-09-16T09:45:25.380 INFO:tasks.workunit.client.1.smithi114.stdout:2/19: mknod d1/d8/cb 0 2024-09-16T09:45:25.386 INFO:tasks.workunit.client.1.smithi114.stdout:2/20: dread f0 [0,4194304] 0 2024-09-16T09:45:25.389 INFO:tasks.workunit.client.1.smithi114.stdout:1/28: fsync d4/d8/f9 0 2024-09-16T09:45:25.389 INFO:tasks.workunit.client.1.smithi114.stdout:1/29: chown d4 91534832 1 2024-09-16T09:45:25.389 INFO:tasks.workunit.client.1.smithi114.stdout:1/30: chown d4 51565 1 2024-09-16T09:45:25.389 INFO:tasks.workunit.client.1.smithi114.stdout:1/31: rename d4 to d4/d8/da 22 2024-09-16T09:45:25.390 INFO:tasks.workunit.client.1.smithi114.stdout:1/32: symlink d4/d8/lb 0 2024-09-16T09:45:25.391 INFO:tasks.workunit.client.1.smithi114.stdout:1/33: mknod d4/cc 0 2024-09-16T09:45:25.391 INFO:tasks.workunit.client.1.smithi114.stdout:1/34: dread - d4/d8/f9 zero size 2024-09-16T09:45:25.391 INFO:tasks.workunit.client.1.smithi114.stdout:1/35: write d4/d8/f9 [911509,13304] 0 2024-09-16T09:45:25.391 INFO:tasks.workunit.client.1.smithi114.stdout:1/36: chown d4/c6 760 1 2024-09-16T09:45:25.417 INFO:tasks.workunit.client.1.smithi114.stdout:1/37: dwrite d4/d8/f9 [0,4194304] 0 2024-09-16T09:45:25.417 INFO:tasks.workunit.client.1.smithi114.stdout:1/38: chown d4 156516270 1 2024-09-16T09:45:25.418 INFO:tasks.workunit.client.1.smithi114.stdout:1/39: mknod d4/cd 0 2024-09-16T09:45:25.420 INFO:tasks.workunit.client.1.smithi114.stdout:1/40: link d4/c6 d4/ce 0 2024-09-16T09:45:25.421 INFO:tasks.workunit.client.1.smithi114.stdout:1/41: mknod d4/cf 0 2024-09-16T09:45:25.421 INFO:tasks.workunit.client.1.smithi114.stdout:1/42: readlink d4/d8/lb 0 2024-09-16T09:45:25.427 INFO:tasks.workunit.client.1.smithi114.stdout:6/38: rename d6/da/de to d6/da/d10 0 2024-09-16T09:45:25.428 INFO:tasks.workunit.client.1.smithi114.stdout:6/39: fsync d6/fc 0 2024-09-16T09:45:25.430 INFO:tasks.workunit.client.1.smithi114.stdout:5/40: truncate d3/f4 2815765 0 2024-09-16T09:45:25.430 INFO:tasks.workunit.client.1.smithi114.stdout:5/41: chown d3/f8 2878 1 2024-09-16T09:45:25.431 INFO:tasks.workunit.client.1.smithi114.stdout:5/42: creat d3/fd x:0 0 0 2024-09-16T09:45:25.436 INFO:tasks.workunit.client.1.smithi114.stdout:6/40: dread f5 [0,4194304] 0 2024-09-16T09:45:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:25 smithi114 ceph-mon[35635]: Upgrade: Target is version 19.3.0-4882-g66e33d6a (squid) 2024-09-16T09:45:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:25 smithi114 ceph-mon[35635]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f'] 2024-09-16T09:45:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:25 smithi114 ceph-mon[35635]: Upgrade: Need to upgrade myself (mgr.smithi111.erxodt) 2024-09-16T09:45:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:25 smithi114 ceph-mon[35635]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f on smithi114 2024-09-16T09:45:25.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:25 smithi114 ceph-mon[35635]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:25.438 INFO:tasks.workunit.client.1.smithi114.stdout:6/41: rename d6/l9 to d6/l11 0 2024-09-16T09:45:25.453 INFO:tasks.workunit.client.1.smithi114.stdout:5/43: dwrite d3/f8 [0,4194304] 0 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:5/44: dread - d3/fd zero size 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/25: unlink c3 0 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/26: link - no file 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/27: write - no filename 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/28: truncate - no filename 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/29: dread - no filename 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/30: dread - no filename 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/31: rename - no filename 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/32: chown . 634457 1 2024-09-16T09:45:25.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/33: write - no filename 2024-09-16T09:45:25.455 INFO:tasks.workunit.client.1.smithi114.stdout:5/45: rename d3/la to d3/le 0 2024-09-16T09:45:25.455 INFO:tasks.workunit.client.1.smithi114.stdout:5/46: chown d3/le 129269 1 2024-09-16T09:45:25.455 INFO:tasks.workunit.client.1.smithi114.stdout:5/47: chown d3/f8 11641704 1 2024-09-16T09:45:25.455 INFO:tasks.workunit.client.1.smithi114.stdout:3/34: symlink l4 0 2024-09-16T09:45:25.456 INFO:tasks.workunit.client.1.smithi114.stdout:5/48: mkdir d3/df 0 2024-09-16T09:45:25.458 INFO:tasks.workunit.client.1.smithi114.stdout:3/35: creat f5 x:0 0 0 2024-09-16T09:45:25.458 INFO:tasks.workunit.client.1.smithi114.stdout:3/36: dread - f5 zero size 2024-09-16T09:45:25.458 INFO:tasks.workunit.client.1.smithi114.stdout:3/37: dread - f5 zero size 2024-09-16T09:45:25.458 INFO:tasks.workunit.client.1.smithi114.stdout:3/38: write f5 [873182,13472] 0 2024-09-16T09:45:25.458 INFO:tasks.workunit.client.1.smithi114.stdout:6/42: dwrite f5 [4194304,4194304] 0 2024-09-16T09:45:25.458 INFO:tasks.workunit.client.1.smithi114.stdout:5/49: creat d3/df/f10 x:0 0 0 2024-09-16T09:45:25.460 INFO:tasks.workunit.client.1.smithi114.stdout:3/39: unlink f5 0 2024-09-16T09:45:25.462 INFO:tasks.workunit.client.1.smithi114.stdout:5/50: unlink d3/c6 0 2024-09-16T09:45:25.463 INFO:tasks.workunit.client.1.smithi114.stdout:3/40: rename l4 to l6 0 2024-09-16T09:45:25.466 INFO:tasks.workunit.client.1.smithi114.stdout:1/43: write d4/d8/f9 [4784378,109698] 0 2024-09-16T09:45:25.466 INFO:tasks.workunit.client.1.smithi114.stdout:1/44: stat d4 0 2024-09-16T09:45:25.475 INFO:tasks.workunit.client.1.smithi114.stdout:1/45: write d4/d8/f9 [2416312,68930] 0 2024-09-16T09:45:25.475 INFO:tasks.workunit.client.1.smithi114.stdout:1/46: write d4/d8/f9 [3427734,21876] 0 2024-09-16T09:45:25.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/47: write d4/d8/f9 [1976447,126335] 0 2024-09-16T09:45:25.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/48: read d4/d8/f9 [1375501,78204] 0 2024-09-16T09:45:25.476 INFO:tasks.workunit.client.1.smithi114.stdout:2/21: unlink f0 0 2024-09-16T09:45:25.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/49: rmdir d4/d8 39 2024-09-16T09:45:25.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/50: chown d4/cd 19 1 2024-09-16T09:45:25.477 INFO:tasks.workunit.client.1.smithi114.stdout:2/22: symlink d1/lc 0 2024-09-16T09:45:25.477 INFO:tasks.workunit.client.1.smithi114.stdout:2/23: chown d1 8974 1 2024-09-16T09:45:25.477 INFO:tasks.workunit.client.1.smithi114.stdout:2/24: write - no filename 2024-09-16T09:45:25.478 INFO:tasks.workunit.client.1.smithi114.stdout:2/25: rename d1/d8/l9 to d1/d8/ld 0 2024-09-16T09:45:25.478 INFO:tasks.workunit.client.1.smithi114.stdout:2/26: write - no filename 2024-09-16T09:45:25.480 INFO:tasks.workunit.client.1.smithi114.stdout:2/27: unlink d1/c7 0 2024-09-16T09:45:25.480 INFO:tasks.workunit.client.1.smithi114.stdout:2/28: chown d1/c6 12948874 1 2024-09-16T09:45:25.480 INFO:tasks.workunit.client.1.smithi114.stdout:2/29: dread - no filename 2024-09-16T09:45:25.481 INFO:tasks.workunit.client.1.smithi114.stdout:2/30: creat d1/fe x:0 0 0 2024-09-16T09:45:25.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/31: rmdir d1 39 2024-09-16T09:45:25.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/32: dread - d1/fe zero size 2024-09-16T09:45:25.482 INFO:tasks.workunit.client.1.smithi114.stdout:1/51: dread d4/d8/f9 [4194304,4194304] 0 2024-09-16T09:45:25.483 INFO:tasks.workunit.client.1.smithi114.stdout:2/33: symlink d1/lf 0 2024-09-16T09:45:25.484 INFO:tasks.workunit.client.1.smithi114.stdout:1/52: creat d4/d8/f10 x:0 0 0 2024-09-16T09:45:25.484 INFO:tasks.workunit.client.1.smithi114.stdout:1/53: dread - d4/d8/f10 zero size 2024-09-16T09:45:25.484 INFO:tasks.workunit.client.1.smithi114.stdout:1/54: readlink d4/d8/lb 0 2024-09-16T09:45:25.484 INFO:tasks.workunit.client.1.smithi114.stdout:1/55: readlink d4/d8/lb 0 2024-09-16T09:45:25.485 INFO:tasks.workunit.client.1.smithi114.stdout:3/41: rename l6 to l7 0 2024-09-16T09:45:25.485 INFO:tasks.workunit.client.1.smithi114.stdout:3/42: write - no filename 2024-09-16T09:45:25.485 INFO:tasks.workunit.client.1.smithi114.stdout:2/34: mkdir d1/d8/d10 0 2024-09-16T09:45:25.487 INFO:tasks.workunit.client.1.smithi114.stdout:1/56: symlink d4/l11 0 2024-09-16T09:45:25.487 INFO:tasks.workunit.client.1.smithi114.stdout:1/57: readlink d4/l11 0 2024-09-16T09:45:25.487 INFO:tasks.workunit.client.1.smithi114.stdout:1/58: fdatasync d4/d8/f9 0 2024-09-16T09:45:25.489 INFO:tasks.workunit.client.1.smithi114.stdout:2/35: unlink d1/c6 0 2024-09-16T09:45:25.490 INFO:tasks.workunit.client.1.smithi114.stdout:2/36: read - d1/fe zero size 2024-09-16T09:45:25.491 INFO:tasks.workunit.client.1.smithi114.stdout:2/37: symlink d1/d8/d10/l11 0 2024-09-16T09:45:25.494 INFO:tasks.workunit.client.1.smithi114.stdout:2/38: creat d1/d8/f12 x:0 0 0 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/43: unlink l7 0 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/44: chown . 133033884 1 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/45: chown . 95410547 1 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/46: write - no filename 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/47: dread - no filename 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/48: rmdir - no directory 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/49: readlink - no filename 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/50: readlink - no filename 2024-09-16T09:45:25.499 INFO:tasks.workunit.client.1.smithi114.stdout:3/51: stat - no entries 2024-09-16T09:45:25.500 INFO:tasks.workunit.client.1.smithi114.stdout:1/59: dwrite d4/d8/f9 [4194304,4194304] 0 2024-09-16T09:45:25.501 INFO:tasks.workunit.client.1.smithi114.stdout:3/52: symlink l8 0 2024-09-16T09:45:25.503 INFO:tasks.workunit.client.1.smithi114.stdout:1/60: symlink d4/d8/l12 0 2024-09-16T09:45:25.505 INFO:tasks.workunit.client.1.smithi114.stdout:3/53: creat f9 x:0 0 0 2024-09-16T09:45:25.506 INFO:tasks.workunit.client.1.smithi114.stdout:1/61: creat d4/f13 x:0 0 0 2024-09-16T09:45:25.506 INFO:tasks.workunit.client.1.smithi114.stdout:1/62: truncate d4/d8/f10 401817 0 2024-09-16T09:45:25.508 INFO:tasks.workunit.client.1.smithi114.stdout:3/54: symlink la 0 2024-09-16T09:45:25.508 INFO:tasks.workunit.client.1.smithi114.stdout:3/55: write f9 [508804,62779] 0 2024-09-16T09:45:25.509 INFO:tasks.workunit.client.1.smithi114.stdout:3/56: creat fb x:0 0 0 2024-09-16T09:45:25.510 INFO:tasks.workunit.client.1.smithi114.stdout:2/39: dwrite d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:25.510 INFO:tasks.workunit.client.1.smithi114.stdout:3/57: mkdir dc 0 2024-09-16T09:45:25.512 INFO:tasks.workunit.client.1.smithi114.stdout:2/40: rename d1/d8/cb to d1/d8/c13 0 2024-09-16T09:45:25.514 INFO:tasks.workunit.client.1.smithi114.stdout:3/58: mknod dc/cd 0 2024-09-16T09:45:25.515 INFO:tasks.workunit.client.1.smithi114.stdout:3/59: read f9 [503531,80321] 0 2024-09-16T09:45:25.515 INFO:tasks.workunit.client.1.smithi114.stdout:3/60: readlink l8 0 2024-09-16T09:45:25.515 INFO:tasks.workunit.client.1.smithi114.stdout:3/61: chown l8 1066566 1 2024-09-16T09:45:25.522 INFO:tasks.workunit.client.1.smithi114.stdout:2/41: dread d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:25.523 INFO:tasks.workunit.client.1.smithi114.stdout:2/42: mknod d1/d8/d10/c14 0 2024-09-16T09:45:25.525 INFO:tasks.workunit.client.1.smithi114.stdout:2/43: mknod d1/d8/d10/c15 0 2024-09-16T09:45:25.527 INFO:tasks.workunit.client.1.smithi114.stdout:2/44: mkdir d1/d8/d10/d16 0 2024-09-16T09:45:25.527 INFO:tasks.workunit.client.1.smithi114.stdout:2/45: read - d1/fe zero size 2024-09-16T09:45:25.528 INFO:tasks.workunit.client.1.smithi114.stdout:2/46: chown d1/d8/c13 29255563 1 2024-09-16T09:45:25.542 INFO:tasks.workunit.client.1.smithi114.stdout:3/62: getdents dc 0 2024-09-16T09:45:25.542 INFO:tasks.workunit.client.1.smithi114.stdout:3/63: write fb [506093,22880] 0 2024-09-16T09:45:25.545 INFO:tasks.workunit.client.1.smithi114.stdout:2/47: dwrite d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:25.555 INFO:tasks.workunit.client.1.smithi114.stdout:2/48: dread d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:25.557 INFO:tasks.workunit.client.1.smithi114.stdout:2/49: link d1/d8/d10/l11 d1/d8/l17 0 2024-09-16T09:45:25.558 INFO:tasks.workunit.client.1.smithi114.stdout:2/50: unlink d1/d8/la 0 2024-09-16T09:45:25.564 INFO:tasks.workunit.client.1.smithi114.stdout:2/51: dread d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:25.564 INFO:tasks.workunit.client.1.smithi114.stdout:2/52: write d1/fe [102856,126817] 0 2024-09-16T09:45:25.564 INFO:tasks.workunit.client.1.smithi114.stdout:2/53: write d1/fe [986489,11456] 0 2024-09-16T09:45:25.564 INFO:tasks.workunit.client.1.smithi114.stdout:2/54: write d1/fe [767779,73047] 0 2024-09-16T09:45:25.565 INFO:tasks.workunit.client.1.smithi114.stdout:3/64: dwrite fb [0,4194304] 0 2024-09-16T09:45:25.565 INFO:tasks.workunit.client.1.smithi114.stdout:2/55: getdents d1 0 2024-09-16T09:45:25.567 INFO:tasks.workunit.client.1.smithi114.stdout:3/65: mkdir dc/de 0 2024-09-16T09:45:25.567 INFO:tasks.workunit.client.1.smithi114.stdout:2/56: fsync d1/fe 0 2024-09-16T09:45:25.571 INFO:tasks.workunit.client.1.smithi114.stdout:2/57: link d1/fe d1/d8/d10/f18 0 2024-09-16T09:45:25.573 INFO:tasks.workunit.client.1.smithi114.stdout:2/58: symlink d1/d8/l19 0 2024-09-16T09:45:25.574 INFO:tasks.workunit.client.1.smithi114.stdout:2/59: write d1/fe [1583537,14535] 0 2024-09-16T09:45:25.574 INFO:tasks.workunit.client.1.smithi114.stdout:2/60: chown d1/lf 6 1 2024-09-16T09:45:25.576 INFO:tasks.workunit.client.1.smithi114.stdout:2/61: mknod d1/d8/d10/c1a 0 2024-09-16T09:45:25.585 INFO:tasks.workunit.client.1.smithi114.stdout:2/62: read d1/d8/f12 [4171116,21211] 0 2024-09-16T09:45:25.588 INFO:tasks.workunit.client.1.smithi114.stdout:3/66: dwrite f9 [0,4194304] 0 2024-09-16T09:45:25.606 INFO:tasks.workunit.client.1.smithi114.stdout:3/67: dwrite f9 [0,4194304] 0 2024-09-16T09:45:25.606 INFO:tasks.workunit.client.1.smithi114.stdout:3/68: fsync f9 0 2024-09-16T09:45:25.614 INFO:tasks.workunit.client.1.smithi114.stdout:3/69: write f9 [1997044,87188] 0 2024-09-16T09:45:25.616 INFO:tasks.workunit.client.1.smithi114.stdout:3/70: mknod dc/cf 0 2024-09-16T09:45:25.630 INFO:tasks.workunit.client.1.smithi114.stdout:2/63: getdents d1/d8 0 2024-09-16T09:45:25.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:25 smithi111 ceph-mon[27997]: Upgrade: Target is version 19.3.0-4882-g66e33d6a (squid) 2024-09-16T09:45:25.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:25 smithi111 ceph-mon[27997]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f'] 2024-09-16T09:45:25.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:25 smithi111 ceph-mon[27997]: Upgrade: Need to upgrade myself (mgr.smithi111.erxodt) 2024-09-16T09:45:25.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:25 smithi111 ceph-mon[27997]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f on smithi114 2024-09-16T09:45:25.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:25 smithi111 ceph-mon[27997]: from='client.24357 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:25.632 INFO:tasks.workunit.client.1.smithi114.stdout:2/64: creat d1/d8/d10/d16/f1b x:0 0 0 2024-09-16T09:45:25.634 INFO:tasks.workunit.client.1.smithi114.stdout:2/65: link d1/d8/ld d1/l1c 0 2024-09-16T09:45:25.635 INFO:tasks.workunit.client.1.smithi114.stdout:2/66: read d1/d8/d10/f18 [1567002,42753] 0 2024-09-16T09:45:25.649 INFO:tasks.workunit.client.1.smithi114.stdout:2/67: dwrite d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:25.649 INFO:tasks.workunit.client.1.smithi114.stdout:2/68: getdents d1/d8 0 2024-09-16T09:45:25.649 INFO:tasks.workunit.client.1.smithi114.stdout:2/69: chown d1/d8/l19 31 1 2024-09-16T09:45:25.672 INFO:tasks.workunit.client.1.smithi114.stdout:3/71: truncate fb 3942500 0 2024-09-16T09:45:25.673 INFO:tasks.workunit.client.1.smithi114.stdout:3/72: mkdir dc/de/d10 0 2024-09-16T09:45:25.709 INFO:tasks.workunit.client.1.smithi114.stdout:2/70: truncate d1/d8/d10/f18 18210 0 2024-09-16T09:45:25.735 INFO:tasks.workunit.client.1.smithi114.stdout:3/73: write fb [3884355,96251] 0 2024-09-16T09:45:25.736 INFO:tasks.workunit.client.1.smithi114.stdout:3/74: unlink dc/cf 0 2024-09-16T09:45:25.737 INFO:tasks.workunit.client.1.smithi114.stdout:3/75: write fb [2600280,8333] 0 2024-09-16T09:45:25.738 INFO:tasks.workunit.client.1.smithi114.stdout:3/76: mknod dc/de/d10/c11 0 2024-09-16T09:45:25.738 INFO:tasks.workunit.client.1.smithi114.stdout:3/77: chown f9 6790030 1 2024-09-16T09:45:25.740 INFO:tasks.workunit.client.1.smithi114.stdout:3/78: symlink dc/de/l12 0 2024-09-16T09:45:25.760 INFO:tasks.workunit.client.1.smithi114.stdout:3/79: dwrite fb [0,4194304] 0 2024-09-16T09:45:25.762 INFO:tasks.workunit.client.1.smithi114.stdout:3/80: creat dc/de/d10/f13 x:0 0 0 2024-09-16T09:45:25.763 INFO:tasks.workunit.client.1.smithi114.stdout:2/71: dread d1/fe [0,4194304] 0 2024-09-16T09:45:25.765 INFO:tasks.workunit.client.1.smithi114.stdout:3/81: symlink dc/de/l14 0 2024-09-16T09:45:25.785 INFO:tasks.workunit.client.1.smithi114.stdout:2/72: dwrite d1/d8/f12 [4194304,4194304] 0 2024-09-16T09:45:25.785 INFO:tasks.workunit.client.1.smithi114.stdout:2/73: chown d1/lc 8 1 2024-09-16T09:45:25.785 INFO:tasks.workunit.client.1.smithi114.stdout:3/82: dwrite dc/de/d10/f13 [0,4194304] 0 2024-09-16T09:45:25.791 INFO:tasks.workunit.client.1.smithi114.stdout:2/74: getdents d1 0 2024-09-16T09:45:25.794 INFO:tasks.workunit.client.1.smithi114.stdout:3/83: mknod dc/de/c15 0 2024-09-16T09:45:25.794 INFO:tasks.workunit.client.1.smithi114.stdout:3/84: rename dc to dc/de/d10/d16 22 2024-09-16T09:45:25.796 INFO:tasks.workunit.client.1.smithi114.stdout:2/75: unlink d1/lc 0 2024-09-16T09:45:25.799 INFO:tasks.workunit.client.1.smithi114.stdout:3/85: mkdir dc/de/d17 0 2024-09-16T09:45:25.799 INFO:tasks.workunit.client.1.smithi114.stdout:3/86: fdatasync fb 0 2024-09-16T09:45:25.799 INFO:tasks.workunit.client.1.smithi114.stdout:2/76: chown d1/lf 5331224 1 2024-09-16T09:45:25.802 INFO:tasks.workunit.client.1.smithi114.stdout:3/87: mkdir dc/de/d18 0 2024-09-16T09:45:25.810 INFO:tasks.workunit.client.1.smithi114.stdout:2/77: dread d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:25.812 INFO:tasks.workunit.client.1.smithi114.stdout:2/78: mkdir d1/d8/d10/d16/d1d 0 2024-09-16T09:45:25.813 INFO:tasks.workunit.client.1.smithi114.stdout:3/88: write dc/de/d10/f13 [3616778,7742] 0 2024-09-16T09:45:25.813 INFO:tasks.workunit.client.1.smithi114.stdout:3/89: chown dc/de/d10/c11 0 1 2024-09-16T09:45:25.815 INFO:tasks.workunit.client.1.smithi114.stdout:2/79: dread d1/fe [0,4194304] 0 2024-09-16T09:45:25.815 INFO:tasks.workunit.client.1.smithi114.stdout:3/90: creat dc/de/d10/f19 x:0 0 0 2024-09-16T09:45:25.815 INFO:tasks.workunit.client.1.smithi114.stdout:3/91: write f9 [4723990,79130] 0 2024-09-16T09:45:25.838 INFO:tasks.workunit.client.1.smithi114.stdout:2/80: dwrite d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:25.839 INFO:tasks.workunit.client.1.smithi114.stdout:2/81: creat d1/d8/d10/d16/d1d/f1e x:0 0 0 2024-09-16T09:45:25.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/92: dwrite f9 [0,4194304] 0 2024-09-16T09:45:25.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/93: write dc/de/d10/f13 [3923178,65740] 0 2024-09-16T09:45:25.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/94: truncate dc/de/d10/f13 5068403 0 2024-09-16T09:45:25.847 INFO:tasks.workunit.client.1.smithi114.stdout:2/82: rename d1/l2 to d1/l1f 0 2024-09-16T09:45:25.855 INFO:tasks.workunit.client.1.smithi114.stdout:2/83: dread d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:25.855 INFO:tasks.workunit.client.1.smithi114.stdout:2/84: readlink d1/d8/l19 0 2024-09-16T09:45:25.897 INFO:tasks.workunit.client.1.smithi114.stdout:2/85: fsync d1/d8/d10/d16/d1d/f1e 0 2024-09-16T09:45:25.911 INFO:tasks.workunit.client.1.smithi114.stdout:2/86: dwrite d1/fe [0,4194304] 0 2024-09-16T09:45:25.911 INFO:tasks.workunit.client.1.smithi114.stdout:2/87: readlink d1/l1f 0 2024-09-16T09:45:25.915 INFO:tasks.workunit.client.1.smithi114.stdout:2/88: creat d1/d8/d10/d16/f20 x:0 0 0 2024-09-16T09:45:25.915 INFO:tasks.workunit.client.1.smithi114.stdout:2/89: rename d1 to d1/d8/d10/d21 22 2024-09-16T09:45:25.916 INFO:tasks.workunit.client.1.smithi114.stdout:2/90: chown d1/d8/d10/c15 0 1 2024-09-16T09:45:25.929 INFO:tasks.workunit.client.1.smithi114.stdout:2/91: dwrite d1/fe [0,4194304] 0 2024-09-16T09:45:26.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:26 smithi114 ceph-mon[35635]: pgmap v236: 65 pgs: 65 active+clean; 216 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 341 KiB/s rd, 6.8 MiB/s wr, 593 op/s 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:2/92: sync 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:9/22: sync 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:9/23: fdatasync - no filename 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:5/51: sync 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:4/17: sync 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:8/32: sync 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:1/63: sync 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:8/33: fsync d4/fa 0 2024-09-16T09:45:26.570 INFO:tasks.workunit.client.1.smithi114.stdout:1/64: chown d4/d8/f9 0 1 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:8/34: stat d4/c9 0 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:5/52: write d3/f5 [409717,30152] 0 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:8/35: write d4/fa [638655,71072] 0 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:6/43: sync 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:6/44: chown d6/f7 982968 1 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:7/21: sync 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:0/28: sync 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:3/95: sync 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:7/22: fdatasync f1 0 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:3/96: fsync dc/de/d10/f19 0 2024-09-16T09:45:26.571 INFO:tasks.workunit.client.1.smithi114.stdout:7/23: write f1 [4951384,115053] 0 2024-09-16T09:45:26.572 INFO:tasks.workunit.client.1.smithi114.stdout:9/24: mkdir d3 0 2024-09-16T09:45:26.572 INFO:tasks.workunit.client.1.smithi114.stdout:9/25: read - no filename 2024-09-16T09:45:26.572 INFO:tasks.workunit.client.1.smithi114.stdout:9/26: dwrite - no filename 2024-09-16T09:45:26.572 INFO:tasks.workunit.client.1.smithi114.stdout:4/18: creat d0/f7 x:0 0 0 2024-09-16T09:45:26.574 INFO:tasks.workunit.client.1.smithi114.stdout:2/93: creat d1/d8/d10/f22 x:0 0 0 2024-09-16T09:45:26.575 INFO:tasks.workunit.client.1.smithi114.stdout:7/24: fsync f1 0 2024-09-16T09:45:26.575 INFO:tasks.workunit.client.1.smithi114.stdout:7/25: fdatasync f1 0 2024-09-16T09:45:26.575 INFO:tasks.workunit.client.1.smithi114.stdout:5/53: mkdir d3/d11 0 2024-09-16T09:45:26.577 INFO:tasks.workunit.client.1.smithi114.stdout:8/36: mkdir d4/db 0 2024-09-16T09:45:26.579 INFO:tasks.workunit.client.1.smithi114.stdout:6/45: symlink d6/da/d10/l12 0 2024-09-16T09:45:26.580 INFO:tasks.workunit.client.1.smithi114.stdout:6/46: write d6/f7 [3579823,45373] 0 2024-09-16T09:45:26.580 INFO:tasks.workunit.client.1.smithi114.stdout:0/29: rename f8 to fa 0 2024-09-16T09:45:26.581 INFO:tasks.workunit.client.1.smithi114.stdout:3/97: rmdir dc 39 2024-09-16T09:45:26.585 INFO:tasks.workunit.client.1.smithi114.stdout:9/27: link c2 d3/c4 0 2024-09-16T09:45:26.585 INFO:tasks.workunit.client.1.smithi114.stdout:0/30: dread fa [0,4194304] 0 2024-09-16T09:45:26.587 INFO:tasks.workunit.client.1.smithi114.stdout:2/94: mknod d1/d8/d10/d16/c23 0 2024-09-16T09:45:26.589 INFO:tasks.workunit.client.1.smithi114.stdout:7/26: creat d2/f5 x:0 0 0 2024-09-16T09:45:26.592 INFO:tasks.workunit.client.1.smithi114.stdout:7/27: dread f1 [0,4194304] 0 2024-09-16T09:45:26.592 INFO:tasks.workunit.client.1.smithi114.stdout:7/28: dread - d2/f5 zero size 2024-09-16T09:45:26.592 INFO:tasks.workunit.client.1.smithi114.stdout:7/29: write f1 [2692457,50021] 0 2024-09-16T09:45:26.592 INFO:tasks.workunit.client.1.smithi114.stdout:8/37: symlink d4/db/lc 0 2024-09-16T09:45:26.592 INFO:tasks.workunit.client.1.smithi114.stdout:8/38: chown d4 13 1 2024-09-16T09:45:26.593 INFO:tasks.workunit.client.1.smithi114.stdout:6/47: unlink l1 0 2024-09-16T09:45:26.597 INFO:tasks.workunit.client.1.smithi114.stdout:9/28: creat d3/f5 x:0 0 0 2024-09-16T09:45:26.598 INFO:tasks.workunit.client.1.smithi114.stdout:9/29: write d3/f5 [176409,106628] 0 2024-09-16T09:45:26.599 INFO:tasks.workunit.client.1.smithi114.stdout:1/65: dwrite d4/d8/f9 [8388608,4194304] 0 2024-09-16T09:45:26.600 INFO:tasks.workunit.client.1.smithi114.stdout:0/31: rename c7 to cb 0 2024-09-16T09:45:26.601 INFO:tasks.workunit.client.1.smithi114.stdout:2/95: symlink d1/d8/d10/l24 0 2024-09-16T09:45:26.601 INFO:tasks.workunit.client.1.smithi114.stdout:2/96: dread - d1/d8/d10/d16/f20 zero size 2024-09-16T09:45:26.602 INFO:tasks.workunit.client.1.smithi114.stdout:4/19: dwrite d0/f2 [0,4194304] 0 2024-09-16T09:45:26.602 INFO:tasks.workunit.client.1.smithi114.stdout:4/20: chown d0/f2 168504638 1 2024-09-16T09:45:26.603 INFO:tasks.workunit.client.1.smithi114.stdout:7/30: mkdir d2/d6 0 2024-09-16T09:45:26.603 INFO:tasks.workunit.client.1.smithi114.stdout:7/31: read f1 [2423939,16672] 0 2024-09-16T09:45:26.603 INFO:tasks.workunit.client.1.smithi114.stdout:8/39: mkdir d4/db/dd 0 2024-09-16T09:45:26.605 INFO:tasks.workunit.client.1.smithi114.stdout:5/54: dwrite d3/fd [0,4194304] 0 2024-09-16T09:45:26.606 INFO:tasks.workunit.client.1.smithi114.stdout:9/30: creat d3/f6 x:0 0 0 2024-09-16T09:45:26.608 INFO:tasks.workunit.client.1.smithi114.stdout:1/66: creat d4/d8/f14 x:0 0 0 2024-09-16T09:45:26.609 INFO:tasks.workunit.client.1.smithi114.stdout:2/97: creat d1/d8/d10/f25 x:0 0 0 2024-09-16T09:45:26.612 INFO:tasks.workunit.client.1.smithi114.stdout:7/32: mknod d2/c7 0 2024-09-16T09:45:26.613 INFO:tasks.workunit.client.1.smithi114.stdout:8/40: rmdir d4 39 2024-09-16T09:45:26.614 INFO:tasks.workunit.client.1.smithi114.stdout:4/21: write d0/f2 [2314025,62382] 0 2024-09-16T09:45:26.619 INFO:tasks.workunit.client.1.smithi114.stdout:0/32: dwrite f3 [0,4194304] 0 2024-09-16T09:45:26.619 INFO:tasks.workunit.client.1.smithi114.stdout:0/33: stat f6 0 2024-09-16T09:45:26.622 INFO:tasks.workunit.client.1.smithi114.stdout:5/55: rename d3/fb to d3/f12 0 2024-09-16T09:45:26.622 INFO:tasks.workunit.client.1.smithi114.stdout:5/56: stat d3/f5 0 2024-09-16T09:45:26.623 INFO:tasks.workunit.client.1.smithi114.stdout:3/98: dwrite f9 [0,4194304] 0 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/67: symlink d4/l15 0 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/68: chown d4/c6 0 1 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/69: chown d4/c6 5 1 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/70: readlink d4/l11 0 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/71: readlink d4/l15 0 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/72: truncate d4/f13 611762 0 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/73: dread - d4/d8/f14 zero size 2024-09-16T09:45:26.625 INFO:tasks.workunit.client.1.smithi114.stdout:1/74: chown d4/l15 11 1 2024-09-16T09:45:26.626 INFO:tasks.workunit.client.1.smithi114.stdout:8/41: creat d4/db/fe x:0 0 0 2024-09-16T09:45:26.626 INFO:tasks.workunit.client.1.smithi114.stdout:8/42: chown d4/c9 55749940 1 2024-09-16T09:45:26.626 INFO:tasks.workunit.client.1.smithi114.stdout:8/43: dread - d4/db/fe zero size 2024-09-16T09:45:26.630 INFO:tasks.workunit.client.1.smithi114.stdout:7/33: dwrite d2/f5 [0,4194304] 0 2024-09-16T09:45:26.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/22: creat d0/f8 x:0 0 0 2024-09-16T09:45:26.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/23: chown d0/f7 17 1 2024-09-16T09:45:26.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/24: write d0/f2 [3950610,80621] 0 2024-09-16T09:45:26.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/25: write d0/f7 [318437,57223] 0 2024-09-16T09:45:26.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:26 smithi111 ceph-mon[27997]: pgmap v236: 65 pgs: 65 active+clean; 216 MiB data, 973 MiB used, 535 GiB / 536 GiB avail; 341 KiB/s rd, 6.8 MiB/s wr, 593 op/s 2024-09-16T09:45:26.636 INFO:tasks.workunit.client.1.smithi114.stdout:9/31: dwrite d3/f5 [0,4194304] 0 2024-09-16T09:45:26.640 INFO:tasks.workunit.client.1.smithi114.stdout:0/34: truncate f2 1890091 0 2024-09-16T09:45:26.642 INFO:tasks.workunit.client.1.smithi114.stdout:0/35: dread f5 [0,4194304] 0 2024-09-16T09:45:26.642 INFO:tasks.workunit.client.1.smithi114.stdout:5/57: mknod d3/d11/c13 0 2024-09-16T09:45:26.644 INFO:tasks.workunit.client.1.smithi114.stdout:3/99: creat dc/de/d17/f1a x:0 0 0 2024-09-16T09:45:26.645 INFO:tasks.workunit.client.1.smithi114.stdout:8/44: unlink d4/db/fe 0 2024-09-16T09:45:26.656 INFO:tasks.workunit.client.1.smithi114.stdout:0/36: mknod cc 0 2024-09-16T09:45:26.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/58: mkdir d3/df/d14 0 2024-09-16T09:45:26.659 INFO:tasks.workunit.client.1.smithi114.stdout:3/100: dwrite dc/de/d10/f13 [0,4194304] 0 2024-09-16T09:45:26.661 INFO:tasks.workunit.client.1.smithi114.stdout:3/101: mknod dc/c1b 0 2024-09-16T09:45:26.661 INFO:tasks.workunit.client.1.smithi114.stdout:5/59: dread d3/f5 [0,4194304] 0 2024-09-16T09:45:26.674 INFO:tasks.workunit.client.1.smithi114.stdout:5/60: dread d3/f8 [0,4194304] 0 2024-09-16T09:45:26.674 INFO:tasks.workunit.client.1.smithi114.stdout:5/61: truncate d3/f5 1211978 0 2024-09-16T09:45:26.674 INFO:tasks.workunit.client.1.smithi114.stdout:3/102: dwrite dc/de/d10/f19 [0,4194304] 0 2024-09-16T09:45:26.691 INFO:tasks.workunit.client.1.smithi114.stdout:3/103: dwrite fb [0,4194304] 0 2024-09-16T09:45:26.691 INFO:tasks.workunit.client.1.smithi114.stdout:3/104: dread - dc/de/d17/f1a zero size 2024-09-16T09:45:26.693 INFO:tasks.workunit.client.1.smithi114.stdout:3/105: creat dc/de/d18/f1c x:0 0 0 2024-09-16T09:45:26.694 INFO:tasks.workunit.client.1.smithi114.stdout:3/106: rmdir dc/de/d17 39 2024-09-16T09:45:26.715 INFO:tasks.workunit.client.1.smithi114.stdout:3/107: dwrite dc/de/d10/f13 [4194304,4194304] 0 2024-09-16T09:45:26.715 INFO:tasks.workunit.client.1.smithi114.stdout:3/108: truncate dc/de/d17/f1a 87183 0 2024-09-16T09:45:26.717 INFO:tasks.workunit.client.1.smithi114.stdout:3/109: rename dc/de/d18/f1c to dc/de/d17/f1d 0 2024-09-16T09:45:26.719 INFO:tasks.workunit.client.1.smithi114.stdout:3/110: rmdir dc 39 2024-09-16T09:45:26.728 INFO:tasks.workunit.client.1.smithi114.stdout:3/111: dread dc/de/d10/f13 [0,4194304] 0 2024-09-16T09:45:26.728 INFO:tasks.workunit.client.1.smithi114.stdout:3/112: stat dc 0 2024-09-16T09:45:26.728 INFO:tasks.workunit.client.1.smithi114.stdout:3/113: chown dc/de/d10/f13 47 1 2024-09-16T09:45:26.730 INFO:tasks.workunit.client.1.smithi114.stdout:3/114: creat dc/de/d10/f1e x:0 0 0 2024-09-16T09:45:26.730 INFO:tasks.workunit.client.1.smithi114.stdout:3/115: readlink dc/de/l12 0 2024-09-16T09:45:27.014 INFO:tasks.workunit.client.1.smithi114.stdout:9/32: fsync d3/f5 0 2024-09-16T09:45:27.014 INFO:tasks.workunit.client.1.smithi114.stdout:9/33: stat d3/f5 0 2024-09-16T09:45:27.015 INFO:tasks.workunit.client.1.smithi114.stdout:9/34: mkdir d3/d7 0 2024-09-16T09:45:27.015 INFO:tasks.workunit.client.1.smithi114.stdout:9/35: rename d3 to d3/d8 22 2024-09-16T09:45:27.015 INFO:tasks.workunit.client.1.smithi114.stdout:9/36: rename d3/d7 to d3/d7/d9 22 2024-09-16T09:45:27.015 INFO:tasks.workunit.client.1.smithi114.stdout:9/37: stat d3 0 2024-09-16T09:45:27.015 INFO:tasks.workunit.client.1.smithi114.stdout:9/38: truncate d3/f5 4396337 0 2024-09-16T09:45:27.028 INFO:tasks.workunit.client.1.smithi114.stdout:6/48: truncate d6/f7 786873 0 2024-09-16T09:45:27.038 INFO:tasks.workunit.client.1.smithi114.stdout:4/26: getdents d0 0 2024-09-16T09:45:27.038 INFO:tasks.workunit.client.1.smithi114.stdout:4/27: write d0/f7 [1170691,109092] 0 2024-09-16T09:45:27.038 INFO:tasks.workunit.client.1.smithi114.stdout:4/28: fsync d0/f8 0 2024-09-16T09:45:27.040 INFO:tasks.workunit.client.1.smithi114.stdout:4/29: mkdir d0/d9 0 2024-09-16T09:45:27.040 INFO:tasks.workunit.client.1.smithi114.stdout:4/30: getdents d0/d9 0 2024-09-16T09:45:27.042 INFO:tasks.workunit.client.1.smithi114.stdout:4/31: creat d0/d9/fa x:0 0 0 2024-09-16T09:45:27.047 INFO:tasks.workunit.client.1.smithi114.stdout:4/32: mknod d0/cb 0 2024-09-16T09:45:27.050 INFO:tasks.workunit.client.1.smithi114.stdout:4/33: creat d0/fc x:0 0 0 2024-09-16T09:45:27.050 INFO:tasks.workunit.client.1.smithi114.stdout:4/34: chown d0/cb 6326406 1 2024-09-16T09:45:27.055 INFO:tasks.workunit.client.1.smithi114.stdout:8/45: getdents d4/db 0 2024-09-16T09:45:27.057 INFO:tasks.workunit.client.1.smithi114.stdout:8/46: dread d4/fa [0,4194304] 0 2024-09-16T09:45:27.058 INFO:tasks.workunit.client.1.smithi114.stdout:7/34: write d2/f5 [4480505,48139] 0 2024-09-16T09:45:27.058 INFO:tasks.workunit.client.1.smithi114.stdout:8/47: mkdir d4/db/df 0 2024-09-16T09:45:27.059 INFO:tasks.workunit.client.1.smithi114.stdout:8/48: chown d4/db/dd 0 1 2024-09-16T09:45:27.061 INFO:tasks.workunit.client.1.smithi114.stdout:7/35: mkdir d2/d8 0 2024-09-16T09:45:27.063 INFO:tasks.workunit.client.1.smithi114.stdout:7/36: mkdir d2/d9 0 2024-09-16T09:45:27.063 INFO:tasks.workunit.client.1.smithi114.stdout:7/37: chown d2/d8 432684 1 2024-09-16T09:45:27.064 INFO:tasks.workunit.client.1.smithi114.stdout:0/37: getdents . 0 2024-09-16T09:45:27.065 INFO:tasks.workunit.client.1.smithi114.stdout:5/62: getdents d3/df 0 2024-09-16T09:45:27.066 INFO:tasks.workunit.client.1.smithi114.stdout:4/35: dwrite d0/f7 [0,4194304] 0 2024-09-16T09:45:27.066 INFO:tasks.workunit.client.1.smithi114.stdout:4/36: write d0/d9/fa [404381,83113] 0 2024-09-16T09:45:27.067 INFO:tasks.workunit.client.1.smithi114.stdout:0/38: rename cc to cd 0 2024-09-16T09:45:27.071 INFO:tasks.workunit.client.1.smithi114.stdout:4/37: unlink d0/c4 0 2024-09-16T09:45:27.071 INFO:tasks.workunit.client.1.smithi114.stdout:4/38: fsync d0/f7 0 2024-09-16T09:45:27.074 INFO:tasks.workunit.client.1.smithi114.stdout:7/38: write d2/f5 [2520129,122792] 0 2024-09-16T09:45:27.076 INFO:tasks.workunit.client.1.smithi114.stdout:4/39: rmdir d0/d9 39 2024-09-16T09:45:27.076 INFO:tasks.workunit.client.1.smithi114.stdout:4/40: write d0/f2 [2441137,129066] 0 2024-09-16T09:45:27.077 INFO:tasks.workunit.client.1.smithi114.stdout:8/49: dwrite f3 [0,4194304] 0 2024-09-16T09:45:27.079 INFO:tasks.workunit.client.1.smithi114.stdout:0/39: mknod ce 0 2024-09-16T09:45:27.080 INFO:tasks.workunit.client.1.smithi114.stdout:7/39: unlink d2/l3 0 2024-09-16T09:45:27.080 INFO:tasks.workunit.client.1.smithi114.stdout:7/40: write d2/f5 [1123235,63294] 0 2024-09-16T09:45:27.083 INFO:tasks.workunit.client.1.smithi114.stdout:8/50: creat d4/db/f10 x:0 0 0 2024-09-16T09:45:27.090 INFO:tasks.workunit.client.1.smithi114.stdout:5/63: truncate d3/f5 508711 0 2024-09-16T09:45:27.091 INFO:tasks.workunit.client.1.smithi114.stdout:5/64: chown d3/fd 1011147949 1 2024-09-16T09:45:27.092 INFO:tasks.workunit.client.1.smithi114.stdout:7/41: dread d2/f5 [0,4194304] 0 2024-09-16T09:45:27.094 INFO:tasks.workunit.client.1.smithi114.stdout:5/65: mknod d3/df/d14/c15 0 2024-09-16T09:45:27.094 INFO:tasks.workunit.client.1.smithi114.stdout:5/66: fdatasync d3/f5 0 2024-09-16T09:45:27.094 INFO:tasks.workunit.client.1.smithi114.stdout:5/67: stat d3/df/d14/c15 0 2024-09-16T09:45:27.094 INFO:tasks.workunit.client.1.smithi114.stdout:7/42: symlink d2/d8/la 0 2024-09-16T09:45:27.098 INFO:tasks.workunit.client.1.smithi114.stdout:7/43: creat d2/fb x:0 0 0 2024-09-16T09:45:27.099 INFO:tasks.workunit.client.1.smithi114.stdout:7/44: chown d2/d9 31566 1 2024-09-16T09:45:27.099 INFO:tasks.workunit.client.1.smithi114.stdout:7/45: write f1 [5592257,86126] 0 2024-09-16T09:45:27.099 INFO:tasks.workunit.client.1.smithi114.stdout:7/46: chown d2/c4 3 1 2024-09-16T09:45:27.099 INFO:tasks.workunit.client.1.smithi114.stdout:7/47: truncate d2/fb 607331 0 2024-09-16T09:45:27.101 INFO:tasks.workunit.client.1.smithi114.stdout:7/48: creat d2/d9/fc x:0 0 0 2024-09-16T09:45:27.101 INFO:tasks.workunit.client.1.smithi114.stdout:7/49: chown d2 1901 1 2024-09-16T09:45:27.105 INFO:tasks.workunit.client.1.smithi114.stdout:5/68: dread f2 [0,4194304] 0 2024-09-16T09:45:27.107 INFO:tasks.workunit.client.1.smithi114.stdout:8/51: dwrite f3 [0,4194304] 0 2024-09-16T09:45:27.109 INFO:tasks.workunit.client.1.smithi114.stdout:7/50: dread d2/f5 [0,4194304] 0 2024-09-16T09:45:27.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/51: stat d2/c7 0 2024-09-16T09:45:27.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/52: readlink d2/d8/la 0 2024-09-16T09:45:27.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/53: write d2/f5 [1404810,95136] 0 2024-09-16T09:45:27.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/54: fdatasync d2/d9/fc 0 2024-09-16T09:45:27.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/55: read - d2/d9/fc zero size 2024-09-16T09:45:27.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/56: truncate d2/d9/fc 880399 0 2024-09-16T09:45:27.112 INFO:tasks.workunit.client.1.smithi114.stdout:8/52: rename d4/db/lc to d4/db/df/l11 0 2024-09-16T09:45:27.117 INFO:tasks.workunit.client.1.smithi114.stdout:7/57: link d2/c7 d2/d8/cd 0 2024-09-16T09:45:27.120 INFO:tasks.workunit.client.1.smithi114.stdout:8/53: creat d4/db/df/f12 x:0 0 0 2024-09-16T09:45:27.121 INFO:tasks.workunit.client.1.smithi114.stdout:7/58: mknod d2/d9/ce 0 2024-09-16T09:45:27.123 INFO:tasks.workunit.client.1.smithi114.stdout:8/54: creat d4/db/dd/f13 x:0 0 0 2024-09-16T09:45:27.124 INFO:tasks.workunit.client.1.smithi114.stdout:7/59: rename d2/d6 to d2/df 0 2024-09-16T09:45:27.125 INFO:tasks.workunit.client.1.smithi114.stdout:7/60: write f1 [198390,118862] 0 2024-09-16T09:45:27.127 INFO:tasks.workunit.client.1.smithi114.stdout:8/55: mknod d4/db/dd/c14 0 2024-09-16T09:45:27.127 INFO:tasks.workunit.client.1.smithi114.stdout:7/61: fsync f1 0 2024-09-16T09:45:27.127 INFO:tasks.workunit.client.1.smithi114.stdout:7/62: stat f1 0 2024-09-16T09:45:27.127 INFO:tasks.workunit.client.1.smithi114.stdout:8/56: write d4/db/df/f12 [613700,5212] 0 2024-09-16T09:45:27.130 INFO:tasks.workunit.client.1.smithi114.stdout:8/57: creat d4/f15 x:0 0 0 2024-09-16T09:45:27.134 INFO:tasks.workunit.client.1.smithi114.stdout:8/58: creat d4/db/dd/f16 x:0 0 0 2024-09-16T09:45:27.135 INFO:tasks.workunit.client.1.smithi114.stdout:7/63: dread d2/f5 [0,4194304] 0 2024-09-16T09:45:27.143 INFO:tasks.workunit.client.1.smithi114.stdout:7/64: rename f1 to d2/df/f10 0 2024-09-16T09:45:27.143 INFO:tasks.workunit.client.1.smithi114.stdout:7/65: write d2/d9/fc [27522,16589] 0 2024-09-16T09:45:27.148 INFO:tasks.workunit.client.1.smithi114.stdout:7/66: mkdir d2/df/d11 0 2024-09-16T09:45:27.153 INFO:tasks.workunit.client.1.smithi114.stdout:7/67: dread d2/d9/fc [0,4194304] 0 2024-09-16T09:45:27.154 INFO:tasks.workunit.client.1.smithi114.stdout:7/68: dread d2/fb [0,4194304] 0 2024-09-16T09:45:27.155 INFO:tasks.workunit.client.1.smithi114.stdout:3/116: truncate dc/de/d10/f13 2163376 0 2024-09-16T09:45:27.156 INFO:tasks.workunit.client.1.smithi114.stdout:7/69: creat d2/d9/f12 x:0 0 0 2024-09-16T09:45:27.159 INFO:tasks.workunit.client.1.smithi114.stdout:3/117: mkdir dc/de/d1f 0 2024-09-16T09:45:27.159 INFO:tasks.workunit.client.1.smithi114.stdout:3/118: truncate dc/de/d17/f1d 726718 0 2024-09-16T09:45:27.160 INFO:tasks.workunit.client.1.smithi114.stdout:7/70: mknod d2/df/c13 0 2024-09-16T09:45:27.160 INFO:tasks.workunit.client.1.smithi114.stdout:7/71: truncate d2/d9/fc 1177483 0 2024-09-16T09:45:27.163 INFO:tasks.workunit.client.1.smithi114.stdout:7/72: symlink d2/df/d11/l14 0 2024-09-16T09:45:27.166 INFO:tasks.workunit.client.1.smithi114.stdout:7/73: creat d2/d8/f15 x:0 0 0 2024-09-16T09:45:27.166 INFO:tasks.workunit.client.1.smithi114.stdout:3/119: write dc/de/d10/f19 [3156383,22253] 0 2024-09-16T09:45:27.167 INFO:tasks.workunit.client.1.smithi114.stdout:7/74: dread d2/fb [0,4194304] 0 2024-09-16T09:45:27.169 INFO:tasks.workunit.client.1.smithi114.stdout:3/120: creat dc/de/d18/f20 x:0 0 0 2024-09-16T09:45:27.169 INFO:tasks.workunit.client.1.smithi114.stdout:3/121: read dc/de/d17/f1a [9791,101717] 0 2024-09-16T09:45:27.174 INFO:tasks.workunit.client.1.smithi114.stdout:3/122: rename dc/de/l14 to dc/de/d17/l21 0 2024-09-16T09:45:27.174 INFO:tasks.workunit.client.1.smithi114.stdout:3/123: fdatasync dc/de/d17/f1a 0 2024-09-16T09:45:27.177 INFO:tasks.workunit.client.1.smithi114.stdout:3/124: rename fb to dc/de/d18/f22 0 2024-09-16T09:45:27.177 INFO:tasks.workunit.client.1.smithi114.stdout:3/125: fdatasync dc/de/d17/f1d 0 2024-09-16T09:45:27.178 INFO:tasks.workunit.client.1.smithi114.stdout:3/126: creat dc/de/d1f/f23 x:0 0 0 2024-09-16T09:45:27.191 INFO:tasks.workunit.client.1.smithi114.stdout:3/127: dwrite dc/de/d17/f1a [0,4194304] 0 2024-09-16T09:45:27.191 INFO:tasks.workunit.client.1.smithi114.stdout:3/128: chown dc/de/l12 2103499 1 2024-09-16T09:45:27.279 INFO:tasks.workunit.client.0.smithi111.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-16T09:45:27.279 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T09:45:27.280 INFO:tasks.workunit.client.0.smithi111.stderr:+ make 2024-09-16T09:45:27.323 INFO:tasks.workunit.client.1.smithi114.stdout:6/49: write d6/f7 [1309744,43863] 0 2024-09-16T09:45:27.362 INFO:tasks.workunit.client.1.smithi114.stdout:5/69: dwrite d3/f5 [0,4194304] 0 2024-09-16T09:45:27.362 INFO:tasks.workunit.client.1.smithi114.stdout:5/70: fdatasync d3/f4 0 2024-09-16T09:45:27.364 INFO:tasks.workunit.client.1.smithi114.stdout:5/71: creat d3/df/d14/f16 x:0 0 0 2024-09-16T09:45:27.364 INFO:tasks.workunit.client.1.smithi114.stdout:5/72: fsync d3/fd 0 2024-09-16T09:45:27.366 INFO:tasks.workunit.client.1.smithi114.stdout:8/59: getdents d4 0 2024-09-16T09:45:27.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/60: creat d4/db/f17 x:0 0 0 2024-09-16T09:45:27.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/61: fdatasync d4/db/df/f12 0 2024-09-16T09:45:27.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/62: stat d4/c8 0 2024-09-16T09:45:27.369 INFO:tasks.workunit.client.1.smithi114.stdout:5/73: read d3/f4 [2016119,3748] 0 2024-09-16T09:45:27.370 INFO:tasks.workunit.client.1.smithi114.stdout:5/74: symlink d3/df/l17 0 2024-09-16T09:45:27.390 INFO:tasks.workunit.client.1.smithi114.stdout:5/75: dwrite d3/fd [0,4194304] 0 2024-09-16T09:45:27.390 INFO:tasks.workunit.client.1.smithi114.stdout:8/63: dwrite f3 [4194304,4194304] 0 2024-09-16T09:45:27.390 INFO:tasks.workunit.client.1.smithi114.stdout:8/64: readlink d4/db/df/l11 0 2024-09-16T09:45:27.391 INFO:tasks.workunit.client.1.smithi114.stdout:5/76: rename d3/f12 to d3/f18 0 2024-09-16T09:45:27.392 INFO:tasks.workunit.client.1.smithi114.stdout:8/65: dread d4/fa [0,4194304] 0 2024-09-16T09:45:27.392 INFO:tasks.workunit.client.1.smithi114.stdout:8/66: dread - d4/db/f10 zero size 2024-09-16T09:45:27.392 INFO:tasks.workunit.client.1.smithi114.stdout:8/67: write d4/db/dd/f13 [756723,16705] 0 2024-09-16T09:45:27.392 INFO:tasks.workunit.client.1.smithi114.stdout:8/68: write d4/db/df/f12 [1648811,97414] 0 2024-09-16T09:45:27.392 INFO:tasks.workunit.client.1.smithi114.stdout:8/69: dread - d4/db/f17 zero size 2024-09-16T09:45:27.394 INFO:tasks.workunit.client.1.smithi114.stdout:5/77: rename d3/f9 to d3/df/f19 0 2024-09-16T09:45:27.395 INFO:tasks.workunit.client.1.smithi114.stdout:5/78: creat d3/d11/f1a x:0 0 0 2024-09-16T09:45:27.396 INFO:tasks.workunit.client.1.smithi114.stdout:5/79: symlink d3/df/d14/l1b 0 2024-09-16T09:45:27.399 INFO:tasks.workunit.client.1.smithi114.stdout:8/70: dread d4/db/df/f12 [0,4194304] 0 2024-09-16T09:45:27.399 INFO:tasks.workunit.client.1.smithi114.stdout:8/71: write d4/db/f10 [200867,83700] 0 2024-09-16T09:45:27.400 INFO:tasks.workunit.client.1.smithi114.stdout:8/72: mknod d4/db/df/c18 0 2024-09-16T09:45:27.401 INFO:tasks.workunit.client.1.smithi114.stdout:8/73: chown d4/fa 0 1 2024-09-16T09:45:27.402 INFO:tasks.workunit.client.1.smithi114.stdout:8/74: dread d4/fa [0,4194304] 0 2024-09-16T09:45:27.403 INFO:tasks.workunit.client.1.smithi114.stdout:8/75: creat d4/db/df/f19 x:0 0 0 2024-09-16T09:45:27.405 INFO:tasks.workunit.client.1.smithi114.stdout:8/76: rename d4/db/f10 to d4/db/df/f1a 0 2024-09-16T09:45:27.405 INFO:tasks.workunit.client.1.smithi114.stdout:8/77: write d4/db/f17 [984109,117895] 0 2024-09-16T09:45:27.405 INFO:tasks.workunit.client.1.smithi114.stdout:8/78: chown d4/db 0 1 2024-09-16T09:45:27.405 INFO:tasks.workunit.client.1.smithi114.stdout:8/79: fsync d4/fa 0 2024-09-16T09:45:27.406 INFO:tasks.workunit.client.1.smithi114.stdout:8/80: mkdir d4/db/dd/d1b 0 2024-09-16T09:45:27.406 INFO:tasks.workunit.client.1.smithi114.stdout:8/81: dread - d4/f15 zero size 2024-09-16T09:45:27.407 INFO:tasks.workunit.client.1.smithi114.stdout:8/82: rename d4/db/df/f19 to d4/db/df/f1c 0 2024-09-16T09:45:27.408 INFO:tasks.workunit.client.1.smithi114.stdout:8/83: rename d4/db/dd/c14 to d4/c1d 0 2024-09-16T09:45:27.408 INFO:tasks.workunit.client.1.smithi114.stdout:8/84: write d4/db/dd/f16 [806766,4766] 0 2024-09-16T09:45:27.409 INFO:tasks.workunit.client.1.smithi114.stdout:8/85: write d4/db/f17 [891036,44713] 0 2024-09-16T09:45:27.410 INFO:tasks.workunit.client.1.smithi114.stdout:5/80: dwrite f2 [4194304,4194304] 0 2024-09-16T09:45:27.410 INFO:tasks.workunit.client.1.smithi114.stdout:8/86: creat d4/db/df/f1e x:0 0 0 2024-09-16T09:45:27.410 INFO:tasks.workunit.client.1.smithi114.stdout:5/81: stat d3/df/d14/c15 0 2024-09-16T09:45:27.410 INFO:tasks.workunit.client.1.smithi114.stdout:5/82: write d3/d11/f1a [579881,93612] 0 2024-09-16T09:45:27.412 INFO:tasks.workunit.client.1.smithi114.stdout:5/83: creat d3/df/d14/f1c x:0 0 0 2024-09-16T09:45:27.412 INFO:tasks.workunit.client.1.smithi114.stdout:5/84: truncate d3/f5 5214316 0 2024-09-16T09:45:27.412 INFO:tasks.workunit.client.1.smithi114.stdout:5/85: readlink d3/le 0 2024-09-16T09:45:27.424 INFO:tasks.workunit.client.1.smithi114.stdout:8/87: dwrite d4/db/df/f1c [0,4194304] 0 2024-09-16T09:45:27.426 INFO:tasks.workunit.client.1.smithi114.stdout:8/88: mkdir d4/d1f 0 2024-09-16T09:45:27.426 INFO:tasks.workunit.client.1.smithi114.stdout:8/89: write d4/db/dd/f16 [1012802,67714] 0 2024-09-16T09:45:27.427 INFO:tasks.workunit.client.1.smithi114.stdout:8/90: rmdir d4/db/df 39 2024-09-16T09:45:27.429 INFO:tasks.workunit.client.1.smithi114.stdout:1/75: sync 2024-09-16T09:45:27.429 INFO:tasks.workunit.client.1.smithi114.stdout:2/98: sync 2024-09-16T09:45:27.429 INFO:tasks.workunit.client.1.smithi114.stdout:9/39: sync 2024-09-16T09:45:27.429 INFO:tasks.workunit.client.1.smithi114.stdout:0/40: sync 2024-09-16T09:45:27.429 INFO:tasks.workunit.client.1.smithi114.stdout:2/99: chown d1/d8 90 1 2024-09-16T09:45:27.429 INFO:tasks.workunit.client.1.smithi114.stdout:1/76: truncate d4/f13 1153866 0 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:7/75: sync 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:1/77: chown d4/c7 0 1 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:1/78: write d4/d8/f14 [667497,26809] 0 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:4/41: sync 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:4/42: write d0/f8 [241477,35510] 0 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:4/43: write d0/f8 [934917,67685] 0 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:3/129: sync 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:8/91: dread d4/db/df/f12 [0,4194304] 0 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:6/50: truncate d6/f7 14616 0 2024-09-16T09:45:27.430 INFO:tasks.workunit.client.1.smithi114.stdout:6/51: write f5 [9187725,85818] 0 2024-09-16T09:45:27.431 INFO:tasks.workunit.client.1.smithi114.stdout:9/40: rmdir d3/d7 0 2024-09-16T09:45:27.431 INFO:tasks.workunit.client.1.smithi114.stdout:9/41: readlink - no filename 2024-09-16T09:45:27.431 INFO:tasks.workunit.client.1.smithi114.stdout:9/42: chown d3/f5 140717166 1 2024-09-16T09:45:27.431 INFO:tasks.workunit.client.1.smithi114.stdout:9/43: stat d3/f6 0 2024-09-16T09:45:27.432 INFO:tasks.workunit.client.1.smithi114.stdout:7/76: symlink d2/d9/l16 0 2024-09-16T09:45:27.441 INFO:tasks.workunit.client.1.smithi114.stdout:6/52: dread d6/fc [0,4194304] 0 2024-09-16T09:45:27.441 INFO:tasks.workunit.client.1.smithi114.stdout:6/53: readlink d6/da/d10/l12 0 2024-09-16T09:45:27.441 INFO:tasks.workunit.client.1.smithi114.stdout:4/44: creat d0/d9/fd x:0 0 0 2024-09-16T09:45:27.442 INFO:tasks.workunit.client.1.smithi114.stdout:4/45: write d0/f2 [2992219,21156] 0 2024-09-16T09:45:27.442 INFO:tasks.workunit.client.1.smithi114.stdout:3/130: symlink dc/de/d1f/l24 0 2024-09-16T09:45:27.442 INFO:tasks.workunit.client.1.smithi114.stdout:9/44: rmdir d3 39 2024-09-16T09:45:27.442 INFO:tasks.workunit.client.1.smithi114.stdout:0/41: mknod cf 0 2024-09-16T09:45:27.442 INFO:tasks.workunit.client.1.smithi114.stdout:5/86: link d3/df/f19 d3/df/f1d 0 2024-09-16T09:45:27.444 INFO:tasks.workunit.client.1.smithi114.stdout:4/46: rename d0/f8 to d0/fe 0 2024-09-16T09:45:27.445 INFO:tasks.workunit.client.1.smithi114.stdout:8/92: write f3 [330798,118948] 0 2024-09-16T09:45:27.445 INFO:tasks.workunit.client.1.smithi114.stdout:8/93: chown d4/f15 183261326 1 2024-09-16T09:45:27.445 INFO:tasks.workunit.client.1.smithi114.stdout:8/94: write d4/f15 [562349,3127] 0 2024-09-16T09:45:27.445 INFO:tasks.workunit.client.1.smithi114.stdout:8/95: write d4/f15 [607836,118622] 0 2024-09-16T09:45:27.446 INFO:tasks.workunit.client.1.smithi114.stdout:9/45: mkdir d3/da 0 2024-09-16T09:45:27.446 INFO:tasks.workunit.client.1.smithi114.stdout:0/42: fdatasync f3 0 2024-09-16T09:45:27.448 INFO:tasks.workunit.client.1.smithi114.stdout:5/87: creat d3/d11/f1e x:0 0 0 2024-09-16T09:45:27.450 INFO:tasks.workunit.client.1.smithi114.stdout:2/100: dwrite d1/d8/d10/f22 [0,4194304] 0 2024-09-16T09:45:27.451 INFO:tasks.workunit.client.1.smithi114.stdout:7/77: dwrite d2/d9/fc [0,4194304] 0 2024-09-16T09:45:27.453 INFO:tasks.workunit.client.1.smithi114.stdout:9/46: creat d3/da/fb x:0 0 0 2024-09-16T09:45:27.460 INFO:tasks.workunit.client.1.smithi114.stdout:5/88: rename d3/df/d14 to d3/d1f 0 2024-09-16T09:45:27.460 INFO:tasks.workunit.client.1.smithi114.stdout:5/89: fsync d3/fd 0 2024-09-16T09:45:27.460 INFO:tasks.workunit.client.1.smithi114.stdout:5/90: read - d3/d11/f1e zero size 2024-09-16T09:45:27.460 INFO:tasks.workunit.client.1.smithi114.stdout:5/91: chown d3/df 17 1 2024-09-16T09:45:27.460 INFO:tasks.workunit.client.1.smithi114.stdout:2/101: mkdir d1/d8/d26 0 2024-09-16T09:45:27.460 INFO:tasks.workunit.client.1.smithi114.stdout:2/102: stat d1/d8/f12 0 2024-09-16T09:45:27.461 INFO:tasks.workunit.client.1.smithi114.stdout:3/131: dwrite dc/de/d18/f22 [0,4194304] 0 2024-09-16T09:45:27.464 INFO:tasks.workunit.client.1.smithi114.stdout:7/78: mknod d2/df/d11/c17 0 2024-09-16T09:45:27.465 INFO:tasks.workunit.client.1.smithi114.stdout:7/79: stat d2/d9/ce 0 2024-09-16T09:45:27.465 INFO:tasks.workunit.client.1.smithi114.stdout:7/80: truncate d2/fb 1630272 0 2024-09-16T09:45:27.467 INFO:tasks.workunit.client.0.smithi111.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-16T09:45:27.470 INFO:tasks.workunit.client.1.smithi114.stdout:1/79: truncate d4/f13 418846 0 2024-09-16T09:45:27.471 INFO:tasks.workunit.client.1.smithi114.stdout:8/96: dwrite f3 [4194304,4194304] 0 2024-09-16T09:45:27.471 INFO:tasks.workunit.client.1.smithi114.stdout:8/97: readlink d4/db/df/l11 0 2024-09-16T09:45:27.474 INFO:tasks.workunit.client.1.smithi114.stdout:5/92: rename f2 to d3/f20 0 2024-09-16T09:45:27.475 INFO:tasks.workunit.client.1.smithi114.stdout:2/103: getdents d1/d8/d10 0 2024-09-16T09:45:27.475 INFO:tasks.workunit.client.1.smithi114.stdout:2/104: write d1/d8/f12 [2321566,67426] 0 2024-09-16T09:45:27.476 INFO:tasks.workunit.client.1.smithi114.stdout:9/47: getdents d3 0 2024-09-16T09:45:27.481 INFO:tasks.workunit.client.1.smithi114.stdout:1/80: truncate d4/d8/f10 256286 0 2024-09-16T09:45:27.483 INFO:tasks.workunit.client.1.smithi114.stdout:9/48: creat d3/fc x:0 0 0 2024-09-16T09:45:27.484 INFO:tasks.workunit.client.1.smithi114.stdout:1/81: rmdir d4/d8 39 2024-09-16T09:45:27.485 INFO:tasks.workunit.client.1.smithi114.stdout:9/49: creat d3/da/fd x:0 0 0 2024-09-16T09:45:27.487 INFO:tasks.workunit.client.1.smithi114.stdout:1/82: mkdir d4/d8/d16 0 2024-09-16T09:45:27.487 INFO:tasks.workunit.client.1.smithi114.stdout:1/83: read d4/d8/f9 [626634,62399] 0 2024-09-16T09:45:27.487 INFO:tasks.workunit.client.1.smithi114.stdout:1/84: readlink d4/l11 0 2024-09-16T09:45:27.491 INFO:tasks.workunit.client.1.smithi114.stdout:3/132: dwrite dc/de/d17/f1a [0,4194304] 0 2024-09-16T09:45:27.491 INFO:tasks.workunit.client.1.smithi114.stdout:3/133: dread - dc/de/d18/f20 zero size 2024-09-16T09:45:27.492 INFO:tasks.workunit.client.1.smithi114.stdout:7/81: dwrite d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:27.492 INFO:tasks.workunit.client.1.smithi114.stdout:3/134: creat dc/de/d10/f25 x:0 0 0 2024-09-16T09:45:27.494 INFO:tasks.workunit.client.1.smithi114.stdout:5/93: dwrite d3/df/f10 [0,4194304] 0 2024-09-16T09:45:27.501 INFO:tasks.workunit.client.1.smithi114.stdout:2/105: dread d1/d8/f12 [4194304,4194304] 0 2024-09-16T09:45:27.503 INFO:tasks.workunit.client.1.smithi114.stdout:2/106: truncate d1/d8/d10/d16/f1b 2890044 0 2024-09-16T09:45:27.504 INFO:tasks.workunit.client.1.smithi114.stdout:8/98: truncate f3 5260563 0 2024-09-16T09:45:27.504 INFO:tasks.workunit.client.1.smithi114.stdout:2/107: creat d1/d8/d10/d16/f27 x:0 0 0 2024-09-16T09:45:27.504 INFO:tasks.workunit.client.1.smithi114.stdout:2/108: dread - d1/d8/d10/d16/f27 zero size 2024-09-16T09:45:27.505 INFO:tasks.workunit.client.1.smithi114.stdout:2/109: symlink d1/d8/d10/l28 0 2024-09-16T09:45:27.506 INFO:tasks.workunit.client.1.smithi114.stdout:3/135: dread dc/de/d18/f22 [0,4194304] 0 2024-09-16T09:45:27.507 INFO:tasks.workunit.client.1.smithi114.stdout:3/136: mkdir dc/de/d10/d26 0 2024-09-16T09:45:27.508 INFO:tasks.workunit.client.1.smithi114.stdout:3/137: creat dc/f27 x:0 0 0 2024-09-16T09:45:27.508 INFO:tasks.workunit.client.1.smithi114.stdout:3/138: fsync dc/de/d10/f1e 0 2024-09-16T09:45:27.509 INFO:tasks.workunit.client.1.smithi114.stdout:9/50: dwrite d3/fc [0,4194304] 0 2024-09-16T09:45:27.509 INFO:tasks.workunit.client.1.smithi114.stdout:9/51: chown d3/f6 968788891 1 2024-09-16T09:45:27.509 INFO:tasks.workunit.client.1.smithi114.stdout:3/139: creat dc/de/d18/f28 x:0 0 0 2024-09-16T09:45:27.510 INFO:tasks.workunit.client.1.smithi114.stdout:5/94: dwrite d3/d1f/f1c [0,4194304] 0 2024-09-16T09:45:27.512 INFO:tasks.workunit.client.1.smithi114.stdout:7/82: truncate d2/d9/f12 843475 0 2024-09-16T09:45:27.513 INFO:tasks.workunit.client.1.smithi114.stdout:9/52: mknod d3/ce 0 2024-09-16T09:45:27.514 INFO:tasks.workunit.client.1.smithi114.stdout:3/140: rmdir dc/de/d1f 39 2024-09-16T09:45:27.514 INFO:tasks.workunit.client.1.smithi114.stdout:3/141: readlink dc/de/d1f/l24 0 2024-09-16T09:45:27.514 INFO:tasks.workunit.client.1.smithi114.stdout:3/142: write dc/de/d1f/f23 [574402,24973] 0 2024-09-16T09:45:27.517 INFO:tasks.workunit.client.1.smithi114.stdout:5/95: symlink d3/d11/l21 0 2024-09-16T09:45:27.518 INFO:tasks.workunit.client.1.smithi114.stdout:8/99: write f3 [6240885,84015] 0 2024-09-16T09:45:27.519 INFO:tasks.workunit.client.1.smithi114.stdout:7/83: creat d2/df/d11/f18 x:0 0 0 2024-09-16T09:45:27.519 INFO:tasks.workunit.client.1.smithi114.stdout:3/143: dread dc/de/d10/f19 [0,4194304] 0 2024-09-16T09:45:27.521 INFO:tasks.workunit.client.1.smithi114.stdout:9/53: creat d3/ff x:0 0 0 2024-09-16T09:45:27.522 INFO:tasks.workunit.client.1.smithi114.stdout:5/96: creat d3/f22 x:0 0 0 2024-09-16T09:45:27.523 INFO:tasks.workunit.client.1.smithi114.stdout:8/100: creat d4/db/dd/f20 x:0 0 0 2024-09-16T09:45:27.524 INFO:tasks.workunit.client.1.smithi114.stdout:7/84: creat d2/d9/f19 x:0 0 0 2024-09-16T09:45:27.524 INFO:tasks.workunit.client.1.smithi114.stdout:7/85: chown d2/df/d11/f18 1 1 2024-09-16T09:45:27.525 INFO:tasks.workunit.client.1.smithi114.stdout:5/97: dread f0 [0,4194304] 0 2024-09-16T09:45:27.525 INFO:tasks.workunit.client.1.smithi114.stdout:9/54: mkdir d3/da/d10 0 2024-09-16T09:45:27.526 INFO:tasks.workunit.client.1.smithi114.stdout:9/55: dread - d3/da/fd zero size 2024-09-16T09:45:27.527 INFO:tasks.workunit.client.1.smithi114.stdout:8/101: link d4/c7 d4/c21 0 2024-09-16T09:45:27.527 INFO:tasks.workunit.client.1.smithi114.stdout:8/102: fsync d4/db/df/f1e 0 2024-09-16T09:45:27.527 INFO:tasks.workunit.client.1.smithi114.stdout:8/103: fsync d4/db/df/f1c 0 2024-09-16T09:45:27.527 INFO:tasks.workunit.client.1.smithi114.stdout:5/98: truncate f0 221654 0 2024-09-16T09:45:27.529 INFO:tasks.workunit.client.1.smithi114.stdout:9/56: rmdir d3 39 2024-09-16T09:45:27.529 INFO:tasks.workunit.client.1.smithi114.stdout:9/57: write d3/da/fd [546893,122639] 0 2024-09-16T09:45:27.529 INFO:tasks.workunit.client.1.smithi114.stdout:9/58: dread - d3/ff zero size 2024-09-16T09:45:27.530 INFO:tasks.workunit.client.1.smithi114.stdout:8/104: dread d4/fa [0,4194304] 0 2024-09-16T09:45:27.530 INFO:tasks.workunit.client.1.smithi114.stdout:8/105: truncate d4/db/df/f1e 65830 0 2024-09-16T09:45:27.530 INFO:tasks.workunit.client.1.smithi114.stdout:8/106: write d4/db/dd/f13 [758274,54575] 0 2024-09-16T09:45:27.531 INFO:tasks.workunit.client.1.smithi114.stdout:8/107: creat d4/db/f22 x:0 0 0 2024-09-16T09:45:27.532 INFO:tasks.workunit.client.1.smithi114.stdout:8/108: symlink d4/db/dd/d1b/l23 0 2024-09-16T09:45:27.541 INFO:tasks.workunit.client.1.smithi114.stdout:1/85: dwrite d4/d8/f10 [0,4194304] 0 2024-09-16T09:45:27.541 INFO:tasks.workunit.client.1.smithi114.stdout:1/86: chown d4/f13 429861 1 2024-09-16T09:45:27.542 INFO:tasks.workunit.client.1.smithi114.stdout:2/110: dwrite d1/d8/d10/d16/f20 [0,4194304] 0 2024-09-16T09:45:27.544 INFO:tasks.workunit.client.1.smithi114.stdout:2/111: creat d1/d8/f29 x:0 0 0 2024-09-16T09:45:27.544 INFO:tasks.workunit.client.1.smithi114.stdout:9/59: dread d3/fc [0,4194304] 0 2024-09-16T09:45:27.545 INFO:tasks.workunit.client.1.smithi114.stdout:2/112: chown d1/l5 7 1 2024-09-16T09:45:27.545 INFO:tasks.workunit.client.1.smithi114.stdout:2/113: dread - d1/d8/d10/d16/d1d/f1e zero size 2024-09-16T09:45:27.546 INFO:tasks.workunit.client.1.smithi114.stdout:2/114: symlink d1/d8/l2a 0 2024-09-16T09:45:27.549 INFO:tasks.workunit.client.1.smithi114.stdout:2/115: symlink d1/l2b 0 2024-09-16T09:45:27.550 INFO:tasks.workunit.client.1.smithi114.stdout:2/116: rmdir d1/d8 39 2024-09-16T09:45:27.551 INFO:tasks.workunit.client.1.smithi114.stdout:2/117: creat d1/f2c x:0 0 0 2024-09-16T09:45:27.564 INFO:tasks.workunit.client.1.smithi114.stdout:2/118: dread d1/d8/d10/f22 [0,4194304] 0 2024-09-16T09:45:27.569 INFO:tasks.workunit.client.1.smithi114.stdout:7/86: dwrite d2/df/d11/f18 [0,4194304] 0 2024-09-16T09:45:27.569 INFO:tasks.workunit.client.1.smithi114.stdout:5/99: dwrite d3/d11/f1e [0,4194304] 0 2024-09-16T09:45:27.569 INFO:tasks.workunit.client.1.smithi114.stdout:8/109: getdents d4/db 0 2024-09-16T09:45:27.570 INFO:tasks.workunit.client.1.smithi114.stdout:9/60: dwrite d3/f6 [0,4194304] 0 2024-09-16T09:45:27.573 INFO:tasks.workunit.client.1.smithi114.stdout:2/119: write d1/d8/d10/d16/f20 [1322587,130869] 0 2024-09-16T09:45:27.573 INFO:tasks.workunit.client.1.smithi114.stdout:3/144: dwrite dc/de/d10/f25 [0,4194304] 0 2024-09-16T09:45:27.573 INFO:tasks.workunit.client.1.smithi114.stdout:5/100: mknod d3/df/c23 0 2024-09-16T09:45:27.573 INFO:tasks.workunit.client.1.smithi114.stdout:8/110: rename d4/db/df/c18 to d4/db/df/c24 0 2024-09-16T09:45:27.574 INFO:tasks.workunit.client.1.smithi114.stdout:8/111: truncate d4/db/df/f1a 671530 0 2024-09-16T09:45:27.575 INFO:tasks.workunit.client.1.smithi114.stdout:9/61: creat d3/da/f11 x:0 0 0 2024-09-16T09:45:27.576 INFO:tasks.workunit.client.1.smithi114.stdout:8/112: dread d4/fa [0,4194304] 0 2024-09-16T09:45:27.580 INFO:tasks.workunit.client.1.smithi114.stdout:7/87: dread d2/d9/fc [0,4194304] 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/145: unlink dc/de/c15 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/146: chown dc/c1b 202 1 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:9/62: symlink d3/l12 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:2/120: symlink d1/d8/d10/d16/l2d 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:8/113: rmdir d4 39 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:8/114: truncate d4/db/dd/f20 260773 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:2/121: write d1/d8/f29 [377079,48348] 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:2/122: write d1/d8/f29 [525285,36297] 0 2024-09-16T09:45:27.583 INFO:tasks.workunit.client.1.smithi114.stdout:5/101: dread d3/df/f19 [0,4194304] 0 2024-09-16T09:45:27.584 INFO:tasks.workunit.client.1.smithi114.stdout:3/147: creat dc/de/d1f/f29 x:0 0 0 2024-09-16T09:45:27.584 INFO:tasks.workunit.client.1.smithi114.stdout:9/63: mkdir d3/d13 0 2024-09-16T09:45:27.584 INFO:tasks.workunit.client.1.smithi114.stdout:9/64: fdatasync d3/da/f11 0 2024-09-16T09:45:27.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/88: dread d2/df/f10 [4194304,4194304] 0 2024-09-16T09:45:27.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/89: read d2/f5 [1546580,48367] 0 2024-09-16T09:45:27.586 INFO:tasks.workunit.client.1.smithi114.stdout:8/115: symlink d4/db/dd/d1b/l25 0 2024-09-16T09:45:27.586 INFO:tasks.workunit.client.1.smithi114.stdout:8/116: write d4/db/f17 [148500,82851] 0 2024-09-16T09:45:27.586 INFO:tasks.workunit.client.1.smithi114.stdout:2/123: creat d1/d8/f2e x:0 0 0 2024-09-16T09:45:27.589 INFO:tasks.workunit.client.1.smithi114.stdout:9/65: rename d3/c4 to d3/d13/c14 0 2024-09-16T09:45:27.591 INFO:tasks.workunit.client.1.smithi114.stdout:7/90: creat d2/f1a x:0 0 0 2024-09-16T09:45:27.592 INFO:tasks.workunit.client.1.smithi114.stdout:8/117: symlink d4/db/dd/d1b/l26 0 2024-09-16T09:45:27.593 INFO:tasks.workunit.client.1.smithi114.stdout:2/124: rmdir d1/d8 39 2024-09-16T09:45:27.595 INFO:tasks.workunit.client.1.smithi114.stdout:9/66: creat d3/f15 x:0 0 0 2024-09-16T09:45:27.595 INFO:tasks.workunit.client.1.smithi114.stdout:9/67: chown d3/da 3970273 1 2024-09-16T09:45:27.596 INFO:tasks.workunit.client.1.smithi114.stdout:7/91: unlink d2/f1a 0 2024-09-16T09:45:27.597 INFO:tasks.workunit.client.1.smithi114.stdout:8/118: dread d4/f15 [0,4194304] 0 2024-09-16T09:45:27.597 INFO:tasks.workunit.client.1.smithi114.stdout:8/119: write d4/db/dd/f16 [1384253,98164] 0 2024-09-16T09:45:27.598 INFO:tasks.workunit.client.1.smithi114.stdout:2/125: unlink d1/d8/d10/d16/f20 0 2024-09-16T09:45:27.600 INFO:tasks.workunit.client.1.smithi114.stdout:9/68: creat d3/d13/f16 x:0 0 0 2024-09-16T09:45:27.601 INFO:tasks.workunit.client.1.smithi114.stdout:8/120: link d4/c9 d4/d1f/c27 0 2024-09-16T09:45:27.603 INFO:tasks.workunit.client.1.smithi114.stdout:2/126: creat d1/d8/d26/f2f x:0 0 0 2024-09-16T09:45:27.603 INFO:tasks.workunit.client.1.smithi114.stdout:2/127: read - d1/d8/d10/d16/f27 zero size 2024-09-16T09:45:27.603 INFO:tasks.workunit.client.1.smithi114.stdout:2/128: dread - d1/d8/d10/f25 zero size 2024-09-16T09:45:27.603 INFO:tasks.workunit.client.1.smithi114.stdout:2/129: dread - d1/d8/d10/d16/f27 zero size 2024-09-16T09:45:27.604 INFO:tasks.workunit.client.1.smithi114.stdout:9/69: creat d3/da/f17 x:0 0 0 2024-09-16T09:45:27.604 INFO:tasks.workunit.client.1.smithi114.stdout:9/70: write d3/da/fb [251507,62248] 0 2024-09-16T09:45:27.606 INFO:tasks.workunit.client.1.smithi114.stdout:9/71: rename d3/f15 to d3/d13/f18 0 2024-09-16T09:45:27.606 INFO:tasks.workunit.client.1.smithi114.stdout:9/72: readlink d3/l12 0 2024-09-16T09:45:27.606 INFO:tasks.workunit.client.1.smithi114.stdout:9/73: dread - d3/d13/f18 zero size 2024-09-16T09:45:27.609 INFO:tasks.workunit.client.1.smithi114.stdout:9/74: mknod d3/c19 0 2024-09-16T09:45:27.609 INFO:tasks.workunit.client.1.smithi114.stdout:9/75: read - d3/d13/f18 zero size 2024-09-16T09:45:27.613 INFO:tasks.workunit.client.1.smithi114.stdout:0/43: sync 2024-09-16T09:45:27.613 INFO:tasks.workunit.client.1.smithi114.stdout:6/54: sync 2024-09-16T09:45:27.613 INFO:tasks.workunit.client.1.smithi114.stdout:4/47: sync 2024-09-16T09:45:27.613 INFO:tasks.workunit.client.1.smithi114.stdout:0/44: write f9 [237086,42397] 0 2024-09-16T09:45:27.614 INFO:tasks.workunit.client.1.smithi114.stdout:5/102: dwrite d3/df/f10 [0,4194304] 0 2024-09-16T09:45:27.614 INFO:tasks.workunit.client.1.smithi114.stdout:6/55: rmdir d6 39 2024-09-16T09:45:27.614 INFO:tasks.workunit.client.1.smithi114.stdout:6/56: fdatasync d6/fc 0 2024-09-16T09:45:27.615 INFO:tasks.workunit.client.1.smithi114.stdout:4/48: rmdir d0/d9 39 2024-09-16T09:45:27.615 INFO:tasks.workunit.client.1.smithi114.stdout:4/49: fdatasync d0/d9/fd 0 2024-09-16T09:45:27.615 INFO:tasks.workunit.client.1.smithi114.stdout:4/50: chown d0/c5 563873 1 2024-09-16T09:45:27.617 INFO:tasks.workunit.client.1.smithi114.stdout:5/103: mkdir d3/d24 0 2024-09-16T09:45:27.617 INFO:tasks.workunit.client.1.smithi114.stdout:5/104: truncate d3/fd 5064283 0 2024-09-16T09:45:27.618 INFO:tasks.workunit.client.1.smithi114.stdout:6/57: creat d6/da/d10/f13 x:0 0 0 2024-09-16T09:45:27.618 INFO:tasks.workunit.client.1.smithi114.stdout:0/45: dread f2 [0,4194304] 0 2024-09-16T09:45:27.620 INFO:tasks.workunit.client.1.smithi114.stdout:4/51: rename d0/f2 to d0/ff 0 2024-09-16T09:45:27.621 INFO:tasks.workunit.client.1.smithi114.stdout:5/105: creat d3/f25 x:0 0 0 2024-09-16T09:45:27.621 INFO:tasks.workunit.client.1.smithi114.stdout:0/46: fsync fa 0 2024-09-16T09:45:27.621 INFO:tasks.workunit.client.1.smithi114.stdout:0/47: rmdir - no directory 2024-09-16T09:45:27.622 INFO:tasks.workunit.client.1.smithi114.stdout:4/52: symlink d0/l10 0 2024-09-16T09:45:27.623 INFO:tasks.workunit.client.1.smithi114.stdout:0/48: read f5 [120626,18045] 0 2024-09-16T09:45:27.626 INFO:tasks.workunit.client.1.smithi114.stdout:5/106: read d3/f8 [534631,44295] 0 2024-09-16T09:45:27.628 INFO:tasks.workunit.client.1.smithi114.stdout:0/49: dread f6 [0,4194304] 0 2024-09-16T09:45:27.628 INFO:tasks.workunit.client.1.smithi114.stdout:5/107: link d3/f20 d3/d11/f26 0 2024-09-16T09:45:27.631 INFO:tasks.workunit.client.1.smithi114.stdout:3/148: dwrite dc/de/d10/f1e [0,4194304] 0 2024-09-16T09:45:27.631 INFO:tasks.workunit.client.1.smithi114.stdout:3/149: read - dc/de/d1f/f29 zero size 2024-09-16T09:45:27.631 INFO:tasks.workunit.client.1.smithi114.stdout:7/92: dwrite d2/df/d11/f18 [0,4194304] 0 2024-09-16T09:45:27.631 INFO:tasks.workunit.client.1.smithi114.stdout:7/93: fdatasync d2/f5 0 2024-09-16T09:45:27.632 INFO:tasks.workunit.client.1.smithi114.stdout:5/108: dread d3/f5 [4194304,4194304] 0 2024-09-16T09:45:27.632 INFO:tasks.workunit.client.1.smithi114.stdout:2/130: dwrite d1/d8/d10/d16/f27 [0,4194304] 0 2024-09-16T09:45:27.632 INFO:tasks.workunit.client.1.smithi114.stdout:2/131: stat d1/d8/d10/d16/d1d/f1e 0 2024-09-16T09:45:27.632 INFO:tasks.workunit.client.1.smithi114.stdout:9/76: dwrite d3/da/f11 [0,4194304] 0 2024-09-16T09:45:27.632 INFO:tasks.workunit.client.1.smithi114.stdout:3/150: creat dc/de/d18/f2a x:0 0 0 2024-09-16T09:45:27.633 INFO:tasks.workunit.client.1.smithi114.stdout:7/94: symlink d2/l1b 0 2024-09-16T09:45:27.635 INFO:tasks.workunit.client.1.smithi114.stdout:3/151: write dc/de/d10/f13 [539826,74110] 0 2024-09-16T09:45:27.636 INFO:tasks.workunit.client.1.smithi114.stdout:2/132: rename d1/d8/f29 to d1/d8/d10/d16/f30 0 2024-09-16T09:45:27.639 INFO:tasks.workunit.client.1.smithi114.stdout:9/77: symlink d3/l1a 0 2024-09-16T09:45:27.642 INFO:tasks.workunit.client.1.smithi114.stdout:3/152: rename dc/de/d10/f13 to dc/de/d10/d26/f2b 0 2024-09-16T09:45:27.642 INFO:tasks.workunit.client.1.smithi114.stdout:3/153: chown dc/de 1996741281 1 2024-09-16T09:45:27.643 INFO:tasks.workunit.client.1.smithi114.stdout:9/78: creat d3/da/d10/f1b x:0 0 0 2024-09-16T09:45:27.645 INFO:tasks.workunit.client.1.smithi114.stdout:9/79: dread d3/da/fd [0,4194304] 0 2024-09-16T09:45:27.645 INFO:tasks.workunit.client.1.smithi114.stdout:8/121: truncate d4/db/f17 620998 0 2024-09-16T09:45:27.645 INFO:tasks.workunit.client.1.smithi114.stdout:8/122: write d4/db/f22 [664514,70349] 0 2024-09-16T09:45:27.646 INFO:tasks.workunit.client.1.smithi114.stdout:9/80: link d3/l12 d3/da/d10/l1c 0 2024-09-16T09:45:27.647 INFO:tasks.workunit.client.1.smithi114.stdout:8/123: mkdir d4/db/dd/d1b/d28 0 2024-09-16T09:45:27.648 INFO:tasks.workunit.client.1.smithi114.stdout:9/81: truncate d3/fc 956627 0 2024-09-16T09:45:27.648 INFO:tasks.workunit.client.1.smithi114.stdout:9/82: fsync d3/f6 0 2024-09-16T09:45:27.652 INFO:tasks.workunit.client.1.smithi114.stdout:7/95: dread d2/d9/fc [0,4194304] 0 2024-09-16T09:45:27.653 INFO:tasks.workunit.client.1.smithi114.stdout:6/58: dwrite f5 [4194304,4194304] 0 2024-09-16T09:45:27.653 INFO:tasks.workunit.client.1.smithi114.stdout:6/59: stat d6/f7 0 2024-09-16T09:45:27.653 INFO:tasks.workunit.client.1.smithi114.stdout:7/96: creat d2/f1c x:0 0 0 2024-09-16T09:45:27.654 INFO:tasks.workunit.client.1.smithi114.stdout:6/60: link f5 d6/da/f14 0 2024-09-16T09:45:27.655 INFO:tasks.workunit.client.1.smithi114.stdout:6/61: write d6/da/d10/f13 [560484,56335] 0 2024-09-16T09:45:27.655 INFO:tasks.workunit.client.1.smithi114.stdout:6/62: write f5 [10158255,58906] 0 2024-09-16T09:45:27.655 INFO:tasks.workunit.client.1.smithi114.stdout:7/97: symlink d2/d8/l1d 0 2024-09-16T09:45:27.660 INFO:tasks.workunit.client.1.smithi114.stdout:4/53: getdents d0 0 2024-09-16T09:45:27.662 INFO:tasks.workunit.client.1.smithi114.stdout:5/109: write d3/f5 [2866532,120703] 0 2024-09-16T09:45:27.662 INFO:tasks.workunit.client.1.smithi114.stdout:4/54: truncate d0/d9/fa 402896 0 2024-09-16T09:45:27.662 INFO:tasks.workunit.client.1.smithi114.stdout:4/55: fsync d0/f7 0 2024-09-16T09:45:27.662 INFO:tasks.workunit.client.1.smithi114.stdout:4/56: stat d0/f7 0 2024-09-16T09:45:27.662 INFO:tasks.workunit.client.1.smithi114.stdout:7/98: dread d2/f5 [0,4194304] 0 2024-09-16T09:45:27.664 INFO:tasks.workunit.client.1.smithi114.stdout:7/99: rmdir d2/df/d11 39 2024-09-16T09:45:27.664 INFO:tasks.workunit.client.1.smithi114.stdout:2/133: read d1/d8/d10/f22 [3341290,46628] 0 2024-09-16T09:45:27.665 INFO:tasks.workunit.client.1.smithi114.stdout:7/100: creat d2/df/d11/f1e x:0 0 0 2024-09-16T09:45:27.666 INFO:tasks.workunit.client.1.smithi114.stdout:7/101: creat d2/df/d11/f1f x:0 0 0 2024-09-16T09:45:27.666 INFO:tasks.workunit.client.1.smithi114.stdout:7/102: readlink d2/l1b 0 2024-09-16T09:45:27.666 INFO:tasks.workunit.client.1.smithi114.stdout:9/83: dwrite d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:27.667 INFO:tasks.workunit.client.1.smithi114.stdout:7/103: rmdir d2/df/d11 39 2024-09-16T09:45:27.667 INFO:tasks.workunit.client.1.smithi114.stdout:7/104: dread - d2/f1c zero size 2024-09-16T09:45:27.672 INFO:tasks.workunit.client.1.smithi114.stdout:3/154: getdents dc/de/d10 0 2024-09-16T09:45:27.674 INFO:tasks.workunit.client.1.smithi114.stdout:5/110: dread d3/d11/f1e [0,4194304] 0 2024-09-16T09:45:27.674 INFO:tasks.workunit.client.1.smithi114.stdout:5/111: chown d3/f4 932 1 2024-09-16T09:45:27.674 INFO:tasks.workunit.client.1.smithi114.stdout:5/112: chown d3/le 1 1 2024-09-16T09:45:27.675 INFO:tasks.workunit.client.1.smithi114.stdout:3/155: dread dc/de/d1f/f23 [0,4194304] 0 2024-09-16T09:45:27.676 INFO:tasks.workunit.client.1.smithi114.stdout:5/113: creat d3/d1f/f27 x:0 0 0 2024-09-16T09:45:27.676 INFO:tasks.workunit.client.1.smithi114.stdout:5/114: read d3/f8 [679864,13436] 0 2024-09-16T09:45:27.676 INFO:tasks.workunit.client.1.smithi114.stdout:5/115: write d3/d1f/f1c [4922266,82388] 0 2024-09-16T09:45:27.676 INFO:tasks.workunit.client.1.smithi114.stdout:5/116: read f0 [92787,92572] 0 2024-09-16T09:45:27.676 INFO:tasks.workunit.client.1.smithi114.stdout:8/124: dwrite d4/db/f22 [0,4194304] 0 2024-09-16T09:45:27.677 INFO:tasks.workunit.client.1.smithi114.stdout:3/156: creat dc/de/d18/f2c x:0 0 0 2024-09-16T09:45:27.677 INFO:tasks.workunit.client.1.smithi114.stdout:3/157: chown dc/de 1 1 2024-09-16T09:45:27.679 INFO:tasks.workunit.client.1.smithi114.stdout:3/158: mkdir dc/de/d17/d2d 0 2024-09-16T09:45:27.680 INFO:tasks.workunit.client.1.smithi114.stdout:6/63: fsync f5 0 2024-09-16T09:45:27.681 INFO:tasks.workunit.client.1.smithi114.stdout:6/64: creat d6/da/f15 x:0 0 0 2024-09-16T09:45:27.682 INFO:tasks.workunit.client.1.smithi114.stdout:6/65: rmdir d6 39 2024-09-16T09:45:27.683 INFO:tasks.workunit.client.1.smithi114.stdout:6/66: creat d6/da/d10/f16 x:0 0 0 2024-09-16T09:45:27.687 INFO:tasks.workunit.client.1.smithi114.stdout:7/105: dwrite d2/d8/f15 [0,4194304] 0 2024-09-16T09:45:27.689 INFO:tasks.workunit.client.1.smithi114.stdout:6/67: dread d6/da/f14 [8388608,4194304] 0 2024-09-16T09:45:27.690 INFO:tasks.workunit.client.1.smithi114.stdout:4/57: rename d0/d9/fa to d0/f11 0 2024-09-16T09:45:27.690 INFO:tasks.workunit.client.1.smithi114.stdout:4/58: chown d0/l10 38580 1 2024-09-16T09:45:27.692 INFO:tasks.workunit.client.1.smithi114.stdout:2/134: rename d1/d8/d10/d16/l2d to d1/d8/l31 0 2024-09-16T09:45:27.693 INFO:tasks.workunit.client.1.smithi114.stdout:4/59: rename d0/cb to d0/c12 0 2024-09-16T09:45:27.693 INFO:tasks.workunit.client.1.smithi114.stdout:4/60: dread - d0/fc zero size 2024-09-16T09:45:27.693 INFO:tasks.workunit.client.1.smithi114.stdout:4/61: chown d0/f11 7304 1 2024-09-16T09:45:27.695 INFO:tasks.workunit.client.1.smithi114.stdout:2/135: unlink d1/d8/ld 0 2024-09-16T09:45:27.695 INFO:tasks.workunit.client.1.smithi114.stdout:2/136: write d1/d8/d26/f2f [443035,65334] 0 2024-09-16T09:45:27.697 INFO:tasks.workunit.client.1.smithi114.stdout:2/137: creat d1/d8/f32 x:0 0 0 2024-09-16T09:45:27.698 INFO:tasks.workunit.client.1.smithi114.stdout:2/138: mkdir d1/d8/d26/d33 0 2024-09-16T09:45:27.699 INFO:tasks.workunit.client.1.smithi114.stdout:5/117: fsync d3/d1f/f27 0 2024-09-16T09:45:27.699 INFO:tasks.workunit.client.1.smithi114.stdout:5/118: read d3/f4 [68202,111381] 0 2024-09-16T09:45:27.701 INFO:tasks.workunit.client.1.smithi114.stdout:5/119: creat d3/d24/f28 x:0 0 0 2024-09-16T09:45:27.703 INFO:tasks.workunit.client.1.smithi114.stdout:6/68: dread f5 [4194304,4194304] 0 2024-09-16T09:45:27.713 INFO:tasks.workunit.client.1.smithi114.stdout:5/120: dread d3/df/f10 [0,4194304] 0 2024-09-16T09:45:27.713 INFO:tasks.workunit.client.1.smithi114.stdout:5/121: dread - d3/d1f/f16 zero size 2024-09-16T09:45:27.715 INFO:tasks.workunit.client.1.smithi114.stdout:5/122: mkdir d3/d11/d29 0 2024-09-16T09:45:27.715 INFO:tasks.workunit.client.1.smithi114.stdout:6/69: dread d6/fc [0,4194304] 0 2024-09-16T09:45:27.715 INFO:tasks.workunit.client.1.smithi114.stdout:6/70: read d6/f7 [3795,10480] 0 2024-09-16T09:45:27.718 INFO:tasks.workunit.client.1.smithi114.stdout:8/125: dwrite d4/db/dd/f16 [0,4194304] 0 2024-09-16T09:45:27.718 INFO:tasks.workunit.client.1.smithi114.stdout:9/84: dwrite d3/fc [0,4194304] 0 2024-09-16T09:45:27.719 INFO:tasks.workunit.client.1.smithi114.stdout:7/106: dwrite d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:27.720 INFO:tasks.workunit.client.1.smithi114.stdout:5/123: dread d3/d11/f1e [0,4194304] 0 2024-09-16T09:45:27.720 INFO:tasks.workunit.client.1.smithi114.stdout:8/126: dread d4/db/dd/f20 [0,4194304] 0 2024-09-16T09:45:27.721 INFO:tasks.workunit.client.1.smithi114.stdout:8/127: chown d4/db/df/l11 8135 1 2024-09-16T09:45:27.722 INFO:tasks.workunit.client.1.smithi114.stdout:9/85: truncate d3/da/fb 298250 0 2024-09-16T09:45:27.725 INFO:tasks.workunit.client.1.smithi114.stdout:8/128: dread d4/db/f17 [0,4194304] 0 2024-09-16T09:45:27.725 INFO:tasks.workunit.client.1.smithi114.stdout:8/129: write d4/db/df/f12 [1767551,34988] 0 2024-09-16T09:45:27.726 INFO:tasks.workunit.client.1.smithi114.stdout:3/159: dwrite dc/de/d10/d26/f2b [0,4194304] 0 2024-09-16T09:45:27.727 INFO:tasks.workunit.client.1.smithi114.stdout:7/107: symlink d2/df/l20 0 2024-09-16T09:45:27.728 INFO:tasks.workunit.client.1.smithi114.stdout:9/86: getdents d3/d13 0 2024-09-16T09:45:27.729 INFO:tasks.workunit.client.1.smithi114.stdout:3/160: mknod dc/de/c2e 0 2024-09-16T09:45:27.731 INFO:tasks.workunit.client.1.smithi114.stdout:7/108: creat d2/f21 x:0 0 0 2024-09-16T09:45:27.731 INFO:tasks.workunit.client.1.smithi114.stdout:7/109: chown d2/d8/cd 1086 1 2024-09-16T09:45:27.731 INFO:tasks.workunit.client.1.smithi114.stdout:8/130: dread f3 [0,4194304] 0 2024-09-16T09:45:27.732 INFO:tasks.workunit.client.1.smithi114.stdout:4/62: dwrite d0/fc [0,4194304] 0 2024-09-16T09:45:27.732 INFO:tasks.workunit.client.1.smithi114.stdout:9/87: mknod d3/da/d10/c1d 0 2024-09-16T09:45:27.732 INFO:tasks.workunit.client.1.smithi114.stdout:9/88: chown d3/da/f17 9265 1 2024-09-16T09:45:27.734 INFO:tasks.workunit.client.1.smithi114.stdout:3/161: creat dc/de/f2f x:0 0 0 2024-09-16T09:45:27.734 INFO:tasks.workunit.client.1.smithi114.stdout:3/162: fdatasync dc/de/d17/f1a 0 2024-09-16T09:45:27.735 INFO:tasks.workunit.client.1.smithi114.stdout:6/71: dwrite d6/da/f14 [4194304,4194304] 0 2024-09-16T09:45:27.735 INFO:tasks.workunit.client.1.smithi114.stdout:7/110: mkdir d2/d8/d22 0 2024-09-16T09:45:27.735 INFO:tasks.workunit.client.1.smithi114.stdout:7/111: dread - d2/df/d11/f1e zero size 2024-09-16T09:45:27.737 INFO:tasks.workunit.client.1.smithi114.stdout:6/72: dread d6/f7 [0,4194304] 0 2024-09-16T09:45:27.738 INFO:tasks.workunit.client.1.smithi114.stdout:6/73: write d6/f7 [220457,48680] 0 2024-09-16T09:45:27.738 INFO:tasks.workunit.client.1.smithi114.stdout:5/124: getdents d3/d11 0 2024-09-16T09:45:27.739 INFO:tasks.workunit.client.1.smithi114.stdout:9/89: truncate d3/da/d10/f1b 602918 0 2024-09-16T09:45:27.743 INFO:tasks.workunit.client.1.smithi114.stdout:3/163: creat dc/de/d18/f30 x:0 0 0 2024-09-16T09:45:27.743 INFO:tasks.workunit.client.1.smithi114.stdout:3/164: write dc/de/d10/f19 [917995,11497] 0 2024-09-16T09:45:27.744 INFO:tasks.workunit.client.1.smithi114.stdout:7/112: rmdir d2/d9 39 2024-09-16T09:45:27.744 INFO:tasks.workunit.client.1.smithi114.stdout:6/74: stat d6/l11 0 2024-09-16T09:45:27.746 INFO:tasks.workunit.client.1.smithi114.stdout:5/125: rmdir d3/d11/d29 0 2024-09-16T09:45:27.748 INFO:tasks.workunit.client.1.smithi114.stdout:9/90: mkdir d3/d13/d1e 0 2024-09-16T09:45:27.748 INFO:tasks.workunit.client.1.smithi114.stdout:9/91: chown d3/da/d10 82215735 1 2024-09-16T09:45:27.748 INFO:tasks.workunit.client.1.smithi114.stdout:9/92: dread - d3/d13/f16 zero size 2024-09-16T09:45:27.748 INFO:tasks.workunit.client.1.smithi114.stdout:9/93: truncate d3/da/f17 618368 0 2024-09-16T09:45:27.750 INFO:tasks.workunit.client.1.smithi114.stdout:7/113: creat d2/d9/f23 x:0 0 0 2024-09-16T09:45:27.751 INFO:tasks.workunit.client.1.smithi114.stdout:8/131: dwrite d4/db/dd/f20 [0,4194304] 0 2024-09-16T09:45:27.752 INFO:tasks.workunit.client.1.smithi114.stdout:9/94: stat d3/d13/c14 0 2024-09-16T09:45:27.753 INFO:tasks.workunit.client.1.smithi114.stdout:7/114: rename d2/c4 to d2/d8/d22/c24 0 2024-09-16T09:45:27.754 INFO:tasks.workunit.client.1.smithi114.stdout:1/87: sync 2024-09-16T09:45:27.755 INFO:tasks.workunit.client.1.smithi114.stdout:5/126: write d3/d11/f1e [241011,31084] 0 2024-09-16T09:45:27.756 INFO:tasks.workunit.client.1.smithi114.stdout:5/127: chown d3/d1f 20900635 1 2024-09-16T09:45:27.756 INFO:tasks.workunit.client.1.smithi114.stdout:5/128: write f0 [154683,97678] 0 2024-09-16T09:45:27.756 INFO:tasks.workunit.client.1.smithi114.stdout:8/132: unlink d4/db/df/l11 0 2024-09-16T09:45:27.757 INFO:tasks.workunit.client.1.smithi114.stdout:9/95: mknod d3/da/c1f 0 2024-09-16T09:45:27.759 INFO:tasks.workunit.client.1.smithi114.stdout:4/63: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:45:27.759 INFO:tasks.workunit.client.1.smithi114.stdout:7/115: symlink d2/l25 0 2024-09-16T09:45:27.761 INFO:tasks.workunit.client.1.smithi114.stdout:1/88: mknod d4/c17 0 2024-09-16T09:45:27.763 INFO:tasks.workunit.client.1.smithi114.stdout:1/89: read d4/d8/f14 [36989,87998] 0 2024-09-16T09:45:27.765 INFO:tasks.workunit.client.1.smithi114.stdout:9/96: creat d3/da/d10/f20 x:0 0 0 2024-09-16T09:45:27.767 INFO:tasks.workunit.client.1.smithi114.stdout:7/116: rmdir d2 39 2024-09-16T09:45:27.770 INFO:tasks.workunit.client.1.smithi114.stdout:6/75: dwrite d6/da/d10/f16 [0,4194304] 0 2024-09-16T09:45:27.772 INFO:tasks.workunit.client.1.smithi114.stdout:6/76: rmdir d6/da/d10/df 0 2024-09-16T09:45:27.781 INFO:tasks.workunit.client.1.smithi114.stdout:9/97: write d3/fc [4116630,94275] 0 2024-09-16T09:45:27.784 INFO:tasks.workunit.client.1.smithi114.stdout:3/165: dwrite dc/de/d18/f2c [0,4194304] 0 2024-09-16T09:45:27.784 INFO:tasks.workunit.client.1.smithi114.stdout:3/166: chown dc/de/d10/f25 830 1 2024-09-16T09:45:27.787 INFO:tasks.workunit.client.1.smithi114.stdout:3/167: creat dc/de/d17/d2d/f31 x:0 0 0 2024-09-16T09:45:27.790 INFO:tasks.workunit.client.1.smithi114.stdout:3/168: symlink dc/de/d17/d2d/l32 0 2024-09-16T09:45:27.791 INFO:tasks.workunit.client.1.smithi114.stdout:3/169: rename dc/de/d10/c11 to dc/c33 0 2024-09-16T09:45:27.791 INFO:tasks.workunit.client.1.smithi114.stdout:3/170: creat dc/de/f34 x:0 0 0 2024-09-16T09:45:27.792 INFO:tasks.workunit.client.1.smithi114.stdout:3/171: chown dc/de/d17 0 1 2024-09-16T09:45:27.792 INFO:tasks.workunit.client.1.smithi114.stdout:3/172: creat dc/de/d18/f35 x:0 0 0 2024-09-16T09:45:27.792 INFO:tasks.workunit.client.1.smithi114.stdout:3/173: read - dc/de/d18/f30 zero size 2024-09-16T09:45:27.793 INFO:tasks.workunit.client.1.smithi114.stdout:3/174: stat dc/f27 0 2024-09-16T09:45:27.800 INFO:tasks.workunit.client.1.smithi114.stdout:8/133: dwrite d4/db/dd/f16 [0,4194304] 0 2024-09-16T09:45:27.800 INFO:tasks.workunit.client.1.smithi114.stdout:1/90: dwrite d4/d8/f14 [0,4194304] 0 2024-09-16T09:45:27.800 INFO:tasks.workunit.client.1.smithi114.stdout:8/134: symlink d4/db/dd/d1b/l29 0 2024-09-16T09:45:27.801 INFO:tasks.workunit.client.1.smithi114.stdout:5/129: dwrite d3/d24/f28 [0,4194304] 0 2024-09-16T09:45:27.801 INFO:tasks.workunit.client.1.smithi114.stdout:5/130: write d3/d1f/f16 [658700,123090] 0 2024-09-16T09:45:27.803 INFO:tasks.workunit.client.1.smithi114.stdout:7/117: dwrite d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:27.804 INFO:tasks.workunit.client.1.smithi114.stdout:6/77: dwrite d6/f7 [0,4194304] 0 2024-09-16T09:45:27.804 INFO:tasks.workunit.client.1.smithi114.stdout:6/78: write d6/da/f15 [977560,106036] 0 2024-09-16T09:45:27.805 INFO:tasks.workunit.client.1.smithi114.stdout:9/98: dwrite d3/f6 [0,4194304] 0 2024-09-16T09:45:27.805 INFO:tasks.workunit.client.1.smithi114.stdout:1/91: mknod d4/c18 0 2024-09-16T09:45:27.805 INFO:tasks.workunit.client.1.smithi114.stdout:8/135: symlink d4/db/l2a 0 2024-09-16T09:45:27.809 INFO:tasks.workunit.client.1.smithi114.stdout:7/118: getdents d2/df/d11 0 2024-09-16T09:45:27.811 INFO:tasks.workunit.client.1.smithi114.stdout:6/79: creat d6/f17 x:0 0 0 2024-09-16T09:45:27.813 INFO:tasks.workunit.client.1.smithi114.stdout:9/99: creat d3/da/d10/f21 x:0 0 0 2024-09-16T09:45:27.814 INFO:tasks.workunit.client.1.smithi114.stdout:1/92: stat d4/ce 0 2024-09-16T09:45:27.815 INFO:tasks.workunit.client.1.smithi114.stdout:8/136: rmdir d4/db/df 39 2024-09-16T09:45:27.815 INFO:tasks.workunit.client.1.smithi114.stdout:8/137: chown d4/c1d 144 1 2024-09-16T09:45:27.815 INFO:tasks.workunit.client.1.smithi114.stdout:8/138: rename d4 to d4/d2b 22 2024-09-16T09:45:27.816 INFO:tasks.workunit.client.1.smithi114.stdout:7/119: rmdir d2/d8 39 2024-09-16T09:45:27.816 INFO:tasks.workunit.client.1.smithi114.stdout:7/120: write d2/d9/f23 [519635,41673] 0 2024-09-16T09:45:27.817 INFO:tasks.workunit.client.1.smithi114.stdout:6/80: mknod d6/da/d10/c18 0 2024-09-16T09:45:27.819 INFO:tasks.workunit.client.1.smithi114.stdout:9/100: symlink d3/d13/l22 0 2024-09-16T09:45:27.820 INFO:tasks.workunit.client.1.smithi114.stdout:1/93: creat d4/d8/d16/f19 x:0 0 0 2024-09-16T09:45:27.822 INFO:tasks.workunit.client.1.smithi114.stdout:5/131: link d3/d11/f26 d3/d11/f2a 0 2024-09-16T09:45:27.823 INFO:tasks.workunit.client.1.smithi114.stdout:5/132: readlink d3/d1f/l1b 0 2024-09-16T09:45:27.823 INFO:tasks.workunit.client.1.smithi114.stdout:7/121: symlink d2/df/l26 0 2024-09-16T09:45:27.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/81: dread d6/da/d10/f16 [0,4194304] 0 2024-09-16T09:45:27.825 INFO:tasks.workunit.client.1.smithi114.stdout:9/101: mkdir d3/da/d10/d23 0 2024-09-16T09:45:27.827 INFO:tasks.workunit.client.1.smithi114.stdout:6/82: write d6/da/f14 [9134827,54442] 0 2024-09-16T09:45:27.828 INFO:tasks.workunit.client.1.smithi114.stdout:1/94: rename d4/d8/l12 to d4/l1a 0 2024-09-16T09:45:27.829 INFO:tasks.workunit.client.1.smithi114.stdout:1/95: dread - d4/d8/d16/f19 zero size 2024-09-16T09:45:27.829 INFO:tasks.workunit.client.1.smithi114.stdout:1/96: chown d4/cf 1033794 1 2024-09-16T09:45:27.829 INFO:tasks.workunit.client.1.smithi114.stdout:9/102: mknod d3/da/d10/c24 0 2024-09-16T09:45:27.830 INFO:tasks.workunit.client.1.smithi114.stdout:9/103: dread d3/da/f17 [0,4194304] 0 2024-09-16T09:45:27.830 INFO:tasks.workunit.client.1.smithi114.stdout:7/122: rename d2/df/d11 to d2/d8/d22/d27 0 2024-09-16T09:45:27.832 INFO:tasks.workunit.client.1.smithi114.stdout:5/133: write d3/fd [765187,18501] 0 2024-09-16T09:45:27.834 INFO:tasks.workunit.client.1.smithi114.stdout:8/139: dwrite d4/db/df/f1a [0,4194304] 0 2024-09-16T09:45:27.837 INFO:tasks.workunit.client.1.smithi114.stdout:7/123: rename d2/d9/l16 to d2/l28 0 2024-09-16T09:45:27.837 INFO:tasks.workunit.client.1.smithi114.stdout:7/124: chown d2/fb 15 1 2024-09-16T09:45:27.837 INFO:tasks.workunit.client.1.smithi114.stdout:7/125: write d2/f5 [429082,72560] 0 2024-09-16T09:45:27.837 INFO:tasks.workunit.client.1.smithi114.stdout:0/50: sync 2024-09-16T09:45:27.841 INFO:tasks.workunit.client.1.smithi114.stdout:8/140: link d4/c1d d4/db/df/c2c 0 2024-09-16T09:45:27.843 INFO:tasks.workunit.client.1.smithi114.stdout:7/126: rename d2/df/l26 to d2/d8/l29 0 2024-09-16T09:45:27.843 INFO:tasks.workunit.client.1.smithi114.stdout:7/127: chown d2/df/f10 63436 1 2024-09-16T09:45:27.843 INFO:tasks.workunit.client.1.smithi114.stdout:7/128: dread - d2/d8/d22/d27/f1e zero size 2024-09-16T09:45:27.846 INFO:tasks.workunit.client.1.smithi114.stdout:8/141: unlink d4/db/f17 0 2024-09-16T09:45:27.847 INFO:tasks.workunit.client.1.smithi114.stdout:7/129: rmdir d2/d8 39 2024-09-16T09:45:27.848 INFO:tasks.workunit.client.1.smithi114.stdout:8/142: dread d4/f15 [0,4194304] 0 2024-09-16T09:45:27.848 INFO:tasks.workunit.client.1.smithi114.stdout:0/51: symlink l10 0 2024-09-16T09:45:27.849 INFO:tasks.workunit.client.1.smithi114.stdout:9/104: getdents d3/d13 0 2024-09-16T09:45:27.849 INFO:tasks.workunit.client.1.smithi114.stdout:7/130: stat d2/l28 0 2024-09-16T09:45:27.851 INFO:tasks.workunit.client.1.smithi114.stdout:9/105: mkdir d3/d13/d1e/d25 0 2024-09-16T09:45:27.852 INFO:tasks.workunit.client.1.smithi114.stdout:7/131: rename d2/f21 to d2/d8/d22/d27/f2a 0 2024-09-16T09:45:27.853 INFO:tasks.workunit.client.1.smithi114.stdout:0/52: mknod c11 0 2024-09-16T09:45:27.853 INFO:tasks.workunit.client.1.smithi114.stdout:0/53: fsync fa 0 2024-09-16T09:45:27.853 INFO:tasks.workunit.client.1.smithi114.stdout:0/54: chown f2 28704 1 2024-09-16T09:45:27.854 INFO:tasks.workunit.client.1.smithi114.stdout:8/143: write d4/db/df/f1c [917664,118201] 0 2024-09-16T09:45:27.854 INFO:tasks.workunit.client.1.smithi114.stdout:9/106: creat d3/da/d10/f26 x:0 0 0 2024-09-16T09:45:27.854 INFO:tasks.workunit.client.1.smithi114.stdout:9/107: write d3/da/f17 [875169,96728] 0 2024-09-16T09:45:27.855 INFO:tasks.workunit.client.1.smithi114.stdout:9/108: dread - d3/d13/f18 zero size 2024-09-16T09:45:27.855 INFO:tasks.workunit.client.1.smithi114.stdout:9/109: truncate d3/fc 4408333 0 2024-09-16T09:45:27.858 INFO:tasks.workunit.client.1.smithi114.stdout:8/144: mknod d4/db/dd/d1b/c2d 0 2024-09-16T09:45:27.859 INFO:tasks.workunit.client.1.smithi114.stdout:0/55: mknod c12 0 2024-09-16T09:45:27.860 INFO:tasks.workunit.client.1.smithi114.stdout:8/145: unlink d4/db/df/f1c 0 2024-09-16T09:45:27.861 INFO:tasks.workunit.client.1.smithi114.stdout:0/56: truncate f3 4114977 0 2024-09-16T09:45:27.862 INFO:tasks.workunit.client.1.smithi114.stdout:8/146: truncate d4/fa 173587 0 2024-09-16T09:45:27.864 INFO:tasks.workunit.client.1.smithi114.stdout:8/147: mknod d4/db/c2e 0 2024-09-16T09:45:27.864 INFO:tasks.workunit.client.1.smithi114.stdout:8/148: truncate d4/db/dd/f16 5094040 0 2024-09-16T09:45:27.864 INFO:tasks.workunit.client.1.smithi114.stdout:6/83: dwrite d6/f7 [0,4194304] 0 2024-09-16T09:45:27.864 INFO:tasks.workunit.client.1.smithi114.stdout:0/57: rename cb to c13 0 2024-09-16T09:45:27.865 INFO:tasks.workunit.client.1.smithi114.stdout:8/149: link d4/db/df/c2c d4/c2f 0 2024-09-16T09:45:27.866 INFO:tasks.workunit.client.1.smithi114.stdout:6/84: link d6/da/d10/f13 d6/da/f19 0 2024-09-16T09:45:27.866 INFO:tasks.workunit.client.1.smithi114.stdout:6/85: chown d6/da/d10/f13 127176 1 2024-09-16T09:45:27.867 INFO:tasks.workunit.client.1.smithi114.stdout:0/58: creat f14 x:0 0 0 2024-09-16T09:45:27.867 INFO:tasks.workunit.client.1.smithi114.stdout:1/97: dwrite d4/d8/f14 [0,4194304] 0 2024-09-16T09:45:27.868 INFO:tasks.workunit.client.1.smithi114.stdout:8/150: mkdir d4/db/dd/d1b/d30 0 2024-09-16T09:45:27.869 INFO:tasks.workunit.client.1.smithi114.stdout:6/86: link d6/cd d6/da/d10/c1a 0 2024-09-16T09:45:27.870 INFO:tasks.workunit.client.1.smithi114.stdout:5/134: dwrite d3/d11/f26 [0,4194304] 0 2024-09-16T09:45:27.870 INFO:tasks.workunit.client.1.smithi114.stdout:0/59: creat f15 x:0 0 0 2024-09-16T09:45:27.872 INFO:tasks.workunit.client.1.smithi114.stdout:1/98: creat d4/d8/d16/f1b x:0 0 0 2024-09-16T09:45:27.873 INFO:tasks.workunit.client.1.smithi114.stdout:6/87: write d6/da/d10/f16 [3253140,85869] 0 2024-09-16T09:45:27.878 INFO:tasks.workunit.client.1.smithi114.stdout:6/88: symlink d6/da/d10/l1b 0 2024-09-16T09:45:27.879 INFO:tasks.workunit.client.1.smithi114.stdout:9/110: dwrite d3/fc [4194304,4194304] 0 2024-09-16T09:45:27.879 INFO:tasks.workunit.client.1.smithi114.stdout:9/111: write d3/da/f17 [1814991,54205] 0 2024-09-16T09:45:27.880 INFO:tasks.workunit.client.1.smithi114.stdout:5/135: symlink d3/d11/l2b 0 2024-09-16T09:45:27.880 INFO:tasks.workunit.client.1.smithi114.stdout:5/136: dread - d3/f18 zero size 2024-09-16T09:45:27.881 INFO:tasks.workunit.client.1.smithi114.stdout:8/151: dread d4/db/df/f1a [0,4194304] 0 2024-09-16T09:45:27.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/89: unlink d6/da/f19 0 2024-09-16T09:45:27.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/90: fdatasync d6/f7 0 2024-09-16T09:45:27.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/91: fdatasync d6/f7 0 2024-09-16T09:45:27.882 INFO:tasks.workunit.client.1.smithi114.stdout:5/137: creat d3/f2c x:0 0 0 2024-09-16T09:45:27.882 INFO:tasks.workunit.client.1.smithi114.stdout:5/138: readlink d3/d11/l2b 0 2024-09-16T09:45:27.883 INFO:tasks.workunit.client.1.smithi114.stdout:7/132: dwrite d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:27.883 INFO:tasks.workunit.client.1.smithi114.stdout:8/152: getdents d4/db/dd 0 2024-09-16T09:45:27.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/92: stat d6/da/d10/c1a 0 2024-09-16T09:45:27.885 INFO:tasks.workunit.client.1.smithi114.stdout:5/139: mkdir d3/df/d2d 0 2024-09-16T09:45:27.890 INFO:tasks.workunit.client.1.smithi114.stdout:7/133: mkdir d2/d9/d2b 0 2024-09-16T09:45:27.891 INFO:tasks.workunit.client.1.smithi114.stdout:9/112: write d3/f6 [1276347,67923] 0 2024-09-16T09:45:27.891 INFO:tasks.workunit.client.1.smithi114.stdout:9/113: stat d3/da/d10/c1d 0 2024-09-16T09:45:27.892 INFO:tasks.workunit.client.1.smithi114.stdout:8/153: getdents d4/d1f 0 2024-09-16T09:45:27.892 INFO:tasks.workunit.client.1.smithi114.stdout:6/93: symlink d6/l1c 0 2024-09-16T09:45:27.893 INFO:tasks.workunit.client.1.smithi114.stdout:5/140: creat d3/d24/f2e x:0 0 0 2024-09-16T09:45:27.896 INFO:tasks.workunit.client.1.smithi114.stdout:9/114: creat d3/d13/d1e/d25/f27 x:0 0 0 2024-09-16T09:45:27.898 INFO:tasks.workunit.client.1.smithi114.stdout:0/60: dwrite fa [0,4194304] 0 2024-09-16T09:45:27.899 INFO:tasks.workunit.client.1.smithi114.stdout:1/99: dwrite d4/d8/f10 [4194304,4194304] 0 2024-09-16T09:45:27.899 INFO:tasks.workunit.client.1.smithi114.stdout:1/100: chown d4/l1a 33106 1 2024-09-16T09:45:27.900 INFO:tasks.workunit.client.1.smithi114.stdout:1/101: write d4/f13 [432526,10270] 0 2024-09-16T09:45:27.900 INFO:tasks.workunit.client.1.smithi114.stdout:1/102: stat d4/d8/f14 0 2024-09-16T09:45:27.906 INFO:tasks.workunit.client.1.smithi114.stdout:7/134: read d2/d8/d22/d27/f18 [2757939,123285] 0 2024-09-16T09:45:27.907 INFO:tasks.workunit.client.1.smithi114.stdout:0/61: rename f5 to f16 0 2024-09-16T09:45:27.907 INFO:tasks.workunit.client.1.smithi114.stdout:0/62: truncate f16 340166 0 2024-09-16T09:45:27.909 INFO:tasks.workunit.client.1.smithi114.stdout:7/135: creat d2/f2c x:0 0 0 2024-09-16T09:45:27.909 INFO:tasks.workunit.client.1.smithi114.stdout:7/136: chown d2/d9/f12 2807 1 2024-09-16T09:45:27.911 INFO:tasks.workunit.client.1.smithi114.stdout:7/137: symlink d2/d9/d2b/l2d 0 2024-09-16T09:45:27.911 INFO:tasks.workunit.client.1.smithi114.stdout:7/138: dread - d2/d8/d22/d27/f1f zero size 2024-09-16T09:45:27.912 INFO:tasks.workunit.client.1.smithi114.stdout:7/139: fsync d2/d9/f12 0 2024-09-16T09:45:27.913 INFO:tasks.workunit.client.1.smithi114.stdout:0/63: rename l10 to l17 0 2024-09-16T09:45:27.913 INFO:tasks.workunit.client.1.smithi114.stdout:0/64: fsync f6 0 2024-09-16T09:45:27.918 INFO:tasks.workunit.client.1.smithi114.stdout:7/140: rename d2/d8 to d2/d9/d2b/d2e 0 2024-09-16T09:45:27.918 INFO:tasks.workunit.client.1.smithi114.stdout:7/141: chown d2/d9/d2b/d2e/cd 289 1 2024-09-16T09:45:27.918 INFO:tasks.workunit.client.1.smithi114.stdout:1/103: dread d4/d8/f10 [0,4194304] 0 2024-09-16T09:45:27.919 INFO:tasks.workunit.client.1.smithi114.stdout:7/142: mknod d2/c2f 0 2024-09-16T09:45:27.919 INFO:tasks.workunit.client.1.smithi114.stdout:7/143: truncate d2/d9/d2b/d2e/d22/d27/f1f 212186 0 2024-09-16T09:45:27.919 INFO:tasks.workunit.client.1.smithi114.stdout:1/104: link d4/cd d4/c1c 0 2024-09-16T09:45:27.921 INFO:tasks.workunit.client.1.smithi114.stdout:7/144: unlink d2/d9/d2b/d2e/f15 0 2024-09-16T09:45:27.921 INFO:tasks.workunit.client.1.smithi114.stdout:2/139: sync 2024-09-16T09:45:27.921 INFO:tasks.workunit.client.1.smithi114.stdout:3/175: sync 2024-09-16T09:45:27.921 INFO:tasks.workunit.client.1.smithi114.stdout:4/64: sync 2024-09-16T09:45:27.923 INFO:tasks.workunit.client.1.smithi114.stdout:1/105: link d4/c5 d4/d8/d16/c1d 0 2024-09-16T09:45:27.924 INFO:tasks.workunit.client.1.smithi114.stdout:7/145: link d2/fb d2/df/f30 0 2024-09-16T09:45:27.925 INFO:tasks.workunit.client.1.smithi114.stdout:2/140: chown d1/d8/d10/d16/d1d/f1e 24724 1 2024-09-16T09:45:27.926 INFO:tasks.workunit.client.1.smithi114.stdout:0/65: write f3 [2343674,11503] 0 2024-09-16T09:45:27.926 INFO:tasks.workunit.client.1.smithi114.stdout:8/154: dwrite d4/db/df/f1e [0,4194304] 0 2024-09-16T09:45:27.926 INFO:tasks.workunit.client.1.smithi114.stdout:8/155: write d4/db/dd/f16 [5216773,78692] 0 2024-09-16T09:45:27.926 INFO:tasks.workunit.client.1.smithi114.stdout:3/176: getdents dc/de 0 2024-09-16T09:45:27.926 INFO:tasks.workunit.client.1.smithi114.stdout:3/177: stat dc/c1b 0 2024-09-16T09:45:27.927 INFO:tasks.workunit.client.1.smithi114.stdout:1/106: creat d4/d8/f1e x:0 0 0 2024-09-16T09:45:27.928 INFO:tasks.workunit.client.1.smithi114.stdout:7/146: mknod d2/d9/d2b/d2e/d22/c31 0 2024-09-16T09:45:27.929 INFO:tasks.workunit.client.1.smithi114.stdout:9/115: dwrite d3/d13/f16 [0,4194304] 0 2024-09-16T09:45:27.929 INFO:tasks.workunit.client.1.smithi114.stdout:2/141: unlink d1/d8/c13 0 2024-09-16T09:45:27.930 INFO:tasks.workunit.client.1.smithi114.stdout:2/142: fdatasync d1/d8/d26/f2f 0 2024-09-16T09:45:27.931 INFO:tasks.workunit.client.1.smithi114.stdout:2/143: write d1/d8/d10/d16/f30 [487824,84822] 0 2024-09-16T09:45:27.931 INFO:tasks.workunit.client.1.smithi114.stdout:6/94: dwrite d6/fc [0,4194304] 0 2024-09-16T09:45:27.931 INFO:tasks.workunit.client.1.smithi114.stdout:3/178: write dc/de/d18/f22 [3673209,95242] 0 2024-09-16T09:45:27.931 INFO:tasks.workunit.client.1.smithi114.stdout:3/179: fdatasync dc/de/d10/d26/f2b 0 2024-09-16T09:45:27.931 INFO:tasks.workunit.client.1.smithi114.stdout:5/141: dwrite d3/d11/f1a [0,4194304] 0 2024-09-16T09:45:27.932 INFO:tasks.workunit.client.1.smithi114.stdout:5/142: write d3/f2c [707762,113751] 0 2024-09-16T09:45:27.932 INFO:tasks.workunit.client.1.smithi114.stdout:5/143: chown d3/le 263322 1 2024-09-16T09:45:27.932 INFO:tasks.workunit.client.1.smithi114.stdout:5/144: dread - d3/f18 zero size 2024-09-16T09:45:27.933 INFO:tasks.workunit.client.1.smithi114.stdout:8/156: creat d4/db/dd/d1b/d28/f31 x:0 0 0 2024-09-16T09:45:27.933 INFO:tasks.workunit.client.1.smithi114.stdout:8/157: fsync d4/db/dd/f13 0 2024-09-16T09:45:27.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/107: symlink d4/d8/d16/l1f 0 2024-09-16T09:45:27.935 INFO:tasks.workunit.client.1.smithi114.stdout:7/147: creat d2/df/f32 x:0 0 0 2024-09-16T09:45:27.937 INFO:tasks.workunit.client.1.smithi114.stdout:6/95: creat d6/da/d10/f1d x:0 0 0 2024-09-16T09:45:27.939 INFO:tasks.workunit.client.1.smithi114.stdout:0/66: symlink l18 0 2024-09-16T09:45:27.939 INFO:tasks.workunit.client.1.smithi114.stdout:0/67: fsync f2 0 2024-09-16T09:45:27.940 INFO:tasks.workunit.client.1.smithi114.stdout:8/158: symlink d4/db/l32 0 2024-09-16T09:45:27.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/108: symlink d4/l20 0 2024-09-16T09:45:27.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/109: write d4/d8/f1e [495659,68822] 0 2024-09-16T09:45:27.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/110: write d4/d8/f10 [8867483,17692] 0 2024-09-16T09:45:27.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/111: dread - d4/d8/d16/f19 zero size 2024-09-16T09:45:27.941 INFO:tasks.workunit.client.1.smithi114.stdout:5/145: dread d3/f2c [0,4194304] 0 2024-09-16T09:45:27.942 INFO:tasks.workunit.client.1.smithi114.stdout:6/96: creat d6/da/f1e x:0 0 0 2024-09-16T09:45:27.942 INFO:tasks.workunit.client.1.smithi114.stdout:6/97: chown d6/l11 0 1 2024-09-16T09:45:27.942 INFO:tasks.workunit.client.1.smithi114.stdout:9/116: dread d3/da/f17 [0,4194304] 0 2024-09-16T09:45:27.944 INFO:tasks.workunit.client.1.smithi114.stdout:0/68: creat f19 x:0 0 0 2024-09-16T09:45:27.944 INFO:tasks.workunit.client.1.smithi114.stdout:0/69: chown ce 1 1 2024-09-16T09:45:27.947 INFO:tasks.workunit.client.1.smithi114.stdout:1/112: unlink d4/d8/d16/l1f 0 2024-09-16T09:45:27.949 INFO:tasks.workunit.client.1.smithi114.stdout:5/146: rename d3/d1f/c15 to d3/d24/c2f 0 2024-09-16T09:45:27.949 INFO:tasks.workunit.client.1.smithi114.stdout:5/147: write d3/d1f/f27 [232297,53372] 0 2024-09-16T09:45:27.949 INFO:tasks.workunit.client.1.smithi114.stdout:5/148: truncate d3/d24/f2e 612083 0 2024-09-16T09:45:27.950 INFO:tasks.workunit.client.1.smithi114.stdout:6/98: creat d6/f1f x:0 0 0 2024-09-16T09:45:27.951 INFO:tasks.workunit.client.1.smithi114.stdout:8/159: write d4/db/df/f1e [2405535,8778] 0 2024-09-16T09:45:27.952 INFO:tasks.workunit.client.1.smithi114.stdout:9/117: creat d3/d13/f28 x:0 0 0 2024-09-16T09:45:27.955 INFO:tasks.workunit.client.1.smithi114.stdout:2/144: dwrite d1/d8/d10/f18 [4194304,4194304] 0 2024-09-16T09:45:27.957 INFO:tasks.workunit.client.1.smithi114.stdout:1/113: mkdir d4/d21 0 2024-09-16T09:45:27.957 INFO:tasks.workunit.client.1.smithi114.stdout:7/148: dwrite d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:27.957 INFO:tasks.workunit.client.1.smithi114.stdout:7/149: stat d2/d9/d2b/d2e/d22/d27 0 2024-09-16T09:45:27.958 INFO:tasks.workunit.client.1.smithi114.stdout:5/149: mknod d3/df/d2d/c30 0 2024-09-16T09:45:27.959 INFO:tasks.workunit.client.1.smithi114.stdout:7/150: write d2/fb [320316,104760] 0 2024-09-16T09:45:27.959 INFO:tasks.workunit.client.1.smithi114.stdout:7/151: read - d2/d9/d2b/d2e/d22/d27/f2a zero size 2024-09-16T09:45:27.960 INFO:tasks.workunit.client.1.smithi114.stdout:6/99: rmdir d6/da 39 2024-09-16T09:45:27.961 INFO:tasks.workunit.client.1.smithi114.stdout:7/152: dread d2/d9/d2b/d2e/d22/d27/f1f [0,4194304] 0 2024-09-16T09:45:27.963 INFO:tasks.workunit.client.1.smithi114.stdout:2/145: truncate d1/d8/f12 6738373 0 2024-09-16T09:45:27.964 INFO:tasks.workunit.client.1.smithi114.stdout:0/70: mknod c1a 0 2024-09-16T09:45:27.966 INFO:tasks.workunit.client.1.smithi114.stdout:1/114: unlink d4/l1a 0 2024-09-16T09:45:27.968 INFO:tasks.workunit.client.1.smithi114.stdout:6/100: rename d6/l1c to d6/da/l20 0 2024-09-16T09:45:27.969 INFO:tasks.workunit.client.1.smithi114.stdout:7/153: write d2/d9/fc [3959420,57381] 0 2024-09-16T09:45:27.969 INFO:tasks.workunit.client.1.smithi114.stdout:6/101: mknod d6/da/c21 0 2024-09-16T09:45:27.970 INFO:tasks.workunit.client.1.smithi114.stdout:7/154: stat d2/l1b 0 2024-09-16T09:45:27.970 INFO:tasks.workunit.client.1.smithi114.stdout:0/71: mknod c1b 0 2024-09-16T09:45:27.971 INFO:tasks.workunit.client.1.smithi114.stdout:6/102: truncate d6/da/d10/f16 1426070 0 2024-09-16T09:45:27.972 INFO:tasks.workunit.client.1.smithi114.stdout:7/155: link d2/d9/d2b/d2e/d22/c24 d2/c33 0 2024-09-16T09:45:27.972 INFO:tasks.workunit.client.1.smithi114.stdout:7/156: readlink d2/d9/d2b/d2e/l29 0 2024-09-16T09:45:27.972 INFO:tasks.workunit.client.1.smithi114.stdout:7/157: read - d2/f2c zero size 2024-09-16T09:45:27.972 INFO:tasks.workunit.client.1.smithi114.stdout:7/158: mknod d2/c34 0 2024-09-16T09:45:27.973 INFO:tasks.workunit.client.1.smithi114.stdout:7/159: write d2/df/f32 [212987,12900] 0 2024-09-16T09:45:27.974 INFO:tasks.workunit.client.1.smithi114.stdout:7/160: rename d2/d9/d2b/d2e/d22/c24 to d2/d9/d2b/d2e/d22/d27/c35 0 2024-09-16T09:45:27.976 INFO:tasks.workunit.client.1.smithi114.stdout:6/103: dread d6/da/d10/f13 [0,4194304] 0 2024-09-16T09:45:27.976 INFO:tasks.workunit.client.1.smithi114.stdout:6/104: chown d6/fc 32455 1 2024-09-16T09:45:27.978 INFO:tasks.workunit.client.1.smithi114.stdout:6/105: creat d6/f22 x:0 0 0 2024-09-16T09:45:27.979 INFO:tasks.workunit.client.1.smithi114.stdout:6/106: truncate d6/f7 2967997 0 2024-09-16T09:45:27.980 INFO:tasks.workunit.client.1.smithi114.stdout:6/107: creat d6/f23 x:0 0 0 2024-09-16T09:45:27.981 INFO:tasks.workunit.client.1.smithi114.stdout:0/72: dread fa [0,4194304] 0 2024-09-16T09:45:27.982 INFO:tasks.workunit.client.1.smithi114.stdout:6/108: link d6/cd d6/da/d10/c24 0 2024-09-16T09:45:27.983 INFO:tasks.workunit.client.1.smithi114.stdout:6/109: unlink d6/l11 0 2024-09-16T09:45:27.985 INFO:tasks.workunit.client.1.smithi114.stdout:7/161: dread d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:27.986 INFO:tasks.workunit.client.1.smithi114.stdout:7/162: mkdir d2/d9/d2b/d2e/d36 0 2024-09-16T09:45:27.987 INFO:tasks.workunit.client.1.smithi114.stdout:7/163: rmdir d2/d9 39 2024-09-16T09:45:27.992 INFO:tasks.workunit.client.1.smithi114.stdout:5/150: dwrite d3/df/f1d [0,4194304] 0 2024-09-16T09:45:27.992 INFO:tasks.workunit.client.1.smithi114.stdout:8/160: dwrite d4/fa [0,4194304] 0 2024-09-16T09:45:27.992 INFO:tasks.workunit.client.1.smithi114.stdout:9/118: dwrite d3/da/fd [0,4194304] 0 2024-09-16T09:45:27.993 INFO:tasks.workunit.client.1.smithi114.stdout:9/119: fdatasync d3/f6 0 2024-09-16T09:45:27.993 INFO:tasks.workunit.client.1.smithi114.stdout:2/146: dwrite d1/d8/d10/f18 [0,4194304] 0 2024-09-16T09:45:27.995 INFO:tasks.workunit.client.1.smithi114.stdout:5/151: dread d3/f4 [0,4194304] 0 2024-09-16T09:45:27.997 INFO:tasks.workunit.client.1.smithi114.stdout:8/161: creat d4/db/dd/d1b/d30/f33 x:0 0 0 2024-09-16T09:45:28.000 INFO:tasks.workunit.client.1.smithi114.stdout:9/120: mkdir d3/da/d10/d23/d29 0 2024-09-16T09:45:28.000 INFO:tasks.workunit.client.1.smithi114.stdout:9/121: read - d3/d13/f28 zero size 2024-09-16T09:45:28.002 INFO:tasks.workunit.client.1.smithi114.stdout:5/152: mknod d3/df/c31 0 2024-09-16T09:45:28.002 INFO:tasks.workunit.client.1.smithi114.stdout:5/153: chown d3/d11/l2b 7 1 2024-09-16T09:45:28.002 INFO:tasks.workunit.client.1.smithi114.stdout:8/162: getdents d4/db/dd/d1b 0 2024-09-16T09:45:28.002 INFO:tasks.workunit.client.1.smithi114.stdout:8/163: truncate d4/db/dd/d1b/d28/f31 104981 0 2024-09-16T09:45:28.002 INFO:tasks.workunit.client.1.smithi114.stdout:8/164: write d4/db/dd/d1b/d28/f31 [367893,96096] 0 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:5/154: symlink d3/l32 0 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:5/155: write d3/f25 [234948,39855] 0 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:5/156: readlink d3/df/l17 0 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:5/157: chown d3/cc 1830471671 1 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:5/158: chown d3/d1f/f16 53 1 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:7/164: dread d2/d9/fc [0,4194304] 0 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:7/165: fdatasync d2/f1c 0 2024-09-16T09:45:28.004 INFO:tasks.workunit.client.1.smithi114.stdout:7/166: dread - d2/d9/d2b/d2e/d22/d27/f2a zero size 2024-09-16T09:45:28.005 INFO:tasks.workunit.client.1.smithi114.stdout:7/167: chown d2 50 1 2024-09-16T09:45:28.005 INFO:tasks.workunit.client.1.smithi114.stdout:8/165: symlink d4/db/dd/d1b/l34 0 2024-09-16T09:45:28.005 INFO:tasks.workunit.client.1.smithi114.stdout:5/159: symlink d3/d24/l33 0 2024-09-16T09:45:28.006 INFO:tasks.workunit.client.1.smithi114.stdout:7/168: link d2/d9/d2b/d2e/cd d2/c37 0 2024-09-16T09:45:28.008 INFO:tasks.workunit.client.1.smithi114.stdout:0/73: dwrite f2 [0,4194304] 0 2024-09-16T09:45:28.008 INFO:tasks.workunit.client.1.smithi114.stdout:8/166: creat d4/d1f/f35 x:0 0 0 2024-09-16T09:45:28.008 INFO:tasks.workunit.client.1.smithi114.stdout:1/115: dwrite d4/d8/f10 [4194304,4194304] 0 2024-09-16T09:45:28.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/160: mkdir d3/df/d2d/d34 0 2024-09-16T09:45:28.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/161: chown d3/d11/f26 836 1 2024-09-16T09:45:28.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/162: chown d3/d11 14191922 1 2024-09-16T09:45:28.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/163: chown d3/f5 57164 1 2024-09-16T09:45:28.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/164: stat d3/d11 0 2024-09-16T09:45:28.010 INFO:tasks.workunit.client.1.smithi114.stdout:7/169: mknod d2/d9/d2b/d2e/d36/c38 0 2024-09-16T09:45:28.010 INFO:tasks.workunit.client.1.smithi114.stdout:7/170: dread - d2/f1c zero size 2024-09-16T09:45:28.016 INFO:tasks.workunit.client.1.smithi114.stdout:5/165: rmdir d3 39 2024-09-16T09:45:28.019 INFO:tasks.workunit.client.1.smithi114.stdout:7/171: mknod d2/d9/d2b/d2e/d22/d27/c39 0 2024-09-16T09:45:28.024 INFO:tasks.workunit.client.1.smithi114.stdout:1/116: dwrite d4/d8/d16/f1b [0,4194304] 0 2024-09-16T09:45:28.024 INFO:tasks.workunit.client.1.smithi114.stdout:5/166: creat d3/df/f35 x:0 0 0 2024-09-16T09:45:28.026 INFO:tasks.workunit.client.1.smithi114.stdout:7/172: creat d2/df/f3a x:0 0 0 2024-09-16T09:45:28.026 INFO:tasks.workunit.client.1.smithi114.stdout:7/173: write d2/df/f32 [42450,74841] 0 2024-09-16T09:45:28.030 INFO:tasks.workunit.client.1.smithi114.stdout:1/117: link d4/d8/f10 d4/d8/d16/f22 0 2024-09-16T09:45:28.031 INFO:tasks.workunit.client.1.smithi114.stdout:7/174: link d2/d9/f23 d2/f3b 0 2024-09-16T09:45:28.032 INFO:tasks.workunit.client.1.smithi114.stdout:7/175: stat d2/c33 0 2024-09-16T09:45:28.033 INFO:tasks.workunit.client.1.smithi114.stdout:5/167: write d3/d11/f26 [7726891,61719] 0 2024-09-16T09:45:28.034 INFO:tasks.workunit.client.1.smithi114.stdout:5/168: symlink d3/l36 0 2024-09-16T09:45:28.037 INFO:tasks.workunit.client.1.smithi114.stdout:5/169: mkdir d3/d11/d37 0 2024-09-16T09:45:28.038 INFO:tasks.workunit.client.1.smithi114.stdout:7/176: dread d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:28.038 INFO:tasks.workunit.client.1.smithi114.stdout:5/170: mknod d3/d11/d37/c38 0 2024-09-16T09:45:28.038 INFO:tasks.workunit.client.1.smithi114.stdout:5/171: dread - d3/f18 zero size 2024-09-16T09:45:28.038 INFO:tasks.workunit.client.1.smithi114.stdout:5/172: chown d3/d1f/f16 1718 1 2024-09-16T09:45:28.039 INFO:tasks.workunit.client.1.smithi114.stdout:7/177: symlink d2/d9/d2b/l3c 0 2024-09-16T09:45:28.039 INFO:tasks.workunit.client.1.smithi114.stdout:7/178: write d2/d9/d2b/d2e/d22/d27/f2a [195660,5207] 0 2024-09-16T09:45:28.040 INFO:tasks.workunit.client.1.smithi114.stdout:7/179: symlink d2/df/l3d 0 2024-09-16T09:45:28.043 INFO:tasks.workunit.client.1.smithi114.stdout:7/180: rename d2/d9/d2b/d2e/d36 to d2/d9/d2b/d2e/d3e 0 2024-09-16T09:45:28.043 INFO:tasks.workunit.client.1.smithi114.stdout:7/181: truncate d2/d9/d2b/d2e/d22/d27/f1e 732784 0 2024-09-16T09:45:28.044 INFO:tasks.workunit.client.1.smithi114.stdout:0/74: truncate f2 3699212 0 2024-09-16T09:45:28.045 INFO:tasks.workunit.client.1.smithi114.stdout:6/110: dwrite d6/f7 [0,4194304] 0 2024-09-16T09:45:28.046 INFO:tasks.workunit.client.1.smithi114.stdout:0/75: creat f1c x:0 0 0 2024-09-16T09:45:28.046 INFO:tasks.workunit.client.1.smithi114.stdout:0/76: write f19 [7664,70906] 0 2024-09-16T09:45:28.046 INFO:tasks.workunit.client.1.smithi114.stdout:5/173: dread d3/d11/f1e [0,4194304] 0 2024-09-16T09:45:28.046 INFO:tasks.workunit.client.1.smithi114.stdout:5/174: chown d3/d1f/f27 842514087 1 2024-09-16T09:45:28.047 INFO:tasks.workunit.client.1.smithi114.stdout:5/175: stat d3/d11/f26 0 2024-09-16T09:45:28.047 INFO:tasks.workunit.client.1.smithi114.stdout:5/176: readlink d3/d24/l33 0 2024-09-16T09:45:28.047 INFO:tasks.workunit.client.1.smithi114.stdout:5/177: write d3/d11/f2a [5048112,123876] 0 2024-09-16T09:45:28.047 INFO:tasks.workunit.client.1.smithi114.stdout:1/118: dwrite d4/d8/f14 [4194304,4194304] 0 2024-09-16T09:45:28.048 INFO:tasks.workunit.client.1.smithi114.stdout:5/178: mkdir d3/df/d39 0 2024-09-16T09:45:28.050 INFO:tasks.workunit.client.1.smithi114.stdout:5/179: symlink d3/l3a 0 2024-09-16T09:45:28.051 INFO:tasks.workunit.client.1.smithi114.stdout:0/77: link c4 c1d 0 2024-09-16T09:45:28.051 INFO:tasks.workunit.client.1.smithi114.stdout:0/78: truncate f9 493433 0 2024-09-16T09:45:28.051 INFO:tasks.workunit.client.1.smithi114.stdout:0/79: stat c1b 0 2024-09-16T09:45:28.052 INFO:tasks.workunit.client.1.smithi114.stdout:7/182: dread d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:28.060 INFO:tasks.workunit.client.1.smithi114.stdout:7/183: dread d2/d9/d2b/d2e/d22/d27/f18 [0,4194304] 0 2024-09-16T09:45:28.068 INFO:tasks.workunit.client.1.smithi114.stdout:6/111: dwrite d6/da/d10/f13 [0,4194304] 0 2024-09-16T09:45:28.091 INFO:tasks.workunit.client.1.smithi114.stdout:5/180: dwrite d3/fd [4194304,4194304] 0 2024-09-16T09:45:28.091 INFO:tasks.workunit.client.1.smithi114.stdout:5/181: fsync d3/f2c 0 2024-09-16T09:45:28.091 INFO:tasks.workunit.client.1.smithi114.stdout:1/119: dwrite d4/d8/f9 [4194304,4194304] 0 2024-09-16T09:45:28.091 INFO:tasks.workunit.client.1.smithi114.stdout:6/112: dwrite d6/f23 [0,4194304] 0 2024-09-16T09:45:28.091 INFO:tasks.workunit.client.1.smithi114.stdout:0/80: dwrite f19 [0,4194304] 0 2024-09-16T09:45:28.093 INFO:tasks.workunit.client.1.smithi114.stdout:1/120: creat d4/f23 x:0 0 0 2024-09-16T09:45:28.095 INFO:tasks.workunit.client.1.smithi114.stdout:5/182: write d3/df/f10 [68085,42476] 0 2024-09-16T09:45:28.095 INFO:tasks.workunit.client.1.smithi114.stdout:6/113: creat d6/da/d10/f25 x:0 0 0 2024-09-16T09:45:28.095 INFO:tasks.workunit.client.1.smithi114.stdout:6/114: chown d6/f23 9945028 1 2024-09-16T09:45:28.097 INFO:tasks.workunit.client.1.smithi114.stdout:0/81: creat f1e x:0 0 0 2024-09-16T09:45:28.097 INFO:tasks.workunit.client.1.smithi114.stdout:1/121: symlink d4/d21/l24 0 2024-09-16T09:45:28.098 INFO:tasks.workunit.client.1.smithi114.stdout:5/183: symlink d3/df/d2d/d34/l3b 0 2024-09-16T09:45:28.098 INFO:tasks.workunit.client.1.smithi114.stdout:5/184: truncate f0 541854 0 2024-09-16T09:45:28.099 INFO:tasks.workunit.client.1.smithi114.stdout:4/65: sync 2024-09-16T09:45:28.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/180: sync 2024-09-16T09:45:28.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/181: write dc/de/f34 [560026,32622] 0 2024-09-16T09:45:28.100 INFO:tasks.workunit.client.1.smithi114.stdout:4/66: mkdir d0/d13 0 2024-09-16T09:45:28.101 INFO:tasks.workunit.client.1.smithi114.stdout:3/182: link dc/c1b dc/de/d17/c36 0 2024-09-16T09:45:28.101 INFO:tasks.workunit.client.1.smithi114.stdout:3/183: truncate dc/de/d18/f30 993715 0 2024-09-16T09:45:28.104 INFO:tasks.workunit.client.1.smithi114.stdout:0/82: dread f2 [0,4194304] 0 2024-09-16T09:45:28.104 INFO:tasks.workunit.client.1.smithi114.stdout:0/83: chown c11 287842 1 2024-09-16T09:45:28.108 INFO:tasks.workunit.client.1.smithi114.stdout:0/84: dread f3 [0,4194304] 0 2024-09-16T09:45:28.111 INFO:tasks.workunit.client.1.smithi114.stdout:3/184: dread dc/de/f34 [0,4194304] 0 2024-09-16T09:45:28.111 INFO:tasks.workunit.client.1.smithi114.stdout:4/67: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:28.111 INFO:tasks.workunit.client.1.smithi114.stdout:4/68: stat d0/d13 0 2024-09-16T09:45:28.111 INFO:tasks.workunit.client.1.smithi114.stdout:1/122: read d4/d8/f14 [2268243,42663] 0 2024-09-16T09:45:28.111 INFO:tasks.workunit.client.1.smithi114.stdout:1/123: write d4/d8/f1e [727835,7393] 0 2024-09-16T09:45:28.112 INFO:tasks.workunit.client.1.smithi114.stdout:3/185: mkdir dc/de/d37 0 2024-09-16T09:45:28.112 INFO:tasks.workunit.client.1.smithi114.stdout:3/186: write dc/de/d18/f35 [320726,43803] 0 2024-09-16T09:45:28.113 INFO:tasks.workunit.client.1.smithi114.stdout:4/69: creat d0/d9/f14 x:0 0 0 2024-09-16T09:45:28.114 INFO:tasks.workunit.client.1.smithi114.stdout:1/124: truncate d4/d8/d16/f1b 4193834 0 2024-09-16T09:45:28.114 INFO:tasks.workunit.client.1.smithi114.stdout:1/125: dread - d4/f23 zero size 2024-09-16T09:45:28.114 INFO:tasks.workunit.client.1.smithi114.stdout:3/187: mkdir dc/d38 0 2024-09-16T09:45:28.115 INFO:tasks.workunit.client.1.smithi114.stdout:4/70: symlink d0/d9/l15 0 2024-09-16T09:45:28.115 INFO:tasks.workunit.client.1.smithi114.stdout:4/71: chown d0/f11 7 1 2024-09-16T09:45:28.116 INFO:tasks.workunit.client.1.smithi114.stdout:3/188: symlink dc/d38/l39 0 2024-09-16T09:45:28.116 INFO:tasks.workunit.client.1.smithi114.stdout:4/72: mknod d0/d9/c16 0 2024-09-16T09:45:28.117 INFO:tasks.workunit.client.1.smithi114.stdout:3/189: dread dc/de/d17/f1d [0,4194304] 0 2024-09-16T09:45:28.117 INFO:tasks.workunit.client.1.smithi114.stdout:3/190: chown dc/c33 6320055 1 2024-09-16T09:45:28.118 INFO:tasks.workunit.client.1.smithi114.stdout:6/115: dwrite d6/f22 [0,4194304] 0 2024-09-16T09:45:28.118 INFO:tasks.workunit.client.1.smithi114.stdout:4/73: mkdir d0/d17 0 2024-09-16T09:45:28.122 INFO:tasks.workunit.client.1.smithi114.stdout:5/185: dwrite d3/d1f/f1c [4194304,4194304] 0 2024-09-16T09:45:28.122 INFO:tasks.workunit.client.1.smithi114.stdout:5/186: stat d3/df/d2d/d34 0 2024-09-16T09:45:28.123 INFO:tasks.workunit.client.1.smithi114.stdout:5/187: fdatasync d3/d1f/f16 0 2024-09-16T09:45:28.123 INFO:tasks.workunit.client.1.smithi114.stdout:0/85: dread f19 [0,4194304] 0 2024-09-16T09:45:28.123 INFO:tasks.workunit.client.1.smithi114.stdout:0/86: chown c1a 23198045 1 2024-09-16T09:45:28.123 INFO:tasks.workunit.client.1.smithi114.stdout:0/87: chown f6 4071 1 2024-09-16T09:45:28.124 INFO:tasks.workunit.client.1.smithi114.stdout:6/116: rename c3 to d6/da/c26 0 2024-09-16T09:45:28.126 INFO:tasks.workunit.client.1.smithi114.stdout:6/117: mknod d6/c27 0 2024-09-16T09:45:28.126 INFO:tasks.workunit.client.1.smithi114.stdout:5/188: dread d3/d1f/f27 [0,4194304] 0 2024-09-16T09:45:28.129 INFO:tasks.workunit.client.1.smithi114.stdout:6/118: creat d6/da/f28 x:0 0 0 2024-09-16T09:45:28.129 INFO:tasks.workunit.client.1.smithi114.stdout:6/119: chown d6/f1f 820469300 1 2024-09-16T09:45:28.129 INFO:tasks.workunit.client.1.smithi114.stdout:6/120: truncate d6/f23 4924687 0 2024-09-16T09:45:28.129 INFO:tasks.workunit.client.1.smithi114.stdout:0/88: dread f19 [0,4194304] 0 2024-09-16T09:45:28.129 INFO:tasks.workunit.client.1.smithi114.stdout:0/89: truncate f6 1291183 0 2024-09-16T09:45:28.130 INFO:tasks.workunit.client.1.smithi114.stdout:0/90: chown f6 49013 1 2024-09-16T09:45:28.130 INFO:tasks.workunit.client.1.smithi114.stdout:0/91: truncate f1e 204712 0 2024-09-16T09:45:28.130 INFO:tasks.workunit.client.1.smithi114.stdout:0/92: read - f15 zero size 2024-09-16T09:45:28.130 INFO:tasks.workunit.client.1.smithi114.stdout:0/93: write f3 [3628956,48929] 0 2024-09-16T09:45:28.130 INFO:tasks.workunit.client.1.smithi114.stdout:0/94: truncate f16 947397 0 2024-09-16T09:45:28.131 INFO:tasks.workunit.client.1.smithi114.stdout:5/189: rename d3/l36 to d3/df/d2d/d34/l3c 0 2024-09-16T09:45:28.131 INFO:tasks.workunit.client.1.smithi114.stdout:5/190: chown d3/df/f10 12087476 1 2024-09-16T09:45:28.131 INFO:tasks.workunit.client.1.smithi114.stdout:6/121: stat d6/da/d10/c1a 0 2024-09-16T09:45:28.132 INFO:tasks.workunit.client.1.smithi114.stdout:5/191: truncate d3/fd 3587259 0 2024-09-16T09:45:28.132 INFO:tasks.workunit.client.1.smithi114.stdout:6/122: rmdir d6/da/d10 39 2024-09-16T09:45:28.133 INFO:tasks.workunit.client.1.smithi114.stdout:0/95: mkdir d1f 0 2024-09-16T09:45:28.134 INFO:tasks.workunit.client.1.smithi114.stdout:5/192: truncate d3/f5 3089214 0 2024-09-16T09:45:28.134 INFO:tasks.workunit.client.1.smithi114.stdout:4/74: read d0/fc [3507566,58594] 0 2024-09-16T09:45:28.135 INFO:tasks.workunit.client.1.smithi114.stdout:6/123: creat d6/da/f29 x:0 0 0 2024-09-16T09:45:28.136 INFO:tasks.workunit.client.1.smithi114.stdout:0/96: mkdir d1f/d20 0 2024-09-16T09:45:28.136 INFO:tasks.workunit.client.1.smithi114.stdout:0/97: write f14 [630909,45179] 0 2024-09-16T09:45:28.137 INFO:tasks.workunit.client.1.smithi114.stdout:6/124: mknod d6/c2a 0 2024-09-16T09:45:28.137 INFO:tasks.workunit.client.1.smithi114.stdout:6/125: read - d6/da/d10/f1d zero size 2024-09-16T09:45:28.138 INFO:tasks.workunit.client.1.smithi114.stdout:5/193: dread d3/d1f/f16 [0,4194304] 0 2024-09-16T09:45:28.138 INFO:tasks.workunit.client.1.smithi114.stdout:5/194: dread - d3/f22 zero size 2024-09-16T09:45:28.138 INFO:tasks.workunit.client.1.smithi114.stdout:0/98: link cf d1f/d20/c21 0 2024-09-16T09:45:28.139 INFO:tasks.workunit.client.1.smithi114.stdout:4/75: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:28.139 INFO:tasks.workunit.client.1.smithi114.stdout:6/126: mknod d6/c2b 0 2024-09-16T09:45:28.142 INFO:tasks.workunit.client.1.smithi114.stdout:5/195: unlink d3/d11/f26 0 2024-09-16T09:45:28.143 INFO:tasks.workunit.client.1.smithi114.stdout:1/126: dwrite d4/d8/f9 [8388608,4194304] 0 2024-09-16T09:45:28.144 INFO:tasks.workunit.client.1.smithi114.stdout:0/99: mkdir d1f/d22 0 2024-09-16T09:45:28.144 INFO:tasks.workunit.client.1.smithi114.stdout:0/100: write f6 [1673761,53651] 0 2024-09-16T09:45:28.144 INFO:tasks.workunit.client.1.smithi114.stdout:0/101: stat f14 0 2024-09-16T09:45:28.144 INFO:tasks.workunit.client.1.smithi114.stdout:0/102: fdatasync f1e 0 2024-09-16T09:45:28.144 INFO:tasks.workunit.client.1.smithi114.stdout:1/127: creat d4/f25 x:0 0 0 2024-09-16T09:45:28.145 INFO:tasks.workunit.client.1.smithi114.stdout:1/128: creat d4/f26 x:0 0 0 2024-09-16T09:45:28.146 INFO:tasks.workunit.client.1.smithi114.stdout:1/129: stat d4/c6 0 2024-09-16T09:45:28.147 INFO:tasks.workunit.client.1.smithi114.stdout:4/76: dread d0/fc [0,4194304] 0 2024-09-16T09:45:28.147 INFO:tasks.workunit.client.1.smithi114.stdout:3/191: dwrite dc/de/d10/f1e [0,4194304] 0 2024-09-16T09:45:28.148 INFO:tasks.workunit.client.1.smithi114.stdout:1/130: rename d4/d8/f10 to d4/d8/f27 0 2024-09-16T09:45:28.148 INFO:tasks.workunit.client.1.smithi114.stdout:1/131: stat d4/d8/f27 0 2024-09-16T09:45:28.152 INFO:tasks.workunit.client.1.smithi114.stdout:3/192: link dc/de/f2f dc/de/d10/d26/f3a 0 2024-09-16T09:45:28.153 INFO:tasks.workunit.client.1.smithi114.stdout:4/77: write d0/fe [332986,28518] 0 2024-09-16T09:45:28.159 INFO:tasks.workunit.client.1.smithi114.stdout:3/193: symlink dc/de/l3b 0 2024-09-16T09:45:28.166 INFO:tasks.workunit.client.1.smithi114.stdout:4/78: dread d0/fc [0,4194304] 0 2024-09-16T09:45:28.173 INFO:tasks.workunit.client.1.smithi114.stdout:3/194: dread f9 [0,4194304] 0 2024-09-16T09:45:28.176 INFO:tasks.workunit.client.1.smithi114.stdout:3/195: unlink dc/de/d18/f2a 0 2024-09-16T09:45:28.177 INFO:tasks.workunit.client.1.smithi114.stdout:5/196: dwrite d3/f22 [0,4194304] 0 2024-09-16T09:45:28.177 INFO:tasks.workunit.client.1.smithi114.stdout:6/127: dwrite d6/da/f28 [0,4194304] 0 2024-09-16T09:45:28.178 INFO:tasks.workunit.client.1.smithi114.stdout:6/128: write d6/da/d10/f1d [320433,19950] 0 2024-09-16T09:45:28.178 INFO:tasks.workunit.client.1.smithi114.stdout:1/132: dwrite d4/f25 [0,4194304] 0 2024-09-16T09:45:28.180 INFO:tasks.workunit.client.1.smithi114.stdout:6/129: write f5 [163408,33376] 0 2024-09-16T09:45:28.180 INFO:tasks.workunit.client.1.smithi114.stdout:6/130: write d6/da/d10/f25 [563052,63206] 0 2024-09-16T09:45:28.183 INFO:tasks.workunit.client.1.smithi114.stdout:6/131: creat d6/da/f2c x:0 0 0 2024-09-16T09:45:28.193 INFO:tasks.workunit.client.1.smithi114.stdout:5/197: dread d3/d11/f1a [0,4194304] 0 2024-09-16T09:45:28.193 INFO:tasks.workunit.client.1.smithi114.stdout:5/198: rmdir d3/df/d2d/d34 39 2024-09-16T09:45:28.204 INFO:tasks.workunit.client.1.smithi114.stdout:4/79: dwrite d0/d9/fd [0,4194304] 0 2024-09-16T09:45:28.204 INFO:tasks.workunit.client.1.smithi114.stdout:4/80: chown d0/d17 861 1 2024-09-16T09:45:28.207 INFO:tasks.workunit.client.1.smithi114.stdout:4/81: rename d0/c12 to d0/d9/c18 0 2024-09-16T09:45:28.207 INFO:tasks.workunit.client.1.smithi114.stdout:2/147: sync 2024-09-16T09:45:28.209 INFO:tasks.workunit.client.1.smithi114.stdout:4/82: unlink d0/c5 0 2024-09-16T09:45:28.210 INFO:tasks.workunit.client.1.smithi114.stdout:3/196: dwrite dc/de/d10/f19 [0,4194304] 0 2024-09-16T09:45:28.210 INFO:tasks.workunit.client.1.smithi114.stdout:1/133: dwrite d4/d8/f14 [4194304,4194304] 0 2024-09-16T09:45:28.210 INFO:tasks.workunit.client.1.smithi114.stdout:2/148: creat d1/d8/d10/d16/d1d/f34 x:0 0 0 2024-09-16T09:45:28.211 INFO:tasks.workunit.client.1.smithi114.stdout:4/83: mknod d0/d9/c19 0 2024-09-16T09:45:28.212 INFO:tasks.workunit.client.1.smithi114.stdout:6/132: dwrite d6/da/d10/f1d [0,4194304] 0 2024-09-16T09:45:28.213 INFO:tasks.workunit.client.1.smithi114.stdout:3/197: rename dc/de/d17/d2d/f31 to dc/de/d10/f3c 0 2024-09-16T09:45:28.213 INFO:tasks.workunit.client.1.smithi114.stdout:3/198: write dc/de/d18/f30 [612912,12977] 0 2024-09-16T09:45:28.214 INFO:tasks.workunit.client.1.smithi114.stdout:2/149: creat d1/d8/d10/f35 x:0 0 0 2024-09-16T09:45:28.215 INFO:tasks.workunit.client.1.smithi114.stdout:4/84: symlink d0/l1a 0 2024-09-16T09:45:28.215 INFO:tasks.workunit.client.1.smithi114.stdout:4/85: write d0/d9/f14 [1004394,26209] 0 2024-09-16T09:45:28.215 INFO:tasks.workunit.client.1.smithi114.stdout:4/86: stat d0/d9/c19 0 2024-09-16T09:45:28.215 INFO:tasks.workunit.client.1.smithi114.stdout:3/199: mkdir dc/de/d37/d3d 0 2024-09-16T09:45:28.216 INFO:tasks.workunit.client.1.smithi114.stdout:3/200: truncate dc/de/d10/f25 4497218 0 2024-09-16T09:45:28.217 INFO:tasks.workunit.client.1.smithi114.stdout:4/87: rename d0/d9/c18 to d0/d9/c1b 0 2024-09-16T09:45:28.218 INFO:tasks.workunit.client.1.smithi114.stdout:3/201: mkdir dc/de/d1f/d3e 0 2024-09-16T09:45:28.220 INFO:tasks.workunit.client.1.smithi114.stdout:3/202: mkdir dc/d38/d3f 0 2024-09-16T09:45:28.221 INFO:tasks.workunit.client.1.smithi114.stdout:3/203: creat dc/de/d18/f40 x:0 0 0 2024-09-16T09:45:28.221 INFO:tasks.workunit.client.1.smithi114.stdout:3/204: chown f9 18 1 2024-09-16T09:45:28.221 INFO:tasks.workunit.client.1.smithi114.stdout:3/205: truncate f9 5143123 0 2024-09-16T09:45:28.221 INFO:tasks.workunit.client.1.smithi114.stdout:3/206: chown dc/de/d17/d2d/l32 1210010 1 2024-09-16T09:45:28.221 INFO:tasks.workunit.client.1.smithi114.stdout:4/88: write d0/f7 [187091,105509] 0 2024-09-16T09:45:28.232 INFO:tasks.workunit.client.1.smithi114.stdout:4/89: dread d0/d9/fd [0,4194304] 0 2024-09-16T09:45:28.232 INFO:tasks.workunit.client.1.smithi114.stdout:4/90: chown d0/d13 39 1 2024-09-16T09:45:28.244 INFO:tasks.workunit.client.1.smithi114.stdout:2/150: dwrite d1/d8/d26/f2f [0,4194304] 0 2024-09-16T09:45:28.244 INFO:tasks.workunit.client.1.smithi114.stdout:3/207: dwrite dc/de/f2f [0,4194304] 0 2024-09-16T09:45:28.244 INFO:tasks.workunit.client.1.smithi114.stdout:3/208: getdents dc/de/d1f/d3e 0 2024-09-16T09:45:28.245 INFO:tasks.workunit.client.1.smithi114.stdout:2/151: creat d1/d8/d26/f36 x:0 0 0 2024-09-16T09:45:28.245 INFO:tasks.workunit.client.1.smithi114.stdout:2/152: chown d1/d8/d10/c15 58427 1 2024-09-16T09:45:28.246 INFO:tasks.workunit.client.1.smithi114.stdout:3/209: rmdir dc/de/d1f 39 2024-09-16T09:45:28.247 INFO:tasks.workunit.client.1.smithi114.stdout:2/153: chown d1/l5 60450 1 2024-09-16T09:45:28.247 INFO:tasks.workunit.client.1.smithi114.stdout:2/154: truncate d1/d8/d10/f22 4282543 0 2024-09-16T09:45:28.247 INFO:tasks.workunit.client.1.smithi114.stdout:3/210: mkdir dc/de/d17/d2d/d41 0 2024-09-16T09:45:28.248 INFO:tasks.workunit.client.1.smithi114.stdout:3/211: creat dc/de/d17/d2d/d41/f42 x:0 0 0 2024-09-16T09:45:28.248 INFO:tasks.workunit.client.1.smithi114.stdout:3/212: chown dc/d38/d3f 565044574 1 2024-09-16T09:45:28.248 INFO:tasks.workunit.client.1.smithi114.stdout:3/213: truncate dc/de/d18/f30 1708645 0 2024-09-16T09:45:28.248 INFO:tasks.workunit.client.1.smithi114.stdout:4/91: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:28.249 INFO:tasks.workunit.client.1.smithi114.stdout:4/92: read d0/fc [1480632,92405] 0 2024-09-16T09:45:28.249 INFO:tasks.workunit.client.1.smithi114.stdout:4/93: mknod d0/c1c 0 2024-09-16T09:45:28.249 INFO:tasks.workunit.client.1.smithi114.stdout:4/94: chown d0/d9/c1b 11 1 2024-09-16T09:45:28.249 INFO:tasks.workunit.client.1.smithi114.stdout:4/95: chown d0/d17 326831 1 2024-09-16T09:45:28.250 INFO:tasks.workunit.client.1.smithi114.stdout:2/155: dread d1/d8/d10/d16/f30 [0,4194304] 0 2024-09-16T09:45:28.251 INFO:tasks.workunit.client.1.smithi114.stdout:2/156: symlink d1/l37 0 2024-09-16T09:45:28.253 INFO:tasks.workunit.client.1.smithi114.stdout:2/157: mknod d1/d8/d10/c38 0 2024-09-16T09:45:28.254 INFO:tasks.workunit.client.1.smithi114.stdout:2/158: link d1/d8/d10/d16/c23 d1/d8/d10/d16/c39 0 2024-09-16T09:45:28.254 INFO:tasks.workunit.client.1.smithi114.stdout:3/214: dread dc/de/d18/f22 [0,4194304] 0 2024-09-16T09:45:28.254 INFO:tasks.workunit.client.1.smithi114.stdout:3/215: read dc/de/d18/f35 [345217,14018] 0 2024-09-16T09:45:28.255 INFO:tasks.workunit.client.1.smithi114.stdout:2/159: symlink d1/d8/d10/d16/d1d/l3a 0 2024-09-16T09:45:28.263 INFO:tasks.workunit.client.1.smithi114.stdout:2/160: dread d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:28.263 INFO:tasks.workunit.client.1.smithi114.stdout:2/161: read - d1/d8/d10/d16/d1d/f34 zero size 2024-09-16T09:45:28.263 INFO:tasks.workunit.client.1.smithi114.stdout:2/162: mknod d1/d8/c3b 0 2024-09-16T09:45:28.264 INFO:tasks.workunit.client.1.smithi114.stdout:2/163: mknod d1/d8/d10/d16/d1d/c3c 0 2024-09-16T09:45:28.265 INFO:tasks.workunit.client.1.smithi114.stdout:4/96: dwrite d0/ff [0,4194304] 0 2024-09-16T09:45:28.265 INFO:tasks.workunit.client.1.smithi114.stdout:2/164: symlink d1/d8/d26/l3d 0 2024-09-16T09:45:28.266 INFO:tasks.workunit.client.1.smithi114.stdout:3/216: dread dc/de/d18/f2c [0,4194304] 0 2024-09-16T09:45:28.270 INFO:tasks.workunit.client.1.smithi114.stdout:2/165: mkdir d1/d8/d26/d33/d3e 0 2024-09-16T09:45:28.270 INFO:tasks.workunit.client.1.smithi114.stdout:3/217: symlink dc/de/d10/d26/l43 0 2024-09-16T09:45:28.271 INFO:tasks.workunit.client.1.smithi114.stdout:3/218: mknod dc/de/d37/c44 0 2024-09-16T09:45:28.273 INFO:tasks.workunit.client.1.smithi114.stdout:3/219: rmdir dc/de/d10 39 2024-09-16T09:45:28.273 INFO:tasks.workunit.client.1.smithi114.stdout:3/220: chown dc/de/d10/f3c 118736983 1 2024-09-16T09:45:28.273 INFO:tasks.workunit.client.1.smithi114.stdout:3/221: chown dc/de/d17/f1a 101466 1 2024-09-16T09:45:28.273 INFO:tasks.workunit.client.1.smithi114.stdout:3/222: fdatasync dc/de/d1f/f29 0 2024-09-16T09:45:28.274 INFO:tasks.workunit.client.1.smithi114.stdout:3/223: creat dc/d38/f45 x:0 0 0 2024-09-16T09:45:28.276 INFO:tasks.workunit.client.1.smithi114.stdout:3/224: mknod dc/de/d17/d2d/d41/c46 0 2024-09-16T09:45:28.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/225: creat dc/de/d17/d2d/d41/f47 x:0 0 0 2024-09-16T09:45:28.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/226: chown dc/de/l12 1719184760 1 2024-09-16T09:45:28.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/227: write dc/de/d17/d2d/d41/f42 [157069,76877] 0 2024-09-16T09:45:28.286 INFO:tasks.workunit.client.1.smithi114.stdout:3/228: fsync dc/de/f34 0 2024-09-16T09:45:28.286 INFO:tasks.workunit.client.1.smithi114.stdout:3/229: readlink la 0 2024-09-16T09:45:28.286 INFO:tasks.workunit.client.1.smithi114.stdout:3/230: write dc/de/d18/f28 [1040723,51459] 0 2024-09-16T09:45:28.286 INFO:tasks.workunit.client.1.smithi114.stdout:3/231: mknod dc/de/d17/c48 0 2024-09-16T09:45:28.287 INFO:tasks.workunit.client.1.smithi114.stdout:3/232: write dc/de/d1f/f29 [593039,15056] 0 2024-09-16T09:45:28.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/122: sync 2024-09-16T09:45:28.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/123: write d3/da/fb [1292338,53591] 0 2024-09-16T09:45:28.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/124: stat d3/da/c1f 0 2024-09-16T09:45:28.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/125: fdatasync d3/da/d10/f21 0 2024-09-16T09:45:28.295 INFO:tasks.workunit.client.1.smithi114.stdout:9/126: rename d3/da/f17 to d3/da/f2a 0 2024-09-16T09:45:28.295 INFO:tasks.workunit.client.1.smithi114.stdout:3/233: write dc/de/d17/f1a [2084209,60158] 0 2024-09-16T09:45:28.296 INFO:tasks.workunit.client.1.smithi114.stdout:9/127: getdents d3/d13/d1e/d25 0 2024-09-16T09:45:28.296 INFO:tasks.workunit.client.1.smithi114.stdout:3/234: mknod dc/de/d37/c49 0 2024-09-16T09:45:28.296 INFO:tasks.workunit.client.1.smithi114.stdout:3/235: chown dc/de 173225 1 2024-09-16T09:45:28.297 INFO:tasks.workunit.client.1.smithi114.stdout:2/166: dwrite d1/d8/d10/f35 [0,4194304] 0 2024-09-16T09:45:28.298 INFO:tasks.workunit.client.1.smithi114.stdout:2/167: fsync d1/d8/f32 0 2024-09-16T09:45:28.298 INFO:tasks.workunit.client.1.smithi114.stdout:9/128: rename c2 to d3/da/d10/d23/c2b 0 2024-09-16T09:45:28.298 INFO:tasks.workunit.client.1.smithi114.stdout:9/129: fdatasync d3/f5 0 2024-09-16T09:45:28.299 INFO:tasks.workunit.client.1.smithi114.stdout:4/97: dwrite d0/f11 [4194304,4194304] 0 2024-09-16T09:45:28.299 INFO:tasks.workunit.client.1.smithi114.stdout:9/130: unlink d3/c19 0 2024-09-16T09:45:28.311 INFO:tasks.workunit.client.1.smithi114.stdout:4/98: dread d0/f11 [4194304,4194304] 0 2024-09-16T09:45:28.313 INFO:tasks.workunit.client.1.smithi114.stdout:4/99: creat d0/d9/f1d x:0 0 0 2024-09-16T09:45:28.313 INFO:tasks.workunit.client.1.smithi114.stdout:4/100: creat d0/d17/f1e x:0 0 0 2024-09-16T09:45:28.323 INFO:tasks.workunit.client.1.smithi114.stdout:3/236: dwrite dc/de/d18/f2c [4194304,4194304] 0 2024-09-16T09:45:28.323 INFO:tasks.workunit.client.1.smithi114.stdout:3/237: read - dc/de/d18/f40 zero size 2024-09-16T09:45:28.326 INFO:tasks.workunit.client.1.smithi114.stdout:2/168: dwrite d1/d8/f12 [4194304,4194304] 0 2024-09-16T09:45:28.327 INFO:tasks.workunit.client.1.smithi114.stdout:9/131: dwrite d3/f5 [0,4194304] 0 2024-09-16T09:45:28.330 INFO:tasks.workunit.client.1.smithi114.stdout:9/132: mkdir d3/da/d10/d23/d29/d2c 0 2024-09-16T09:45:28.332 INFO:tasks.workunit.client.1.smithi114.stdout:9/133: rename d3/da/d10/l1c to d3/da/l2d 0 2024-09-16T09:45:28.332 INFO:tasks.workunit.client.1.smithi114.stdout:9/134: read - d3/ff zero size 2024-09-16T09:45:28.334 INFO:tasks.workunit.client.1.smithi114.stdout:4/101: getdents d0/d17 0 2024-09-16T09:45:28.334 INFO:tasks.workunit.client.1.smithi114.stdout:9/135: read d3/da/d10/f1b [126781,77529] 0 2024-09-16T09:45:28.335 INFO:tasks.workunit.client.1.smithi114.stdout:8/167: sync 2024-09-16T09:45:28.335 INFO:tasks.workunit.client.1.smithi114.stdout:7/184: sync 2024-09-16T09:45:28.335 INFO:tasks.workunit.client.1.smithi114.stdout:5/199: sync 2024-09-16T09:45:28.336 INFO:tasks.workunit.client.1.smithi114.stdout:8/168: truncate d4/db/dd/f13 1805274 0 2024-09-16T09:45:28.336 INFO:tasks.workunit.client.1.smithi114.stdout:0/103: sync 2024-09-16T09:45:28.336 INFO:tasks.workunit.client.1.smithi114.stdout:0/104: chown c1a 163 1 2024-09-16T09:45:28.337 INFO:tasks.workunit.client.1.smithi114.stdout:6/133: sync 2024-09-16T09:45:28.337 INFO:tasks.workunit.client.1.smithi114.stdout:6/134: dread - d6/da/f2c zero size 2024-09-16T09:45:28.337 INFO:tasks.workunit.client.1.smithi114.stdout:1/134: sync 2024-09-16T09:45:28.337 INFO:tasks.workunit.client.1.smithi114.stdout:9/136: rename d3/ce to d3/d13/c2e 0 2024-09-16T09:45:28.337 INFO:tasks.workunit.client.1.smithi114.stdout:8/169: mknod d4/c36 0 2024-09-16T09:45:28.337 INFO:tasks.workunit.client.1.smithi114.stdout:5/200: creat d3/df/d2d/d34/f3d x:0 0 0 2024-09-16T09:45:28.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/105: link f9 d1f/d20/f23 0 2024-09-16T09:45:28.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/106: readlink l17 0 2024-09-16T09:45:28.339 INFO:tasks.workunit.client.1.smithi114.stdout:7/185: getdents d2 0 2024-09-16T09:45:28.339 INFO:tasks.workunit.client.1.smithi114.stdout:7/186: dread - d2/f1c zero size 2024-09-16T09:45:28.339 INFO:tasks.workunit.client.1.smithi114.stdout:6/135: mkdir d6/d2d 0 2024-09-16T09:45:28.340 INFO:tasks.workunit.client.1.smithi114.stdout:9/137: link d3/da/d10/f1b d3/d13/f2f 0 2024-09-16T09:45:28.341 INFO:tasks.workunit.client.1.smithi114.stdout:5/201: mknod d3/d1f/c3e 0 2024-09-16T09:45:28.342 INFO:tasks.workunit.client.1.smithi114.stdout:0/107: symlink d1f/d20/l24 0 2024-09-16T09:45:28.344 INFO:tasks.workunit.client.1.smithi114.stdout:9/138: mknod d3/da/c30 0 2024-09-16T09:45:28.344 INFO:tasks.workunit.client.1.smithi114.stdout:9/139: write d3/d13/f18 [533569,45370] 0 2024-09-16T09:45:28.345 INFO:tasks.workunit.client.1.smithi114.stdout:0/108: mkdir d1f/d20/d25 0 2024-09-16T09:45:28.346 INFO:tasks.workunit.client.1.smithi114.stdout:7/187: write d2/f3b [1123684,47175] 0 2024-09-16T09:45:28.347 INFO:tasks.workunit.client.1.smithi114.stdout:0/109: rmdir d1f/d20/d25 0 2024-09-16T09:45:28.347 INFO:tasks.workunit.client.1.smithi114.stdout:0/110: stat d1f/d20/l24 0 2024-09-16T09:45:28.348 INFO:tasks.workunit.client.1.smithi114.stdout:7/188: truncate d2/df/f32 178167 0 2024-09-16T09:45:28.351 INFO:tasks.workunit.client.1.smithi114.stdout:8/170: write d4/db/dd/f16 [787536,106487] 0 2024-09-16T09:45:28.353 INFO:tasks.workunit.client.1.smithi114.stdout:8/171: symlink d4/l37 0 2024-09-16T09:45:28.353 INFO:tasks.workunit.client.1.smithi114.stdout:1/135: write d4/f25 [248549,116227] 0 2024-09-16T09:45:28.353 INFO:tasks.workunit.client.1.smithi114.stdout:1/136: write d4/d8/f1e [1379408,128174] 0 2024-09-16T09:45:28.353 INFO:tasks.workunit.client.1.smithi114.stdout:1/137: stat d4/f13 0 2024-09-16T09:45:28.354 INFO:tasks.workunit.client.1.smithi114.stdout:8/172: getdents d4/db/dd/d1b 0 2024-09-16T09:45:28.356 INFO:tasks.workunit.client.1.smithi114.stdout:8/173: symlink d4/db/dd/d1b/d30/l38 0 2024-09-16T09:45:28.357 INFO:tasks.workunit.client.1.smithi114.stdout:8/174: mkdir d4/db/d39 0 2024-09-16T09:45:28.358 INFO:tasks.workunit.client.1.smithi114.stdout:8/175: write d4/db/df/f1e [3621747,125126] 0 2024-09-16T09:45:28.358 INFO:tasks.workunit.client.1.smithi114.stdout:8/176: chown d4/c7 113162 1 2024-09-16T09:45:28.359 INFO:tasks.workunit.client.1.smithi114.stdout:0/111: dread f9 [0,4194304] 0 2024-09-16T09:45:28.365 INFO:tasks.workunit.client.1.smithi114.stdout:6/136: dread d6/f7 [0,4194304] 0 2024-09-16T09:45:28.366 INFO:tasks.workunit.client.1.smithi114.stdout:4/102: dwrite d0/ff [4194304,4194304] 0 2024-09-16T09:45:28.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/177: read d4/db/dd/f13 [715554,39822] 0 2024-09-16T09:45:28.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/178: readlink d4/db/dd/d1b/l25 0 2024-09-16T09:45:28.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/179: chown d4/db/dd/d1b/d30/f33 2721358 1 2024-09-16T09:45:28.367 INFO:tasks.workunit.client.1.smithi114.stdout:6/137: symlink d6/l2e 0 2024-09-16T09:45:28.367 INFO:tasks.workunit.client.1.smithi114.stdout:6/138: stat d6/f17 0 2024-09-16T09:45:28.367 INFO:tasks.workunit.client.1.smithi114.stdout:1/138: dread d4/d8/f9 [0,4194304] 0 2024-09-16T09:45:28.368 INFO:tasks.workunit.client.1.smithi114.stdout:1/139: dread - d4/f23 zero size 2024-09-16T09:45:28.369 INFO:tasks.workunit.client.1.smithi114.stdout:6/139: symlink d6/d2d/l2f 0 2024-09-16T09:45:28.369 INFO:tasks.workunit.client.1.smithi114.stdout:8/180: write d4/db/df/f12 [1156314,16871] 0 2024-09-16T09:45:28.369 INFO:tasks.workunit.client.1.smithi114.stdout:8/181: truncate d4/db/dd/f13 1945805 0 2024-09-16T09:45:28.370 INFO:tasks.workunit.client.1.smithi114.stdout:2/169: dwrite d1/d8/f32 [0,4194304] 0 2024-09-16T09:45:28.370 INFO:tasks.workunit.client.1.smithi114.stdout:1/140: truncate d4/d8/d16/f22 1740730 0 2024-09-16T09:45:28.371 INFO:tasks.workunit.client.1.smithi114.stdout:6/140: symlink d6/da/l30 0 2024-09-16T09:45:28.371 INFO:tasks.workunit.client.1.smithi114.stdout:3/238: dwrite dc/de/d10/f25 [0,4194304] 0 2024-09-16T09:45:28.374 INFO:tasks.workunit.client.1.smithi114.stdout:1/141: unlink d4/f13 0 2024-09-16T09:45:28.375 INFO:tasks.workunit.client.1.smithi114.stdout:6/141: rmdir d6/da/d10 39 2024-09-16T09:45:28.376 INFO:tasks.workunit.client.1.smithi114.stdout:3/239: symlink dc/de/d1f/l4a 0 2024-09-16T09:45:28.377 INFO:tasks.workunit.client.1.smithi114.stdout:1/142: rmdir d4 39 2024-09-16T09:45:28.378 INFO:tasks.workunit.client.1.smithi114.stdout:6/142: link d6/c2a d6/da/c31 0 2024-09-16T09:45:28.379 INFO:tasks.workunit.client.1.smithi114.stdout:3/240: symlink dc/de/d17/d2d/d41/l4b 0 2024-09-16T09:45:28.380 INFO:tasks.workunit.client.1.smithi114.stdout:6/143: link d6/da/d10/l12 d6/l32 0 2024-09-16T09:45:28.381 INFO:tasks.workunit.client.1.smithi114.stdout:3/241: mknod dc/c4c 0 2024-09-16T09:45:28.382 INFO:tasks.workunit.client.1.smithi114.stdout:6/144: creat d6/da/d10/f33 x:0 0 0 2024-09-16T09:45:28.383 INFO:tasks.workunit.client.1.smithi114.stdout:3/242: creat dc/de/d10/d26/f4d x:0 0 0 2024-09-16T09:45:28.385 INFO:tasks.workunit.client.1.smithi114.stdout:6/145: link d6/fc d6/d2d/f34 0 2024-09-16T09:45:28.385 INFO:tasks.workunit.client.1.smithi114.stdout:6/146: write d6/da/d10/f16 [452537,48097] 0 2024-09-16T09:45:28.385 INFO:tasks.workunit.client.1.smithi114.stdout:8/182: write d4/db/f22 [438,70921] 0 2024-09-16T09:45:28.386 INFO:tasks.workunit.client.1.smithi114.stdout:6/147: creat d6/f35 x:0 0 0 2024-09-16T09:45:28.386 INFO:tasks.workunit.client.1.smithi114.stdout:8/183: symlink d4/db/dd/d1b/d30/l3a 0 2024-09-16T09:45:28.387 INFO:tasks.workunit.client.1.smithi114.stdout:6/148: mkdir d6/da/d36 0 2024-09-16T09:45:28.387 INFO:tasks.workunit.client.1.smithi114.stdout:6/149: truncate d6/f1f 537989 0 2024-09-16T09:45:28.387 INFO:tasks.workunit.client.1.smithi114.stdout:6/150: chown d6/da/c21 80352305 1 2024-09-16T09:45:28.388 INFO:tasks.workunit.client.1.smithi114.stdout:9/140: dwrite d3/da/d10/f21 [0,4194304] 0 2024-09-16T09:45:28.390 INFO:tasks.workunit.client.1.smithi114.stdout:1/143: write d4/d8/d16/f1b [1647074,2414] 0 2024-09-16T09:45:28.391 INFO:tasks.workunit.client.1.smithi114.stdout:0/112: dwrite f19 [4194304,4194304] 0 2024-09-16T09:45:28.391 INFO:tasks.workunit.client.1.smithi114.stdout:1/144: mknod d4/c28 0 2024-09-16T09:45:28.392 INFO:tasks.workunit.client.1.smithi114.stdout:3/243: dread dc/de/f2f [0,4194304] 0 2024-09-16T09:45:28.393 INFO:tasks.workunit.client.1.smithi114.stdout:0/113: creat d1f/d22/f26 x:0 0 0 2024-09-16T09:45:28.393 INFO:tasks.workunit.client.1.smithi114.stdout:0/114: fsync f16 0 2024-09-16T09:45:28.394 INFO:tasks.workunit.client.1.smithi114.stdout:7/189: truncate d2/f3b 342047 0 2024-09-16T09:45:28.395 INFO:tasks.workunit.client.1.smithi114.stdout:9/141: dread d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:28.396 INFO:tasks.workunit.client.1.smithi114.stdout:1/145: rename d4/d21 to d4/d8/d29 0 2024-09-16T09:45:28.396 INFO:tasks.workunit.client.1.smithi114.stdout:6/151: read d6/fc [4042761,30964] 0 2024-09-16T09:45:28.399 INFO:tasks.workunit.client.1.smithi114.stdout:3/244: mkdir dc/de/d37/d4e 0 2024-09-16T09:45:28.399 INFO:tasks.workunit.client.1.smithi114.stdout:0/115: mkdir d1f/d27 0 2024-09-16T09:45:28.399 INFO:tasks.workunit.client.1.smithi114.stdout:4/103: truncate d0/ff 5898484 0 2024-09-16T09:45:28.400 INFO:tasks.workunit.client.1.smithi114.stdout:6/152: creat d6/d2d/f37 x:0 0 0 2024-09-16T09:45:28.401 INFO:tasks.workunit.client.1.smithi114.stdout:3/245: dread dc/de/d17/f1d [0,4194304] 0 2024-09-16T09:45:28.402 INFO:tasks.workunit.client.1.smithi114.stdout:7/190: rename d2/d9/d2b/d2e/d22/d27/l14 to d2/df/l3f 0 2024-09-16T09:45:28.403 INFO:tasks.workunit.client.1.smithi114.stdout:4/104: truncate d0/f7 3458130 0 2024-09-16T09:45:28.403 INFO:tasks.workunit.client.1.smithi114.stdout:4/105: chown d0/c1c 35806 1 2024-09-16T09:45:28.403 INFO:tasks.workunit.client.1.smithi114.stdout:6/153: creat d6/da/d36/f38 x:0 0 0 2024-09-16T09:45:28.404 INFO:tasks.workunit.client.1.smithi114.stdout:6/154: chown d6/da/d10/c18 9185 1 2024-09-16T09:45:28.404 INFO:tasks.workunit.client.1.smithi114.stdout:3/246: mknod dc/de/d17/d2d/c4f 0 2024-09-16T09:45:28.405 INFO:tasks.workunit.client.1.smithi114.stdout:7/191: rename d2/df/f32 to d2/d9/d2b/d2e/d22/d27/f40 0 2024-09-16T09:45:28.405 INFO:tasks.workunit.client.1.smithi114.stdout:7/192: chown d2/d9/d2b/d2e/d3e/c38 282631 1 2024-09-16T09:45:28.405 INFO:tasks.workunit.client.1.smithi114.stdout:7/193: truncate d2/d9/f19 684456 0 2024-09-16T09:45:28.407 INFO:tasks.workunit.client.1.smithi114.stdout:4/106: write d0/f11 [7248686,7367] 0 2024-09-16T09:45:28.412 INFO:tasks.workunit.client.1.smithi114.stdout:3/247: mkdir dc/de/d1f/d3e/d50 0 2024-09-16T09:45:28.412 INFO:tasks.workunit.client.1.smithi114.stdout:3/248: truncate dc/de/d1f/f23 1305921 0 2024-09-16T09:45:28.412 INFO:tasks.workunit.client.1.smithi114.stdout:3/249: dread - dc/de/d17/d2d/d41/f47 zero size 2024-09-16T09:45:28.412 INFO:tasks.workunit.client.1.smithi114.stdout:7/194: mknod d2/d9/d2b/d2e/d22/d27/c41 0 2024-09-16T09:45:28.413 INFO:tasks.workunit.client.1.smithi114.stdout:7/195: chown d2/c34 533 1 2024-09-16T09:45:28.414 INFO:tasks.workunit.client.1.smithi114.stdout:3/250: dread dc/de/d17/f1d [0,4194304] 0 2024-09-16T09:45:28.414 INFO:tasks.workunit.client.1.smithi114.stdout:7/196: mknod d2/d9/c42 0 2024-09-16T09:45:28.414 INFO:tasks.workunit.client.1.smithi114.stdout:7/197: chown d2/df/f10 8 1 2024-09-16T09:45:28.415 INFO:tasks.workunit.client.1.smithi114.stdout:3/251: creat dc/de/d37/d4e/f51 x:0 0 0 2024-09-16T09:45:28.415 INFO:tasks.workunit.client.1.smithi114.stdout:3/252: stat dc/c4c 0 2024-09-16T09:45:28.416 INFO:tasks.workunit.client.1.smithi114.stdout:3/253: creat dc/d38/f52 x:0 0 0 2024-09-16T09:45:28.417 INFO:tasks.workunit.client.1.smithi114.stdout:8/184: dwrite d4/fa [0,4194304] 0 2024-09-16T09:45:28.417 INFO:tasks.workunit.client.1.smithi114.stdout:8/185: write d4/f15 [784902,51521] 0 2024-09-16T09:45:28.418 INFO:tasks.workunit.client.1.smithi114.stdout:3/254: symlink dc/de/l53 0 2024-09-16T09:45:28.418 INFO:tasks.workunit.client.1.smithi114.stdout:3/255: chown dc/de/d18/f35 185389497 1 2024-09-16T09:45:28.420 INFO:tasks.workunit.client.1.smithi114.stdout:8/186: mknod d4/db/dd/c3b 0 2024-09-16T09:45:28.425 INFO:tasks.workunit.client.1.smithi114.stdout:3/256: dread dc/de/d18/f28 [0,4194304] 0 2024-09-16T09:45:28.425 INFO:tasks.workunit.client.1.smithi114.stdout:9/142: dwrite d3/d13/f2f [0,4194304] 0 2024-09-16T09:45:28.426 INFO:tasks.workunit.client.1.smithi114.stdout:3/257: creat dc/de/d10/d26/f54 x:0 0 0 2024-09-16T09:45:28.428 INFO:tasks.workunit.client.1.smithi114.stdout:9/143: symlink d3/d13/d1e/l31 0 2024-09-16T09:45:28.429 INFO:tasks.workunit.client.1.smithi114.stdout:8/187: dread d4/db/df/f1a [0,4194304] 0 2024-09-16T09:45:28.429 INFO:tasks.workunit.client.1.smithi114.stdout:8/188: readlink d4/db/l32 0 2024-09-16T09:45:28.429 INFO:tasks.workunit.client.1.smithi114.stdout:8/189: fdatasync d4/db/df/f12 0 2024-09-16T09:45:28.430 INFO:tasks.workunit.client.1.smithi114.stdout:3/258: creat dc/de/d1f/d3e/f55 x:0 0 0 2024-09-16T09:45:28.430 INFO:tasks.workunit.client.1.smithi114.stdout:3/259: fsync dc/de/d10/f1e 0 2024-09-16T09:45:28.431 INFO:tasks.workunit.client.1.smithi114.stdout:9/144: creat d3/f32 x:0 0 0 2024-09-16T09:45:28.432 INFO:tasks.workunit.client.1.smithi114.stdout:3/260: mkdir dc/d38/d56 0 2024-09-16T09:45:28.432 INFO:tasks.workunit.client.1.smithi114.stdout:3/261: write dc/de/d37/d4e/f51 [256624,125870] 0 2024-09-16T09:45:28.432 INFO:tasks.workunit.client.1.smithi114.stdout:3/262: chown dc/de/d1f/l4a 254355534 1 2024-09-16T09:45:28.433 INFO:tasks.workunit.client.1.smithi114.stdout:3/263: mkdir dc/de/d37/d57 0 2024-09-16T09:45:28.435 INFO:tasks.workunit.client.1.smithi114.stdout:3/264: link dc/de/d17/d2d/l32 dc/d38/d3f/l58 0 2024-09-16T09:45:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:28 smithi114 ceph-mon[35635]: pgmap v237: 65 pgs: 65 active+clean; 284 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 17 MiB/s wr, 605 op/s 2024-09-16T09:45:28.444 INFO:tasks.workunit.client.1.smithi114.stdout:4/107: dread d0/ff [0,4194304] 0 2024-09-16T09:45:28.444 INFO:tasks.workunit.client.1.smithi114.stdout:4/108: chown d0/d9/c1b 17399138 1 2024-09-16T09:45:28.445 INFO:tasks.workunit.client.1.smithi114.stdout:1/146: dwrite d4/f25 [4194304,4194304] 0 2024-09-16T09:45:28.445 INFO:tasks.workunit.client.1.smithi114.stdout:1/147: readlink d4/d8/d29/l24 0 2024-09-16T09:45:28.445 INFO:tasks.workunit.client.1.smithi114.stdout:4/109: creat d0/f1f x:0 0 0 2024-09-16T09:45:28.446 INFO:tasks.workunit.client.1.smithi114.stdout:4/110: write d0/d9/f14 [1018092,38440] 0 2024-09-16T09:45:28.446 INFO:tasks.workunit.client.1.smithi114.stdout:3/265: dread dc/de/d10/d26/f2b [0,4194304] 0 2024-09-16T09:45:28.447 INFO:tasks.workunit.client.1.smithi114.stdout:4/111: creat d0/f20 x:0 0 0 2024-09-16T09:45:28.447 INFO:tasks.workunit.client.1.smithi114.stdout:4/112: chown d0 349254588 1 2024-09-16T09:45:28.448 INFO:tasks.workunit.client.1.smithi114.stdout:3/266: symlink dc/de/d37/d4e/l59 0 2024-09-16T09:45:28.448 INFO:tasks.workunit.client.1.smithi114.stdout:3/267: chown f9 81307687 1 2024-09-16T09:45:28.449 INFO:tasks.workunit.client.1.smithi114.stdout:4/113: creat d0/f21 x:0 0 0 2024-09-16T09:45:28.449 INFO:tasks.workunit.client.1.smithi114.stdout:4/114: chown d0/fc 146065 1 2024-09-16T09:45:28.450 INFO:tasks.workunit.client.1.smithi114.stdout:3/268: symlink dc/de/d17/d2d/d41/l5a 0 2024-09-16T09:45:28.450 INFO:tasks.workunit.client.1.smithi114.stdout:3/269: write dc/d38/f52 [777735,76990] 0 2024-09-16T09:45:28.454 INFO:tasks.workunit.client.1.smithi114.stdout:7/198: dwrite d2/d9/d2b/d2e/d22/d27/f18 [0,4194304] 0 2024-09-16T09:45:28.454 INFO:tasks.workunit.client.1.smithi114.stdout:7/199: write d2/d9/fc [3069673,36062] 0 2024-09-16T09:45:28.454 INFO:tasks.workunit.client.1.smithi114.stdout:7/200: fdatasync d2/f3b 0 2024-09-16T09:45:28.455 INFO:tasks.workunit.client.1.smithi114.stdout:0/116: dwrite f6 [0,4194304] 0 2024-09-16T09:45:28.456 INFO:tasks.workunit.client.1.smithi114.stdout:9/145: dwrite d3/d13/f16 [0,4194304] 0 2024-09-16T09:45:28.459 INFO:tasks.workunit.client.1.smithi114.stdout:7/201: read d2/df/f10 [5095084,74522] 0 2024-09-16T09:45:28.459 INFO:tasks.workunit.client.1.smithi114.stdout:7/202: truncate d2/d9/d2b/d2e/d22/d27/f40 1092883 0 2024-09-16T09:45:28.460 INFO:tasks.workunit.client.1.smithi114.stdout:0/117: symlink d1f/d27/l28 0 2024-09-16T09:45:28.464 INFO:tasks.workunit.client.1.smithi114.stdout:0/118: creat d1f/d20/f29 x:0 0 0 2024-09-16T09:45:28.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/190: dread d4/f15 [0,4194304] 0 2024-09-16T09:45:28.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/191: write f3 [1096475,87299] 0 2024-09-16T09:45:28.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/192: fdatasync d4/db/df/f1a 0 2024-09-16T09:45:28.467 INFO:tasks.workunit.client.1.smithi114.stdout:0/119: rename c4 to d1f/c2a 0 2024-09-16T09:45:28.469 INFO:tasks.workunit.client.1.smithi114.stdout:8/193: unlink d4/db/dd/c3b 0 2024-09-16T09:45:28.470 INFO:tasks.workunit.client.1.smithi114.stdout:0/120: creat d1f/d22/f2b x:0 0 0 2024-09-16T09:45:28.471 INFO:tasks.workunit.client.1.smithi114.stdout:9/146: dread d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:28.476 INFO:tasks.workunit.client.1.smithi114.stdout:9/147: dread d3/f6 [0,4194304] 0 2024-09-16T09:45:28.476 INFO:tasks.workunit.client.1.smithi114.stdout:9/148: dread - d3/f32 zero size 2024-09-16T09:45:28.476 INFO:tasks.workunit.client.1.smithi114.stdout:8/194: mkdir d4/db/d39/d3c 0 2024-09-16T09:45:28.476 INFO:tasks.workunit.client.1.smithi114.stdout:0/121: mknod d1f/d20/c2c 0 2024-09-16T09:45:28.477 INFO:tasks.workunit.client.1.smithi114.stdout:9/149: creat d3/d13/f33 x:0 0 0 2024-09-16T09:45:28.478 INFO:tasks.workunit.client.1.smithi114.stdout:0/122: mkdir d1f/d2d 0 2024-09-16T09:45:28.479 INFO:tasks.workunit.client.1.smithi114.stdout:0/123: mkdir d1f/d22/d2e 0 2024-09-16T09:45:28.481 INFO:tasks.workunit.client.1.smithi114.stdout:1/148: dwrite d4/f26 [0,4194304] 0 2024-09-16T09:45:28.483 INFO:tasks.workunit.client.1.smithi114.stdout:8/195: dread d4/db/df/f12 [0,4194304] 0 2024-09-16T09:45:28.484 INFO:tasks.workunit.client.1.smithi114.stdout:1/149: mknod d4/d8/d16/c2a 0 2024-09-16T09:45:28.485 INFO:tasks.workunit.client.1.smithi114.stdout:8/196: creat d4/db/df/f3d x:0 0 0 2024-09-16T09:45:28.485 INFO:tasks.workunit.client.1.smithi114.stdout:3/270: dwrite dc/de/d17/f1a [0,4194304] 0 2024-09-16T09:45:28.486 INFO:tasks.workunit.client.1.smithi114.stdout:8/197: mkdir d4/db/d3e 0 2024-09-16T09:45:28.488 INFO:tasks.workunit.client.1.smithi114.stdout:3/271: mknod dc/de/d17/d2d/d41/c5b 0 2024-09-16T09:45:28.489 INFO:tasks.workunit.client.1.smithi114.stdout:8/198: link d4/db/f22 d4/f3f 0 2024-09-16T09:45:28.490 INFO:tasks.workunit.client.1.smithi114.stdout:3/272: mkdir dc/d38/d56/d5c 0 2024-09-16T09:45:28.491 INFO:tasks.workunit.client.1.smithi114.stdout:8/199: creat d4/f40 x:0 0 0 2024-09-16T09:45:28.493 INFO:tasks.workunit.client.1.smithi114.stdout:3/273: getdents dc/de/d37 0 2024-09-16T09:45:28.494 INFO:tasks.workunit.client.1.smithi114.stdout:8/200: dread d4/db/df/f12 [0,4194304] 0 2024-09-16T09:45:28.495 INFO:tasks.workunit.client.1.smithi114.stdout:8/201: creat d4/db/dd/d1b/d30/f41 x:0 0 0 2024-09-16T09:45:28.496 INFO:tasks.workunit.client.1.smithi114.stdout:8/202: write f3 [6440288,64379] 0 2024-09-16T09:45:28.496 INFO:tasks.workunit.client.1.smithi114.stdout:7/203: dwrite d2/f5 [0,4194304] 0 2024-09-16T09:45:28.497 INFO:tasks.workunit.client.1.smithi114.stdout:1/150: dread d4/f26 [0,4194304] 0 2024-09-16T09:45:28.497 INFO:tasks.workunit.client.1.smithi114.stdout:4/115: dwrite d0/d9/f1d [0,4194304] 0 2024-09-16T09:45:28.497 INFO:tasks.workunit.client.1.smithi114.stdout:1/151: readlink d4/l11 0 2024-09-16T09:45:28.497 INFO:tasks.workunit.client.1.smithi114.stdout:7/204: fdatasync d2/f1c 0 2024-09-16T09:45:28.498 INFO:tasks.workunit.client.1.smithi114.stdout:4/116: write d0/fc [3953647,114384] 0 2024-09-16T09:45:28.498 INFO:tasks.workunit.client.1.smithi114.stdout:4/117: readlink d0/d9/l15 0 2024-09-16T09:45:28.500 INFO:tasks.workunit.client.1.smithi114.stdout:9/150: dwrite d3/d13/f18 [0,4194304] 0 2024-09-16T09:45:28.500 INFO:tasks.workunit.client.1.smithi114.stdout:9/151: truncate d3/d13/f28 338093 0 2024-09-16T09:45:28.502 INFO:tasks.workunit.client.1.smithi114.stdout:3/274: dread dc/de/d18/f2c [0,4194304] 0 2024-09-16T09:45:28.502 INFO:tasks.workunit.client.1.smithi114.stdout:3/275: fdatasync dc/de/d17/f1d 0 2024-09-16T09:45:28.502 INFO:tasks.workunit.client.1.smithi114.stdout:0/124: dwrite fa [4194304,4194304] 0 2024-09-16T09:45:28.504 INFO:tasks.workunit.client.1.smithi114.stdout:9/152: mknod d3/d13/d1e/d25/c34 0 2024-09-16T09:45:28.504 INFO:tasks.workunit.client.1.smithi114.stdout:4/118: dread d0/fe [0,4194304] 0 2024-09-16T09:45:28.506 INFO:tasks.workunit.client.1.smithi114.stdout:3/276: truncate dc/de/d10/d26/f2b 643806 0 2024-09-16T09:45:28.509 INFO:tasks.workunit.client.1.smithi114.stdout:0/125: rename d1f/d20/f23 to d1f/d2d/f2f 0 2024-09-16T09:45:28.511 INFO:tasks.workunit.client.1.smithi114.stdout:0/126: unlink c11 0 2024-09-16T09:45:28.511 INFO:tasks.workunit.client.1.smithi114.stdout:0/127: stat l18 0 2024-09-16T09:45:28.512 INFO:tasks.workunit.client.1.smithi114.stdout:0/128: mknod d1f/d22/c30 0 2024-09-16T09:45:28.512 INFO:tasks.workunit.client.1.smithi114.stdout:0/129: write f1e [638669,105037] 0 2024-09-16T09:45:28.517 INFO:tasks.workunit.client.1.smithi114.stdout:1/152: rename d4/d8 to d4/d2b 0 2024-09-16T09:45:28.519 INFO:tasks.workunit.client.1.smithi114.stdout:1/153: mknod d4/d2b/c2c 0 2024-09-16T09:45:28.522 INFO:tasks.workunit.client.1.smithi114.stdout:1/154: truncate d4/f26 2040513 0 2024-09-16T09:45:28.523 INFO:tasks.workunit.client.1.smithi114.stdout:9/153: read d3/f5 [759528,56939] 0 2024-09-16T09:45:28.523 INFO:tasks.workunit.client.1.smithi114.stdout:1/155: truncate d4/d2b/f27 916323 0 2024-09-16T09:45:28.523 INFO:tasks.workunit.client.1.smithi114.stdout:1/156: fdatasync d4/d2b/d16/f22 0 2024-09-16T09:45:28.524 INFO:tasks.workunit.client.1.smithi114.stdout:9/154: rmdir d3 39 2024-09-16T09:45:28.531 INFO:tasks.workunit.client.1.smithi114.stdout:8/203: dwrite d4/fa [0,4194304] 0 2024-09-16T09:45:28.531 INFO:tasks.workunit.client.1.smithi114.stdout:7/205: dwrite d2/df/f3a [0,4194304] 0 2024-09-16T09:45:28.531 INFO:tasks.workunit.client.1.smithi114.stdout:8/204: write d4/f40 [699786,64577] 0 2024-09-16T09:45:28.531 INFO:tasks.workunit.client.1.smithi114.stdout:7/206: fsync d2/df/f3a 0 2024-09-16T09:45:28.532 INFO:tasks.workunit.client.1.smithi114.stdout:7/207: write d2/df/f30 [869040,40229] 0 2024-09-16T09:45:28.533 INFO:tasks.workunit.client.1.smithi114.stdout:8/205: rename d4/db/df/f1a to d4/d1f/f42 0 2024-09-16T09:45:28.533 INFO:tasks.workunit.client.1.smithi114.stdout:8/206: fdatasync d4/db/dd/f13 0 2024-09-16T09:45:28.533 INFO:tasks.workunit.client.1.smithi114.stdout:7/208: symlink d2/d9/d2b/l43 0 2024-09-16T09:45:28.534 INFO:tasks.workunit.client.1.smithi114.stdout:7/209: chown d2/d9/d2b/d2e/l29 3282380 1 2024-09-16T09:45:28.535 INFO:tasks.workunit.client.1.smithi114.stdout:7/210: rename d2/fb to d2/d9/d2b/d2e/d3e/f44 0 2024-09-16T09:45:28.536 INFO:tasks.workunit.client.1.smithi114.stdout:8/207: dread d4/db/dd/d1b/d28/f31 [0,4194304] 0 2024-09-16T09:45:28.536 INFO:tasks.workunit.client.1.smithi114.stdout:1/157: write d4/d2b/f9 [7919039,20586] 0 2024-09-16T09:45:28.536 INFO:tasks.workunit.client.1.smithi114.stdout:7/211: creat d2/d9/d2b/d2e/f45 x:0 0 0 2024-09-16T09:45:28.537 INFO:tasks.workunit.client.1.smithi114.stdout:8/208: rename d4/c7 to d4/db/d3e/c43 0 2024-09-16T09:45:28.538 INFO:tasks.workunit.client.1.smithi114.stdout:1/158: getdents d4/d2b/d29 0 2024-09-16T09:45:28.539 INFO:tasks.workunit.client.1.smithi114.stdout:7/212: symlink d2/d9/d2b/l46 0 2024-09-16T09:45:28.540 INFO:tasks.workunit.client.1.smithi114.stdout:7/213: readlink d2/d9/d2b/l3c 0 2024-09-16T09:45:28.540 INFO:tasks.workunit.client.1.smithi114.stdout:8/209: unlink d4/db/df/c2c 0 2024-09-16T09:45:28.541 INFO:tasks.workunit.client.1.smithi114.stdout:8/210: truncate d4/f15 994079 0 2024-09-16T09:45:28.541 INFO:tasks.workunit.client.1.smithi114.stdout:7/214: mknod d2/df/c47 0 2024-09-16T09:45:28.542 INFO:tasks.workunit.client.1.smithi114.stdout:8/211: creat d4/db/dd/f44 x:0 0 0 2024-09-16T09:45:28.543 INFO:tasks.workunit.client.1.smithi114.stdout:7/215: mknod d2/d9/d2b/d2e/c48 0 2024-09-16T09:45:28.544 INFO:tasks.workunit.client.1.smithi114.stdout:3/277: dwrite dc/de/d10/d26/f3a [0,4194304] 0 2024-09-16T09:45:28.545 INFO:tasks.workunit.client.1.smithi114.stdout:4/119: dwrite d0/f11 [4194304,4194304] 0 2024-09-16T09:45:28.545 INFO:tasks.workunit.client.1.smithi114.stdout:4/120: chown d0/d17 57 1 2024-09-16T09:45:28.545 INFO:tasks.workunit.client.1.smithi114.stdout:0/130: dwrite f14 [0,4194304] 0 2024-09-16T09:45:28.545 INFO:tasks.workunit.client.1.smithi114.stdout:8/212: rmdir d4/db/dd 39 2024-09-16T09:45:28.545 INFO:tasks.workunit.client.1.smithi114.stdout:9/155: dwrite d3/d13/f16 [0,4194304] 0 2024-09-16T09:45:28.546 INFO:tasks.workunit.client.1.smithi114.stdout:7/216: rmdir d2 39 2024-09-16T09:45:28.546 INFO:tasks.workunit.client.1.smithi114.stdout:7/217: chown d2/d9/d2b/d2e/d22/d27/f1e 31483836 1 2024-09-16T09:45:28.548 INFO:tasks.workunit.client.1.smithi114.stdout:3/278: rename dc/de/d1f/d3e to dc/d38/d56/d5c/d5d 0 2024-09-16T09:45:28.551 INFO:tasks.workunit.client.1.smithi114.stdout:3/279: dread dc/de/d10/d26/f2b [0,4194304] 0 2024-09-16T09:45:28.551 INFO:tasks.workunit.client.1.smithi114.stdout:0/131: mknod d1f/c31 0 2024-09-16T09:45:28.552 INFO:tasks.workunit.client.1.smithi114.stdout:0/132: write d1f/d22/f26 [915536,42547] 0 2024-09-16T09:45:28.553 INFO:tasks.workunit.client.1.smithi114.stdout:3/280: write dc/de/d37/d4e/f51 [12866,96510] 0 2024-09-16T09:45:28.553 INFO:tasks.workunit.client.1.smithi114.stdout:3/281: truncate dc/de/d18/f40 845222 0 2024-09-16T09:45:28.553 INFO:tasks.workunit.client.1.smithi114.stdout:8/213: symlink d4/db/d3e/l45 0 2024-09-16T09:45:28.553 INFO:tasks.workunit.client.1.smithi114.stdout:8/214: stat d4/f15 0 2024-09-16T09:45:28.559 INFO:tasks.workunit.client.1.smithi114.stdout:9/156: dwrite d3/d13/d1e/d25/f27 [0,4194304] 0 2024-09-16T09:45:28.563 INFO:tasks.workunit.client.1.smithi114.stdout:7/218: creat d2/d9/d2b/d2e/d22/f49 x:0 0 0 2024-09-16T09:45:28.564 INFO:tasks.workunit.client.1.smithi114.stdout:4/121: rename d0/fc to d0/d13/f22 0 2024-09-16T09:45:28.565 INFO:tasks.workunit.client.1.smithi114.stdout:3/282: creat dc/de/d17/f5e x:0 0 0 2024-09-16T09:45:28.565 INFO:tasks.workunit.client.1.smithi114.stdout:3/283: getdents dc/de/d37/d57 0 2024-09-16T09:45:28.567 INFO:tasks.workunit.client.1.smithi114.stdout:8/215: rename d4/db/l2a to d4/db/l46 0 2024-09-16T09:45:28.571 INFO:tasks.workunit.client.1.smithi114.stdout:7/219: creat d2/f4a x:0 0 0 2024-09-16T09:45:28.572 INFO:tasks.workunit.client.1.smithi114.stdout:0/133: rename d1f/d22/c30 to d1f/d27/c32 0 2024-09-16T09:45:28.573 INFO:tasks.workunit.client.1.smithi114.stdout:3/284: creat dc/d38/d3f/f5f x:0 0 0 2024-09-16T09:45:28.574 INFO:tasks.workunit.client.1.smithi114.stdout:1/159: truncate d4/f26 546152 0 2024-09-16T09:45:28.574 INFO:tasks.workunit.client.1.smithi114.stdout:1/160: getdents d4/d2b/d29 0 2024-09-16T09:45:28.575 INFO:tasks.workunit.client.1.smithi114.stdout:0/134: stat l17 0 2024-09-16T09:45:28.575 INFO:tasks.workunit.client.1.smithi114.stdout:1/161: mknod d4/d2b/d16/c2d 0 2024-09-16T09:45:28.576 INFO:tasks.workunit.client.1.smithi114.stdout:0/135: mknod d1f/d20/c33 0 2024-09-16T09:45:28.577 INFO:tasks.workunit.client.1.smithi114.stdout:1/162: mknod d4/d2b/d29/c2e 0 2024-09-16T09:45:28.578 INFO:tasks.workunit.client.1.smithi114.stdout:1/163: mkdir d4/d2b/d2f 0 2024-09-16T09:45:28.580 INFO:tasks.workunit.client.1.smithi114.stdout:1/164: link d4/c1c d4/d2b/d29/c30 0 2024-09-16T09:45:28.580 INFO:tasks.workunit.client.1.smithi114.stdout:1/165: fsync d4/d2b/f1e 0 2024-09-16T09:45:28.580 INFO:tasks.workunit.client.1.smithi114.stdout:1/166: write d4/f23 [232256,83503] 0 2024-09-16T09:45:28.584 INFO:tasks.workunit.client.1.smithi114.stdout:7/220: dread d2/df/f3a [0,4194304] 0 2024-09-16T09:45:28.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/221: truncate d2/df/f3a 3889929 0 2024-09-16T09:45:28.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/222: readlink d2/df/l3f 0 2024-09-16T09:45:28.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/223: truncate d2/f3b 1285985 0 2024-09-16T09:45:28.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/224: stat d2/d9/d2b/d2e/d3e/c38 0 2024-09-16T09:45:28.585 INFO:tasks.workunit.client.1.smithi114.stdout:7/225: dread - d2/f4a zero size 2024-09-16T09:45:28.589 INFO:tasks.workunit.client.1.smithi114.stdout:0/136: write f14 [3366040,65022] 0 2024-09-16T09:45:28.589 INFO:tasks.workunit.client.1.smithi114.stdout:0/137: chown d1f/d20/c2c 777371 1 2024-09-16T09:45:28.589 INFO:tasks.workunit.client.1.smithi114.stdout:0/138: fsync f6 0 2024-09-16T09:45:28.590 INFO:tasks.workunit.client.1.smithi114.stdout:0/139: write f15 [784535,64476] 0 2024-09-16T09:45:28.590 INFO:tasks.workunit.client.1.smithi114.stdout:0/140: creat d1f/d20/f34 x:0 0 0 2024-09-16T09:45:28.591 INFO:tasks.workunit.client.1.smithi114.stdout:0/141: unlink ce 0 2024-09-16T09:45:28.592 INFO:tasks.workunit.client.1.smithi114.stdout:0/142: symlink d1f/d22/d2e/l35 0 2024-09-16T09:45:28.593 INFO:tasks.workunit.client.1.smithi114.stdout:0/143: mknod d1f/c36 0 2024-09-16T09:45:28.593 INFO:tasks.workunit.client.1.smithi114.stdout:0/144: chown d1f/d22/f2b 581546 1 2024-09-16T09:45:28.593 INFO:tasks.workunit.client.1.smithi114.stdout:0/145: stat d1f/d22/d2e/l35 0 2024-09-16T09:45:28.593 INFO:tasks.workunit.client.1.smithi114.stdout:0/146: creat d1f/d22/d2e/f37 x:0 0 0 2024-09-16T09:45:28.594 INFO:tasks.workunit.client.1.smithi114.stdout:0/147: symlink d1f/d22/d2e/l38 0 2024-09-16T09:45:28.594 INFO:tasks.workunit.client.1.smithi114.stdout:0/148: symlink d1f/d22/d2e/l39 0 2024-09-16T09:45:28.595 INFO:tasks.workunit.client.1.smithi114.stdout:0/149: truncate d1f/d22/f26 1185056 0 2024-09-16T09:45:28.597 INFO:tasks.workunit.client.1.smithi114.stdout:0/150: creat d1f/d27/f3a x:0 0 0 2024-09-16T09:45:28.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:28 smithi111 ceph-mon[27997]: pgmap v237: 65 pgs: 65 active+clean; 284 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 17 MiB/s wr, 605 op/s 2024-09-16T09:45:28.598 INFO:tasks.workunit.client.1.smithi114.stdout:0/151: creat d1f/d27/f3b x:0 0 0 2024-09-16T09:45:28.599 INFO:tasks.workunit.client.1.smithi114.stdout:0/152: link d1f/d22/d2e/f37 d1f/d22/f3c 0 2024-09-16T09:45:28.603 INFO:tasks.workunit.client.1.smithi114.stdout:9/157: dwrite d3/f32 [0,4194304] 0 2024-09-16T09:45:28.603 INFO:tasks.workunit.client.1.smithi114.stdout:9/158: chown d3/f32 4 1 2024-09-16T09:45:28.603 INFO:tasks.workunit.client.1.smithi114.stdout:8/216: dwrite d4/db/dd/f16 [4194304,4194304] 0 2024-09-16T09:45:28.604 INFO:tasks.workunit.client.1.smithi114.stdout:3/285: dwrite dc/d38/f52 [0,4194304] 0 2024-09-16T09:45:28.605 INFO:tasks.workunit.client.1.smithi114.stdout:9/159: unlink d3/d13/c2e 0 2024-09-16T09:45:28.606 INFO:tasks.workunit.client.1.smithi114.stdout:4/122: dwrite d0/fe [0,4194304] 0 2024-09-16T09:45:28.608 INFO:tasks.workunit.client.1.smithi114.stdout:8/217: mkdir d4/db/d3e/d47 0 2024-09-16T09:45:28.608 INFO:tasks.workunit.client.1.smithi114.stdout:8/218: readlink d4/db/dd/d1b/l34 0 2024-09-16T09:45:28.611 INFO:tasks.workunit.client.1.smithi114.stdout:3/286: symlink dc/l60 0 2024-09-16T09:45:28.613 INFO:tasks.workunit.client.1.smithi114.stdout:9/160: creat d3/da/d10/d23/d29/d2c/f35 x:0 0 0 2024-09-16T09:45:28.613 INFO:tasks.workunit.client.1.smithi114.stdout:9/161: chown d3/f5 5655 1 2024-09-16T09:45:28.614 INFO:tasks.workunit.client.1.smithi114.stdout:2/170: sync 2024-09-16T09:45:28.614 INFO:tasks.workunit.client.1.smithi114.stdout:5/202: sync 2024-09-16T09:45:28.614 INFO:tasks.workunit.client.1.smithi114.stdout:6/155: sync 2024-09-16T09:45:28.614 INFO:tasks.workunit.client.1.smithi114.stdout:5/203: chown d3/f25 7 1 2024-09-16T09:45:28.616 INFO:tasks.workunit.client.1.smithi114.stdout:4/123: mknod d0/d9/c23 0 2024-09-16T09:45:28.616 INFO:tasks.workunit.client.1.smithi114.stdout:4/124: chown d0/f20 4 1 2024-09-16T09:45:28.618 INFO:tasks.workunit.client.1.smithi114.stdout:1/167: dread d4/f26 [0,4194304] 0 2024-09-16T09:45:28.618 INFO:tasks.workunit.client.1.smithi114.stdout:8/219: symlink d4/db/d39/l48 0 2024-09-16T09:45:28.618 INFO:tasks.workunit.client.1.smithi114.stdout:5/204: dread d3/f5 [0,4194304] 0 2024-09-16T09:45:28.619 INFO:tasks.workunit.client.1.smithi114.stdout:3/287: creat dc/de/d37/d57/f61 x:0 0 0 2024-09-16T09:45:28.620 INFO:tasks.workunit.client.1.smithi114.stdout:9/162: creat d3/da/d10/d23/f36 x:0 0 0 2024-09-16T09:45:28.622 INFO:tasks.workunit.client.1.smithi114.stdout:6/156: rename d6/da/f29 to d6/da/d10/f39 0 2024-09-16T09:45:28.625 INFO:tasks.workunit.client.1.smithi114.stdout:4/125: symlink d0/l24 0 2024-09-16T09:45:28.625 INFO:tasks.workunit.client.1.smithi114.stdout:4/126: chown d0/l1a 1038 1 2024-09-16T09:45:28.627 INFO:tasks.workunit.client.1.smithi114.stdout:1/168: symlink d4/d2b/d16/l31 0 2024-09-16T09:45:28.628 INFO:tasks.workunit.client.1.smithi114.stdout:8/220: symlink d4/l49 0 2024-09-16T09:45:28.628 INFO:tasks.workunit.client.1.smithi114.stdout:8/221: read f3 [849795,65024] 0 2024-09-16T09:45:28.629 INFO:tasks.workunit.client.1.smithi114.stdout:5/205: rmdir d3/d11 39 2024-09-16T09:45:28.629 INFO:tasks.workunit.client.1.smithi114.stdout:5/206: stat d3/df/d2d/d34 0 2024-09-16T09:45:28.631 INFO:tasks.workunit.client.1.smithi114.stdout:4/127: truncate d0/f11 6491743 0 2024-09-16T09:45:28.632 INFO:tasks.workunit.client.1.smithi114.stdout:9/163: dread d3/fc [0,4194304] 0 2024-09-16T09:45:28.632 INFO:tasks.workunit.client.1.smithi114.stdout:9/164: rename d3 to d3/da/d37 22 2024-09-16T09:45:28.634 INFO:tasks.workunit.client.1.smithi114.stdout:8/222: symlink d4/db/d3e/d47/l4a 0 2024-09-16T09:45:28.634 INFO:tasks.workunit.client.1.smithi114.stdout:5/207: readlink d3/d11/l21 0 2024-09-16T09:45:28.636 INFO:tasks.workunit.client.1.smithi114.stdout:8/223: mknod d4/db/d39/d3c/c4b 0 2024-09-16T09:45:28.637 INFO:tasks.workunit.client.1.smithi114.stdout:8/224: chown d4/db/dd/d1b/d30/f33 80684970 1 2024-09-16T09:45:28.637 INFO:tasks.workunit.client.1.smithi114.stdout:0/153: dwrite d1f/d22/f26 [0,4194304] 0 2024-09-16T09:45:28.638 INFO:tasks.workunit.client.1.smithi114.stdout:5/208: truncate d3/d11/f1a 623041 0 2024-09-16T09:45:28.638 INFO:tasks.workunit.client.1.smithi114.stdout:0/154: write f1e [82882,93860] 0 2024-09-16T09:45:28.640 INFO:tasks.workunit.client.1.smithi114.stdout:8/225: truncate d4/db/dd/f20 2933649 0 2024-09-16T09:45:28.642 INFO:tasks.workunit.client.1.smithi114.stdout:8/226: write d4/f15 [407932,112945] 0 2024-09-16T09:45:28.645 INFO:tasks.workunit.client.1.smithi114.stdout:2/171: dwrite d1/d8/d10/d16/d1d/f34 [0,4194304] 0 2024-09-16T09:45:28.646 INFO:tasks.workunit.client.1.smithi114.stdout:5/209: getdents d3 0 2024-09-16T09:45:28.646 INFO:tasks.workunit.client.1.smithi114.stdout:5/210: write d3/f2c [756861,27991] 0 2024-09-16T09:45:28.647 INFO:tasks.workunit.client.1.smithi114.stdout:0/155: creat d1f/d20/f3d x:0 0 0 2024-09-16T09:45:28.647 INFO:tasks.workunit.client.1.smithi114.stdout:0/156: write f16 [284304,22416] 0 2024-09-16T09:45:28.648 INFO:tasks.workunit.client.1.smithi114.stdout:0/157: chown cf 248584 1 2024-09-16T09:45:28.648 INFO:tasks.workunit.client.1.smithi114.stdout:8/227: rename d4/db/d39/d3c/c4b to d4/db/dd/d1b/c4c 0 2024-09-16T09:45:28.650 INFO:tasks.workunit.client.1.smithi114.stdout:2/172: symlink d1/d8/d10/d16/l3f 0 2024-09-16T09:45:28.651 INFO:tasks.workunit.client.1.smithi114.stdout:0/158: mknod d1f/c3e 0 2024-09-16T09:45:28.652 INFO:tasks.workunit.client.1.smithi114.stdout:8/228: rename f3 to d4/db/f4d 0 2024-09-16T09:45:28.653 INFO:tasks.workunit.client.1.smithi114.stdout:0/159: creat d1f/f3f x:0 0 0 2024-09-16T09:45:28.656 INFO:tasks.workunit.client.1.smithi114.stdout:0/160: unlink d1f/d22/d2e/l39 0 2024-09-16T09:45:28.656 INFO:tasks.workunit.client.1.smithi114.stdout:0/161: fdatasync d1f/d20/f3d 0 2024-09-16T09:45:28.656 INFO:tasks.workunit.client.1.smithi114.stdout:2/173: dread d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:28.656 INFO:tasks.workunit.client.1.smithi114.stdout:2/174: chown d1/d8/d10/d16/d1d/f1e 7024489 1 2024-09-16T09:45:28.658 INFO:tasks.workunit.client.1.smithi114.stdout:0/162: creat d1f/d22/d2e/f40 x:0 0 0 2024-09-16T09:45:28.658 INFO:tasks.workunit.client.1.smithi114.stdout:0/163: chown d1f/d22 199784967 1 2024-09-16T09:45:28.658 INFO:tasks.workunit.client.1.smithi114.stdout:0/164: fsync f3 0 2024-09-16T09:45:28.659 INFO:tasks.workunit.client.1.smithi114.stdout:1/169: dwrite d4/f25 [4194304,4194304] 0 2024-09-16T09:45:28.659 INFO:tasks.workunit.client.1.smithi114.stdout:9/165: dwrite d3/f32 [0,4194304] 0 2024-09-16T09:45:28.659 INFO:tasks.workunit.client.1.smithi114.stdout:9/166: write d3/fc [8690407,96465] 0 2024-09-16T09:45:28.659 INFO:tasks.workunit.client.1.smithi114.stdout:8/229: dread d4/db/dd/f16 [0,4194304] 0 2024-09-16T09:45:28.661 INFO:tasks.workunit.client.1.smithi114.stdout:5/211: write d3/d24/f28 [2811408,106512] 0 2024-09-16T09:45:28.661 INFO:tasks.workunit.client.1.smithi114.stdout:3/288: dwrite dc/d38/f45 [0,4194304] 0 2024-09-16T09:45:28.662 INFO:tasks.workunit.client.1.smithi114.stdout:2/175: creat d1/d8/d26/f40 x:0 0 0 2024-09-16T09:45:28.662 INFO:tasks.workunit.client.1.smithi114.stdout:6/157: getdents d6/da 0 2024-09-16T09:45:28.662 INFO:tasks.workunit.client.1.smithi114.stdout:6/158: stat d6/da/d10/f39 0 2024-09-16T09:45:28.664 INFO:tasks.workunit.client.1.smithi114.stdout:5/212: rmdir d3/d24 39 2024-09-16T09:45:28.664 INFO:tasks.workunit.client.1.smithi114.stdout:5/213: write d3/d24/f28 [378207,25696] 0 2024-09-16T09:45:28.668 INFO:tasks.workunit.client.1.smithi114.stdout:3/289: truncate dc/de/d10/d26/f2b 277696 0 2024-09-16T09:45:28.669 INFO:tasks.workunit.client.1.smithi114.stdout:2/176: mkdir d1/d8/d10/d16/d1d/d41 0 2024-09-16T09:45:28.671 INFO:tasks.workunit.client.1.smithi114.stdout:4/128: dwrite d0/fe [4194304,4194304] 0 2024-09-16T09:45:28.672 INFO:tasks.workunit.client.1.smithi114.stdout:6/159: creat d6/d2d/f3a x:0 0 0 2024-09-16T09:45:28.672 INFO:tasks.workunit.client.1.smithi114.stdout:6/160: write d6/f35 [426899,10561] 0 2024-09-16T09:45:28.673 INFO:tasks.workunit.client.1.smithi114.stdout:5/214: mkdir d3/df/d2d/d3f 0 2024-09-16T09:45:28.673 INFO:tasks.workunit.client.1.smithi114.stdout:1/170: dread d4/f25 [0,4194304] 0 2024-09-16T09:45:28.675 INFO:tasks.workunit.client.1.smithi114.stdout:3/290: unlink dc/d38/f52 0 2024-09-16T09:45:28.677 INFO:tasks.workunit.client.1.smithi114.stdout:2/177: mknod d1/d8/d26/d33/c42 0 2024-09-16T09:45:28.677 INFO:tasks.workunit.client.1.smithi114.stdout:2/178: truncate d1/d8/d26/f40 876511 0 2024-09-16T09:45:28.681 INFO:tasks.workunit.client.1.smithi114.stdout:2/179: dread d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:28.683 INFO:tasks.workunit.client.1.smithi114.stdout:1/171: creat d4/d2b/d29/f32 x:0 0 0 2024-09-16T09:45:28.684 INFO:tasks.workunit.client.1.smithi114.stdout:3/291: creat dc/d38/d56/d5c/d5d/f62 x:0 0 0 2024-09-16T09:45:28.685 INFO:tasks.workunit.client.1.smithi114.stdout:2/180: mknod d1/d8/d10/d16/d1d/d41/c43 0 2024-09-16T09:45:28.686 INFO:tasks.workunit.client.1.smithi114.stdout:2/181: chown d1/d8/d26/f40 300971 1 2024-09-16T09:45:28.686 INFO:tasks.workunit.client.1.smithi114.stdout:5/215: write d3/d1f/f1c [3390656,18573] 0 2024-09-16T09:45:28.686 INFO:tasks.workunit.client.1.smithi114.stdout:5/216: chown d3/f5 118 1 2024-09-16T09:45:28.686 INFO:tasks.workunit.client.1.smithi114.stdout:8/230: dwrite d4/f3f [0,4194304] 0 2024-09-16T09:45:28.686 INFO:tasks.workunit.client.1.smithi114.stdout:1/172: symlink d4/l33 0 2024-09-16T09:45:28.687 INFO:tasks.workunit.client.1.smithi114.stdout:3/292: truncate dc/de/d37/d4e/f51 146679 0 2024-09-16T09:45:28.688 INFO:tasks.workunit.client.1.smithi114.stdout:2/182: truncate d1/d8/d10/f22 361119 0 2024-09-16T09:45:28.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/173: creat d4/d2b/d29/f34 x:0 0 0 2024-09-16T09:45:28.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/174: write d4/d2b/f1e [2127912,82207] 0 2024-09-16T09:45:28.693 INFO:tasks.workunit.client.1.smithi114.stdout:9/167: dwrite d3/ff [0,4194304] 0 2024-09-16T09:45:28.695 INFO:tasks.workunit.client.1.smithi114.stdout:2/183: mknod d1/d8/d26/c44 0 2024-09-16T09:45:28.695 INFO:tasks.workunit.client.1.smithi114.stdout:5/217: mknod d3/d11/c40 0 2024-09-16T09:45:28.695 INFO:tasks.workunit.client.1.smithi114.stdout:5/218: truncate d3/df/d2d/d34/f3d 623117 0 2024-09-16T09:45:28.696 INFO:tasks.workunit.client.1.smithi114.stdout:1/175: getdents d4/d2b 0 2024-09-16T09:45:28.698 INFO:tasks.workunit.client.1.smithi114.stdout:4/129: dwrite d0/d9/f1d [4194304,4194304] 0 2024-09-16T09:45:28.699 INFO:tasks.workunit.client.1.smithi114.stdout:9/168: mkdir d3/da/d10/d23/d38 0 2024-09-16T09:45:28.699 INFO:tasks.workunit.client.1.smithi114.stdout:9/169: dread - d3/da/d10/d23/f36 zero size 2024-09-16T09:45:28.700 INFO:tasks.workunit.client.1.smithi114.stdout:5/219: unlink d3/fd 0 2024-09-16T09:45:28.702 INFO:tasks.workunit.client.1.smithi114.stdout:4/130: dread d0/ff [0,4194304] 0 2024-09-16T09:45:28.703 INFO:tasks.workunit.client.1.smithi114.stdout:2/184: unlink d1/lf 0 2024-09-16T09:45:28.704 INFO:tasks.workunit.client.1.smithi114.stdout:9/170: creat d3/da/d10/d23/d29/f39 x:0 0 0 2024-09-16T09:45:28.704 INFO:tasks.workunit.client.1.smithi114.stdout:9/171: chown d3/d13/f2f 51710474 1 2024-09-16T09:45:28.704 INFO:tasks.workunit.client.1.smithi114.stdout:9/172: write d3/da/d10/d23/d29/d2c/f35 [536322,109391] 0 2024-09-16T09:45:28.705 INFO:tasks.workunit.client.1.smithi114.stdout:1/176: dread d4/d2b/d16/f1b [0,4194304] 0 2024-09-16T09:45:28.705 INFO:tasks.workunit.client.1.smithi114.stdout:5/220: mkdir d3/df/d2d/d3f/d41 0 2024-09-16T09:45:28.707 INFO:tasks.workunit.client.1.smithi114.stdout:4/131: mkdir d0/d13/d25 0 2024-09-16T09:45:28.708 INFO:tasks.workunit.client.1.smithi114.stdout:2/185: mkdir d1/d8/d10/d45 0 2024-09-16T09:45:28.708 INFO:tasks.workunit.client.1.smithi114.stdout:6/161: dwrite d6/fc [0,4194304] 0 2024-09-16T09:45:28.709 INFO:tasks.workunit.client.1.smithi114.stdout:8/231: dwrite d4/db/dd/f44 [0,4194304] 0 2024-09-16T09:45:28.709 INFO:tasks.workunit.client.1.smithi114.stdout:5/221: link d3/df/c23 d3/d24/c42 0 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/132: mkdir d0/d26 0 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/133: dread - d0/f1f zero size 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/134: chown d0/d13/f22 414 1 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/135: fsync d0/f20 0 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/136: fdatasync d0/d9/f14 0 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/137: dread - d0/d17/f1e zero size 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/138: read d0/d13/f22 [420313,87857] 0 2024-09-16T09:45:28.711 INFO:tasks.workunit.client.1.smithi114.stdout:4/139: chown d0/d9/f14 0 1 2024-09-16T09:45:28.712 INFO:tasks.workunit.client.1.smithi114.stdout:2/186: creat d1/d8/f46 x:0 0 0 2024-09-16T09:45:28.715 INFO:tasks.workunit.client.1.smithi114.stdout:5/222: dread d3/f25 [0,4194304] 0 2024-09-16T09:45:28.718 INFO:tasks.workunit.client.1.smithi114.stdout:1/177: dread d4/f25 [0,4194304] 0 2024-09-16T09:45:28.718 INFO:tasks.workunit.client.1.smithi114.stdout:1/178: fdatasync d4/d2b/d16/f19 0 2024-09-16T09:45:28.721 INFO:tasks.workunit.client.1.smithi114.stdout:5/223: mkdir d3/d11/d37/d43 0 2024-09-16T09:45:28.723 INFO:tasks.workunit.client.1.smithi114.stdout:3/293: rename dc/de/d37/d4e/f51 to dc/de/d17/d2d/f63 0 2024-09-16T09:45:28.724 INFO:tasks.workunit.client.1.smithi114.stdout:1/179: write d4/d2b/d16/f22 [590944,126769] 0 2024-09-16T09:45:28.725 INFO:tasks.workunit.client.1.smithi114.stdout:2/187: mknod d1/c47 0 2024-09-16T09:45:28.726 INFO:tasks.workunit.client.1.smithi114.stdout:1/180: truncate d4/f26 529385 0 2024-09-16T09:45:28.727 INFO:tasks.workunit.client.1.smithi114.stdout:2/188: rmdir d1/d8 39 2024-09-16T09:45:28.728 INFO:tasks.workunit.client.1.smithi114.stdout:1/181: mknod d4/c35 0 2024-09-16T09:45:28.729 INFO:tasks.workunit.client.1.smithi114.stdout:2/189: rename d1/d8/d26/f2f to d1/d8/d26/d33/d3e/f48 0 2024-09-16T09:45:28.729 INFO:tasks.workunit.client.1.smithi114.stdout:2/190: readlink d1/d8/d26/l3d 0 2024-09-16T09:45:28.729 INFO:tasks.workunit.client.1.smithi114.stdout:8/232: dwrite d4/f40 [0,4194304] 0 2024-09-16T09:45:28.730 INFO:tasks.workunit.client.1.smithi114.stdout:1/182: mknod d4/d2b/d2f/c36 0 2024-09-16T09:45:28.730 INFO:tasks.workunit.client.1.smithi114.stdout:1/183: readlink d4/d2b/d29/l24 0 2024-09-16T09:45:28.730 INFO:tasks.workunit.client.1.smithi114.stdout:1/184: chown d4/ce 111 1 2024-09-16T09:45:28.733 INFO:tasks.workunit.client.1.smithi114.stdout:2/191: creat d1/d8/d10/f49 x:0 0 0 2024-09-16T09:45:28.735 INFO:tasks.workunit.client.1.smithi114.stdout:2/192: readlink d1/l1f 0 2024-09-16T09:45:28.735 INFO:tasks.workunit.client.1.smithi114.stdout:2/193: chown d1/d8/l19 0 1 2024-09-16T09:45:28.735 INFO:tasks.workunit.client.1.smithi114.stdout:2/194: fsync d1/d8/d10/f18 0 2024-09-16T09:45:28.735 INFO:tasks.workunit.client.1.smithi114.stdout:2/195: dread - d1/d8/d10/f49 zero size 2024-09-16T09:45:28.736 INFO:tasks.workunit.client.1.smithi114.stdout:2/196: dread - d1/f2c zero size 2024-09-16T09:45:28.738 INFO:tasks.workunit.client.1.smithi114.stdout:2/197: rmdir d1/d8/d10/d45 0 2024-09-16T09:45:28.740 INFO:tasks.workunit.client.1.smithi114.stdout:1/185: read d4/f25 [6008900,35783] 0 2024-09-16T09:45:28.741 INFO:tasks.workunit.client.1.smithi114.stdout:8/233: dread d4/f40 [0,4194304] 0 2024-09-16T09:45:28.742 INFO:tasks.workunit.client.1.smithi114.stdout:8/234: mkdir d4/db/d39/d3c/d4e 0 2024-09-16T09:45:28.748 INFO:tasks.workunit.client.1.smithi114.stdout:3/294: dwrite dc/d38/d56/d5c/d5d/f55 [0,4194304] 0 2024-09-16T09:45:28.749 INFO:tasks.workunit.client.1.smithi114.stdout:8/235: dread d4/db/df/f1e [0,4194304] 0 2024-09-16T09:45:28.749 INFO:tasks.workunit.client.1.smithi114.stdout:8/236: fsync d4/fa 0 2024-09-16T09:45:28.749 INFO:tasks.workunit.client.1.smithi114.stdout:4/140: dwrite d0/f21 [0,4194304] 0 2024-09-16T09:45:28.750 INFO:tasks.workunit.client.1.smithi114.stdout:6/162: dwrite d6/fc [0,4194304] 0 2024-09-16T09:45:28.750 INFO:tasks.workunit.client.1.smithi114.stdout:6/163: read d6/f1f [223223,89476] 0 2024-09-16T09:45:28.750 INFO:tasks.workunit.client.1.smithi114.stdout:3/295: creat dc/d38/d56/f64 x:0 0 0 2024-09-16T09:45:28.751 INFO:tasks.workunit.client.1.smithi114.stdout:3/296: truncate dc/de/d10/d26/f4d 294878 0 2024-09-16T09:45:28.751 INFO:tasks.workunit.client.1.smithi114.stdout:3/297: write dc/de/d18/f35 [483191,58062] 0 2024-09-16T09:45:28.751 INFO:tasks.workunit.client.1.smithi114.stdout:6/164: dread d6/f23 [4194304,4194304] 0 2024-09-16T09:45:28.757 INFO:tasks.workunit.client.1.smithi114.stdout:2/198: rename d1/d8/d26/d33 to d1/d8/d10/d16/d1d/d4a 0 2024-09-16T09:45:28.758 INFO:tasks.workunit.client.1.smithi114.stdout:4/141: dread d0/d9/f1d [0,4194304] 0 2024-09-16T09:45:28.758 INFO:tasks.workunit.client.1.smithi114.stdout:3/298: creat dc/f65 x:0 0 0 2024-09-16T09:45:28.758 INFO:tasks.workunit.client.1.smithi114.stdout:3/299: write dc/de/d18/f40 [1282430,25850] 0 2024-09-16T09:45:28.760 INFO:tasks.workunit.client.1.smithi114.stdout:6/165: rename d6/da/f14 to d6/da/d36/f3b 0 2024-09-16T09:45:28.762 INFO:tasks.workunit.client.1.smithi114.stdout:3/300: creat dc/d38/f66 x:0 0 0 2024-09-16T09:45:28.764 INFO:tasks.workunit.client.1.smithi114.stdout:2/199: getdents d1/d8/d10 0 2024-09-16T09:45:28.772 INFO:tasks.workunit.client.1.smithi114.stdout:7/226: sync 2024-09-16T09:45:28.774 INFO:tasks.workunit.client.1.smithi114.stdout:2/200: write d1/d8/d10/d16/d1d/d4a/d3e/f48 [162079,35211] 0 2024-09-16T09:45:28.775 INFO:tasks.workunit.client.1.smithi114.stdout:2/201: chown d1/d8/d10/c14 37 1 2024-09-16T09:45:28.775 INFO:tasks.workunit.client.1.smithi114.stdout:7/227: rename d2/df/c47 to d2/d9/d2b/d2e/c4b 0 2024-09-16T09:45:28.777 INFO:tasks.workunit.client.1.smithi114.stdout:2/202: mkdir d1/d8/d10/d16/d1d/d41/d4b 0 2024-09-16T09:45:28.777 INFO:tasks.workunit.client.1.smithi114.stdout:2/203: dread - d1/d8/d10/f49 zero size 2024-09-16T09:45:28.778 INFO:tasks.workunit.client.1.smithi114.stdout:7/228: mkdir d2/d9/d2b/d2e/d22/d4c 0 2024-09-16T09:45:28.779 INFO:tasks.workunit.client.1.smithi114.stdout:2/204: rename d1/d8/d26/c44 to d1/d8/d10/d16/d1d/d41/d4b/c4c 0 2024-09-16T09:45:28.780 INFO:tasks.workunit.client.1.smithi114.stdout:7/229: truncate d2/f5 4066764 0 2024-09-16T09:45:28.781 INFO:tasks.workunit.client.1.smithi114.stdout:2/205: rename d1/d8/d10/l28 to d1/d8/d10/d16/d1d/d41/l4d 0 2024-09-16T09:45:28.782 INFO:tasks.workunit.client.1.smithi114.stdout:7/230: mkdir d2/d9/d2b/d2e/d22/d27/d4d 0 2024-09-16T09:45:28.782 INFO:tasks.workunit.client.1.smithi114.stdout:2/206: symlink d1/d8/d10/d16/d1d/d4a/l4e 0 2024-09-16T09:45:28.782 INFO:tasks.workunit.client.1.smithi114.stdout:2/207: chown d1/d8/l17 94107195 1 2024-09-16T09:45:28.783 INFO:tasks.workunit.client.1.smithi114.stdout:7/231: rmdir d2/d9 39 2024-09-16T09:45:28.784 INFO:tasks.workunit.client.1.smithi114.stdout:2/208: rename d1/d8/d10/d16/d1d/d4a/l4e to d1/d8/d10/d16/l4f 0 2024-09-16T09:45:28.785 INFO:tasks.workunit.client.1.smithi114.stdout:4/142: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:45:28.786 INFO:tasks.workunit.client.1.smithi114.stdout:7/232: unlink d2/d9/d2b/l2d 0 2024-09-16T09:45:28.786 INFO:tasks.workunit.client.1.smithi114.stdout:7/233: chown d2/d9/d2b/d2e/c4b 33 1 2024-09-16T09:45:28.787 INFO:tasks.workunit.client.1.smithi114.stdout:2/209: creat d1/d8/d10/f50 x:0 0 0 2024-09-16T09:45:28.787 INFO:tasks.workunit.client.1.smithi114.stdout:3/301: dwrite dc/de/d10/f3c [0,4194304] 0 2024-09-16T09:45:28.787 INFO:tasks.workunit.client.1.smithi114.stdout:3/302: fsync dc/de/f34 0 2024-09-16T09:45:28.789 INFO:tasks.workunit.client.1.smithi114.stdout:4/143: rename d0/d9/c16 to d0/d26/c27 0 2024-09-16T09:45:28.789 INFO:tasks.workunit.client.1.smithi114.stdout:7/234: rename d2/d9/d2b/d2e to d2/d9/d2b/d2e/d22/d27/d4e 22 2024-09-16T09:45:28.789 INFO:tasks.workunit.client.1.smithi114.stdout:6/166: dwrite d6/fc [0,4194304] 0 2024-09-16T09:45:28.790 INFO:tasks.workunit.client.1.smithi114.stdout:2/210: creat d1/d8/d10/d16/f51 x:0 0 0 2024-09-16T09:45:28.791 INFO:tasks.workunit.client.1.smithi114.stdout:2/211: chown d1/d8/d10/f18 34233 1 2024-09-16T09:45:28.791 INFO:tasks.workunit.client.1.smithi114.stdout:2/212: dread - d1/d8/d10/f25 zero size 2024-09-16T09:45:28.792 INFO:tasks.workunit.client.1.smithi114.stdout:3/303: dread dc/de/d18/f30 [0,4194304] 0 2024-09-16T09:45:28.792 INFO:tasks.workunit.client.1.smithi114.stdout:4/144: symlink d0/l28 0 2024-09-16T09:45:28.792 INFO:tasks.workunit.client.1.smithi114.stdout:3/304: stat dc/de/d17 0 2024-09-16T09:45:28.793 INFO:tasks.workunit.client.1.smithi114.stdout:7/235: symlink d2/d9/d2b/l4f 0 2024-09-16T09:45:28.793 INFO:tasks.workunit.client.1.smithi114.stdout:6/167: getdents d6/da 0 2024-09-16T09:45:28.794 INFO:tasks.workunit.client.1.smithi114.stdout:3/305: creat dc/de/d37/d4e/f67 x:0 0 0 2024-09-16T09:45:28.794 INFO:tasks.workunit.client.1.smithi114.stdout:7/236: dread d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:28.795 INFO:tasks.workunit.client.1.smithi114.stdout:3/306: mknod dc/d38/d56/d5c/c68 0 2024-09-16T09:45:28.796 INFO:tasks.workunit.client.1.smithi114.stdout:3/307: symlink dc/l69 0 2024-09-16T09:45:28.796 INFO:tasks.workunit.client.1.smithi114.stdout:3/308: write dc/d38/f66 [368252,9477] 0 2024-09-16T09:45:28.797 INFO:tasks.workunit.client.1.smithi114.stdout:6/168: dread d6/da/f15 [0,4194304] 0 2024-09-16T09:45:28.797 INFO:tasks.workunit.client.1.smithi114.stdout:3/309: mkdir dc/de/d10/d6a 0 2024-09-16T09:45:28.798 INFO:tasks.workunit.client.1.smithi114.stdout:6/169: rename d6/da/f28 to d6/d2d/f3c 0 2024-09-16T09:45:28.798 INFO:tasks.workunit.client.1.smithi114.stdout:6/170: truncate d6/da/d36/f38 612108 0 2024-09-16T09:45:28.800 INFO:tasks.workunit.client.1.smithi114.stdout:3/310: mknod dc/d38/d56/d5c/c6b 0 2024-09-16T09:45:28.801 INFO:tasks.workunit.client.1.smithi114.stdout:2/213: dread d1/d8/d10/d16/f27 [0,4194304] 0 2024-09-16T09:45:28.801 INFO:tasks.workunit.client.1.smithi114.stdout:6/171: creat d6/da/d36/f3d x:0 0 0 2024-09-16T09:45:28.803 INFO:tasks.workunit.client.1.smithi114.stdout:3/311: rmdir dc/d38/d56 39 2024-09-16T09:45:28.803 INFO:tasks.workunit.client.1.smithi114.stdout:3/312: read - dc/d38/d3f/f5f zero size 2024-09-16T09:45:28.805 INFO:tasks.workunit.client.1.smithi114.stdout:2/214: creat d1/d8/d26/f52 x:0 0 0 2024-09-16T09:45:28.806 INFO:tasks.workunit.client.1.smithi114.stdout:2/215: symlink d1/d8/d10/l53 0 2024-09-16T09:45:28.806 INFO:tasks.workunit.client.1.smithi114.stdout:2/216: readlink d1/l37 0 2024-09-16T09:45:28.816 INFO:tasks.workunit.client.1.smithi114.stdout:7/237: dwrite d2/d9/d2b/d2e/d22/d27/f1e [0,4194304] 0 2024-09-16T09:45:28.818 INFO:tasks.workunit.client.1.smithi114.stdout:7/238: unlink d2/d9/d2b/d2e/d22/d27/c39 0 2024-09-16T09:45:28.820 INFO:tasks.workunit.client.1.smithi114.stdout:7/239: mkdir d2/d9/d2b/d2e/d22/d27/d50 0 2024-09-16T09:45:28.820 INFO:tasks.workunit.client.1.smithi114.stdout:7/240: stat d2/d9/d2b/l43 0 2024-09-16T09:45:28.821 INFO:tasks.workunit.client.1.smithi114.stdout:2/217: read d1/d8/d10/f35 [4185936,57193] 0 2024-09-16T09:45:28.821 INFO:tasks.workunit.client.1.smithi114.stdout:7/241: unlink d2/f3b 0 2024-09-16T09:45:28.821 INFO:tasks.workunit.client.1.smithi114.stdout:7/242: dread - d2/d9/d2b/d2e/d22/f49 zero size 2024-09-16T09:45:28.821 INFO:tasks.workunit.client.1.smithi114.stdout:7/243: readlink d2/d9/d2b/l43 0 2024-09-16T09:45:28.821 INFO:tasks.workunit.client.1.smithi114.stdout:7/244: mkdir d2/d9/d51 0 2024-09-16T09:45:28.823 INFO:tasks.workunit.client.1.smithi114.stdout:6/172: dwrite d6/da/f15 [0,4194304] 0 2024-09-16T09:45:28.824 INFO:tasks.workunit.client.1.smithi114.stdout:4/145: dwrite d0/d9/fd [0,4194304] 0 2024-09-16T09:45:28.834 INFO:tasks.workunit.client.1.smithi114.stdout:2/218: write d1/d8/d10/d16/d1d/f34 [1153692,77839] 0 2024-09-16T09:45:28.836 INFO:tasks.workunit.client.1.smithi114.stdout:6/173: dread d6/da/f15 [0,4194304] 0 2024-09-16T09:45:28.836 INFO:tasks.workunit.client.1.smithi114.stdout:6/174: write d6/da/f2c [387294,89120] 0 2024-09-16T09:45:28.839 INFO:tasks.workunit.client.1.smithi114.stdout:6/175: creat d6/da/f3e x:0 0 0 2024-09-16T09:45:28.841 INFO:tasks.workunit.client.1.smithi114.stdout:6/176: creat d6/da/d36/f3f x:0 0 0 2024-09-16T09:45:28.843 INFO:tasks.workunit.client.1.smithi114.stdout:6/177: mkdir d6/da/d10/d40 0 2024-09-16T09:45:28.844 INFO:tasks.workunit.client.1.smithi114.stdout:4/146: dwrite d0/f1f [0,4194304] 0 2024-09-16T09:45:28.844 INFO:tasks.workunit.client.1.smithi114.stdout:6/178: rmdir d6/da/d36 39 2024-09-16T09:45:28.849 INFO:tasks.workunit.client.1.smithi114.stdout:4/147: rename d0/d9 to d0/d26/d29 0 2024-09-16T09:45:28.850 INFO:tasks.workunit.client.1.smithi114.stdout:6/179: getdents d6 0 2024-09-16T09:45:28.850 INFO:tasks.workunit.client.1.smithi114.stdout:6/180: getdents d6 0 2024-09-16T09:45:28.850 INFO:tasks.workunit.client.1.smithi114.stdout:6/181: fsync d6/da/d36/f3d 0 2024-09-16T09:45:28.851 INFO:tasks.workunit.client.1.smithi114.stdout:3/313: dwrite dc/d38/f66 [0,4194304] 0 2024-09-16T09:45:28.851 INFO:tasks.workunit.client.1.smithi114.stdout:6/182: symlink d6/da/d36/l41 0 2024-09-16T09:45:28.851 INFO:tasks.workunit.client.1.smithi114.stdout:6/183: stat d6/f1f 0 2024-09-16T09:45:28.851 INFO:tasks.workunit.client.1.smithi114.stdout:6/184: write d6/da/d36/f3d [1043733,66096] 0 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:8/237: sync 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:5/224: sync 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:9/173: sync 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:1/186: sync 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:0/165: sync 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:8/238: chown d4/db 334932853 1 2024-09-16T09:45:28.852 INFO:tasks.workunit.client.1.smithi114.stdout:9/174: dread - d3/da/d10/f26 zero size 2024-09-16T09:45:28.853 INFO:tasks.workunit.client.1.smithi114.stdout:8/239: read - d4/db/df/f3d zero size 2024-09-16T09:45:28.855 INFO:tasks.workunit.client.1.smithi114.stdout:0/166: symlink d1f/d22/l41 0 2024-09-16T09:45:28.856 INFO:tasks.workunit.client.1.smithi114.stdout:1/187: creat d4/d2b/f37 x:0 0 0 2024-09-16T09:45:28.858 INFO:tasks.workunit.client.1.smithi114.stdout:8/240: creat d4/db/d3e/f4f x:0 0 0 2024-09-16T09:45:28.859 INFO:tasks.workunit.client.1.smithi114.stdout:1/188: creat d4/f38 x:0 0 0 2024-09-16T09:45:28.859 INFO:tasks.workunit.client.1.smithi114.stdout:2/219: dwrite d1/f2c [0,4194304] 0 2024-09-16T09:45:28.860 INFO:tasks.workunit.client.1.smithi114.stdout:8/241: unlink d4/db/d3e/c43 0 2024-09-16T09:45:28.860 INFO:tasks.workunit.client.1.smithi114.stdout:8/242: readlink d4/db/d3e/l45 0 2024-09-16T09:45:28.861 INFO:tasks.workunit.client.1.smithi114.stdout:4/148: dread d0/d13/f22 [0,4194304] 0 2024-09-16T09:45:28.861 INFO:tasks.workunit.client.1.smithi114.stdout:1/189: rename d4/cc to d4/d2b/d29/c39 0 2024-09-16T09:45:28.861 INFO:tasks.workunit.client.1.smithi114.stdout:1/190: fdatasync d4/d2b/d29/f32 0 2024-09-16T09:45:28.862 INFO:tasks.workunit.client.1.smithi114.stdout:2/220: symlink d1/d8/d10/d16/d1d/d41/d4b/l54 0 2024-09-16T09:45:28.863 INFO:tasks.workunit.client.1.smithi114.stdout:8/243: symlink d4/db/df/l50 0 2024-09-16T09:45:28.863 INFO:tasks.workunit.client.1.smithi114.stdout:1/191: mkdir d4/d2b/d2f/d3a 0 2024-09-16T09:45:28.864 INFO:tasks.workunit.client.1.smithi114.stdout:2/221: unlink d1/d8/d10/d16/c39 0 2024-09-16T09:45:28.865 INFO:tasks.workunit.client.1.smithi114.stdout:8/244: rmdir d4 39 2024-09-16T09:45:28.865 INFO:tasks.workunit.client.1.smithi114.stdout:1/192: symlink d4/d2b/d29/l3b 0 2024-09-16T09:45:28.866 INFO:tasks.workunit.client.1.smithi114.stdout:5/225: dread d3/f20 [4194304,4194304] 0 2024-09-16T09:45:28.866 INFO:tasks.workunit.client.1.smithi114.stdout:5/226: readlink d3/d24/l33 0 2024-09-16T09:45:28.869 INFO:tasks.workunit.client.1.smithi114.stdout:5/227: link d3/le d3/df/d2d/d34/l44 0 2024-09-16T09:45:28.871 INFO:tasks.workunit.client.1.smithi114.stdout:9/175: write d3/da/fd [3303080,117014] 0 2024-09-16T09:45:28.871 INFO:tasks.workunit.client.1.smithi114.stdout:5/228: symlink d3/df/d2d/d3f/l45 0 2024-09-16T09:45:28.874 INFO:tasks.workunit.client.1.smithi114.stdout:5/229: symlink d3/d11/d37/l46 0 2024-09-16T09:45:28.880 INFO:tasks.workunit.client.1.smithi114.stdout:5/230: dread d3/f4 [0,4194304] 0 2024-09-16T09:45:28.881 INFO:tasks.workunit.client.1.smithi114.stdout:5/231: truncate d3/f8 2674750 0 2024-09-16T09:45:28.884 INFO:tasks.workunit.client.1.smithi114.stdout:9/176: write d3/d13/f16 [2902304,76014] 0 2024-09-16T09:45:28.886 INFO:tasks.workunit.client.1.smithi114.stdout:9/177: creat d3/da/f3a x:0 0 0 2024-09-16T09:45:28.887 INFO:tasks.workunit.client.1.smithi114.stdout:9/178: mknod d3/c3b 0 2024-09-16T09:45:28.887 INFO:tasks.workunit.client.1.smithi114.stdout:9/179: fsync d3/da/d10/d23/d29/d2c/f35 0 2024-09-16T09:45:28.892 INFO:tasks.workunit.client.1.smithi114.stdout:5/232: dread d3/f22 [0,4194304] 0 2024-09-16T09:45:28.894 INFO:tasks.workunit.client.1.smithi114.stdout:5/233: rename d3/f22 to d3/d11/d37/d43/f47 0 2024-09-16T09:45:28.903 INFO:tasks.workunit.client.1.smithi114.stdout:0/167: dwrite f3 [0,4194304] 0 2024-09-16T09:45:28.904 INFO:tasks.workunit.client.1.smithi114.stdout:5/234: dread d3/df/f19 [0,4194304] 0 2024-09-16T09:45:28.914 INFO:tasks.workunit.client.1.smithi114.stdout:4/149: dwrite d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:28.914 INFO:tasks.workunit.client.1.smithi114.stdout:8/245: dwrite d4/fa [0,4194304] 0 2024-09-16T09:45:28.923 INFO:tasks.workunit.client.1.smithi114.stdout:1/193: dwrite d4/d2b/d16/f1b [0,4194304] 0 2024-09-16T09:45:28.923 INFO:tasks.workunit.client.1.smithi114.stdout:9/180: dwrite d3/d13/f28 [0,4194304] 0 2024-09-16T09:45:28.924 INFO:tasks.workunit.client.1.smithi114.stdout:5/235: dwrite d3/d11/f2a [4194304,4194304] 0 2024-09-16T09:45:28.925 INFO:tasks.workunit.client.1.smithi114.stdout:2/222: dwrite d1/d8/d10/f35 [0,4194304] 0 2024-09-16T09:45:28.925 INFO:tasks.workunit.client.1.smithi114.stdout:4/150: write d0/d26/d29/fd [1808584,32657] 0 2024-09-16T09:45:28.926 INFO:tasks.workunit.client.1.smithi114.stdout:8/246: write d4/db/dd/f16 [6016987,33094] 0 2024-09-16T09:45:28.927 INFO:tasks.workunit.client.1.smithi114.stdout:1/194: creat d4/d2b/f3c x:0 0 0 2024-09-16T09:45:28.927 INFO:tasks.workunit.client.1.smithi114.stdout:1/195: chown d4/d2b/d29/c2e 60223 1 2024-09-16T09:45:28.928 INFO:tasks.workunit.client.1.smithi114.stdout:5/236: rename d3/df/f19 to d3/d11/d37/d43/f48 0 2024-09-16T09:45:28.928 INFO:tasks.workunit.client.1.smithi114.stdout:5/237: getdents d3/df/d2d/d3f/d41 0 2024-09-16T09:45:28.931 INFO:tasks.workunit.client.1.smithi114.stdout:4/151: symlink d0/d13/l2a 0 2024-09-16T09:45:28.934 INFO:tasks.workunit.client.1.smithi114.stdout:8/247: creat d4/db/dd/d1b/d28/f51 x:0 0 0 2024-09-16T09:45:28.935 INFO:tasks.workunit.client.1.smithi114.stdout:8/248: write d4/db/dd/f13 [1006557,49950] 0 2024-09-16T09:45:28.936 INFO:tasks.workunit.client.1.smithi114.stdout:9/181: read d3/d13/f18 [3841116,47838] 0 2024-09-16T09:45:28.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/196: mkdir d4/d3d 0 2024-09-16T09:45:28.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/197: dread - d4/d2b/f37 zero size 2024-09-16T09:45:28.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/198: write d4/d2b/f27 [1002861,39785] 0 2024-09-16T09:45:28.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/199: chown d4/l15 43863602 1 2024-09-16T09:45:28.942 INFO:tasks.workunit.client.1.smithi114.stdout:2/223: symlink d1/l55 0 2024-09-16T09:45:28.944 INFO:tasks.workunit.client.1.smithi114.stdout:8/249: truncate d4/d1f/f35 32243 0 2024-09-16T09:45:28.945 INFO:tasks.workunit.client.1.smithi114.stdout:1/200: rmdir d4/d2b 39 2024-09-16T09:45:28.947 INFO:tasks.workunit.client.1.smithi114.stdout:5/238: dwrite f0 [0,4194304] 0 2024-09-16T09:45:28.947 INFO:tasks.workunit.client.1.smithi114.stdout:2/224: creat d1/d8/d26/f56 x:0 0 0 2024-09-16T09:45:28.947 INFO:tasks.workunit.client.1.smithi114.stdout:2/225: chown d1/d8/d10/d16/d1d/f1e 10 1 2024-09-16T09:45:28.949 INFO:tasks.workunit.client.1.smithi114.stdout:1/201: mknod d4/d2b/d2f/c3e 0 2024-09-16T09:45:28.955 INFO:tasks.workunit.client.1.smithi114.stdout:9/182: dwrite d3/d13/f2f [0,4194304] 0 2024-09-16T09:45:28.960 INFO:tasks.workunit.client.1.smithi114.stdout:9/183: mknod d3/da/d10/d23/d29/d2c/c3c 0 2024-09-16T09:45:28.962 INFO:tasks.workunit.client.1.smithi114.stdout:9/184: mknod d3/da/d10/d23/d38/c3d 0 2024-09-16T09:45:28.964 INFO:tasks.workunit.client.1.smithi114.stdout:5/239: truncate d3/f20 5547395 0 2024-09-16T09:45:28.965 INFO:tasks.workunit.client.1.smithi114.stdout:5/240: creat d3/df/d2d/d3f/f49 x:0 0 0 2024-09-16T09:45:28.971 INFO:tasks.workunit.client.1.smithi114.stdout:7/245: sync 2024-09-16T09:45:28.974 INFO:tasks.workunit.client.1.smithi114.stdout:5/241: dread d3/df/f10 [0,4194304] 0 2024-09-16T09:45:28.974 INFO:tasks.workunit.client.1.smithi114.stdout:5/242: write d3/d1f/f1c [3721954,63181] 0 2024-09-16T09:45:28.976 INFO:tasks.workunit.client.1.smithi114.stdout:5/243: link d3/d24/f2e d3/df/d2d/d3f/f4a 0 2024-09-16T09:45:28.976 INFO:tasks.workunit.client.1.smithi114.stdout:5/244: dread - d3/df/d2d/d3f/f49 zero size 2024-09-16T09:45:28.976 INFO:tasks.workunit.client.1.smithi114.stdout:5/245: mknod d3/df/d2d/d3f/c4b 0 2024-09-16T09:45:28.979 INFO:tasks.workunit.client.1.smithi114.stdout:2/226: dwrite d1/d8/d10/f35 [0,4194304] 0 2024-09-16T09:45:28.981 INFO:tasks.workunit.client.1.smithi114.stdout:5/246: write d3/d11/d37/d43/f48 [3024643,55959] 0 2024-09-16T09:45:28.982 INFO:tasks.workunit.client.1.smithi114.stdout:5/247: write d3/d24/f2e [286597,50140] 0 2024-09-16T09:45:28.982 INFO:tasks.workunit.client.1.smithi114.stdout:5/248: write d3/d1f/f16 [1785456,30934] 0 2024-09-16T09:45:28.983 INFO:tasks.workunit.client.1.smithi114.stdout:5/249: mkdir d3/d11/d37/d43/d4c 0 2024-09-16T09:45:28.983 INFO:tasks.workunit.client.1.smithi114.stdout:5/250: mknod d3/d11/d37/c4d 0 2024-09-16T09:45:28.984 INFO:tasks.workunit.client.1.smithi114.stdout:5/251: mknod d3/df/d2d/d34/c4e 0 2024-09-16T09:45:28.984 INFO:tasks.workunit.client.1.smithi114.stdout:5/252: chown d3/d11/d37/d43/f47 529100 1 2024-09-16T09:45:28.986 INFO:tasks.workunit.client.1.smithi114.stdout:5/253: dread d3/d11/f1a [0,4194304] 0 2024-09-16T09:45:28.988 INFO:tasks.workunit.client.1.smithi114.stdout:5/254: rename d3/df/d2d/d3f/f49 to d3/d11/f4f 0 2024-09-16T09:45:28.988 INFO:tasks.workunit.client.1.smithi114.stdout:5/255: readlink d3/d11/l21 0 2024-09-16T09:45:28.988 INFO:tasks.workunit.client.1.smithi114.stdout:5/256: truncate d3/f4 4522323 0 2024-09-16T09:45:28.988 INFO:tasks.workunit.client.1.smithi114.stdout:5/257: write d3/f25 [66133,18181] 0 2024-09-16T09:45:28.989 INFO:tasks.workunit.client.1.smithi114.stdout:1/202: dwrite d4/d2b/d29/f34 [0,4194304] 0 2024-09-16T09:45:28.991 INFO:tasks.workunit.client.1.smithi114.stdout:8/250: dwrite d4/db/dd/d1b/d30/f41 [0,4194304] 0 2024-09-16T09:45:28.992 INFO:tasks.workunit.client.1.smithi114.stdout:9/185: dwrite d3/da/d10/d23/d29/f39 [0,4194304] 0 2024-09-16T09:45:28.994 INFO:tasks.workunit.client.1.smithi114.stdout:8/251: rmdir d4/db/df 39 2024-09-16T09:45:28.995 INFO:tasks.workunit.client.1.smithi114.stdout:2/227: write d1/d8/f12 [7025407,25682] 0 2024-09-16T09:45:28.999 INFO:tasks.workunit.client.1.smithi114.stdout:8/252: mkdir d4/db/dd/d1b/d52 0 2024-09-16T09:45:28.999 INFO:tasks.workunit.client.1.smithi114.stdout:1/203: write d4/d2b/d16/f1b [3669659,69800] 0 2024-09-16T09:45:29.001 INFO:tasks.workunit.client.1.smithi114.stdout:5/258: truncate d3/d11/d37/d43/f48 14905 0 2024-09-16T09:45:29.005 INFO:tasks.workunit.client.1.smithi114.stdout:1/204: rename d4/c35 to d4/c3f 0 2024-09-16T09:45:29.005 INFO:tasks.workunit.client.1.smithi114.stdout:1/205: chown d4/c3f 1 1 2024-09-16T09:45:29.005 INFO:tasks.workunit.client.1.smithi114.stdout:1/206: write d4/f23 [235730,24843] 0 2024-09-16T09:45:29.005 INFO:tasks.workunit.client.1.smithi114.stdout:1/207: getdents d4/d3d 0 2024-09-16T09:45:29.008 INFO:tasks.workunit.client.1.smithi114.stdout:5/259: mkdir d3/df/d2d/d3f/d41/d50 0 2024-09-16T09:45:29.008 INFO:tasks.workunit.client.1.smithi114.stdout:2/228: dread d1/d8/d10/d16/d1d/f34 [0,4194304] 0 2024-09-16T09:45:29.008 INFO:tasks.workunit.client.1.smithi114.stdout:1/208: getdents d4/d2b/d2f 0 2024-09-16T09:45:29.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/260: creat d3/d11/d37/d43/f51 x:0 0 0 2024-09-16T09:45:29.010 INFO:tasks.workunit.client.1.smithi114.stdout:1/209: truncate d4/f25 2057316 0 2024-09-16T09:45:29.011 INFO:tasks.workunit.client.1.smithi114.stdout:2/229: link d1/d8/d10/d16/d1d/c3c d1/d8/d10/c57 0 2024-09-16T09:45:29.012 INFO:tasks.workunit.client.1.smithi114.stdout:5/261: rename d3/df/d2d/d3f/d41/d50 to d3/df/d52 0 2024-09-16T09:45:29.013 INFO:tasks.workunit.client.1.smithi114.stdout:2/230: mknod d1/d8/d26/c58 0 2024-09-16T09:45:29.013 INFO:tasks.workunit.client.1.smithi114.stdout:2/231: dread - d1/d8/d10/d16/d1d/f1e zero size 2024-09-16T09:45:29.015 INFO:tasks.workunit.client.1.smithi114.stdout:5/262: unlink d3/d24/f28 0 2024-09-16T09:45:29.015 INFO:tasks.workunit.client.1.smithi114.stdout:5/263: chown d3/d11 217798048 1 2024-09-16T09:45:29.015 INFO:tasks.workunit.client.1.smithi114.stdout:5/264: stat d3/d11/d37/c38 0 2024-09-16T09:45:29.015 INFO:tasks.workunit.client.1.smithi114.stdout:2/232: creat d1/d8/d10/d16/d1d/d4a/d3e/f59 x:0 0 0 2024-09-16T09:45:29.017 INFO:tasks.workunit.client.1.smithi114.stdout:5/265: link d3/d11/d37/d43/f48 d3/d11/d37/f53 0 2024-09-16T09:45:29.017 INFO:tasks.workunit.client.1.smithi114.stdout:5/266: chown d3/l3a 205 1 2024-09-16T09:45:29.017 INFO:tasks.workunit.client.1.smithi114.stdout:2/233: chown d1/l2b 2657958 1 2024-09-16T09:45:29.018 INFO:tasks.workunit.client.1.smithi114.stdout:1/210: dread d4/f23 [0,4194304] 0 2024-09-16T09:45:29.018 INFO:tasks.workunit.client.1.smithi114.stdout:2/234: rmdir d1/d8/d10/d16/d1d/d41 39 2024-09-16T09:45:29.018 INFO:tasks.workunit.client.1.smithi114.stdout:2/235: stat d1/d8/d10/d16/f51 0 2024-09-16T09:45:29.019 INFO:tasks.workunit.client.1.smithi114.stdout:1/211: creat d4/d2b/d2f/d3a/f40 x:0 0 0 2024-09-16T09:45:29.020 INFO:tasks.workunit.client.1.smithi114.stdout:1/212: getdents d4 0 2024-09-16T09:45:29.021 INFO:tasks.workunit.client.1.smithi114.stdout:1/213: mkdir d4/d3d/d41 0 2024-09-16T09:45:29.022 INFO:tasks.workunit.client.1.smithi114.stdout:9/186: dwrite d3/da/d10/f21 [0,4194304] 0 2024-09-16T09:45:29.026 INFO:tasks.workunit.client.1.smithi114.stdout:9/187: creat d3/da/d10/d23/d38/f3e x:0 0 0 2024-09-16T09:45:29.029 INFO:tasks.workunit.client.1.smithi114.stdout:9/188: dread d3/da/d10/d23/d29/d2c/f35 [0,4194304] 0 2024-09-16T09:45:29.029 INFO:tasks.workunit.client.1.smithi114.stdout:9/189: readlink d3/l12 0 2024-09-16T09:45:29.031 INFO:tasks.workunit.client.1.smithi114.stdout:9/190: mkdir d3/da/d10/d23/d29/d3f 0 2024-09-16T09:45:29.031 INFO:tasks.workunit.client.1.smithi114.stdout:9/191: fsync d3/da/f3a 0 2024-09-16T09:45:29.036 INFO:tasks.workunit.client.1.smithi114.stdout:9/192: rename d3/da/c30 to d3/c40 0 2024-09-16T09:45:29.036 INFO:tasks.workunit.client.1.smithi114.stdout:2/236: dwrite d1/d8/d10/d16/f30 [0,4194304] 0 2024-09-16T09:45:29.036 INFO:tasks.workunit.client.1.smithi114.stdout:2/237: write d1/d8/d10/d16/f51 [920897,66641] 0 2024-09-16T09:45:29.042 INFO:tasks.workunit.client.1.smithi114.stdout:2/238: rmdir d1/d8/d10/d16/d1d 39 2024-09-16T09:45:29.043 INFO:tasks.workunit.client.1.smithi114.stdout:2/239: mkdir d1/d8/d10/d5a 0 2024-09-16T09:45:29.043 INFO:tasks.workunit.client.1.smithi114.stdout:2/240: truncate d1/d8/f2e 424804 0 2024-09-16T09:45:29.044 INFO:tasks.workunit.client.1.smithi114.stdout:2/241: dread d1/d8/d26/f40 [0,4194304] 0 2024-09-16T09:45:29.044 INFO:tasks.workunit.client.1.smithi114.stdout:2/242: readlink d1/d8/d10/l11 0 2024-09-16T09:45:29.044 INFO:tasks.workunit.client.1.smithi114.stdout:2/243: write d1/d8/d10/d16/d1d/d4a/d3e/f59 [893960,81922] 0 2024-09-16T09:45:29.045 INFO:tasks.workunit.client.1.smithi114.stdout:2/244: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b 0 2024-09-16T09:45:29.045 INFO:tasks.workunit.client.1.smithi114.stdout:2/245: dread - d1/d8/d10/f49 zero size 2024-09-16T09:45:29.045 INFO:tasks.workunit.client.1.smithi114.stdout:2/246: truncate d1/d8/d10/d16/d1d/f1e 387007 0 2024-09-16T09:45:29.045 INFO:tasks.workunit.client.1.smithi114.stdout:2/247: creat d1/d8/d10/d16/d1d/f5c x:0 0 0 2024-09-16T09:45:29.047 INFO:tasks.workunit.client.1.smithi114.stdout:2/248: rename d1/l55 to d1/d8/d10/d16/d1d/d41/l5d 0 2024-09-16T09:45:29.047 INFO:tasks.workunit.client.1.smithi114.stdout:2/249: write d1/d8/d10/d16/d1d/d4a/d3e/f59 [1346555,68675] 0 2024-09-16T09:45:29.057 INFO:tasks.workunit.client.1.smithi114.stdout:5/267: dwrite d3/d1f/f16 [0,4194304] 0 2024-09-16T09:45:29.058 INFO:tasks.workunit.client.1.smithi114.stdout:5/268: fdatasync d3/d11/d37/f53 0 2024-09-16T09:45:29.058 INFO:tasks.workunit.client.1.smithi114.stdout:5/269: write d3/d11/f4f [228210,98970] 0 2024-09-16T09:45:29.058 INFO:tasks.workunit.client.1.smithi114.stdout:1/214: dwrite d4/d2b/f9 [4194304,4194304] 0 2024-09-16T09:45:29.058 INFO:tasks.workunit.client.1.smithi114.stdout:1/215: readlink d4/d2b/d29/l3b 0 2024-09-16T09:45:29.059 INFO:tasks.workunit.client.1.smithi114.stdout:1/216: chown d4/d2b/f1e 15071811 1 2024-09-16T09:45:29.059 INFO:tasks.workunit.client.1.smithi114.stdout:9/193: dwrite d3/da/f11 [4194304,4194304] 0 2024-09-16T09:45:29.059 INFO:tasks.workunit.client.1.smithi114.stdout:9/194: dread - d3/da/d10/d23/f36 zero size 2024-09-16T09:45:29.059 INFO:tasks.workunit.client.1.smithi114.stdout:5/270: rmdir d3/df/d39 0 2024-09-16T09:45:29.064 INFO:tasks.workunit.client.1.smithi114.stdout:1/217: mkdir d4/d3d/d41/d42 0 2024-09-16T09:45:29.064 INFO:tasks.workunit.client.1.smithi114.stdout:1/218: write d4/f25 [726298,71945] 0 2024-09-16T09:45:29.066 INFO:tasks.workunit.client.1.smithi114.stdout:9/195: mkdir d3/d13/d1e/d25/d41 0 2024-09-16T09:45:29.066 INFO:tasks.workunit.client.1.smithi114.stdout:9/196: chown d3/d13/c14 1929 1 2024-09-16T09:45:29.067 INFO:tasks.workunit.client.1.smithi114.stdout:1/219: rename d4/c5 to d4/d3d/d41/d42/c43 0 2024-09-16T09:45:29.069 INFO:tasks.workunit.client.1.smithi114.stdout:9/197: rename d3/d13/d1e/d25/d41 to d3/da/d10/d23/d42 0 2024-09-16T09:45:29.069 INFO:tasks.workunit.client.1.smithi114.stdout:1/220: creat d4/d2b/d2f/d3a/f44 x:0 0 0 2024-09-16T09:45:29.070 INFO:tasks.workunit.client.1.smithi114.stdout:9/198: getdents d3/da/d10/d23/d38 0 2024-09-16T09:45:29.072 INFO:tasks.workunit.client.1.smithi114.stdout:1/221: mknod d4/d3d/c45 0 2024-09-16T09:45:29.072 INFO:tasks.workunit.client.1.smithi114.stdout:1/222: read - d4/d2b/d29/f32 zero size 2024-09-16T09:45:29.072 INFO:tasks.workunit.client.1.smithi114.stdout:1/223: symlink d4/d2b/d29/l46 0 2024-09-16T09:45:29.073 INFO:tasks.workunit.client.1.smithi114.stdout:1/224: mkdir d4/d2b/d16/d47 0 2024-09-16T09:45:29.073 INFO:tasks.workunit.client.1.smithi114.stdout:1/225: truncate d4/d2b/d16/f22 1355817 0 2024-09-16T09:45:29.073 INFO:tasks.workunit.client.1.smithi114.stdout:1/226: readlink d4/d2b/d29/l46 0 2024-09-16T09:45:29.075 INFO:tasks.workunit.client.1.smithi114.stdout:1/227: unlink d4/f23 0 2024-09-16T09:45:29.076 INFO:tasks.workunit.client.1.smithi114.stdout:1/228: rename d4/d2b/d29/f34 to d4/d2b/d16/d47/f48 0 2024-09-16T09:45:29.076 INFO:tasks.workunit.client.1.smithi114.stdout:3/314: sync 2024-09-16T09:45:29.079 INFO:tasks.workunit.client.1.smithi114.stdout:6/185: sync 2024-09-16T09:45:29.079 INFO:tasks.workunit.client.1.smithi114.stdout:6/186: fsync d6/da/f15 0 2024-09-16T09:45:29.079 INFO:tasks.workunit.client.1.smithi114.stdout:5/271: dwrite d3/df/d2d/d3f/f4a [0,4194304] 0 2024-09-16T09:45:29.080 INFO:tasks.workunit.client.1.smithi114.stdout:6/187: mknod d6/da/d10/c42 0 2024-09-16T09:45:29.080 INFO:tasks.workunit.client.1.smithi114.stdout:6/188: getdents d6 0 2024-09-16T09:45:29.080 INFO:tasks.workunit.client.1.smithi114.stdout:3/315: dread dc/de/d10/d26/f4d [0,4194304] 0 2024-09-16T09:45:29.081 INFO:tasks.workunit.client.1.smithi114.stdout:6/189: fdatasync d6/f23 0 2024-09-16T09:45:29.084 INFO:tasks.workunit.client.1.smithi114.stdout:9/199: write d3/d13/f28 [1726968,19045] 0 2024-09-16T09:45:29.089 INFO:tasks.workunit.client.1.smithi114.stdout:5/272: dread d3/df/f10 [0,4194304] 0 2024-09-16T09:45:29.097 INFO:tasks.workunit.client.1.smithi114.stdout:5/273: write d3/d11/d37/d43/f47 [1295632,27155] 0 2024-09-16T09:45:29.109 INFO:tasks.workunit.client.1.smithi114.stdout:9/200: dread d3/d13/f28 [0,4194304] 0 2024-09-16T09:45:29.113 INFO:tasks.workunit.client.1.smithi114.stdout:1/229: dwrite d4/d2b/d16/f1b [0,4194304] 0 2024-09-16T09:45:29.113 INFO:tasks.workunit.client.1.smithi114.stdout:1/230: chown d4/d3d/d41 235172469 1 2024-09-16T09:45:29.115 INFO:tasks.workunit.client.1.smithi114.stdout:3/316: dwrite dc/de/d18/f22 [0,4194304] 0 2024-09-16T09:45:29.115 INFO:tasks.workunit.client.1.smithi114.stdout:6/190: dwrite d6/f1f [0,4194304] 0 2024-09-16T09:45:29.115 INFO:tasks.workunit.client.1.smithi114.stdout:6/191: chown d6/da/c26 833470 1 2024-09-16T09:45:29.119 INFO:tasks.workunit.client.1.smithi114.stdout:6/192: rename d6/da/d10/f13 to d6/da/d10/d40/f43 0 2024-09-16T09:45:29.119 INFO:tasks.workunit.client.1.smithi114.stdout:6/193: truncate d6/da/d10/f39 149117 0 2024-09-16T09:45:29.119 INFO:tasks.workunit.client.1.smithi114.stdout:6/194: truncate d6/da/d36/f3f 262946 0 2024-09-16T09:45:29.123 INFO:tasks.workunit.client.1.smithi114.stdout:5/274: dwrite d3/d11/d37/f53 [0,4194304] 0 2024-09-16T09:45:29.124 INFO:tasks.workunit.client.1.smithi114.stdout:6/195: dread d6/da/d10/f25 [0,4194304] 0 2024-09-16T09:45:29.125 INFO:tasks.workunit.client.1.smithi114.stdout:6/196: getdents d6 0 2024-09-16T09:45:29.136 INFO:tasks.workunit.client.1.smithi114.stdout:5/275: write d3/d1f/f16 [1776108,12422] 0 2024-09-16T09:45:29.138 INFO:tasks.workunit.client.1.smithi114.stdout:3/317: dwrite dc/de/d10/f3c [0,4194304] 0 2024-09-16T09:45:29.139 INFO:tasks.workunit.client.1.smithi114.stdout:5/276: unlink d3/d1f/f1c 0 2024-09-16T09:45:29.140 INFO:tasks.workunit.client.1.smithi114.stdout:6/197: write d6/d2d/f34 [1996997,109576] 0 2024-09-16T09:45:29.140 INFO:tasks.workunit.client.1.smithi114.stdout:3/318: creat dc/de/d37/d3d/f6c x:0 0 0 2024-09-16T09:45:29.140 INFO:tasks.workunit.client.1.smithi114.stdout:3/319: write dc/d38/d56/d5c/d5d/f62 [11639,92083] 0 2024-09-16T09:45:29.141 INFO:tasks.workunit.client.1.smithi114.stdout:5/277: rename d3/d11/f1e to d3/d11/d37/d43/d4c/f54 0 2024-09-16T09:45:29.142 INFO:tasks.workunit.client.1.smithi114.stdout:5/278: dread d3/d11/f1a [0,4194304] 0 2024-09-16T09:45:29.147 INFO:tasks.workunit.client.0.smithi111.stderr:++ readlink -f fsstress 2024-09-16T09:45:29.148 INFO:tasks.workunit.client.0.smithi111.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-16T09:45:29.148 INFO:tasks.workunit.client.0.smithi111.stderr:+ popd 2024-09-16T09:45:29.148 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-16T09:45:29.149 INFO:tasks.workunit.client.0.smithi111.stderr:+ popd 2024-09-16T09:45:29.149 INFO:tasks.workunit.client.0.smithi111.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-16T09:45:29.149 INFO:tasks.workunit.client.0.smithi111.stderr:++ mktemp -d -p . 2024-09-16T09:45:29.151 INFO:tasks.workunit.client.1.smithi114.stdout:6/198: dread d6/f1f [0,4194304] 0 2024-09-16T09:45:29.151 INFO:tasks.workunit.client.0.smithi111.stderr:+ T=./tmp.NMUTlfrAEY 2024-09-16T09:45:29.151 INFO:tasks.workunit.client.0.smithi111.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.NMUTlfrAEY -l 1 -n 1000 -p 10 -v 2024-09-16T09:45:29.152 INFO:tasks.workunit.client.1.smithi114.stdout:6/199: creat d6/f44 x:0 0 0 2024-09-16T09:45:29.154 INFO:tasks.workunit.client.1.smithi114.stdout:1/231: dwrite d4/d2b/d16/f19 [0,4194304] 0 2024-09-16T09:45:29.154 INFO:tasks.workunit.client.1.smithi114.stdout:1/232: chown d4/d2b/d29/c39 3126 1 2024-09-16T09:45:29.155 INFO:tasks.workunit.client.0.smithi111.stdout:seed = 1726326666 2024-09-16T09:45:29.155 INFO:tasks.workunit.client.1.smithi114.stdout:9/201: dwrite d3/da/d10/f21 [0,4194304] 0 2024-09-16T09:45:29.155 INFO:tasks.workunit.client.1.smithi114.stdout:6/200: rmdir d6/da/d10/d40 39 2024-09-16T09:45:29.156 INFO:tasks.workunit.client.1.smithi114.stdout:6/201: dread d6/da/d36/f3f [0,4194304] 0 2024-09-16T09:45:29.160 INFO:tasks.workunit.client.1.smithi114.stdout:1/233: rmdir d4 39 2024-09-16T09:45:29.165 INFO:tasks.workunit.client.0.smithi111.stdout:1/0: fdatasync - no filename 2024-09-16T09:45:29.165 INFO:tasks.workunit.client.0.smithi111.stdout:1/1: link - no file 2024-09-16T09:45:29.165 INFO:tasks.workunit.client.0.smithi111.stdout:1/2: getdents . 0 2024-09-16T09:45:29.165 INFO:tasks.workunit.client.0.smithi111.stdout:1/3: chown . 766 1 2024-09-16T09:45:29.165 INFO:tasks.workunit.client.1.smithi114.stdout:3/320: dwrite dc/de/d17/f5e [0,4194304] 0 2024-09-16T09:45:29.165 INFO:tasks.workunit.client.1.smithi114.stdout:3/321: fdatasync dc/de/d17/d2d/d41/f47 0 2024-09-16T09:45:29.166 INFO:tasks.workunit.client.1.smithi114.stdout:3/322: dread - dc/de/d18/f20 zero size 2024-09-16T09:45:29.166 INFO:tasks.workunit.client.1.smithi114.stdout:7/246: sync 2024-09-16T09:45:29.166 INFO:tasks.workunit.client.1.smithi114.stdout:7/247: fsync d2/d9/fc 0 2024-09-16T09:45:29.166 INFO:tasks.workunit.client.0.smithi111.stdout:0/0: mkdir d0 0 2024-09-16T09:45:29.166 INFO:tasks.workunit.client.0.smithi111.stdout:0/1: fsync - no filename 2024-09-16T09:45:29.166 INFO:tasks.workunit.client.0.smithi111.stdout:0/2: chown d0 63 1 2024-09-16T09:45:29.167 INFO:tasks.workunit.client.1.smithi114.stdout:0/168: sync 2024-09-16T09:45:29.167 INFO:tasks.workunit.client.1.smithi114.stdout:4/152: sync 2024-09-16T09:45:29.167 INFO:tasks.workunit.client.1.smithi114.stdout:4/153: fsync d0/d26/d29/f14 0 2024-09-16T09:45:29.168 INFO:tasks.workunit.client.0.smithi111.stdout:2/0: chown . 7211 1 2024-09-16T09:45:29.168 INFO:tasks.workunit.client.0.smithi111.stdout:2/1: fsync - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/2: write - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/3: dread - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/4: write - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/5: rename - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/6: read - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/7: readlink - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/8: write - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/9: dread - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/10: dread - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/11: dread - no filename 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/12: unlink - no file 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/13: chown . 6439 1 2024-09-16T09:45:29.169 INFO:tasks.workunit.client.0.smithi111.stdout:2/14: chown . 448 1 2024-09-16T09:45:29.170 INFO:tasks.workunit.client.1.smithi114.stdout:5/279: dwrite d3/d11/d37/d43/f51 [0,4194304] 0 2024-09-16T09:45:29.170 INFO:tasks.workunit.client.0.smithi111.stdout:1/4: creat f0 x:0 0 0 2024-09-16T09:45:29.172 INFO:tasks.workunit.client.1.smithi114.stdout:4/154: dread d0/d26/d29/fd [0,4194304] 0 2024-09-16T09:45:29.172 INFO:tasks.workunit.client.1.smithi114.stdout:4/155: write d0/d26/d29/fd [1309959,58130] 0 2024-09-16T09:45:29.173 INFO:tasks.workunit.client.0.smithi111.stdout:0/3: mknod d0/c1 0 2024-09-16T09:45:29.173 INFO:tasks.workunit.client.0.smithi111.stdout:0/4: read - no filename 2024-09-16T09:45:29.174 INFO:tasks.workunit.client.1.smithi114.stdout:9/202: unlink d3/da/d10/d23/d38/c3d 0 2024-09-16T09:45:29.175 INFO:tasks.workunit.client.0.smithi111.stdout:3/0: chown . 16095 1 2024-09-16T09:45:29.176 INFO:tasks.workunit.client.1.smithi114.stdout:3/323: dread dc/de/d18/f22 [0,4194304] 0 2024-09-16T09:45:29.176 INFO:tasks.workunit.client.1.smithi114.stdout:6/202: getdents d6/da 0 2024-09-16T09:45:29.177 INFO:tasks.workunit.client.1.smithi114.stdout:7/248: write d2/d9/d2b/d2e/d22/d27/f1e [59209,71387] 0 2024-09-16T09:45:29.179 INFO:tasks.workunit.client.1.smithi114.stdout:5/280: write d3/d11/d37/f53 [1323461,55532] 0 2024-09-16T09:45:29.181 INFO:tasks.workunit.client.1.smithi114.stdout:1/234: dwrite d4/d2b/f9 [8388608,4194304] 0 2024-09-16T09:45:29.181 INFO:tasks.workunit.client.1.smithi114.stdout:1/235: stat d4/d2b/d16 0 2024-09-16T09:45:29.181 INFO:tasks.workunit.client.1.smithi114.stdout:1/236: stat d4/d2b/d16/f19 0 2024-09-16T09:45:29.189 INFO:tasks.workunit.client.0.smithi111.stdout:1/5: unlink f0 0 2024-09-16T09:45:29.189 INFO:tasks.workunit.client.0.smithi111.stdout:1/6: rmdir - no directory 2024-09-16T09:45:29.189 INFO:tasks.workunit.client.0.smithi111.stdout:0/5: mknod d0/c2 0 2024-09-16T09:45:29.207 INFO:tasks.workunit.client.1.smithi114.stdout:0/169: unlink f1c 0 2024-09-16T09:45:29.210 INFO:tasks.workunit.client.1.smithi114.stdout:2/250: sync 2024-09-16T09:45:29.210 INFO:tasks.workunit.client.1.smithi114.stdout:8/253: sync 2024-09-16T09:45:29.217 INFO:tasks.workunit.client.0.smithi111.stdout:3/1: symlink l0 0 2024-09-16T09:45:29.217 INFO:tasks.workunit.client.0.smithi111.stdout:3/2: truncate - no filename 2024-09-16T09:45:29.222 INFO:tasks.workunit.client.0.smithi111.stdout:1/7: creat f1 x:0 0 0 2024-09-16T09:45:29.222 INFO:tasks.workunit.client.0.smithi111.stdout:1/8: write f1 [607368,75210] 0 2024-09-16T09:45:29.222 INFO:tasks.workunit.client.0.smithi111.stdout:1/9: write f1 [625759,86084] 0 2024-09-16T09:45:29.232 INFO:tasks.workunit.client.0.smithi111.stdout:0/6: unlink d0/c2 0 2024-09-16T09:45:29.232 INFO:tasks.workunit.client.0.smithi111.stdout:0/7: rename d0 to d0/d3 22 2024-09-16T09:45:29.232 INFO:tasks.workunit.client.1.smithi114.stdout:4/156: mkdir d0/d26/d29/d2b 0 2024-09-16T09:45:29.233 INFO:tasks.workunit.client.1.smithi114.stdout:4/157: chown d0/f21 316781191 1 2024-09-16T09:45:29.235 INFO:tasks.workunit.client.1.smithi114.stdout:3/324: rename dc/de/d18/f20 to dc/d38/d3f/f6d 0 2024-09-16T09:45:29.239 INFO:tasks.workunit.client.1.smithi114.stdout:5/281: truncate d3/d11/d37/d43/f47 1017879 0 2024-09-16T09:45:29.244 INFO:tasks.workunit.client.1.smithi114.stdout:1/237: creat d4/d2b/d29/f49 x:0 0 0 2024-09-16T09:45:29.245 INFO:tasks.workunit.client.1.smithi114.stdout:1/238: fdatasync d4/d2b/d16/f19 0 2024-09-16T09:45:29.248 INFO:tasks.workunit.client.1.smithi114.stdout:2/251: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d5e 0 2024-09-16T09:45:29.254 INFO:tasks.workunit.client.0.smithi111.stdout:1/10: creat f2 x:0 0 0 2024-09-16T09:45:29.256 INFO:tasks.workunit.client.1.smithi114.stdout:3/325: mkdir dc/d38/d56/d5c/d6e 0 2024-09-16T09:45:29.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/8: mknod d0/c4 0 2024-09-16T09:45:29.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/9: readlink - no filename 2024-09-16T09:45:29.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/10: dread - no filename 2024-09-16T09:45:29.259 INFO:tasks.workunit.client.1.smithi114.stdout:7/249: rename d2/d9/d2b/d2e/l29 to d2/d9/d2b/d2e/d22/d4c/l52 0 2024-09-16T09:45:29.265 INFO:tasks.workunit.client.1.smithi114.stdout:1/239: creat d4/d3d/d41/d42/f4a x:0 0 0 2024-09-16T09:45:29.267 INFO:tasks.workunit.client.1.smithi114.stdout:2/252: creat d1/d8/d10/d16/d1d/f5f x:0 0 0 2024-09-16T09:45:29.270 INFO:tasks.workunit.client.1.smithi114.stdout:7/250: mknod d2/d9/d2b/d2e/c53 0 2024-09-16T09:45:29.272 INFO:tasks.workunit.client.1.smithi114.stdout:5/282: rename d3/df/f1d to d3/df/d2d/d3f/f55 0 2024-09-16T09:45:29.276 INFO:tasks.workunit.client.1.smithi114.stdout:2/253: mkdir d1/d8/d10/d16/d60 0 2024-09-16T09:45:29.285 INFO:tasks.workunit.client.1.smithi114.stdout:5/283: link d3/df/l17 d3/df/d2d/d3f/l56 0 2024-09-16T09:45:29.293 INFO:tasks.workunit.client.1.smithi114.stdout:2/254: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/f61 x:0 0 0 2024-09-16T09:45:29.295 INFO:tasks.workunit.client.0.smithi111.stdout:0/11: symlink d0/l5 0 2024-09-16T09:45:29.295 INFO:tasks.workunit.client.0.smithi111.stdout:0/12: truncate - no filename 2024-09-16T09:45:29.296 INFO:tasks.workunit.client.0.smithi111.stdout:0/13: dread - no filename 2024-09-16T09:45:29.296 INFO:tasks.workunit.client.0.smithi111.stdout:0/14: chown d0/c4 372786 1 2024-09-16T09:45:29.296 INFO:tasks.workunit.client.0.smithi111.stdout:0/15: chown d0/l5 104391802 1 2024-09-16T09:45:29.296 INFO:tasks.workunit.client.0.smithi111.stdout:0/16: dwrite - no filename 2024-09-16T09:45:29.296 INFO:tasks.workunit.client.0.smithi111.stdout:0/17: chown d0/c1 168073 1 2024-09-16T09:45:29.305 INFO:tasks.workunit.client.1.smithi114.stdout:2/255: creat d1/d8/d10/d16/d1d/f62 x:0 0 0 2024-09-16T09:45:29.320 INFO:tasks.workunit.client.1.smithi114.stdout:2/256: rename d1/d8/d26 to d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63 0 2024-09-16T09:45:29.320 INFO:tasks.workunit.client.1.smithi114.stdout:2/257: readlink d1/d8/d10/d16/d1d/d41/l5d 0 2024-09-16T09:45:29.320 INFO:tasks.workunit.client.1.smithi114.stdout:2/258: write d1/d8/f46 [487223,105132] 0 2024-09-16T09:45:29.325 INFO:tasks.workunit.client.1.smithi114.stdout:5/284: dread d3/f20 [0,4194304] 0 2024-09-16T09:45:29.325 INFO:tasks.workunit.client.1.smithi114.stdout:5/285: dread - d3/f18 zero size 2024-09-16T09:45:29.335 INFO:tasks.workunit.client.1.smithi114.stdout:5/286: symlink d3/df/d2d/d3f/d41/l57 0 2024-09-16T09:45:29.362 INFO:tasks.workunit.client.0.smithi111.stdout:0/18: creat d0/f6 x:0 0 0 2024-09-16T09:45:29.362 INFO:tasks.workunit.client.0.smithi111.stdout:0/19: chown d0/c4 16 1 2024-09-16T09:45:29.385 INFO:tasks.workunit.client.1.smithi114.stdout:2/259: dread d1/d8/d10/d16/f30 [0,4194304] 0 2024-09-16T09:45:29.389 INFO:tasks.workunit.client.1.smithi114.stdout:2/260: creat d1/d8/d10/d16/d1d/f64 x:0 0 0 2024-09-16T09:45:29.389 INFO:tasks.workunit.client.1.smithi114.stdout:2/261: write d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f56 [83840,106510] 0 2024-09-16T09:45:29.392 INFO:tasks.workunit.client.1.smithi114.stdout:2/262: rmdir d1/d8/d10/d16/d1d/d4a/d3e/d5b 39 2024-09-16T09:45:29.444 INFO:tasks.workunit.client.1.smithi114.stdout:9/203: dwrite d3/da/d10/d23/d38/f3e [0,4194304] 0 2024-09-16T09:45:29.451 INFO:tasks.workunit.client.1.smithi114.stdout:6/203: dwrite d6/da/d36/f3b [8388608,4194304] 0 2024-09-16T09:45:29.452 INFO:tasks.workunit.client.1.smithi114.stdout:9/204: rename d3/d13 to d3/da/d10/d23/d43 0 2024-09-16T09:45:29.453 INFO:tasks.workunit.client.1.smithi114.stdout:1/240: dwrite d4/d2b/d2f/d3a/f40 [0,4194304] 0 2024-09-16T09:45:29.458 INFO:tasks.workunit.client.1.smithi114.stdout:9/205: getdents d3/da/d10 0 2024-09-16T09:45:29.462 INFO:tasks.workunit.client.1.smithi114.stdout:1/241: creat d4/d2b/d16/d47/f4b x:0 0 0 2024-09-16T09:45:29.462 INFO:tasks.workunit.client.1.smithi114.stdout:1/242: dread - d4/d2b/d29/f32 zero size 2024-09-16T09:45:29.466 INFO:tasks.workunit.client.1.smithi114.stdout:1/243: creat d4/d2b/d2f/f4c x:0 0 0 2024-09-16T09:45:29.466 INFO:tasks.workunit.client.1.smithi114.stdout:1/244: write d4/d3d/d41/d42/f4a [285136,103914] 0 2024-09-16T09:45:29.471 INFO:tasks.workunit.client.1.smithi114.stdout:1/245: unlink d4/d2b/d29/f32 0 2024-09-16T09:45:29.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/246: rename d4/l33 to d4/d2b/d2f/d3a/l4d 0 2024-09-16T09:45:29.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/247: fdatasync d4/d2b/f1e 0 2024-09-16T09:45:29.476 INFO:tasks.workunit.client.1.smithi114.stdout:1/248: write d4/d2b/f3c [239992,36701] 0 2024-09-16T09:45:29.477 INFO:tasks.workunit.client.1.smithi114.stdout:6/204: write d6/da/d36/f3b [7638518,30783] 0 2024-09-16T09:45:29.490 INFO:tasks.workunit.client.0.smithi111.stdout:0/20: link d0/c4 d0/c7 0 2024-09-16T09:45:29.490 INFO:tasks.workunit.client.0.smithi111.stdout:0/21: chown d0 221658 1 2024-09-16T09:45:29.491 INFO:tasks.workunit.client.0.smithi111.stdout:0/22: chown d0/c7 136613636 1 2024-09-16T09:45:29.491 INFO:tasks.workunit.client.0.smithi111.stdout:0/23: dread - d0/f6 zero size 2024-09-16T09:45:29.491 INFO:tasks.workunit.client.0.smithi111.stdout:0/24: dread - d0/f6 zero size 2024-09-16T09:45:29.512 INFO:tasks.workunit.client.1.smithi114.stdout:3/326: write dc/de/d10/f25 [1064362,61727] 0 2024-09-16T09:45:29.513 INFO:tasks.workunit.client.1.smithi114.stdout:3/327: getdents dc/de/d37/d3d 0 2024-09-16T09:45:29.516 INFO:tasks.workunit.client.1.smithi114.stdout:3/328: creat dc/de/d17/d2d/d41/f6f x:0 0 0 2024-09-16T09:45:29.516 INFO:tasks.workunit.client.1.smithi114.stdout:5/287: dread d3/f8 [0,4194304] 0 2024-09-16T09:45:29.519 INFO:tasks.workunit.client.1.smithi114.stdout:3/329: unlink dc/d38/d56/d5c/d5d/f62 0 2024-09-16T09:45:29.520 INFO:tasks.workunit.client.1.smithi114.stdout:5/288: mkdir d3/d11/d37/d43/d58 0 2024-09-16T09:45:29.520 INFO:tasks.workunit.client.1.smithi114.stdout:5/289: chown d3/d1f/f27 173114536 1 2024-09-16T09:45:29.522 INFO:tasks.workunit.client.1.smithi114.stdout:3/330: creat dc/de/d37/d4e/f70 x:0 0 0 2024-09-16T09:45:29.522 INFO:tasks.workunit.client.1.smithi114.stdout:3/331: fdatasync dc/d38/f45 0 2024-09-16T09:45:29.523 INFO:tasks.workunit.client.0.smithi111.stdout:1/11: write f1 [499709,62165] 0 2024-09-16T09:45:29.523 INFO:tasks.workunit.client.1.smithi114.stdout:3/332: mknod dc/de/d37/d3d/c71 0 2024-09-16T09:45:29.524 INFO:tasks.workunit.client.1.smithi114.stdout:1/249: dwrite d4/f26 [0,4194304] 0 2024-09-16T09:45:29.524 INFO:tasks.workunit.client.1.smithi114.stdout:1/250: readlink d4/d2b/lb 0 2024-09-16T09:45:29.524 INFO:tasks.workunit.client.1.smithi114.stdout:1/251: dread - d4/d2b/d2f/d3a/f44 zero size 2024-09-16T09:45:29.525 INFO:tasks.workunit.client.1.smithi114.stdout:3/333: mkdir dc/de/d17/d72 0 2024-09-16T09:45:29.527 INFO:tasks.workunit.client.1.smithi114.stdout:1/252: stat d4/d2b/d16/c1d 0 2024-09-16T09:45:29.527 INFO:tasks.workunit.client.1.smithi114.stdout:1/253: write d4/f38 [674453,126170] 0 2024-09-16T09:45:29.529 INFO:tasks.workunit.client.1.smithi114.stdout:6/205: dread d6/da/d10/f16 [0,4194304] 0 2024-09-16T09:45:29.532 INFO:tasks.workunit.client.1.smithi114.stdout:6/206: rename d6/f17 to d6/da/f45 0 2024-09-16T09:45:29.534 INFO:tasks.workunit.client.1.smithi114.stdout:4/158: dwrite d0/f20 [0,4194304] 0 2024-09-16T09:45:29.538 INFO:tasks.workunit.client.1.smithi114.stdout:9/206: dwrite d3/ff [0,4194304] 0 2024-09-16T09:45:29.538 INFO:tasks.workunit.client.1.smithi114.stdout:9/207: stat d3/da/d10/d23/d29 0 2024-09-16T09:45:29.540 INFO:tasks.workunit.client.1.smithi114.stdout:9/208: rmdir d3/da/d10/d23/d29/d2c 39 2024-09-16T09:45:29.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/263: dwrite d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:29.545 INFO:tasks.workunit.client.1.smithi114.stdout:6/207: fdatasync f5 0 2024-09-16T09:45:29.545 INFO:tasks.workunit.client.1.smithi114.stdout:9/209: symlink d3/da/l44 0 2024-09-16T09:45:29.545 INFO:tasks.workunit.client.1.smithi114.stdout:2/264: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f65 x:0 0 0 2024-09-16T09:45:29.545 INFO:tasks.workunit.client.1.smithi114.stdout:9/210: truncate d3/da/d10/f20 71462 0 2024-09-16T09:45:29.546 INFO:tasks.workunit.client.1.smithi114.stdout:6/208: mkdir d6/d2d/d46 0 2024-09-16T09:45:29.546 INFO:tasks.workunit.client.1.smithi114.stdout:4/159: write d0/f21 [1688390,59737] 0 2024-09-16T09:45:29.547 INFO:tasks.workunit.client.1.smithi114.stdout:2/265: creat d1/d8/d10/d16/d1d/f66 x:0 0 0 2024-09-16T09:45:29.549 INFO:tasks.workunit.client.1.smithi114.stdout:9/211: mkdir d3/da/d10/d23/d29/d2c/d45 0 2024-09-16T09:45:29.552 INFO:tasks.workunit.client.1.smithi114.stdout:8/254: dread d4/f40 [0,4194304] 0 2024-09-16T09:45:29.553 INFO:tasks.workunit.client.1.smithi114.stdout:9/212: rmdir d3/da 39 2024-09-16T09:45:29.553 INFO:tasks.workunit.client.1.smithi114.stdout:4/160: mknod d0/d13/c2c 0 2024-09-16T09:45:29.555 INFO:tasks.workunit.client.1.smithi114.stdout:8/255: mknod d4/db/d3e/d47/c53 0 2024-09-16T09:45:29.556 INFO:tasks.workunit.client.1.smithi114.stdout:3/334: fdatasync dc/de/d10/f25 0 2024-09-16T09:45:29.557 INFO:tasks.workunit.client.1.smithi114.stdout:9/213: truncate d3/f6 1260237 0 2024-09-16T09:45:29.557 INFO:tasks.workunit.client.1.smithi114.stdout:9/214: readlink d3/l1a 0 2024-09-16T09:45:29.558 INFO:tasks.workunit.client.1.smithi114.stdout:4/161: creat d0/d17/f2d x:0 0 0 2024-09-16T09:45:29.559 INFO:tasks.workunit.client.1.smithi114.stdout:8/256: mkdir d4/db/dd/d1b/d52/d54 0 2024-09-16T09:45:29.559 INFO:tasks.workunit.client.1.smithi114.stdout:8/257: stat d4/db/f22 0 2024-09-16T09:45:29.562 INFO:tasks.workunit.client.1.smithi114.stdout:3/335: rename dc/de/d10/d26/f3a to dc/d38/d56/f73 0 2024-09-16T09:45:29.562 INFO:tasks.workunit.client.1.smithi114.stdout:3/336: fsync dc/de/d17/f1a 0 2024-09-16T09:45:29.564 INFO:tasks.workunit.client.1.smithi114.stdout:9/215: creat d3/da/f46 x:0 0 0 2024-09-16T09:45:29.564 INFO:tasks.workunit.client.1.smithi114.stdout:9/216: chown d3/c3b 177946 1 2024-09-16T09:45:29.564 INFO:tasks.workunit.client.1.smithi114.stdout:9/217: readlink d3/l1a 0 2024-09-16T09:45:29.568 INFO:tasks.workunit.client.1.smithi114.stdout:8/258: getdents d4/db/d3e 0 2024-09-16T09:45:29.568 INFO:tasks.workunit.client.1.smithi114.stdout:8/259: write d4/db/d3e/f4f [139697,80047] 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:0/170: dread d1f/d2d/f2f [0,4194304] 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:0/171: write d1f/d20/f29 [362455,41298] 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:0/172: readlink d1f/d20/l24 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:0/173: chown d1f/c31 78151516 1 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:0/174: readlink d1f/d20/l24 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:0/175: write d1f/d22/f2b [568954,73330] 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:3/337: creat dc/de/d17/f74 x:0 0 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:9/218: mknod d3/da/c47 0 2024-09-16T09:45:29.573 INFO:tasks.workunit.client.1.smithi114.stdout:4/162: write d0/fe [2129439,21020] 0 2024-09-16T09:45:29.575 INFO:tasks.workunit.client.1.smithi114.stdout:0/176: link d1f/d22/d2e/l38 d1f/d2d/l42 0 2024-09-16T09:45:29.580 INFO:tasks.workunit.client.1.smithi114.stdout:3/338: mknod dc/c75 0 2024-09-16T09:45:29.580 INFO:tasks.workunit.client.1.smithi114.stdout:3/339: readlink dc/de/d10/d26/l43 0 2024-09-16T09:45:29.581 INFO:tasks.workunit.client.1.smithi114.stdout:9/219: symlink d3/da/d10/d23/l48 0 2024-09-16T09:45:29.583 INFO:tasks.workunit.client.1.smithi114.stdout:0/177: symlink d1f/d22/l43 0 2024-09-16T09:45:29.595 INFO:tasks.workunit.client.1.smithi114.stdout:3/340: read dc/d38/d56/f73 [2517431,23027] 0 2024-09-16T09:45:29.595 INFO:tasks.workunit.client.1.smithi114.stdout:8/260: dwrite d4/db/dd/f44 [0,4194304] 0 2024-09-16T09:45:29.597 INFO:tasks.workunit.client.1.smithi114.stdout:8/261: mkdir d4/db/dd/d1b/d30/d55 0 2024-09-16T09:45:29.600 INFO:tasks.workunit.client.1.smithi114.stdout:3/341: dread dc/de/d18/f22 [0,4194304] 0 2024-09-16T09:45:29.601 INFO:tasks.workunit.client.1.smithi114.stdout:8/262: mknod d4/db/d39/d3c/c56 0 2024-09-16T09:45:29.601 INFO:tasks.workunit.client.1.smithi114.stdout:8/263: fdatasync d4/db/dd/f13 0 2024-09-16T09:45:29.605 INFO:tasks.workunit.client.1.smithi114.stdout:8/264: symlink d4/db/dd/d1b/d52/d54/l57 0 2024-09-16T09:45:29.611 INFO:tasks.workunit.client.1.smithi114.stdout:6/209: read d6/da/d10/f25 [37555,92489] 0 2024-09-16T09:45:29.611 INFO:tasks.workunit.client.1.smithi114.stdout:6/210: write d6/da/d36/f3b [12933860,80094] 0 2024-09-16T09:45:29.616 INFO:tasks.workunit.client.1.smithi114.stdout:9/220: dwrite d3/da/d10/d23/d43/f18 [0,4194304] 0 2024-09-16T09:45:29.617 INFO:tasks.workunit.client.1.smithi114.stdout:9/221: truncate d3/da/f46 665115 0 2024-09-16T09:45:29.617 INFO:tasks.workunit.client.1.smithi114.stdout:9/222: chown d3/da/d10/d23/d43/d1e/d25/c34 25449 1 2024-09-16T09:45:29.619 INFO:tasks.workunit.client.1.smithi114.stdout:9/223: unlink d3/da/d10/c1d 0 2024-09-16T09:45:29.619 INFO:tasks.workunit.client.1.smithi114.stdout:9/224: write d3/da/d10/d23/d43/f2f [4471839,1520] 0 2024-09-16T09:45:29.619 INFO:tasks.workunit.client.1.smithi114.stdout:9/225: chown d3/da/d10/d23/d43/d1e/d25 179466 1 2024-09-16T09:45:29.621 INFO:tasks.workunit.client.1.smithi114.stdout:0/178: dwrite f19 [4194304,4194304] 0 2024-09-16T09:45:29.626 INFO:tasks.workunit.client.1.smithi114.stdout:1/254: read d4/f38 [78858,74630] 0 2024-09-16T09:45:29.629 INFO:tasks.workunit.client.1.smithi114.stdout:1/255: creat d4/f4e x:0 0 0 2024-09-16T09:45:29.629 INFO:tasks.workunit.client.1.smithi114.stdout:1/256: truncate d4/d2b/d2f/f4c 412895 0 2024-09-16T09:45:29.633 INFO:tasks.workunit.client.1.smithi114.stdout:0/179: read d1f/d22/f26 [324125,55460] 0 2024-09-16T09:45:29.633 INFO:tasks.workunit.client.1.smithi114.stdout:3/342: dwrite dc/d38/d56/d5c/d5d/f55 [0,4194304] 0 2024-09-16T09:45:29.633 INFO:tasks.workunit.client.1.smithi114.stdout:3/343: write dc/de/d37/d57/f61 [797973,76513] 0 2024-09-16T09:45:29.634 INFO:tasks.workunit.client.1.smithi114.stdout:0/180: mknod d1f/d22/d2e/c44 0 2024-09-16T09:45:29.635 INFO:tasks.workunit.client.1.smithi114.stdout:0/181: chown d1f/d22/d2e/c44 0 1 2024-09-16T09:45:29.636 INFO:tasks.workunit.client.1.smithi114.stdout:3/344: truncate f9 1778443 0 2024-09-16T09:45:29.638 INFO:tasks.workunit.client.1.smithi114.stdout:0/182: creat d1f/f45 x:0 0 0 2024-09-16T09:45:29.645 INFO:tasks.workunit.client.0.smithi111.stdout:3/3: dwrite - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:3/4: stat l0 0 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:5/0: read - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/0: link - no file 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:5/1: dwrite - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/1: dwrite - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:5/2: write - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/2: write - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/3: readlink - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/4: dwrite - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:6/5: dwrite - no filename 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:4/0: chown . 4664117 1 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:8/0: chown . 245611 1 2024-09-16T09:45:29.646 INFO:tasks.workunit.client.0.smithi111.stdout:4/1: read - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/2: dwrite - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:8/1: dwrite - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/3: dread - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/4: getdents . 0 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:7/0: dwrite - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:7/1: dwrite - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:7/2: write - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/5: stat - no entries 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/6: dwrite - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/7: read - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/8: rename - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/9: unlink - no file 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/10: read - no filename 2024-09-16T09:45:29.647 INFO:tasks.workunit.client.0.smithi111.stdout:4/11: rename - no filename 2024-09-16T09:45:29.648 INFO:tasks.workunit.client.0.smithi111.stdout:4/12: rename - no filename 2024-09-16T09:45:29.648 INFO:tasks.workunit.client.0.smithi111.stdout:4/13: getdents . 0 2024-09-16T09:45:29.648 INFO:tasks.workunit.client.1.smithi114.stdout:3/345: dread dc/de/d10/f1e [0,4194304] 0 2024-09-16T09:45:29.653 INFO:tasks.workunit.client.1.smithi114.stdout:6/211: dwrite d6/da/f15 [0,4194304] 0 2024-09-16T09:45:29.658 INFO:tasks.workunit.client.1.smithi114.stdout:6/212: creat d6/da/d10/f47 x:0 0 0 2024-09-16T09:45:29.658 INFO:tasks.workunit.client.1.smithi114.stdout:6/213: chown d6/l2e 104798202 1 2024-09-16T09:45:29.658 INFO:tasks.workunit.client.1.smithi114.stdout:6/214: dread - d6/da/d10/f47 zero size 2024-09-16T09:45:29.658 INFO:tasks.workunit.client.1.smithi114.stdout:6/215: fsync d6/f35 0 2024-09-16T09:45:29.658 INFO:tasks.workunit.client.1.smithi114.stdout:6/216: readlink d6/da/l30 0 2024-09-16T09:45:29.662 INFO:tasks.workunit.client.1.smithi114.stdout:4/163: getdents d0/d26/d29 0 2024-09-16T09:45:29.662 INFO:tasks.workunit.client.1.smithi114.stdout:4/164: write d0/d17/f1e [563974,45441] 0 2024-09-16T09:45:29.662 INFO:tasks.workunit.client.1.smithi114.stdout:4/165: write d0/f21 [1396935,110776] 0 2024-09-16T09:45:29.665 INFO:tasks.workunit.client.1.smithi114.stdout:7/251: truncate d2/d9/d2b/d2e/d22/d27/f1e 2456306 0 2024-09-16T09:45:29.666 INFO:tasks.workunit.client.1.smithi114.stdout:4/166: mkdir d0/d26/d2e 0 2024-09-16T09:45:29.667 INFO:tasks.workunit.client.1.smithi114.stdout:5/290: truncate d3/d11/d37/d43/f47 1281882 0 2024-09-16T09:45:29.667 INFO:tasks.workunit.client.1.smithi114.stdout:5/291: chown f0 8189631 1 2024-09-16T09:45:29.667 INFO:tasks.workunit.client.1.smithi114.stdout:5/292: dread - d3/df/f35 zero size 2024-09-16T09:45:29.669 INFO:tasks.workunit.client.1.smithi114.stdout:7/252: link d2/c37 d2/d9/d2b/d2e/d22/c54 0 2024-09-16T09:45:29.669 INFO:tasks.workunit.client.1.smithi114.stdout:7/253: chown d2/df/l20 3 1 2024-09-16T09:45:29.669 INFO:tasks.workunit.client.1.smithi114.stdout:7/254: chown d2/d9/fc 0 1 2024-09-16T09:45:29.669 INFO:tasks.workunit.client.1.smithi114.stdout:7/255: truncate d2/f1c 383932 0 2024-09-16T09:45:29.670 INFO:tasks.workunit.client.1.smithi114.stdout:5/293: getdents d3/df/d2d/d34 0 2024-09-16T09:45:29.670 INFO:tasks.workunit.client.1.smithi114.stdout:5/294: write d3/d1f/f27 [891600,101183] 0 2024-09-16T09:45:29.671 INFO:tasks.workunit.client.1.smithi114.stdout:6/217: dread d6/da/f15 [0,4194304] 0 2024-09-16T09:45:29.671 INFO:tasks.workunit.client.1.smithi114.stdout:6/218: stat d6/f22 0 2024-09-16T09:45:29.671 INFO:tasks.workunit.client.1.smithi114.stdout:7/256: truncate d2/d9/f12 2368719 0 2024-09-16T09:45:29.673 INFO:tasks.workunit.client.1.smithi114.stdout:5/295: mkdir d3/df/d2d/d3f/d59 0 2024-09-16T09:45:29.674 INFO:tasks.workunit.client.1.smithi114.stdout:6/219: mkdir d6/da/d48 0 2024-09-16T09:45:29.678 INFO:tasks.workunit.client.1.smithi114.stdout:5/296: unlink d3/df/c23 0 2024-09-16T09:45:29.680 INFO:tasks.workunit.client.1.smithi114.stdout:4/167: read d0/f1f [820849,124657] 0 2024-09-16T09:45:29.682 INFO:tasks.workunit.client.1.smithi114.stdout:0/183: dwrite d1f/d22/f3c [0,4194304] 0 2024-09-16T09:45:29.682 INFO:tasks.workunit.client.1.smithi114.stdout:0/184: truncate d1f/d20/f29 1324509 0 2024-09-16T09:45:29.682 INFO:tasks.workunit.client.1.smithi114.stdout:0/185: truncate d1f/d27/f3a 976091 0 2024-09-16T09:45:29.682 INFO:tasks.workunit.client.1.smithi114.stdout:5/297: mkdir d3/df/d2d/d3f/d41/d5a 0 2024-09-16T09:45:29.682 INFO:tasks.workunit.client.1.smithi114.stdout:3/346: dwrite dc/de/d10/d26/f54 [0,4194304] 0 2024-09-16T09:45:29.683 INFO:tasks.workunit.client.1.smithi114.stdout:8/265: dwrite d4/db/dd/f16 [8388608,4194304] 0 2024-09-16T09:45:29.684 INFO:tasks.workunit.client.1.smithi114.stdout:4/168: mkdir d0/d26/d2e/d2f 0 2024-09-16T09:45:29.684 INFO:tasks.workunit.client.1.smithi114.stdout:4/169: chown d0/f21 552257 1 2024-09-16T09:45:29.688 INFO:tasks.workunit.client.1.smithi114.stdout:0/186: mkdir d1f/d22/d2e/d46 0 2024-09-16T09:45:29.692 INFO:tasks.workunit.client.1.smithi114.stdout:5/298: symlink d3/d11/d37/l5b 0 2024-09-16T09:45:29.694 INFO:tasks.workunit.client.1.smithi114.stdout:0/187: write f2 [1537081,49552] 0 2024-09-16T09:45:29.701 INFO:tasks.workunit.client.1.smithi114.stdout:3/347: unlink dc/de/l12 0 2024-09-16T09:45:29.702 INFO:tasks.workunit.client.1.smithi114.stdout:8/266: rmdir d4/db/dd/d1b/d30 39 2024-09-16T09:45:29.702 INFO:tasks.workunit.client.1.smithi114.stdout:8/267: fdatasync d4/db/d3e/f4f 0 2024-09-16T09:45:29.704 INFO:tasks.workunit.client.1.smithi114.stdout:4/170: symlink d0/d17/l30 0 2024-09-16T09:45:29.704 INFO:tasks.workunit.client.1.smithi114.stdout:4/171: write d0/f7 [4007638,119609] 0 2024-09-16T09:45:29.704 INFO:tasks.workunit.client.1.smithi114.stdout:5/299: stat d3/le 0 2024-09-16T09:45:29.706 INFO:tasks.workunit.client.1.smithi114.stdout:0/188: mkdir d1f/d27/d47 0 2024-09-16T09:45:29.707 INFO:tasks.workunit.client.1.smithi114.stdout:0/189: read d1f/d20/f29 [933523,71855] 0 2024-09-16T09:45:29.707 INFO:tasks.workunit.client.1.smithi114.stdout:0/190: write d1f/d22/d2e/f40 [563242,95721] 0 2024-09-16T09:45:29.708 INFO:tasks.workunit.client.1.smithi114.stdout:3/348: rename dc/de/d37/d57/f61 to dc/d38/d56/d5c/d5d/f76 0 2024-09-16T09:45:29.709 INFO:tasks.workunit.client.1.smithi114.stdout:8/268: symlink d4/d1f/l58 0 2024-09-16T09:45:29.710 INFO:tasks.workunit.client.1.smithi114.stdout:8/269: fsync d4/db/df/f12 0 2024-09-16T09:45:29.712 INFO:tasks.workunit.client.1.smithi114.stdout:4/172: rmdir d0/d26/d29 39 2024-09-16T09:45:29.714 INFO:tasks.workunit.client.1.smithi114.stdout:0/191: mkdir d1f/d20/d48 0 2024-09-16T09:45:29.716 INFO:tasks.workunit.client.1.smithi114.stdout:3/349: mkdir dc/de/d10/d6a/d77 0 2024-09-16T09:45:29.717 INFO:tasks.workunit.client.1.smithi114.stdout:8/270: mkdir d4/db/dd/d1b/d30/d55/d59 0 2024-09-16T09:45:29.719 INFO:tasks.workunit.client.1.smithi114.stdout:4/173: link d0/d26/d29/l15 d0/d17/l31 0 2024-09-16T09:45:29.721 INFO:tasks.workunit.client.1.smithi114.stdout:0/192: creat d1f/d22/f49 x:0 0 0 2024-09-16T09:45:29.721 INFO:tasks.workunit.client.1.smithi114.stdout:0/193: dread - d1f/d27/f3b zero size 2024-09-16T09:45:29.724 INFO:tasks.workunit.client.1.smithi114.stdout:8/271: symlink d4/db/dd/d1b/d52/l5a 0 2024-09-16T09:45:29.724 INFO:tasks.workunit.client.1.smithi114.stdout:8/272: fdatasync d4/db/df/f12 0 2024-09-16T09:45:29.725 INFO:tasks.workunit.client.1.smithi114.stdout:4/174: creat d0/d26/d2e/f32 x:0 0 0 2024-09-16T09:45:29.728 INFO:tasks.workunit.client.1.smithi114.stdout:8/273: link d4/d1f/l58 d4/db/d39/d3c/d4e/l5b 0 2024-09-16T09:45:29.730 INFO:tasks.workunit.client.1.smithi114.stdout:4/175: link d0/d26/d29/f1d d0/d26/d2e/f33 0 2024-09-16T09:45:29.730 INFO:tasks.workunit.client.1.smithi114.stdout:4/176: stat d0/d13/l2a 0 2024-09-16T09:45:29.732 INFO:tasks.workunit.client.1.smithi114.stdout:8/274: symlink d4/db/dd/d1b/d52/d54/l5c 0 2024-09-16T09:45:29.733 INFO:tasks.workunit.client.1.smithi114.stdout:4/177: mknod d0/d13/c34 0 2024-09-16T09:45:29.735 INFO:tasks.workunit.client.1.smithi114.stdout:8/275: creat d4/db/dd/d1b/d52/d54/f5d x:0 0 0 2024-09-16T09:45:29.735 INFO:tasks.workunit.client.1.smithi114.stdout:8/276: stat d4/db/d39/d3c/c56 0 2024-09-16T09:45:29.737 INFO:tasks.workunit.client.1.smithi114.stdout:4/178: symlink d0/d26/d2e/l35 0 2024-09-16T09:45:29.737 INFO:tasks.workunit.client.1.smithi114.stdout:4/179: chown d0/fe 0 1 2024-09-16T09:45:29.767 INFO:tasks.workunit.client.1.smithi114.stdout:4/180: dwrite d0/d26/d2e/f33 [4194304,4194304] 0 2024-09-16T09:45:29.768 INFO:tasks.workunit.client.1.smithi114.stdout:8/277: dwrite d4/db/dd/d1b/d30/f41 [0,4194304] 0 2024-09-16T09:45:29.771 INFO:tasks.workunit.client.1.smithi114.stdout:4/181: dread d0/f1f [0,4194304] 0 2024-09-16T09:45:29.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/182: creat d0/d26/d29/d2b/f36 x:0 0 0 2024-09-16T09:45:29.774 INFO:tasks.workunit.client.1.smithi114.stdout:4/183: mknod d0/d26/d2e/c37 0 2024-09-16T09:45:29.778 INFO:tasks.workunit.client.1.smithi114.stdout:4/184: dread d0/f1f [0,4194304] 0 2024-09-16T09:45:29.779 INFO:tasks.workunit.client.1.smithi114.stdout:4/185: chown d0/l1a 7758 1 2024-09-16T09:45:29.779 INFO:tasks.workunit.client.1.smithi114.stdout:8/278: dread d4/f3f [0,4194304] 0 2024-09-16T09:45:29.780 INFO:tasks.workunit.client.1.smithi114.stdout:4/186: creat d0/d13/f38 x:0 0 0 2024-09-16T09:45:29.782 INFO:tasks.workunit.client.1.smithi114.stdout:8/279: creat d4/db/d3e/d47/f5e x:0 0 0 2024-09-16T09:45:29.784 INFO:tasks.workunit.client.1.smithi114.stdout:8/280: creat d4/db/dd/d1b/d30/d55/d59/f5f x:0 0 0 2024-09-16T09:45:29.798 INFO:tasks.workunit.client.1.smithi114.stdout:8/281: dwrite d4/db/dd/f16 [4194304,4194304] 0 2024-09-16T09:45:29.803 INFO:tasks.workunit.client.1.smithi114.stdout:8/282: dread d4/f15 [0,4194304] 0 2024-09-16T09:45:29.805 INFO:tasks.workunit.client.1.smithi114.stdout:8/283: symlink d4/d1f/l60 0 2024-09-16T09:45:29.807 INFO:tasks.workunit.client.1.smithi114.stdout:8/284: readlink d4/l37 0 2024-09-16T09:45:29.809 INFO:tasks.workunit.client.1.smithi114.stdout:8/285: rmdir d4/db/dd/d1b/d28 39 2024-09-16T09:45:29.811 INFO:tasks.workunit.client.1.smithi114.stdout:8/286: mknod d4/db/dd/d1b/d52/c61 0 2024-09-16T09:45:29.812 INFO:tasks.workunit.client.1.smithi114.stdout:1/257: fsync d4/d2b/d16/d47/f4b 0 2024-09-16T09:45:29.815 INFO:tasks.workunit.client.1.smithi114.stdout:1/258: creat d4/d2b/d2f/d3a/f4f x:0 0 0 2024-09-16T09:45:29.817 INFO:tasks.workunit.client.1.smithi114.stdout:1/259: mknod d4/d2b/d16/c50 0 2024-09-16T09:45:29.818 INFO:tasks.workunit.client.1.smithi114.stdout:1/260: truncate d4/f26 5041844 0 2024-09-16T09:45:29.818 INFO:tasks.workunit.client.1.smithi114.stdout:1/261: chown d4/d2b/f14 3332 1 2024-09-16T09:45:29.821 INFO:tasks.workunit.client.1.smithi114.stdout:1/262: link d4/d2b/f9 d4/d2b/d16/f51 0 2024-09-16T09:45:29.824 INFO:tasks.workunit.client.1.smithi114.stdout:1/263: mknod d4/d2b/d29/c52 0 2024-09-16T09:45:29.824 INFO:tasks.workunit.client.1.smithi114.stdout:8/287: dwrite d4/db/f22 [0,4194304] 0 2024-09-16T09:45:29.824 INFO:tasks.workunit.client.1.smithi114.stdout:8/288: chown d4/db/d39/d3c/d4e/l5b 36036839 1 2024-09-16T09:45:29.826 INFO:tasks.workunit.client.1.smithi114.stdout:1/264: creat d4/d2b/f53 x:0 0 0 2024-09-16T09:45:29.830 INFO:tasks.workunit.client.1.smithi114.stdout:8/289: mkdir d4/db/d39/d3c/d4e/d62 0 2024-09-16T09:45:29.830 INFO:tasks.workunit.client.1.smithi114.stdout:8/290: dread - d4/db/d3e/d47/f5e zero size 2024-09-16T09:45:29.830 INFO:tasks.workunit.client.1.smithi114.stdout:8/291: chown d4/d1f/l60 4181642 1 2024-09-16T09:45:29.832 INFO:tasks.workunit.client.1.smithi114.stdout:1/265: symlink d4/d2b/d16/d47/l54 0 2024-09-16T09:45:29.832 INFO:tasks.workunit.client.1.smithi114.stdout:1/266: chown d4/l15 31313774 1 2024-09-16T09:45:29.834 INFO:tasks.workunit.client.1.smithi114.stdout:8/292: unlink d4/db/l32 0 2024-09-16T09:45:29.837 INFO:tasks.workunit.client.1.smithi114.stdout:8/293: symlink d4/db/d39/d3c/l63 0 2024-09-16T09:45:29.840 INFO:tasks.workunit.client.1.smithi114.stdout:8/294: mkdir d4/db/d3e/d47/d64 0 2024-09-16T09:45:29.847 INFO:tasks.workunit.client.1.smithi114.stdout:1/267: dwrite d4/d2b/d2f/d3a/f4f [0,4194304] 0 2024-09-16T09:45:29.852 INFO:tasks.workunit.client.1.smithi114.stdout:1/268: mkdir d4/d2b/d2f/d3a/d55 0 2024-09-16T09:45:29.854 INFO:tasks.workunit.client.1.smithi114.stdout:1/269: mkdir d4/d2b/d2f/d3a/d56 0 2024-09-16T09:45:29.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/270: dread d4/d2b/f1e [0,4194304] 0 2024-09-16T09:45:29.858 INFO:tasks.workunit.client.1.smithi114.stdout:1/271: write d4/f38 [265719,58690] 0 2024-09-16T09:45:29.859 INFO:tasks.workunit.client.1.smithi114.stdout:1/272: getdents d4/d3d 0 2024-09-16T09:45:29.859 INFO:tasks.workunit.client.1.smithi114.stdout:1/273: write d4/d2b/f37 [22297,29452] 0 2024-09-16T09:45:29.859 INFO:tasks.workunit.client.1.smithi114.stdout:1/274: truncate d4/d2b/f53 160659 0 2024-09-16T09:45:29.861 INFO:tasks.workunit.client.1.smithi114.stdout:1/275: symlink d4/d3d/d41/l57 0 2024-09-16T09:45:29.870 INFO:tasks.workunit.client.1.smithi114.stdout:1/276: dread d4/d2b/d16/f19 [0,4194304] 0 2024-09-16T09:45:29.872 INFO:tasks.workunit.client.1.smithi114.stdout:1/277: mkdir d4/d3d/d41/d42/d58 0 2024-09-16T09:45:29.873 INFO:tasks.workunit.client.1.smithi114.stdout:1/278: dread d4/d2b/d2f/f4c [0,4194304] 0 2024-09-16T09:45:29.873 INFO:tasks.workunit.client.1.smithi114.stdout:1/279: fdatasync d4/d2b/f53 0 2024-09-16T09:45:29.876 INFO:tasks.workunit.client.1.smithi114.stdout:1/280: creat d4/d3d/f59 x:0 0 0 2024-09-16T09:45:29.879 INFO:tasks.workunit.client.1.smithi114.stdout:1/281: creat d4/d3d/d41/d42/f5a x:0 0 0 2024-09-16T09:45:29.880 INFO:tasks.workunit.client.1.smithi114.stdout:1/282: fsync d4/d2b/f14 0 2024-09-16T09:45:29.882 INFO:tasks.workunit.client.1.smithi114.stdout:1/283: truncate d4/d2b/d16/d47/f48 1674697 0 2024-09-16T09:45:29.882 INFO:tasks.workunit.client.1.smithi114.stdout:1/284: stat d4/d2b/d16/l31 0 2024-09-16T09:45:29.884 INFO:tasks.workunit.client.1.smithi114.stdout:1/285: mknod d4/d3d/d41/d42/d58/c5b 0 2024-09-16T09:45:29.886 INFO:tasks.workunit.client.1.smithi114.stdout:1/286: truncate d4/d2b/f1e 563550 0 2024-09-16T09:45:29.888 INFO:tasks.workunit.client.1.smithi114.stdout:1/287: creat d4/d3d/d41/d42/d58/f5c x:0 0 0 2024-09-16T09:45:29.890 INFO:tasks.workunit.client.1.smithi114.stdout:1/288: creat d4/d2b/d2f/f5d x:0 0 0 2024-09-16T09:45:29.893 INFO:tasks.workunit.client.1.smithi114.stdout:1/289: creat d4/d2b/d29/f5e x:0 0 0 2024-09-16T09:45:29.915 INFO:tasks.workunit.client.1.smithi114.stdout:9/226: fsync d3/f6 0 2024-09-16T09:45:29.918 INFO:tasks.workunit.client.1.smithi114.stdout:1/290: dwrite d4/d2b/d16/f19 [0,4194304] 0 2024-09-16T09:45:29.918 INFO:tasks.workunit.client.1.smithi114.stdout:1/291: readlink d4/d2b/lb 0 2024-09-16T09:45:29.934 INFO:tasks.workunit.client.1.smithi114.stdout:1/292: dwrite d4/d3d/d41/d42/d58/f5c [0,4194304] 0 2024-09-16T09:45:29.942 INFO:tasks.workunit.client.1.smithi114.stdout:1/293: write d4/d2b/d16/f51 [9231722,66271] 0 2024-09-16T09:45:29.951 INFO:tasks.workunit.client.1.smithi114.stdout:1/294: read d4/d3d/d41/d42/d58/f5c [2740697,28392] 0 2024-09-16T09:45:29.960 INFO:tasks.workunit.client.1.smithi114.stdout:1/295: read d4/d2b/d2f/d3a/f4f [1831803,85804] 0 2024-09-16T09:45:29.960 INFO:tasks.workunit.client.1.smithi114.stdout:1/296: truncate d4/d2b/d2f/d3a/f44 237641 0 2024-09-16T09:45:29.960 INFO:tasks.workunit.client.1.smithi114.stdout:1/297: read d4/d2b/d2f/f4c [328701,97607] 0 2024-09-16T09:45:29.978 INFO:tasks.workunit.client.1.smithi114.stdout:1/298: link d4/l20 d4/d2b/l5f 0 2024-09-16T09:45:29.980 INFO:tasks.workunit.client.1.smithi114.stdout:1/299: mknod d4/d2b/d16/c60 0 2024-09-16T09:45:30.052 INFO:tasks.workunit.client.1.smithi114.stdout:7/257: dwrite d2/d9/d2b/d2e/d22/d27/f1e [0,4194304] 0 2024-09-16T09:45:30.053 INFO:tasks.workunit.client.1.smithi114.stdout:7/258: truncate d2/df/f30 2242576 0 2024-09-16T09:45:30.059 INFO:tasks.workunit.client.1.smithi114.stdout:7/259: mkdir d2/d55 0 2024-09-16T09:45:30.059 INFO:tasks.workunit.client.1.smithi114.stdout:7/260: chown d2/d9/d2b/l46 475118704 1 2024-09-16T09:45:30.059 INFO:tasks.workunit.client.1.smithi114.stdout:7/261: stat d2/d9/c42 0 2024-09-16T09:45:30.061 INFO:tasks.workunit.client.1.smithi114.stdout:7/262: creat d2/d9/d2b/d2e/d22/d27/d50/f56 x:0 0 0 2024-09-16T09:45:30.061 INFO:tasks.workunit.client.1.smithi114.stdout:7/263: chown d2/d9/d2b/d2e/c48 3104 1 2024-09-16T09:45:30.061 INFO:tasks.workunit.client.1.smithi114.stdout:7/264: write d2/d9/d2b/d2e/f45 [971141,77653] 0 2024-09-16T09:45:30.062 INFO:tasks.workunit.client.1.smithi114.stdout:7/265: creat d2/d9/d2b/f57 x:0 0 0 2024-09-16T09:45:30.064 INFO:tasks.workunit.client.1.smithi114.stdout:7/266: dread d2/d9/d2b/d2e/d22/d27/f2a [0,4194304] 0 2024-09-16T09:45:30.073 INFO:tasks.workunit.client.1.smithi114.stdout:3/350: rename dc/d38/d56 to dc/de/d18/d78 0 2024-09-16T09:45:30.076 INFO:tasks.workunit.client.1.smithi114.stdout:9/227: rename d3/da/d10/d23/d43/f28 to d3/f49 0 2024-09-16T09:45:30.077 INFO:tasks.workunit.client.1.smithi114.stdout:7/267: dwrite d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:30.078 INFO:tasks.workunit.client.1.smithi114.stdout:1/300: rename d4/d2b/d29/c39 to d4/d2b/c61 0 2024-09-16T09:45:30.078 INFO:tasks.workunit.client.1.smithi114.stdout:1/301: truncate d4/d2b/d2f/d3a/f44 892227 0 2024-09-16T09:45:30.080 INFO:tasks.workunit.client.1.smithi114.stdout:0/194: getdents d1f/d20 0 2024-09-16T09:45:30.084 INFO:tasks.workunit.client.1.smithi114.stdout:0/195: mknod d1f/d22/d2e/d46/c4a 0 2024-09-16T09:45:30.087 INFO:tasks.workunit.client.1.smithi114.stdout:0/196: creat d1f/f4b x:0 0 0 2024-09-16T09:45:30.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/187: fsync d0/d26/d2e/f32 0 2024-09-16T09:45:30.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/188: write d0/fe [2385147,40490] 0 2024-09-16T09:45:30.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/189: readlink d0/l1a 0 2024-09-16T09:45:30.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/190: fsync d0/d26/d2e/f32 0 2024-09-16T09:45:30.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/191: fsync d0/d26/d2e/f32 0 2024-09-16T09:45:30.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/192: chown d0/d26/d29/d2b 4896 1 2024-09-16T09:45:30.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/193: rename d0/d13/f38 to d0/d26/d29/f39 0 2024-09-16T09:45:30.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/194: write d0/d13/f22 [4010637,81205] 0 2024-09-16T09:45:30.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/195: truncate d0/d26/d29/d2b/f36 656996 0 2024-09-16T09:45:30.097 INFO:tasks.workunit.client.1.smithi114.stdout:4/196: creat d0/f3a x:0 0 0 2024-09-16T09:45:30.097 INFO:tasks.workunit.client.1.smithi114.stdout:4/197: write d0/f3a [1017218,24552] 0 2024-09-16T09:45:30.098 INFO:tasks.workunit.client.1.smithi114.stdout:1/302: dwrite d4/d2b/d16/f51 [8388608,4194304] 0 2024-09-16T09:45:30.099 INFO:tasks.workunit.client.1.smithi114.stdout:4/198: read d0/d17/f1e [326360,90129] 0 2024-09-16T09:45:30.099 INFO:tasks.workunit.client.1.smithi114.stdout:4/199: write d0/d26/d29/fd [3926972,110400] 0 2024-09-16T09:45:30.099 INFO:tasks.workunit.client.1.smithi114.stdout:4/200: fdatasync d0/d26/d2e/f32 0 2024-09-16T09:45:30.099 INFO:tasks.workunit.client.1.smithi114.stdout:4/201: chown d0/d26/d2e/l35 14989483 1 2024-09-16T09:45:30.101 INFO:tasks.workunit.client.1.smithi114.stdout:1/303: mkdir d4/d3d/d41/d42/d62 0 2024-09-16T09:45:30.116 INFO:tasks.workunit.client.1.smithi114.stdout:4/202: dwrite d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:30.121 INFO:tasks.workunit.client.1.smithi114.stdout:4/203: rmdir d0/d26/d29 39 2024-09-16T09:45:30.123 INFO:tasks.workunit.client.1.smithi114.stdout:4/204: getdents d0/d17 0 2024-09-16T09:45:30.140 INFO:tasks.workunit.client.1.smithi114.stdout:4/205: dwrite d0/d13/f22 [0,4194304] 0 2024-09-16T09:45:30.140 INFO:tasks.workunit.client.1.smithi114.stdout:4/206: fsync d0/ff 0 2024-09-16T09:45:30.140 INFO:tasks.workunit.client.1.smithi114.stdout:4/207: stat d0/d26/d2e/f32 0 2024-09-16T09:45:30.141 INFO:tasks.workunit.client.1.smithi114.stdout:4/208: mknod d0/d13/d25/c3b 0 2024-09-16T09:45:30.144 INFO:tasks.workunit.client.1.smithi114.stdout:4/209: rename d0/d17 to d0/d26/d3c 0 2024-09-16T09:45:30.155 INFO:tasks.workunit.client.0.smithi111.stdout:0/25: mkdir d0/d8 0 2024-09-16T09:45:30.156 INFO:tasks.workunit.client.0.smithi111.stdout:0/26: write d0/f6 [124018,90767] 0 2024-09-16T09:45:30.156 INFO:tasks.workunit.client.0.smithi111.stdout:0/27: read d0/f6 [14020,99710] 0 2024-09-16T09:45:30.158 INFO:tasks.workunit.client.1.smithi114.stdout:4/210: dwrite d0/f3a [0,4194304] 0 2024-09-16T09:45:30.158 INFO:tasks.workunit.client.1.smithi114.stdout:4/211: stat d0/d13/d25/c3b 0 2024-09-16T09:45:30.158 INFO:tasks.workunit.client.1.smithi114.stdout:4/212: stat d0/d26/d2e 0 2024-09-16T09:45:30.159 INFO:tasks.workunit.client.1.smithi114.stdout:4/213: mknod d0/d26/d29/d2b/c3d 0 2024-09-16T09:45:30.161 INFO:tasks.workunit.client.1.smithi114.stdout:4/214: mkdir d0/d26/d3c/d3e 0 2024-09-16T09:45:30.162 INFO:tasks.workunit.client.0.smithi111.stdout:0/28: dread d0/f6 [0,4194304] 0 2024-09-16T09:45:30.162 INFO:tasks.workunit.client.0.smithi111.stdout:0/29: chown d0/l5 10 1 2024-09-16T09:45:30.163 INFO:tasks.workunit.client.1.smithi114.stdout:4/215: mknod d0/d26/d2e/c3f 0 2024-09-16T09:45:30.165 INFO:tasks.workunit.client.1.smithi114.stdout:4/216: rmdir d0/d13/d25 39 2024-09-16T09:45:30.165 INFO:tasks.workunit.client.1.smithi114.stdout:4/217: stat d0/d26/d3c/f1e 0 2024-09-16T09:45:30.166 INFO:tasks.workunit.client.1.smithi114.stdout:4/218: mkdir d0/d26/d40 0 2024-09-16T09:45:30.169 INFO:tasks.workunit.client.1.smithi114.stdout:4/219: symlink d0/d26/d29/l41 0 2024-09-16T09:45:30.171 INFO:tasks.workunit.client.1.smithi114.stdout:4/220: link d0/d26/d2e/l35 d0/l42 0 2024-09-16T09:45:30.174 INFO:tasks.workunit.client.1.smithi114.stdout:4/221: symlink d0/d26/d3c/l43 0 2024-09-16T09:45:30.174 INFO:tasks.workunit.client.1.smithi114.stdout:4/222: dread - d0/d26/d2e/f32 zero size 2024-09-16T09:45:30.179 INFO:tasks.workunit.client.0.smithi111.stdout:0/30: dwrite d0/f6 [0,4194304] 0 2024-09-16T09:45:30.190 INFO:tasks.workunit.client.0.smithi111.stdout:0/31: write d0/f6 [2281638,28991] 0 2024-09-16T09:45:30.198 INFO:tasks.workunit.client.1.smithi114.stdout:4/223: dwrite d0/d26/d2e/f33 [0,4194304] 0 2024-09-16T09:45:30.200 INFO:tasks.workunit.client.1.smithi114.stdout:4/224: creat d0/d26/d40/f44 x:0 0 0 2024-09-16T09:45:30.207 INFO:tasks.workunit.client.0.smithi111.stdout:0/32: dread d0/f6 [0,4194304] 0 2024-09-16T09:45:30.221 INFO:tasks.workunit.client.1.smithi114.stdout:4/225: dwrite d0/d26/d29/d2b/f36 [0,4194304] 0 2024-09-16T09:45:30.225 INFO:tasks.workunit.client.1.smithi114.stdout:4/226: unlink d0/l42 0 2024-09-16T09:45:30.225 INFO:tasks.workunit.client.1.smithi114.stdout:4/227: readlink d0/l24 0 2024-09-16T09:45:30.361 INFO:tasks.workunit.client.1.smithi114.stdout:0/197: truncate d1f/d27/f3a 826951 0 2024-09-16T09:45:30.362 INFO:tasks.workunit.client.1.smithi114.stdout:0/198: link c12 d1f/d2d/c4c 0 2024-09-16T09:45:30.365 INFO:tasks.workunit.client.1.smithi114.stdout:0/199: rename l17 to d1f/d27/d47/l4d 0 2024-09-16T09:45:30.367 INFO:tasks.workunit.client.1.smithi114.stdout:0/200: getdents d1f/d27 0 2024-09-16T09:45:30.367 INFO:tasks.workunit.client.1.smithi114.stdout:0/201: getdents d1f/d20 0 2024-09-16T09:45:30.369 INFO:tasks.workunit.client.1.smithi114.stdout:0/202: link f16 d1f/d20/d48/f4e 0 2024-09-16T09:45:30.369 INFO:tasks.workunit.client.1.smithi114.stdout:0/203: dread - d1f/d22/f49 zero size 2024-09-16T09:45:30.372 INFO:tasks.workunit.client.1.smithi114.stdout:0/204: unlink fa 0 2024-09-16T09:45:30.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:30 smithi114 ceph-mon[35635]: pgmap v238: 65 pgs: 65 active+clean; 284 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 16 MiB/s wr, 599 op/s 2024-09-16T09:45:30.456 INFO:tasks.workunit.client.1.smithi114.stdout:7/268: getdents d2/d9/d2b 0 2024-09-16T09:45:30.467 INFO:tasks.workunit.client.0.smithi111.stdout:6/6: mkdir d0 0 2024-09-16T09:45:30.467 INFO:tasks.workunit.client.1.smithi114.stdout:5/300: sync 2024-09-16T09:45:30.467 INFO:tasks.workunit.client.1.smithi114.stdout:2/266: sync 2024-09-16T09:45:30.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/295: sync 2024-09-16T09:45:30.468 INFO:tasks.workunit.client.1.smithi114.stdout:6/220: sync 2024-09-16T09:45:30.468 INFO:tasks.workunit.client.1.smithi114.stdout:6/221: write d6/da/f1e [403427,49934] 0 2024-09-16T09:45:30.468 INFO:tasks.workunit.client.0.smithi111.stdout:5/3: creat f0 x:0 0 0 2024-09-16T09:45:30.468 INFO:tasks.workunit.client.0.smithi111.stdout:5/4: chown f0 0 1 2024-09-16T09:45:30.468 INFO:tasks.workunit.client.0.smithi111.stdout:5/5: dread - f0 zero size 2024-09-16T09:45:30.468 INFO:tasks.workunit.client.0.smithi111.stdout:5/6: chown f0 70195359 1 2024-09-16T09:45:30.469 INFO:tasks.workunit.client.0.smithi111.stdout:7/3: mknod c0 0 2024-09-16T09:45:30.469 INFO:tasks.workunit.client.0.smithi111.stdout:7/4: write - no filename 2024-09-16T09:45:30.470 INFO:tasks.workunit.client.1.smithi114.stdout:8/296: fdatasync d4/fa 0 2024-09-16T09:45:30.470 INFO:tasks.workunit.client.1.smithi114.stdout:8/297: write d4/db/d3e/d47/f5e [307730,115389] 0 2024-09-16T09:45:30.470 INFO:tasks.workunit.client.1.smithi114.stdout:8/298: read d4/db/df/f12 [1098180,24415] 0 2024-09-16T09:45:30.471 INFO:tasks.workunit.client.0.smithi111.stdout:4/14: symlink l0 0 2024-09-16T09:45:30.471 INFO:tasks.workunit.client.0.smithi111.stdout:4/15: chown l0 109775 1 2024-09-16T09:45:30.471 INFO:tasks.workunit.client.0.smithi111.stdout:4/16: fdatasync - no filename 2024-09-16T09:45:30.471 INFO:tasks.workunit.client.0.smithi111.stdout:4/17: truncate - no filename 2024-09-16T09:45:30.471 INFO:tasks.workunit.client.0.smithi111.stdout:4/18: dread - no filename 2024-09-16T09:45:30.472 INFO:tasks.workunit.client.1.smithi114.stdout:2/267: unlink d1/d8/d10/l53 0 2024-09-16T09:45:30.473 INFO:tasks.workunit.client.0.smithi111.stdout:9/0: mkdir d0 0 2024-09-16T09:45:30.473 INFO:tasks.workunit.client.0.smithi111.stdout:9/1: chown d0 15126083 1 2024-09-16T09:45:30.474 INFO:tasks.workunit.client.1.smithi114.stdout:7/269: dwrite d2/d9/d2b/d2e/d3e/f44 [0,4194304] 0 2024-09-16T09:45:30.475 INFO:tasks.workunit.client.1.smithi114.stdout:8/299: rename d4/db/dd/d1b to d4/db/d39/d65 0 2024-09-16T09:45:30.477 INFO:tasks.workunit.client.1.smithi114.stdout:2/268: creat d1/d8/d10/f67 x:0 0 0 2024-09-16T09:45:30.479 INFO:tasks.workunit.client.1.smithi114.stdout:6/222: dread d6/fc [0,4194304] 0 2024-09-16T09:45:30.479 INFO:tasks.workunit.client.1.smithi114.stdout:6/223: chown d6/da/d10 927028 1 2024-09-16T09:45:30.480 INFO:tasks.workunit.client.1.smithi114.stdout:6/224: write d6/da/d36/f3f [959118,33081] 0 2024-09-16T09:45:30.480 INFO:tasks.workunit.client.1.smithi114.stdout:6/225: write d6/da/f3e [320612,96353] 0 2024-09-16T09:45:30.480 INFO:tasks.workunit.client.1.smithi114.stdout:6/226: write d6/da/d36/f3d [1412638,79635] 0 2024-09-16T09:45:30.481 INFO:tasks.workunit.client.1.smithi114.stdout:7/270: write d2/df/f30 [3561097,13652] 0 2024-09-16T09:45:30.482 INFO:tasks.workunit.client.1.smithi114.stdout:8/300: unlink d4/d1f/l60 0 2024-09-16T09:45:30.483 INFO:tasks.workunit.client.1.smithi114.stdout:8/301: chown d4/db/df/f3d 162 1 2024-09-16T09:45:30.483 INFO:tasks.workunit.client.1.smithi114.stdout:8/302: fdatasync d4/fa 0 2024-09-16T09:45:30.483 INFO:tasks.workunit.client.1.smithi114.stdout:6/227: truncate d6/da/d36/f38 513032 0 2024-09-16T09:45:30.484 INFO:tasks.workunit.client.1.smithi114.stdout:8/303: dread d4/db/d39/d65/d28/f31 [0,4194304] 0 2024-09-16T09:45:30.485 INFO:tasks.workunit.client.1.smithi114.stdout:8/304: chown d4/db/d39/d65/l26 457426462 1 2024-09-16T09:45:30.488 INFO:tasks.workunit.client.1.smithi114.stdout:7/271: read d2/f1c [31195,100416] 0 2024-09-16T09:45:30.488 INFO:tasks.workunit.client.1.smithi114.stdout:7/272: write d2/d9/fc [4846087,109977] 0 2024-09-16T09:45:30.488 INFO:tasks.workunit.client.1.smithi114.stdout:7/273: stat d2/df/f30 0 2024-09-16T09:45:30.491 INFO:tasks.workunit.client.1.smithi114.stdout:7/274: mknod d2/d55/c58 0 2024-09-16T09:45:30.491 INFO:tasks.workunit.client.1.smithi114.stdout:7/275: fdatasync d2/f4a 0 2024-09-16T09:45:30.491 INFO:tasks.workunit.client.1.smithi114.stdout:7/276: read d2/d9/d2b/d2e/d3e/f44 [870500,31731] 0 2024-09-16T09:45:30.491 INFO:tasks.workunit.client.1.smithi114.stdout:7/277: chown d2/d9/d2b 15019351 1 2024-09-16T09:45:30.491 INFO:tasks.workunit.client.1.smithi114.stdout:7/278: write d2/d9/d2b/d2e/d22/f49 [924324,75647] 0 2024-09-16T09:45:30.491 INFO:tasks.workunit.client.1.smithi114.stdout:7/279: write d2/df/f10 [1369302,89602] 0 2024-09-16T09:45:30.494 INFO:tasks.workunit.client.1.smithi114.stdout:6/228: write f5 [9672246,127461] 0 2024-09-16T09:45:30.494 INFO:tasks.workunit.client.1.smithi114.stdout:6/229: write d6/f44 [91927,24290] 0 2024-09-16T09:45:30.495 INFO:tasks.workunit.client.1.smithi114.stdout:2/269: dwrite d1/d8/d10/f22 [0,4194304] 0 2024-09-16T09:45:30.496 INFO:tasks.workunit.client.1.smithi114.stdout:7/280: mkdir d2/d9/d2b/d59 0 2024-09-16T09:45:30.498 INFO:tasks.workunit.client.1.smithi114.stdout:7/281: creat d2/d9/d2b/f5a x:0 0 0 2024-09-16T09:45:30.499 INFO:tasks.workunit.client.1.smithi114.stdout:7/282: fdatasync d2/df/f3a 0 2024-09-16T09:45:30.501 INFO:tasks.workunit.client.1.smithi114.stdout:7/283: symlink d2/d9/d2b/d2e/d22/d4c/l5b 0 2024-09-16T09:45:30.504 INFO:tasks.workunit.client.0.smithi111.stdout:0/33: rmdir d0/d8 0 2024-09-16T09:45:30.504 INFO:tasks.workunit.client.0.smithi111.stdout:0/34: rename d0 to d0/d9 22 2024-09-16T09:45:30.505 INFO:tasks.workunit.client.1.smithi114.stdout:8/305: dwrite d4/f3f [4194304,4194304] 0 2024-09-16T09:45:30.505 INFO:tasks.workunit.client.1.smithi114.stdout:8/306: chown d4/db/d3e/d47/d64 53169 1 2024-09-16T09:45:30.506 INFO:tasks.workunit.client.1.smithi114.stdout:7/284: creat d2/d9/f5c x:0 0 0 2024-09-16T09:45:30.507 INFO:tasks.workunit.client.0.smithi111.stdout:5/7: rename f0 to f1 0 2024-09-16T09:45:30.509 INFO:tasks.workunit.client.0.smithi111.stdout:7/5: unlink c0 0 2024-09-16T09:45:30.511 INFO:tasks.workunit.client.0.smithi111.stdout:4/19: mknod c1 0 2024-09-16T09:45:30.511 INFO:tasks.workunit.client.0.smithi111.stdout:4/20: dwrite - no filename 2024-09-16T09:45:30.512 INFO:tasks.workunit.client.0.smithi111.stdout:9/2: creat d0/f1 x:0 0 0 2024-09-16T09:45:30.514 INFO:tasks.workunit.client.0.smithi111.stdout:0/35: creat d0/fa x:0 0 0 2024-09-16T09:45:30.514 INFO:tasks.workunit.client.0.smithi111.stdout:5/8: symlink l2 0 2024-09-16T09:45:30.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/6: mkdir d1 0 2024-09-16T09:45:30.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/7: dwrite - no filename 2024-09-16T09:45:30.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/8: write - no filename 2024-09-16T09:45:30.517 INFO:tasks.workunit.client.0.smithi111.stdout:4/21: unlink l0 0 2024-09-16T09:45:30.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/22: write - no filename 2024-09-16T09:45:30.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/23: chown c1 172 1 2024-09-16T09:45:30.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/24: write - no filename 2024-09-16T09:45:30.520 INFO:tasks.workunit.client.0.smithi111.stdout:0/36: link d0/c7 d0/cb 0 2024-09-16T09:45:30.523 INFO:tasks.workunit.client.0.smithi111.stdout:7/9: symlink d1/l2 0 2024-09-16T09:45:30.523 INFO:tasks.workunit.client.0.smithi111.stdout:7/10: dread - no filename 2024-09-16T09:45:30.524 INFO:tasks.workunit.client.0.smithi111.stdout:7/11: fsync - no filename 2024-09-16T09:45:30.525 INFO:tasks.workunit.client.0.smithi111.stdout:4/25: mkdir d2 0 2024-09-16T09:45:30.525 INFO:tasks.workunit.client.0.smithi111.stdout:4/26: dread - no filename 2024-09-16T09:45:30.526 INFO:tasks.workunit.client.0.smithi111.stdout:0/37: dread d0/f6 [0,4194304] 0 2024-09-16T09:45:30.526 INFO:tasks.workunit.client.0.smithi111.stdout:7/12: link d1/l2 d1/l3 0 2024-09-16T09:45:30.527 INFO:tasks.workunit.client.0.smithi111.stdout:4/27: mknod d2/c3 0 2024-09-16T09:45:30.527 INFO:tasks.workunit.client.0.smithi111.stdout:4/28: write - no filename 2024-09-16T09:45:30.527 INFO:tasks.workunit.client.0.smithi111.stdout:4/29: dread - no filename 2024-09-16T09:45:30.527 INFO:tasks.workunit.client.0.smithi111.stdout:4/30: write - no filename 2024-09-16T09:45:30.529 INFO:tasks.workunit.client.0.smithi111.stdout:0/38: unlink d0/c4 0 2024-09-16T09:45:30.530 INFO:tasks.workunit.client.0.smithi111.stdout:7/13: mknod d1/c4 0 2024-09-16T09:45:30.530 INFO:tasks.workunit.client.0.smithi111.stdout:4/31: mknod d2/c4 0 2024-09-16T09:45:30.531 INFO:tasks.workunit.client.0.smithi111.stdout:0/39: mknod d0/cc 0 2024-09-16T09:45:30.532 INFO:tasks.workunit.client.0.smithi111.stdout:7/14: mknod d1/c5 0 2024-09-16T09:45:30.533 INFO:tasks.workunit.client.0.smithi111.stdout:7/15: rename d1 to d1/d6 22 2024-09-16T09:45:30.533 INFO:tasks.workunit.client.0.smithi111.stdout:7/16: read - no filename 2024-09-16T09:45:30.533 INFO:tasks.workunit.client.0.smithi111.stdout:7/17: fdatasync - no filename 2024-09-16T09:45:30.533 INFO:tasks.workunit.client.0.smithi111.stdout:7/18: dread - no filename 2024-09-16T09:45:30.533 INFO:tasks.workunit.client.0.smithi111.stdout:7/19: write - no filename 2024-09-16T09:45:30.534 INFO:tasks.workunit.client.1.smithi114.stdout:6/230: dwrite d6/da/f15 [0,4194304] 0 2024-09-16T09:45:30.534 INFO:tasks.workunit.client.1.smithi114.stdout:2/270: dwrite d1/d8/d10/f35 [4194304,4194304] 0 2024-09-16T09:45:30.534 INFO:tasks.workunit.client.1.smithi114.stdout:7/285: dwrite d2/d9/d2b/f57 [0,4194304] 0 2024-09-16T09:45:30.534 INFO:tasks.workunit.client.1.smithi114.stdout:8/307: dwrite d4/db/df/f12 [0,4194304] 0 2024-09-16T09:45:30.534 INFO:tasks.workunit.client.0.smithi111.stdout:4/32: creat d2/f5 x:0 0 0 2024-09-16T09:45:30.535 INFO:tasks.workunit.client.0.smithi111.stdout:0/40: creat d0/fd x:0 0 0 2024-09-16T09:45:30.535 INFO:tasks.workunit.client.0.smithi111.stdout:0/41: write d0/fa [48648,93187] 0 2024-09-16T09:45:30.535 INFO:tasks.workunit.client.0.smithi111.stdout:0/42: truncate d0/fa 1071653 0 2024-09-16T09:45:30.535 INFO:tasks.workunit.client.0.smithi111.stdout:7/20: unlink d1/l2 0 2024-09-16T09:45:30.535 INFO:tasks.workunit.client.0.smithi111.stdout:7/21: dread - no filename 2024-09-16T09:45:30.537 INFO:tasks.workunit.client.0.smithi111.stdout:4/33: mkdir d2/d6 0 2024-09-16T09:45:30.538 INFO:tasks.workunit.client.0.smithi111.stdout:0/43: mknod d0/ce 0 2024-09-16T09:45:30.541 INFO:tasks.workunit.client.1.smithi114.stdout:2/271: rename d1/d8/d10/d16/d1d/d41 to d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68 0 2024-09-16T09:45:30.542 INFO:tasks.workunit.client.0.smithi111.stdout:7/22: creat d1/f7 x:0 0 0 2024-09-16T09:45:30.544 INFO:tasks.workunit.client.1.smithi114.stdout:6/231: mknod d6/da/d10/d40/c49 0 2024-09-16T09:45:30.544 INFO:tasks.workunit.client.1.smithi114.stdout:6/232: write d6/fc [3096370,15831] 0 2024-09-16T09:45:30.546 INFO:tasks.workunit.client.0.smithi111.stdout:7/23: unlink d1/f7 0 2024-09-16T09:45:30.546 INFO:tasks.workunit.client.0.smithi111.stdout:7/24: chown d1/c4 7265998 1 2024-09-16T09:45:30.546 INFO:tasks.workunit.client.0.smithi111.stdout:7/25: dread - no filename 2024-09-16T09:45:30.546 INFO:tasks.workunit.client.0.smithi111.stdout:7/26: dread - no filename 2024-09-16T09:45:30.547 INFO:tasks.workunit.client.0.smithi111.stdout:7/27: symlink d1/l8 0 2024-09-16T09:45:30.547 INFO:tasks.workunit.client.0.smithi111.stdout:7/28: dwrite - no filename 2024-09-16T09:45:30.550 INFO:tasks.workunit.client.1.smithi114.stdout:7/286: mknod d2/c5d 0 2024-09-16T09:45:30.550 INFO:tasks.workunit.client.1.smithi114.stdout:7/287: rename d2/d9 to d2/d9/d2b/d2e/d22/d27/d4d/d5e 22 2024-09-16T09:45:30.551 INFO:tasks.workunit.client.1.smithi114.stdout:8/308: link d4/d1f/f42 d4/db/d39/d3c/d4e/f66 0 2024-09-16T09:45:30.554 INFO:tasks.workunit.client.0.smithi111.stdout:0/44: dwrite d0/fd [0,4194304] 0 2024-09-16T09:45:30.558 INFO:tasks.workunit.client.0.smithi111.stdout:0/45: creat d0/ff x:0 0 0 2024-09-16T09:45:30.559 INFO:tasks.workunit.client.1.smithi114.stdout:2/272: mknod d1/d8/d10/d16/d1d/d4a/d3e/d5b/c69 0 2024-09-16T09:45:30.560 INFO:tasks.workunit.client.1.smithi114.stdout:6/233: creat d6/da/f4a x:0 0 0 2024-09-16T09:45:30.561 INFO:tasks.workunit.client.0.smithi111.stdout:0/46: link d0/ff d0/f10 0 2024-09-16T09:45:30.561 INFO:tasks.workunit.client.0.smithi111.stdout:0/47: truncate d0/f10 656039 0 2024-09-16T09:45:30.562 INFO:tasks.workunit.client.1.smithi114.stdout:8/309: creat d4/db/d39/d65/d28/f67 x:0 0 0 2024-09-16T09:45:30.563 INFO:tasks.workunit.client.0.smithi111.stdout:0/48: creat d0/f11 x:0 0 0 2024-09-16T09:45:30.564 INFO:tasks.workunit.client.1.smithi114.stdout:7/288: dwrite d2/d9/d2b/d2e/d22/d27/f40 [0,4194304] 0 2024-09-16T09:45:30.565 INFO:tasks.workunit.client.0.smithi111.stdout:0/49: stat d0/c7 0 2024-09-16T09:45:30.566 INFO:tasks.workunit.client.0.smithi111.stdout:0/50: creat d0/f12 x:0 0 0 2024-09-16T09:45:30.567 INFO:tasks.workunit.client.1.smithi114.stdout:7/289: creat d2/d9/d51/f5f x:0 0 0 2024-09-16T09:45:30.568 INFO:tasks.workunit.client.0.smithi111.stdout:0/51: rename d0/fa to d0/f13 0 2024-09-16T09:45:30.569 INFO:tasks.workunit.client.1.smithi114.stdout:7/290: mknod d2/d9/d2b/d2e/d3e/c60 0 2024-09-16T09:45:30.571 INFO:tasks.workunit.client.0.smithi111.stdout:0/52: creat d0/f14 x:0 0 0 2024-09-16T09:45:30.574 INFO:tasks.workunit.client.1.smithi114.stdout:6/234: dwrite d6/f23 [0,4194304] 0 2024-09-16T09:45:30.574 INFO:tasks.workunit.client.1.smithi114.stdout:6/235: truncate d6/f35 690970 0 2024-09-16T09:45:30.584 INFO:tasks.workunit.client.1.smithi114.stdout:6/236: dread f5 [0,4194304] 0 2024-09-16T09:45:30.587 INFO:tasks.workunit.client.1.smithi114.stdout:6/237: unlink d6/da/d10/c24 0 2024-09-16T09:45:30.588 INFO:tasks.workunit.client.1.smithi114.stdout:6/238: write d6/d2d/f37 [88190,20723] 0 2024-09-16T09:45:30.603 INFO:tasks.workunit.client.1.smithi114.stdout:4/228: getdents d0 0 2024-09-16T09:45:30.604 INFO:tasks.workunit.client.1.smithi114.stdout:4/229: mkdir d0/d26/d3c/d45 0 2024-09-16T09:45:30.604 INFO:tasks.workunit.client.1.smithi114.stdout:4/230: truncate d0/d26/d40/f44 1045269 0 2024-09-16T09:45:30.605 INFO:tasks.workunit.client.1.smithi114.stdout:4/231: truncate d0/d26/d29/f14 1155836 0 2024-09-16T09:45:30.621 INFO:tasks.workunit.client.1.smithi114.stdout:4/232: dwrite d0/d26/d2e/f32 [0,4194304] 0 2024-09-16T09:45:30.621 INFO:tasks.workunit.client.1.smithi114.stdout:4/233: chown d0/d26/d29/f1d 28 1 2024-09-16T09:45:30.629 INFO:tasks.workunit.client.1.smithi114.stdout:4/234: dread d0/d26/d29/f1d [4194304,4194304] 0 2024-09-16T09:45:30.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/235: mkdir d0/d26/d2e/d2f/d46 0 2024-09-16T09:45:30.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/236: chown d0/d26/d3c/l43 31 1 2024-09-16T09:45:30.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/237: write d0/d26/d40/f44 [1898329,91476] 0 2024-09-16T09:45:30.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:30 smithi111 ceph-mon[27997]: pgmap v238: 65 pgs: 65 active+clean; 284 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.8 MiB/s rd, 16 MiB/s wr, 599 op/s 2024-09-16T09:45:30.634 INFO:tasks.workunit.client.1.smithi114.stdout:4/238: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:30.634 INFO:tasks.workunit.client.1.smithi114.stdout:4/239: write d0/d26/d29/fd [3006096,59078] 0 2024-09-16T09:45:30.635 INFO:tasks.workunit.client.1.smithi114.stdout:4/240: symlink d0/d26/d2e/d2f/d46/l47 0 2024-09-16T09:45:30.665 INFO:tasks.workunit.client.1.smithi114.stdout:2/273: rmdir d1/d8 39 2024-09-16T09:45:30.665 INFO:tasks.workunit.client.1.smithi114.stdout:2/274: write d1/d8/d10/d16/d1d/d4a/d3e/f48 [4006461,49315] 0 2024-09-16T09:45:30.666 INFO:tasks.workunit.client.1.smithi114.stdout:2/275: link d1/d8/d10/d16/c23 d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/c6a 0 2024-09-16T09:45:30.666 INFO:tasks.workunit.client.1.smithi114.stdout:2/276: write d1/d8/d10/d16/f51 [1513313,126224] 0 2024-09-16T09:45:30.667 INFO:tasks.workunit.client.1.smithi114.stdout:2/277: mknod d1/d8/d10/d16/d1d/d4a/d3e/d5b/d5e/c6b 0 2024-09-16T09:45:30.667 INFO:tasks.workunit.client.1.smithi114.stdout:2/278: fdatasync d1/d8/d10/d16/d1d/f5f 0 2024-09-16T09:45:30.667 INFO:tasks.workunit.client.1.smithi114.stdout:2/279: fdatasync d1/d8/d10/d16/d1d/f5c 0 2024-09-16T09:45:30.668 INFO:tasks.workunit.client.1.smithi114.stdout:2/280: symlink d1/d8/d10/d16/d1d/d4a/d3e/d5b/d5e/l6c 0 2024-09-16T09:45:30.669 INFO:tasks.workunit.client.1.smithi114.stdout:2/281: mknod d1/d8/d10/d16/d60/c6d 0 2024-09-16T09:45:30.669 INFO:tasks.workunit.client.1.smithi114.stdout:2/282: stat d1/d8/d10/d16 0 2024-09-16T09:45:30.670 INFO:tasks.workunit.client.1.smithi114.stdout:2/283: dread d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f56 [0,4194304] 0 2024-09-16T09:45:30.671 INFO:tasks.workunit.client.1.smithi114.stdout:9/228: sync 2024-09-16T09:45:30.671 INFO:tasks.workunit.client.1.smithi114.stdout:3/351: sync 2024-09-16T09:45:30.671 INFO:tasks.workunit.client.1.smithi114.stdout:1/304: sync 2024-09-16T09:45:30.671 INFO:tasks.workunit.client.1.smithi114.stdout:2/284: mknod d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/c6e 0 2024-09-16T09:45:30.672 INFO:tasks.workunit.client.1.smithi114.stdout:3/352: mkdir dc/de/d17/d79 0 2024-09-16T09:45:30.672 INFO:tasks.workunit.client.1.smithi114.stdout:3/353: truncate dc/f27 646838 0 2024-09-16T09:45:30.673 INFO:tasks.workunit.client.1.smithi114.stdout:1/305: creat d4/d2b/d2f/d3a/d55/f63 x:0 0 0 2024-09-16T09:45:30.674 INFO:tasks.workunit.client.1.smithi114.stdout:2/285: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f6f x:0 0 0 2024-09-16T09:45:30.676 INFO:tasks.workunit.client.1.smithi114.stdout:1/306: creat d4/d3d/d41/f64 x:0 0 0 2024-09-16T09:45:30.676 INFO:tasks.workunit.client.1.smithi114.stdout:1/307: dread - d4/d2b/d29/f5e zero size 2024-09-16T09:45:30.676 INFO:tasks.workunit.client.1.smithi114.stdout:3/354: dread f9 [0,4194304] 0 2024-09-16T09:45:30.676 INFO:tasks.workunit.client.1.smithi114.stdout:3/355: chown dc/de/d18/d78/d5c 241 1 2024-09-16T09:45:30.677 INFO:tasks.workunit.client.1.smithi114.stdout:2/286: link d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/c58 d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/c70 0 2024-09-16T09:45:30.680 INFO:tasks.workunit.client.1.smithi114.stdout:1/308: getdents d4/d3d 0 2024-09-16T09:45:30.680 INFO:tasks.workunit.client.1.smithi114.stdout:1/309: write d4/f25 [882965,82206] 0 2024-09-16T09:45:30.680 INFO:tasks.workunit.client.1.smithi114.stdout:2/287: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/f71 x:0 0 0 2024-09-16T09:45:30.680 INFO:tasks.workunit.client.1.smithi114.stdout:2/288: truncate d1/d8/d10/f50 366419 0 2024-09-16T09:45:30.681 INFO:tasks.workunit.client.1.smithi114.stdout:2/289: stat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f36 0 2024-09-16T09:45:30.682 INFO:tasks.workunit.client.1.smithi114.stdout:1/310: creat d4/d2b/d16/f65 x:0 0 0 2024-09-16T09:45:30.695 INFO:tasks.workunit.client.1.smithi114.stdout:9/229: dwrite d3/da/d10/d23/d43/f18 [0,4194304] 0 2024-09-16T09:45:30.703 INFO:tasks.workunit.client.1.smithi114.stdout:3/356: dwrite dc/de/d10/f3c [0,4194304] 0 2024-09-16T09:45:30.703 INFO:tasks.workunit.client.1.smithi114.stdout:2/290: dwrite d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f36 [0,4194304] 0 2024-09-16T09:45:30.705 INFO:tasks.workunit.client.1.smithi114.stdout:3/357: creat dc/de/d18/d78/d5c/d5d/f7a x:0 0 0 2024-09-16T09:45:30.708 INFO:tasks.workunit.client.1.smithi114.stdout:3/358: unlink dc/d38/d3f/f6d 0 2024-09-16T09:45:30.708 INFO:tasks.workunit.client.1.smithi114.stdout:3/359: getdents dc/de/d17/d2d 0 2024-09-16T09:45:30.709 INFO:tasks.workunit.client.1.smithi114.stdout:9/230: dread d3/da/d10/f21 [0,4194304] 0 2024-09-16T09:45:30.710 INFO:tasks.workunit.client.1.smithi114.stdout:3/360: symlink dc/de/d17/l7b 0 2024-09-16T09:45:30.710 INFO:tasks.workunit.client.1.smithi114.stdout:2/291: dread d1/d8/d10/d16/f51 [0,4194304] 0 2024-09-16T09:45:30.711 INFO:tasks.workunit.client.1.smithi114.stdout:9/231: link d3/da/d10/c24 d3/da/d10/d23/d29/d2c/d45/c4a 0 2024-09-16T09:45:30.713 INFO:tasks.workunit.client.1.smithi114.stdout:2/292: creat d1/d8/f72 x:0 0 0 2024-09-16T09:45:30.713 INFO:tasks.workunit.client.1.smithi114.stdout:2/293: write d1/d8/f72 [388488,22673] 0 2024-09-16T09:45:30.713 INFO:tasks.workunit.client.1.smithi114.stdout:2/294: link d1/d8/d10/d16/d1d/d4a/d3e/d5b/f71 d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f73 0 2024-09-16T09:45:30.716 INFO:tasks.workunit.client.1.smithi114.stdout:3/361: dread dc/de/d17/f5e [0,4194304] 0 2024-09-16T09:45:30.718 INFO:tasks.workunit.client.1.smithi114.stdout:3/362: creat dc/de/d17/d79/f7c x:0 0 0 2024-09-16T09:45:30.719 INFO:tasks.workunit.client.1.smithi114.stdout:3/363: dread dc/de/d18/f30 [0,4194304] 0 2024-09-16T09:45:30.719 INFO:tasks.workunit.client.1.smithi114.stdout:3/364: chown dc/de/d17/d2d/f63 1819990221 1 2024-09-16T09:45:30.728 INFO:tasks.workunit.client.1.smithi114.stdout:9/232: dwrite d3/da/fb [0,4194304] 0 2024-09-16T09:45:30.731 INFO:tasks.workunit.client.1.smithi114.stdout:9/233: creat d3/da/d10/d23/d29/f4b x:0 0 0 2024-09-16T09:45:30.736 INFO:tasks.workunit.client.0.smithi111.stdout:1/12: truncate f1 204361 0 2024-09-16T09:45:30.736 INFO:tasks.workunit.client.0.smithi111.stdout:1/13: mkdir d3 0 2024-09-16T09:45:30.737 INFO:tasks.workunit.client.0.smithi111.stdout:1/14: chown f1 102368 1 2024-09-16T09:45:30.740 INFO:tasks.workunit.client.0.smithi111.stdout:1/15: mknod d3/c4 0 2024-09-16T09:45:30.741 INFO:tasks.workunit.client.1.smithi114.stdout:3/365: dwrite dc/de/d18/f35 [0,4194304] 0 2024-09-16T09:45:30.741 INFO:tasks.workunit.client.1.smithi114.stdout:7/291: truncate d2/df/f10 1695312 0 2024-09-16T09:45:30.742 INFO:tasks.workunit.client.1.smithi114.stdout:3/366: symlink dc/de/l7d 0 2024-09-16T09:45:30.742 INFO:tasks.workunit.client.1.smithi114.stdout:3/367: fdatasync dc/d38/d3f/f5f 0 2024-09-16T09:45:30.742 INFO:tasks.workunit.client.1.smithi114.stdout:3/368: write dc/de/d17/d79/f7c [670809,53953] 0 2024-09-16T09:45:30.742 INFO:tasks.workunit.client.1.smithi114.stdout:7/292: truncate d2/d9/d2b/d2e/d22/d27/f1e 2696042 0 2024-09-16T09:45:30.743 INFO:tasks.workunit.client.1.smithi114.stdout:3/369: mknod dc/de/d18/d78/d5c/d6e/c7e 0 2024-09-16T09:45:30.744 INFO:tasks.workunit.client.1.smithi114.stdout:6/239: truncate d6/da/d36/f3b 9474083 0 2024-09-16T09:45:30.748 INFO:tasks.workunit.client.1.smithi114.stdout:9/234: dwrite d3/f49 [0,4194304] 0 2024-09-16T09:45:30.749 INFO:tasks.workunit.client.1.smithi114.stdout:9/235: mkdir d3/da/d10/d23/d43/d1e/d4c 0 2024-09-16T09:45:30.749 INFO:tasks.workunit.client.1.smithi114.stdout:9/236: write d3/da/d10/d23/f36 [230053,89370] 0 2024-09-16T09:45:30.751 INFO:tasks.workunit.client.1.smithi114.stdout:9/237: creat d3/da/f4d x:0 0 0 2024-09-16T09:45:30.751 INFO:tasks.workunit.client.1.smithi114.stdout:7/293: dread d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:30.752 INFO:tasks.workunit.client.1.smithi114.stdout:7/294: write d2/d9/f5c [1046238,32858] 0 2024-09-16T09:45:30.752 INFO:tasks.workunit.client.1.smithi114.stdout:7/295: write d2/d9/d2b/f5a [69622,96788] 0 2024-09-16T09:45:30.752 INFO:tasks.workunit.client.1.smithi114.stdout:7/296: read d2/d9/d2b/d2e/d3e/f44 [341948,23985] 0 2024-09-16T09:45:30.752 INFO:tasks.workunit.client.1.smithi114.stdout:7/297: chown d2/d9/f23 442062883 1 2024-09-16T09:45:30.752 INFO:tasks.workunit.client.1.smithi114.stdout:9/238: getdents d3/da/d10/d23/d43 0 2024-09-16T09:45:30.753 INFO:tasks.workunit.client.0.smithi111.stdout:5/9: getdents . 0 2024-09-16T09:45:30.754 INFO:tasks.workunit.client.1.smithi114.stdout:7/298: creat d2/d9/d2b/f61 x:0 0 0 2024-09-16T09:45:30.754 INFO:tasks.workunit.client.1.smithi114.stdout:3/370: write dc/de/d18/f22 [2379474,23520] 0 2024-09-16T09:45:30.754 INFO:tasks.workunit.client.1.smithi114.stdout:9/239: symlink d3/da/d10/d23/l4e 0 2024-09-16T09:45:30.754 INFO:tasks.workunit.client.1.smithi114.stdout:9/240: write d3/da/d10/d23/d43/f16 [1479072,24417] 0 2024-09-16T09:45:30.755 INFO:tasks.workunit.client.1.smithi114.stdout:7/299: mknod d2/d9/d2b/d2e/c62 0 2024-09-16T09:45:30.758 INFO:tasks.workunit.client.1.smithi114.stdout:9/241: unlink d3/da/d10/d23/d29/d2c/c3c 0 2024-09-16T09:45:30.761 INFO:tasks.workunit.client.1.smithi114.stdout:7/300: getdents d2/d9/d2b/d2e/d22/d27 0 2024-09-16T09:45:30.765 INFO:tasks.workunit.client.1.smithi114.stdout:9/242: creat d3/da/d10/d23/f4f x:0 0 0 2024-09-16T09:45:30.766 INFO:tasks.workunit.client.1.smithi114.stdout:7/301: creat d2/d9/d2b/d2e/d22/d27/d50/f63 x:0 0 0 2024-09-16T09:45:30.766 INFO:tasks.workunit.client.1.smithi114.stdout:7/302: write d2/d9/f23 [2156544,17239] 0 2024-09-16T09:45:30.767 INFO:tasks.workunit.client.1.smithi114.stdout:9/243: mknod d3/da/d10/d23/d43/d1e/c50 0 2024-09-16T09:45:30.769 INFO:tasks.workunit.client.1.smithi114.stdout:7/303: mkdir d2/d9/d2b/d2e/d22/d27/d64 0 2024-09-16T09:45:30.771 INFO:tasks.workunit.client.1.smithi114.stdout:7/304: link d2/d9/d2b/d2e/d22/d27/d50/f56 d2/d9/d2b/d2e/d3e/f65 0 2024-09-16T09:45:30.771 INFO:tasks.workunit.client.1.smithi114.stdout:7/305: chown d2/d9/d2b/d2e/d22/d4c 172924410 1 2024-09-16T09:45:30.773 INFO:tasks.workunit.client.1.smithi114.stdout:7/306: mkdir d2/d9/d2b/d2e/d22/d66 0 2024-09-16T09:45:30.775 INFO:tasks.workunit.client.1.smithi114.stdout:7/307: symlink d2/df/l67 0 2024-09-16T09:45:30.777 INFO:tasks.workunit.client.1.smithi114.stdout:7/308: mkdir d2/d9/d2b/d2e/d22/d66/d68 0 2024-09-16T09:45:30.779 INFO:tasks.workunit.client.1.smithi114.stdout:7/309: truncate d2/d9/d2b/d2e/d22/d27/f18 3532744 0 2024-09-16T09:45:30.779 INFO:tasks.workunit.client.1.smithi114.stdout:7/310: fdatasync d2/d9/f12 0 2024-09-16T09:45:30.780 INFO:tasks.workunit.client.1.smithi114.stdout:7/311: dread d2/d9/f19 [0,4194304] 0 2024-09-16T09:45:30.781 INFO:tasks.workunit.client.1.smithi114.stdout:7/312: creat d2/d9/d2b/d2e/d22/d4c/f69 x:0 0 0 2024-09-16T09:45:30.783 INFO:tasks.workunit.client.1.smithi114.stdout:7/313: link d2/l28 d2/d9/l6a 0 2024-09-16T09:45:30.785 INFO:tasks.workunit.client.0.smithi111.stdout:7/29: getdents d1 0 2024-09-16T09:45:30.785 INFO:tasks.workunit.client.0.smithi111.stdout:7/30: dwrite - no filename 2024-09-16T09:45:30.785 INFO:tasks.workunit.client.0.smithi111.stdout:7/31: dwrite - no filename 2024-09-16T09:45:30.785 INFO:tasks.workunit.client.0.smithi111.stdout:7/32: chown d1 2958 1 2024-09-16T09:45:30.786 INFO:tasks.workunit.client.0.smithi111.stdout:7/33: write - no filename 2024-09-16T09:45:30.786 INFO:tasks.workunit.client.1.smithi114.stdout:6/240: dwrite d6/fc [0,4194304] 0 2024-09-16T09:45:30.788 INFO:tasks.workunit.client.0.smithi111.stdout:7/34: mkdir d1/d9 0 2024-09-16T09:45:30.789 INFO:tasks.workunit.client.0.smithi111.stdout:7/35: creat d1/d9/fa x:0 0 0 2024-09-16T09:45:30.792 INFO:tasks.workunit.client.0.smithi111.stdout:5/10: dwrite f1 [0,4194304] 0 2024-09-16T09:45:30.793 INFO:tasks.workunit.client.1.smithi114.stdout:3/371: dwrite dc/de/d37/d4e/f70 [0,4194304] 0 2024-09-16T09:45:30.793 INFO:tasks.workunit.client.1.smithi114.stdout:7/314: fsync d2/d9/d2b/f5a 0 2024-09-16T09:45:30.793 INFO:tasks.workunit.client.1.smithi114.stdout:3/372: fsync dc/de/d18/f28 0 2024-09-16T09:45:30.793 INFO:tasks.workunit.client.1.smithi114.stdout:9/244: dwrite d3/f32 [0,4194304] 0 2024-09-16T09:45:30.793 INFO:tasks.workunit.client.1.smithi114.stdout:7/315: write d2/f2c [559321,62396] 0 2024-09-16T09:45:30.793 INFO:tasks.workunit.client.1.smithi114.stdout:9/245: chown d3/da/d10/d23/d43/d1e 191324 1 2024-09-16T09:45:30.798 INFO:tasks.workunit.client.1.smithi114.stdout:3/373: mkdir dc/de/d10/d6a/d77/d7f 0 2024-09-16T09:45:30.798 INFO:tasks.workunit.client.1.smithi114.stdout:6/241: dread d6/d2d/f3c [0,4194304] 0 2024-09-16T09:45:30.798 INFO:tasks.workunit.client.1.smithi114.stdout:6/242: stat d6/da/f1e 0 2024-09-16T09:45:30.799 INFO:tasks.workunit.client.1.smithi114.stdout:6/243: fdatasync d6/f1f 0 2024-09-16T09:45:30.799 INFO:tasks.workunit.client.1.smithi114.stdout:9/246: creat d3/da/d10/f51 x:0 0 0 2024-09-16T09:45:30.801 INFO:tasks.workunit.client.1.smithi114.stdout:8/310: rename d4/db/d39/d65 to d4/db/d68 0 2024-09-16T09:45:30.801 INFO:tasks.workunit.client.1.smithi114.stdout:8/311: readlink d4/db/d68/d52/d54/l57 0 2024-09-16T09:45:30.801 INFO:tasks.workunit.client.1.smithi114.stdout:8/312: chown d4/db/d39/d3c/d4e/d62 1 1 2024-09-16T09:45:30.802 INFO:tasks.workunit.client.1.smithi114.stdout:9/247: truncate d3/da/f11 773128 0 2024-09-16T09:45:30.803 INFO:tasks.workunit.client.1.smithi114.stdout:6/244: truncate d6/da/f2c 74087 0 2024-09-16T09:45:30.805 INFO:tasks.workunit.client.0.smithi111.stdout:0/53: getdents d0 0 2024-09-16T09:45:30.808 INFO:tasks.workunit.client.1.smithi114.stdout:4/241: rename d0/d26/d3c/f1e to d0/d26/f48 0 2024-09-16T09:45:30.813 INFO:tasks.workunit.client.1.smithi114.stdout:9/248: creat d3/da/d10/d23/d38/f52 x:0 0 0 2024-09-16T09:45:30.816 INFO:tasks.workunit.client.1.smithi114.stdout:6/245: creat d6/da/d10/f4b x:0 0 0 2024-09-16T09:45:30.816 INFO:tasks.workunit.client.1.smithi114.stdout:6/246: fdatasync d6/da/d10/f33 0 2024-09-16T09:45:30.821 INFO:tasks.workunit.client.1.smithi114.stdout:1/311: rename d4/d2b/d2f/d3a/f44 to d4/d2b/d2f/d3a/d56/f66 0 2024-09-16T09:45:30.821 INFO:tasks.workunit.client.1.smithi114.stdout:1/312: dread - d4/d2b/d2f/f5d zero size 2024-09-16T09:45:30.822 INFO:tasks.workunit.client.1.smithi114.stdout:4/242: truncate d0/d26/d29/f1d 7050993 0 2024-09-16T09:45:30.825 INFO:tasks.workunit.client.1.smithi114.stdout:9/249: creat d3/da/d10/d23/d29/f53 x:0 0 0 2024-09-16T09:45:30.827 INFO:tasks.workunit.client.1.smithi114.stdout:1/313: dread d4/d3d/d41/d42/f4a [0,4194304] 0 2024-09-16T09:45:30.832 INFO:tasks.workunit.client.1.smithi114.stdout:2/295: rename d1/d8/d10/d16/d1d/f64 to d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f74 0 2024-09-16T09:45:30.833 INFO:tasks.workunit.client.1.smithi114.stdout:2/296: mknod d1/d8/c75 0 2024-09-16T09:45:30.835 INFO:tasks.workunit.client.1.smithi114.stdout:2/297: getdents d1 0 2024-09-16T09:45:30.835 INFO:tasks.workunit.client.1.smithi114.stdout:2/298: write d1/d8/d10/d16/d1d/f1e [1093243,107903] 0 2024-09-16T09:45:30.836 INFO:tasks.workunit.client.0.smithi111.stdout:0/54: dwrite d0/ff [0,4194304] 0 2024-09-16T09:45:30.839 INFO:tasks.workunit.client.1.smithi114.stdout:2/299: rename d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/c6e to d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/c76 0 2024-09-16T09:45:30.842 INFO:tasks.workunit.client.0.smithi111.stdout:0/55: creat d0/f15 x:0 0 0 2024-09-16T09:45:30.843 INFO:tasks.workunit.client.0.smithi111.stdout:0/56: readlink d0/l5 0 2024-09-16T09:45:30.854 INFO:tasks.workunit.client.0.smithi111.stdout:1/16: getdents d3 0 2024-09-16T09:45:30.855 INFO:tasks.workunit.client.0.smithi111.stdout:1/17: creat d3/f5 x:0 0 0 2024-09-16T09:45:30.855 INFO:tasks.workunit.client.0.smithi111.stdout:1/18: fdatasync f1 0 2024-09-16T09:45:30.858 INFO:tasks.workunit.client.1.smithi114.stdout:7/316: dwrite d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:30.867 INFO:tasks.workunit.client.1.smithi114.stdout:3/374: dwrite dc/f27 [0,4194304] 0 2024-09-16T09:45:30.867 INFO:tasks.workunit.client.1.smithi114.stdout:3/375: chown dc/d38/l39 907 1 2024-09-16T09:45:30.870 INFO:tasks.workunit.client.0.smithi111.stdout:7/36: rename d1/c4 to d1/d9/cb 0 2024-09-16T09:45:30.870 INFO:tasks.workunit.client.1.smithi114.stdout:7/317: write d2/d9/f23 [1629486,95594] 0 2024-09-16T09:45:30.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/11: write f1 [5094542,86863] 0 2024-09-16T09:45:30.871 INFO:tasks.workunit.client.1.smithi114.stdout:7/318: read d2/d9/d2b/d2e/d22/d27/f1f [191994,111610] 0 2024-09-16T09:45:30.873 INFO:tasks.workunit.client.1.smithi114.stdout:7/319: mknod d2/d9/d2b/d2e/d22/c6b 0 2024-09-16T09:45:30.874 INFO:tasks.workunit.client.1.smithi114.stdout:6/247: dwrite d6/f23 [4194304,4194304] 0 2024-09-16T09:45:30.874 INFO:tasks.workunit.client.0.smithi111.stdout:5/12: creat f3 x:0 0 0 2024-09-16T09:45:30.874 INFO:tasks.workunit.client.0.smithi111.stdout:5/13: write f3 [762612,108135] 0 2024-09-16T09:45:30.875 INFO:tasks.workunit.client.0.smithi111.stdout:1/19: rename f2 to d3/f6 0 2024-09-16T09:45:30.875 INFO:tasks.workunit.client.0.smithi111.stdout:1/20: chown d3/f6 0 1 2024-09-16T09:45:30.877 INFO:tasks.workunit.client.0.smithi111.stdout:7/37: mknod d1/cc 0 2024-09-16T09:45:30.877 INFO:tasks.workunit.client.1.smithi114.stdout:4/243: dwrite d0/d26/d40/f44 [0,4194304] 0 2024-09-16T09:45:30.878 INFO:tasks.workunit.client.1.smithi114.stdout:9/250: dwrite d3/da/f4d [0,4194304] 0 2024-09-16T09:45:30.880 INFO:tasks.workunit.client.0.smithi111.stdout:5/14: creat f4 x:0 0 0 2024-09-16T09:45:30.881 INFO:tasks.workunit.client.1.smithi114.stdout:6/248: getdents d6/da/d10/d40 0 2024-09-16T09:45:30.881 INFO:tasks.workunit.client.1.smithi114.stdout:6/249: truncate d6/da/d10/f25 1204392 0 2024-09-16T09:45:30.882 INFO:tasks.workunit.client.0.smithi111.stdout:7/38: mknod d1/d9/cd 0 2024-09-16T09:45:30.882 INFO:tasks.workunit.client.0.smithi111.stdout:7/39: write d1/d9/fa [377981,116115] 0 2024-09-16T09:45:30.883 INFO:tasks.workunit.client.1.smithi114.stdout:7/320: dread d2/f5 [0,4194304] 0 2024-09-16T09:45:30.883 INFO:tasks.workunit.client.0.smithi111.stdout:5/15: rename f1 to f5 0 2024-09-16T09:45:30.885 INFO:tasks.workunit.client.1.smithi114.stdout:0/205: sync 2024-09-16T09:45:30.885 INFO:tasks.workunit.client.1.smithi114.stdout:5/301: sync 2024-09-16T09:45:30.886 INFO:tasks.workunit.client.1.smithi114.stdout:4/244: link d0/d26/d3c/l43 d0/l49 0 2024-09-16T09:45:30.886 INFO:tasks.workunit.client.1.smithi114.stdout:4/245: write d0/d13/f22 [5153407,23626] 0 2024-09-16T09:45:30.886 INFO:tasks.workunit.client.1.smithi114.stdout:1/314: dwrite d4/d2b/d2f/f4c [0,4194304] 0 2024-09-16T09:45:30.886 INFO:tasks.workunit.client.1.smithi114.stdout:2/300: dwrite d1/d8/d10/d16/f51 [0,4194304] 0 2024-09-16T09:45:30.887 INFO:tasks.workunit.client.1.smithi114.stdout:3/376: dwrite dc/de/d37/d3d/f6c [0,4194304] 0 2024-09-16T09:45:30.887 INFO:tasks.workunit.client.0.smithi111.stdout:7/40: creat d1/d9/fe x:0 0 0 2024-09-16T09:45:30.889 INFO:tasks.workunit.client.0.smithi111.stdout:5/16: symlink l6 0 2024-09-16T09:45:30.891 INFO:tasks.workunit.client.1.smithi114.stdout:9/251: write d3/da/d10/d23/d29/f39 [2935401,28591] 0 2024-09-16T09:45:30.892 INFO:tasks.workunit.client.1.smithi114.stdout:6/250: symlink d6/da/d48/l4c 0 2024-09-16T09:45:30.892 INFO:tasks.workunit.client.1.smithi114.stdout:6/251: stat d6/f22 0 2024-09-16T09:45:30.892 INFO:tasks.workunit.client.1.smithi114.stdout:6/252: truncate d6/da/d10/f4b 165492 0 2024-09-16T09:45:30.893 INFO:tasks.workunit.client.1.smithi114.stdout:6/253: dread d6/da/d10/f4b [0,4194304] 0 2024-09-16T09:45:30.893 INFO:tasks.workunit.client.1.smithi114.stdout:7/321: truncate d2/d9/d2b/d2e/d22/f49 880683 0 2024-09-16T09:45:30.893 INFO:tasks.workunit.client.1.smithi114.stdout:7/322: read d2/d9/d2b/f5a [85162,46001] 0 2024-09-16T09:45:30.901 INFO:tasks.workunit.client.1.smithi114.stdout:4/246: symlink d0/d13/d25/l4a 0 2024-09-16T09:45:30.904 INFO:tasks.workunit.client.1.smithi114.stdout:1/315: rmdir d4/d2b/d2f/d3a/d55 39 2024-09-16T09:45:30.904 INFO:tasks.workunit.client.1.smithi114.stdout:1/316: truncate d4/d2b/f1e 636710 0 2024-09-16T09:45:30.905 INFO:tasks.workunit.client.0.smithi111.stdout:7/41: dwrite d1/d9/fe [0,4194304] 0 2024-09-16T09:45:30.905 INFO:tasks.workunit.client.1.smithi114.stdout:2/301: unlink d1/d8/l31 0 2024-09-16T09:45:30.906 INFO:tasks.workunit.client.1.smithi114.stdout:2/302: fsync d1/d8/d10/d16/d1d/f5f 0 2024-09-16T09:45:30.908 INFO:tasks.workunit.client.0.smithi111.stdout:0/57: mknod d0/c16 0 2024-09-16T09:45:30.909 INFO:tasks.workunit.client.1.smithi114.stdout:3/377: creat dc/de/d1f/f80 x:0 0 0 2024-09-16T09:45:30.912 INFO:tasks.workunit.client.0.smithi111.stdout:7/42: mknod d1/d9/cf 0 2024-09-16T09:45:30.913 INFO:tasks.workunit.client.1.smithi114.stdout:9/252: link d3/da/d10/d23/d38/f3e d3/da/d10/d23/d38/f54 0 2024-09-16T09:45:30.915 INFO:tasks.workunit.client.1.smithi114.stdout:6/254: truncate d6/da/d10/d40/f43 2602969 0 2024-09-16T09:45:30.917 INFO:tasks.workunit.client.1.smithi114.stdout:7/323: mknod d2/d9/d2b/d59/c6c 0 2024-09-16T09:45:30.917 INFO:tasks.workunit.client.0.smithi111.stdout:5/17: fsync f3 0 2024-09-16T09:45:30.920 INFO:tasks.workunit.client.1.smithi114.stdout:4/247: rename d0/d26/d2e/d2f to d0/d26/d3c/d3e/d4b 0 2024-09-16T09:45:30.923 INFO:tasks.workunit.client.1.smithi114.stdout:2/303: link d1/d8/d10/d16/d1d/d4a/c42 d1/d8/c77 0 2024-09-16T09:45:30.925 INFO:tasks.workunit.client.1.smithi114.stdout:9/253: creat d3/da/f55 x:0 0 0 2024-09-16T09:45:30.925 INFO:tasks.workunit.client.1.smithi114.stdout:9/254: chown d3/da/d10/d23/d29/f4b 2 1 2024-09-16T09:45:30.925 INFO:tasks.workunit.client.1.smithi114.stdout:7/324: dread d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:30.925 INFO:tasks.workunit.client.1.smithi114.stdout:7/325: write d2/d9/d2b/d2e/d3e/f44 [4746591,28907] 0 2024-09-16T09:45:30.926 INFO:tasks.workunit.client.1.smithi114.stdout:7/326: read d2/d9/d2b/d2e/d22/d27/f2a [28406,72604] 0 2024-09-16T09:45:30.929 INFO:tasks.workunit.client.1.smithi114.stdout:3/378: rename dc/de/d18/d78/d5c/c68 to dc/de/d1f/c81 0 2024-09-16T09:45:30.931 INFO:tasks.workunit.client.1.smithi114.stdout:2/304: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d78 0 2024-09-16T09:45:30.931 INFO:tasks.workunit.client.1.smithi114.stdout:2/305: write d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f36 [4548814,119501] 0 2024-09-16T09:45:30.931 INFO:tasks.workunit.client.1.smithi114.stdout:2/306: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/c43 461 1 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/327: rmdir d2/d9/d2b/d2e/d22/d4c 39 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/328: truncate d2/f1c 420109 0 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/329: chown d2/d9/d2b/d2e/d22/f49 3716 1 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/330: chown d2/d9/f19 6 1 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/331: fdatasync d2/d9/d2b/f57 0 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/332: dread - d2/d9/d2b/d2e/d3e/f65 zero size 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:7/333: chown d2/d9/d2b/d2e/d22/d4c 1320 1 2024-09-16T09:45:30.932 INFO:tasks.workunit.client.1.smithi114.stdout:1/317: dwrite d4/f4e [0,4194304] 0 2024-09-16T09:45:30.933 INFO:tasks.workunit.client.1.smithi114.stdout:3/379: symlink dc/de/d37/l82 0 2024-09-16T09:45:30.934 INFO:tasks.workunit.client.1.smithi114.stdout:2/307: symlink d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/l79 0 2024-09-16T09:45:30.934 INFO:tasks.workunit.client.1.smithi114.stdout:2/308: chown d1/d8/d10/d16/d60/c6d 60856052 1 2024-09-16T09:45:30.936 INFO:tasks.workunit.client.1.smithi114.stdout:7/334: dread d2/df/f3a [0,4194304] 0 2024-09-16T09:45:30.937 INFO:tasks.workunit.client.1.smithi114.stdout:7/335: write d2/d9/d2b/d2e/f45 [1470428,4399] 0 2024-09-16T09:45:30.937 INFO:tasks.workunit.client.1.smithi114.stdout:1/318: link d4/f38 d4/d3d/f67 0 2024-09-16T09:45:30.937 INFO:tasks.workunit.client.1.smithi114.stdout:1/319: readlink d4/d2b/d29/l3b 0 2024-09-16T09:45:30.937 INFO:tasks.workunit.client.1.smithi114.stdout:1/320: readlink d4/d2b/l5f 0 2024-09-16T09:45:30.937 INFO:tasks.workunit.client.1.smithi114.stdout:1/321: dread - d4/d3d/d41/d42/f5a zero size 2024-09-16T09:45:30.938 INFO:tasks.workunit.client.0.smithi111.stdout:0/58: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:45:30.938 INFO:tasks.workunit.client.1.smithi114.stdout:2/309: creat d1/d8/f7a x:0 0 0 2024-09-16T09:45:30.939 INFO:tasks.workunit.client.1.smithi114.stdout:1/322: rename d4/d2b/l5f to d4/d2b/d16/l68 0 2024-09-16T09:45:30.940 INFO:tasks.workunit.client.1.smithi114.stdout:1/323: chown d4/d2b/d16 94788204 1 2024-09-16T09:45:30.941 INFO:tasks.workunit.client.1.smithi114.stdout:2/310: creat d1/f7b x:0 0 0 2024-09-16T09:45:30.944 INFO:tasks.workunit.client.1.smithi114.stdout:1/324: symlink d4/d2b/d2f/d3a/l69 0 2024-09-16T09:45:30.944 INFO:tasks.workunit.client.1.smithi114.stdout:6/255: getdents d6/da/d48 0 2024-09-16T09:45:30.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/256: truncate d6/da/f45 958878 0 2024-09-16T09:45:30.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/257: chown d6/da/f3e 3 1 2024-09-16T09:45:30.945 INFO:tasks.workunit.client.1.smithi114.stdout:2/311: mknod d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/c7c 0 2024-09-16T09:45:30.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/258: dread d6/da/d36/f38 [0,4194304] 0 2024-09-16T09:45:30.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/259: fsync d6/da/d36/f38 0 2024-09-16T09:45:30.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/260: truncate d6/d2d/f3a 569936 0 2024-09-16T09:45:30.948 INFO:tasks.workunit.client.0.smithi111.stdout:0/59: rename d0/f14 to d0/f17 0 2024-09-16T09:45:30.950 INFO:tasks.workunit.client.0.smithi111.stdout:0/60: stat d0/f6 0 2024-09-16T09:45:30.951 INFO:tasks.workunit.client.1.smithi114.stdout:7/336: dread d2/d9/d2b/d2e/d22/d27/f40 [0,4194304] 0 2024-09-16T09:45:30.951 INFO:tasks.workunit.client.1.smithi114.stdout:4/248: dwrite d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:30.952 INFO:tasks.workunit.client.1.smithi114.stdout:4/249: chown d0/d13/d25/l4a 124 1 2024-09-16T09:45:30.952 INFO:tasks.workunit.client.1.smithi114.stdout:7/337: write d2/d9/d2b/d2e/d22/f49 [1505370,68211] 0 2024-09-16T09:45:30.952 INFO:tasks.workunit.client.0.smithi111.stdout:5/18: dwrite f4 [0,4194304] 0 2024-09-16T09:45:30.952 INFO:tasks.workunit.client.0.smithi111.stdout:5/19: stat f5 0 2024-09-16T09:45:30.953 INFO:tasks.workunit.client.1.smithi114.stdout:2/312: symlink d1/d8/l7d 0 2024-09-16T09:45:30.955 INFO:tasks.workunit.client.1.smithi114.stdout:6/261: write d6/da/d10/f1d [1276438,80841] 0 2024-09-16T09:45:30.958 INFO:tasks.workunit.client.1.smithi114.stdout:1/325: write d4/d2b/d16/f1b [3609019,77601] 0 2024-09-16T09:45:30.958 INFO:tasks.workunit.client.1.smithi114.stdout:1/326: chown d4/c1c 8719 1 2024-09-16T09:45:30.960 INFO:tasks.workunit.client.0.smithi111.stdout:0/61: write d0/f11 [1454634,103755] 0 2024-09-16T09:45:30.960 INFO:tasks.workunit.client.1.smithi114.stdout:1/327: dread d4/d2b/f3c [0,4194304] 0 2024-09-16T09:45:30.961 INFO:tasks.workunit.client.0.smithi111.stdout:0/62: creat d0/f18 x:0 0 0 2024-09-16T09:45:30.961 INFO:tasks.workunit.client.1.smithi114.stdout:4/250: dread d0/fe [0,4194304] 0 2024-09-16T09:45:30.963 INFO:tasks.workunit.client.1.smithi114.stdout:1/328: link d4/l20 d4/d3d/d41/d42/d58/l6a 0 2024-09-16T09:45:30.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/43: getdents d1/d9 0 2024-09-16T09:45:30.964 INFO:tasks.workunit.client.1.smithi114.stdout:9/255: dwrite d3/da/d10/d23/d29/f39 [0,4194304] 0 2024-09-16T09:45:30.967 INFO:tasks.workunit.client.1.smithi114.stdout:4/251: creat d0/d13/f4c x:0 0 0 2024-09-16T09:45:30.968 INFO:tasks.workunit.client.1.smithi114.stdout:4/252: write d0/f1f [1111967,64970] 0 2024-09-16T09:45:30.968 INFO:tasks.workunit.client.1.smithi114.stdout:2/313: dread d1/f2c [0,4194304] 0 2024-09-16T09:45:30.969 INFO:tasks.workunit.client.1.smithi114.stdout:1/329: creat d4/d3d/f6b x:0 0 0 2024-09-16T09:45:30.971 INFO:tasks.workunit.client.1.smithi114.stdout:7/338: getdents d2/d9/d2b/d59 0 2024-09-16T09:45:30.973 INFO:tasks.workunit.client.1.smithi114.stdout:9/256: dread d3/da/f11 [0,4194304] 0 2024-09-16T09:45:30.973 INFO:tasks.workunit.client.1.smithi114.stdout:1/330: rmdir d4/d3d/d41/d42 39 2024-09-16T09:45:30.977 INFO:tasks.workunit.client.1.smithi114.stdout:9/257: link d3/ff d3/da/d10/d23/d42/f56 0 2024-09-16T09:45:30.978 INFO:tasks.workunit.client.1.smithi114.stdout:6/262: dread d6/fc [0,4194304] 0 2024-09-16T09:45:30.980 INFO:tasks.workunit.client.1.smithi114.stdout:1/331: rename d4/d2b/lb to d4/d2b/d2f/d3a/d56/l6c 0 2024-09-16T09:45:30.981 INFO:tasks.workunit.client.0.smithi111.stdout:5/20: dwrite f4 [0,4194304] 0 2024-09-16T09:45:30.981 INFO:tasks.workunit.client.0.smithi111.stdout:5/21: chown f4 64517905 1 2024-09-16T09:45:30.982 INFO:tasks.workunit.client.1.smithi114.stdout:1/332: getdents d4/d3d/d41/d42/d62 0 2024-09-16T09:45:30.982 INFO:tasks.workunit.client.1.smithi114.stdout:1/333: fsync d4/d2b/d29/f5e 0 2024-09-16T09:45:30.982 INFO:tasks.workunit.client.1.smithi114.stdout:6/263: mknod d6/c4d 0 2024-09-16T09:45:30.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/44: dread d1/d9/fa [0,4194304] 0 2024-09-16T09:45:30.986 INFO:tasks.workunit.client.0.smithi111.stdout:5/22: unlink l2 0 2024-09-16T09:45:30.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/45: write d1/d9/fe [4958436,30558] 0 2024-09-16T09:45:30.986 INFO:tasks.workunit.client.0.smithi111.stdout:5/23: write f3 [1277839,69178] 0 2024-09-16T09:45:30.987 INFO:tasks.workunit.client.0.smithi111.stdout:0/63: dwrite d0/f18 [0,4194304] 0 2024-09-16T09:45:30.988 INFO:tasks.workunit.client.1.smithi114.stdout:1/334: creat d4/d3d/d41/d42/d58/f6d x:0 0 0 2024-09-16T09:45:30.989 INFO:tasks.workunit.client.1.smithi114.stdout:6/264: mknod d6/c4e 0 2024-09-16T09:45:30.989 INFO:tasks.workunit.client.1.smithi114.stdout:6/265: chown d6/da/d10/f33 24542973 1 2024-09-16T09:45:30.989 INFO:tasks.workunit.client.1.smithi114.stdout:6/266: chown d6/f35 48700 1 2024-09-16T09:45:30.990 INFO:tasks.workunit.client.1.smithi114.stdout:1/335: creat d4/d2b/d16/d47/f6e x:0 0 0 2024-09-16T09:45:30.993 INFO:tasks.workunit.client.1.smithi114.stdout:1/336: creat d4/f6f x:0 0 0 2024-09-16T09:45:30.993 INFO:tasks.workunit.client.1.smithi114.stdout:1/337: dread - d4/d2b/d16/d47/f6e zero size 2024-09-16T09:45:30.995 INFO:tasks.workunit.client.0.smithi111.stdout:7/46: symlink d1/l10 0 2024-09-16T09:45:30.995 INFO:tasks.workunit.client.0.smithi111.stdout:7/47: chown d1/d9/fe 6 1 2024-09-16T09:45:30.995 INFO:tasks.workunit.client.0.smithi111.stdout:7/48: chown d1/d9/fe 250255093 1 2024-09-16T09:45:30.995 INFO:tasks.workunit.client.0.smithi111.stdout:0/64: symlink d0/l19 0 2024-09-16T09:45:30.996 INFO:tasks.workunit.client.1.smithi114.stdout:6/267: write d6/da/f15 [2229832,66381] 0 2024-09-16T09:45:30.997 INFO:tasks.workunit.client.0.smithi111.stdout:0/65: unlink d0/f6 0 2024-09-16T09:45:30.998 INFO:tasks.workunit.client.1.smithi114.stdout:6/268: creat d6/da/d36/f4f x:0 0 0 2024-09-16T09:45:30.998 INFO:tasks.workunit.client.1.smithi114.stdout:6/269: truncate d6/da/d10/f4b 1160956 0 2024-09-16T09:45:30.998 INFO:tasks.workunit.client.1.smithi114.stdout:6/270: truncate d6/f44 164878 0 2024-09-16T09:45:31.006 INFO:tasks.workunit.client.1.smithi114.stdout:1/338: write d4/d2b/d2f/f4c [2454722,54158] 0 2024-09-16T09:45:31.008 INFO:tasks.workunit.client.1.smithi114.stdout:7/339: dwrite d2/f1c [0,4194304] 0 2024-09-16T09:45:31.009 INFO:tasks.workunit.client.1.smithi114.stdout:1/339: creat d4/d2b/d16/d47/f70 x:0 0 0 2024-09-16T09:45:31.013 INFO:tasks.workunit.client.1.smithi114.stdout:4/253: dwrite d0/d26/d29/d2b/f36 [4194304,4194304] 0 2024-09-16T09:45:31.016 INFO:tasks.workunit.client.1.smithi114.stdout:6/271: read d6/f22 [859777,11842] 0 2024-09-16T09:45:31.016 INFO:tasks.workunit.client.1.smithi114.stdout:6/272: fdatasync d6/da/f1e 0 2024-09-16T09:45:31.017 INFO:tasks.workunit.client.1.smithi114.stdout:6/273: truncate d6/da/d10/f33 726663 0 2024-09-16T09:45:31.017 INFO:tasks.workunit.client.1.smithi114.stdout:9/258: dwrite d3/da/fb [0,4194304] 0 2024-09-16T09:45:31.026 INFO:tasks.workunit.client.1.smithi114.stdout:6/274: creat d6/da/d10/d40/f50 x:0 0 0 2024-09-16T09:45:31.027 INFO:tasks.workunit.client.1.smithi114.stdout:9/259: link d3/c40 d3/da/d10/d23/d38/c57 0 2024-09-16T09:45:31.028 INFO:tasks.workunit.client.0.smithi111.stdout:5/24: dwrite f4 [4194304,4194304] 0 2024-09-16T09:45:31.028 INFO:tasks.workunit.client.0.smithi111.stdout:5/25: truncate f5 2552518 0 2024-09-16T09:45:31.030 INFO:tasks.workunit.client.1.smithi114.stdout:9/260: symlink d3/da/d10/d23/d29/d2c/l58 0 2024-09-16T09:45:31.030 INFO:tasks.workunit.client.1.smithi114.stdout:9/261: fsync d3/da/fb 0 2024-09-16T09:45:31.040 INFO:tasks.workunit.client.0.smithi111.stdout:5/26: write f4 [2325370,74950] 0 2024-09-16T09:45:31.047 INFO:tasks.workunit.client.1.smithi114.stdout:9/262: dread d3/da/d10/d23/d43/d1e/d25/f27 [0,4194304] 0 2024-09-16T09:45:31.047 INFO:tasks.workunit.client.1.smithi114.stdout:9/263: read - d3/da/d10/d23/d38/f52 zero size 2024-09-16T09:45:31.051 INFO:tasks.workunit.client.1.smithi114.stdout:4/254: dwrite d0/d26/d2e/f32 [4194304,4194304] 0 2024-09-16T09:45:31.052 INFO:tasks.workunit.client.1.smithi114.stdout:4/255: mkdir d0/d26/d3c/d3e/d4d 0 2024-09-16T09:45:31.052 INFO:tasks.workunit.client.1.smithi114.stdout:4/256: write d0/f21 [4694611,76730] 0 2024-09-16T09:45:31.054 INFO:tasks.workunit.client.1.smithi114.stdout:8/313: sync 2024-09-16T09:45:31.055 INFO:tasks.workunit.client.1.smithi114.stdout:7/340: dwrite d2/d9/d2b/d2e/d3e/f65 [0,4194304] 0 2024-09-16T09:45:31.055 INFO:tasks.workunit.client.0.smithi111.stdout:7/49: dwrite d1/d9/fe [0,4194304] 0 2024-09-16T09:45:31.057 INFO:tasks.workunit.client.0.smithi111.stdout:0/66: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:45:31.059 INFO:tasks.workunit.client.0.smithi111.stdout:0/67: link d0/ce d0/c1a 0 2024-09-16T09:45:31.059 INFO:tasks.workunit.client.1.smithi114.stdout:6/275: dwrite d6/f23 [0,4194304] 0 2024-09-16T09:45:31.061 INFO:tasks.workunit.client.0.smithi111.stdout:0/68: truncate d0/ff 4861716 0 2024-09-16T09:45:31.062 INFO:tasks.workunit.client.1.smithi114.stdout:4/257: dread d0/d26/d29/fd [0,4194304] 0 2024-09-16T09:45:31.063 INFO:tasks.workunit.client.1.smithi114.stdout:7/341: dread d2/df/f10 [0,4194304] 0 2024-09-16T09:45:31.065 INFO:tasks.workunit.client.1.smithi114.stdout:4/258: creat d0/d26/d3c/d3e/d4b/f4e x:0 0 0 2024-09-16T09:45:31.067 INFO:tasks.workunit.client.0.smithi111.stdout:5/27: truncate f3 1099658 0 2024-09-16T09:45:31.067 INFO:tasks.workunit.client.1.smithi114.stdout:7/342: link d2/l28 d2/d9/d2b/d2e/d22/d27/d4d/l6d 0 2024-09-16T09:45:31.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/28: creat f7 x:0 0 0 2024-09-16T09:45:31.068 INFO:tasks.workunit.client.1.smithi114.stdout:7/343: write d2/d9/d2b/d2e/d22/f49 [2093980,115627] 0 2024-09-16T09:45:31.068 INFO:tasks.workunit.client.1.smithi114.stdout:7/344: rename d2 to d2/d9/d2b/d2e/d6e 22 2024-09-16T09:45:31.069 INFO:tasks.workunit.client.1.smithi114.stdout:7/345: dread - d2/d9/d2b/d2e/d22/d27/d50/f63 zero size 2024-09-16T09:45:31.069 INFO:tasks.workunit.client.1.smithi114.stdout:8/314: write d4/db/d39/d3c/d4e/f66 [1293190,67377] 0 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.1.smithi114.stdout:9/264: dwrite d3/da/d10/d23/d43/f33 [0,4194304] 0 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.1.smithi114.stdout:6/276: write d6/d2d/f3c [2194657,58708] 0 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.1.smithi114.stdout:6/277: dread - d6/da/d10/f47 zero size 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.1.smithi114.stdout:6/278: dread - d6/da/d10/d40/f50 zero size 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.0.smithi111.stdout:5/29: creat f8 x:0 0 0 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.0.smithi111.stdout:5/30: fsync f5 0 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.0.smithi111.stdout:5/31: read - f7 zero size 2024-09-16T09:45:31.070 INFO:tasks.workunit.client.0.smithi111.stdout:5/32: symlink l9 0 2024-09-16T09:45:31.071 INFO:tasks.workunit.client.0.smithi111.stdout:5/33: write f8 [26279,115854] 0 2024-09-16T09:45:31.071 INFO:tasks.workunit.client.0.smithi111.stdout:7/50: truncate d1/d9/fa 139515 0 2024-09-16T09:45:31.072 INFO:tasks.workunit.client.0.smithi111.stdout:5/34: creat fa x:0 0 0 2024-09-16T09:45:31.072 INFO:tasks.workunit.client.0.smithi111.stdout:5/35: readlink l6 0 2024-09-16T09:45:31.073 INFO:tasks.workunit.client.0.smithi111.stdout:0/69: getdents d0 0 2024-09-16T09:45:31.074 INFO:tasks.workunit.client.0.smithi111.stdout:7/51: creat d1/d9/f11 x:0 0 0 2024-09-16T09:45:31.075 INFO:tasks.workunit.client.1.smithi114.stdout:8/315: link d4/db/f4d d4/db/d68/d30/d55/d59/f69 0 2024-09-16T09:45:31.076 INFO:tasks.workunit.client.0.smithi111.stdout:5/36: rename f8 to fb 0 2024-09-16T09:45:31.077 INFO:tasks.workunit.client.1.smithi114.stdout:7/346: write d2/d9/d2b/d2e/d22/d27/f18 [2953594,107035] 0 2024-09-16T09:45:31.077 INFO:tasks.workunit.client.1.smithi114.stdout:7/347: chown d2/d9/d2b/d2e/d22/c31 924816 1 2024-09-16T09:45:31.077 INFO:tasks.workunit.client.0.smithi111.stdout:0/70: symlink d0/l1b 0 2024-09-16T09:45:31.078 INFO:tasks.workunit.client.0.smithi111.stdout:0/71: chown d0/f12 56643425 1 2024-09-16T09:45:31.079 INFO:tasks.workunit.client.1.smithi114.stdout:4/259: dwrite d0/d26/d3c/f2d [0,4194304] 0 2024-09-16T09:45:31.080 INFO:tasks.workunit.client.1.smithi114.stdout:9/265: creat d3/f59 x:0 0 0 2024-09-16T09:45:31.080 INFO:tasks.workunit.client.1.smithi114.stdout:9/266: write d3/da/f55 [42274,97916] 0 2024-09-16T09:45:31.080 INFO:tasks.workunit.client.1.smithi114.stdout:6/279: mkdir d6/da/d36/d51 0 2024-09-16T09:45:31.081 INFO:tasks.workunit.client.0.smithi111.stdout:5/37: fsync f3 0 2024-09-16T09:45:31.081 INFO:tasks.workunit.client.0.smithi111.stdout:0/72: creat d0/f1c x:0 0 0 2024-09-16T09:45:31.082 INFO:tasks.workunit.client.1.smithi114.stdout:8/316: symlink d4/db/d68/d52/l6a 0 2024-09-16T09:45:31.082 INFO:tasks.workunit.client.1.smithi114.stdout:8/317: chown d4/db/f4d 18464 1 2024-09-16T09:45:31.083 INFO:tasks.workunit.client.1.smithi114.stdout:7/348: truncate d2/d9/d2b/d2e/d3e/f65 482492 0 2024-09-16T09:45:31.083 INFO:tasks.workunit.client.1.smithi114.stdout:8/318: dread d4/d1f/f35 [0,4194304] 0 2024-09-16T09:45:31.083 INFO:tasks.workunit.client.1.smithi114.stdout:8/319: chown d4/d1f/c27 7428 1 2024-09-16T09:45:31.084 INFO:tasks.workunit.client.1.smithi114.stdout:8/320: truncate d4/db/df/f3d 24840 0 2024-09-16T09:45:31.085 INFO:tasks.workunit.client.0.smithi111.stdout:7/52: fsync d1/d9/fa 0 2024-09-16T09:45:31.085 INFO:tasks.workunit.client.0.smithi111.stdout:7/53: fsync d1/d9/fe 0 2024-09-16T09:45:31.085 INFO:tasks.workunit.client.0.smithi111.stdout:5/38: write f3 [921201,46151] 0 2024-09-16T09:45:31.085 INFO:tasks.workunit.client.0.smithi111.stdout:5/39: chown f7 2 1 2024-09-16T09:45:31.089 INFO:tasks.workunit.client.1.smithi114.stdout:6/280: link d6/da/d36/f3f d6/d2d/d46/f52 0 2024-09-16T09:45:31.089 INFO:tasks.workunit.client.1.smithi114.stdout:6/281: write d6/da/d36/f4f [902091,117240] 0 2024-09-16T09:45:31.089 INFO:tasks.workunit.client.0.smithi111.stdout:7/54: symlink d1/d9/l12 0 2024-09-16T09:45:31.090 INFO:tasks.workunit.client.1.smithi114.stdout:6/282: dread d6/da/d10/f4b [0,4194304] 0 2024-09-16T09:45:31.091 INFO:tasks.workunit.client.1.smithi114.stdout:4/260: dread d0/d26/d3c/f2d [0,4194304] 0 2024-09-16T09:45:31.091 INFO:tasks.workunit.client.1.smithi114.stdout:4/261: write d0/f1f [1806247,59039] 0 2024-09-16T09:45:31.091 INFO:tasks.workunit.client.1.smithi114.stdout:7/349: rename d2/c2f to d2/d9/d2b/d2e/d22/d27/d4d/c6f 0 2024-09-16T09:45:31.093 INFO:tasks.workunit.client.0.smithi111.stdout:5/40: creat fc x:0 0 0 2024-09-16T09:45:31.093 INFO:tasks.workunit.client.1.smithi114.stdout:9/267: write d3/da/d10/d23/d29/f39 [4168812,74768] 0 2024-09-16T09:45:31.094 INFO:tasks.workunit.client.1.smithi114.stdout:8/321: creat d4/db/d39/d3c/f6b x:0 0 0 2024-09-16T09:45:31.095 INFO:tasks.workunit.client.0.smithi111.stdout:7/55: creat d1/f13 x:0 0 0 2024-09-16T09:45:31.096 INFO:tasks.workunit.client.1.smithi114.stdout:0/206: sync 2024-09-16T09:45:31.096 INFO:tasks.workunit.client.0.smithi111.stdout:5/41: rename f5 to fd 0 2024-09-16T09:45:31.097 INFO:tasks.workunit.client.1.smithi114.stdout:6/283: creat d6/da/d36/d51/f53 x:0 0 0 2024-09-16T09:45:31.098 INFO:tasks.workunit.client.0.smithi111.stdout:0/73: dwrite d0/f10 [4194304,4194304] 0 2024-09-16T09:45:31.098 INFO:tasks.workunit.client.0.smithi111.stdout:0/74: chown d0/f1c 0 1 2024-09-16T09:45:31.098 INFO:tasks.workunit.client.0.smithi111.stdout:7/56: creat d1/f14 x:0 0 0 2024-09-16T09:45:31.101 INFO:tasks.workunit.client.1.smithi114.stdout:4/262: unlink d0/d26/c27 0 2024-09-16T09:45:31.101 INFO:tasks.workunit.client.1.smithi114.stdout:4/263: chown d0/l1a 59328 1 2024-09-16T09:45:31.103 INFO:tasks.workunit.client.1.smithi114.stdout:5/302: sync 2024-09-16T09:45:31.103 INFO:tasks.workunit.client.1.smithi114.stdout:3/380: sync 2024-09-16T09:45:31.104 INFO:tasks.workunit.client.1.smithi114.stdout:7/350: unlink d2/d9/d2b/d2e/d22/d27/f18 0 2024-09-16T09:45:31.104 INFO:tasks.workunit.client.0.smithi111.stdout:0/75: fsync d0/f13 0 2024-09-16T09:45:31.107 INFO:tasks.workunit.client.1.smithi114.stdout:9/268: rename d3/da/d10/d23/d38 to d3/da/d10/d23/d43/d1e/d25/d5a 0 2024-09-16T09:45:31.109 INFO:tasks.workunit.client.1.smithi114.stdout:9/269: write d3/da/f11 [690443,77092] 0 2024-09-16T09:45:31.110 INFO:tasks.workunit.client.1.smithi114.stdout:9/270: dread d3/da/f46 [0,4194304] 0 2024-09-16T09:45:31.110 INFO:tasks.workunit.client.1.smithi114.stdout:9/271: write d3/fc [9271279,46012] 0 2024-09-16T09:45:31.112 INFO:tasks.workunit.client.1.smithi114.stdout:8/322: unlink d4/db/c2e 0 2024-09-16T09:45:31.114 INFO:tasks.workunit.client.1.smithi114.stdout:0/207: symlink d1f/l4f 0 2024-09-16T09:45:31.116 INFO:tasks.workunit.client.0.smithi111.stdout:7/57: write d1/d9/fe [2224783,69503] 0 2024-09-16T09:45:31.116 INFO:tasks.workunit.client.1.smithi114.stdout:6/284: creat d6/d2d/f54 x:0 0 0 2024-09-16T09:45:31.117 INFO:tasks.workunit.client.1.smithi114.stdout:6/285: write d6/da/d36/f38 [839480,19912] 0 2024-09-16T09:45:31.119 INFO:tasks.workunit.client.1.smithi114.stdout:5/303: truncate f0 3558671 0 2024-09-16T09:45:31.120 INFO:tasks.workunit.client.0.smithi111.stdout:5/42: getdents . 0 2024-09-16T09:45:31.120 INFO:tasks.workunit.client.0.smithi111.stdout:5/43: write fb [455009,94437] 0 2024-09-16T09:45:31.120 INFO:tasks.workunit.client.0.smithi111.stdout:5/44: rmdir - no directory 2024-09-16T09:45:31.121 INFO:tasks.workunit.client.1.smithi114.stdout:3/381: symlink dc/de/d10/l83 0 2024-09-16T09:45:31.122 INFO:tasks.workunit.client.1.smithi114.stdout:3/382: dread dc/de/d10/d26/f4d [0,4194304] 0 2024-09-16T09:45:31.123 INFO:tasks.workunit.client.1.smithi114.stdout:9/272: mkdir d3/da/d10/d23/d43/d1e/d25/d5a/d5b 0 2024-09-16T09:45:31.123 INFO:tasks.workunit.client.1.smithi114.stdout:9/273: stat d3/da/d10 0 2024-09-16T09:45:31.124 INFO:tasks.workunit.client.0.smithi111.stdout:5/45: creat fe x:0 0 0 2024-09-16T09:45:31.125 INFO:tasks.workunit.client.1.smithi114.stdout:8/323: creat d4/db/df/f6c x:0 0 0 2024-09-16T09:45:31.126 INFO:tasks.workunit.client.1.smithi114.stdout:0/208: creat d1f/d2d/f50 x:0 0 0 2024-09-16T09:45:31.127 INFO:tasks.workunit.client.0.smithi111.stdout:5/46: write fc [510022,87314] 0 2024-09-16T09:45:31.129 INFO:tasks.workunit.client.1.smithi114.stdout:6/286: truncate d6/da/f15 1721745 0 2024-09-16T09:45:31.129 INFO:tasks.workunit.client.1.smithi114.stdout:6/287: chown d6/da 23862128 1 2024-09-16T09:45:31.130 INFO:tasks.workunit.client.1.smithi114.stdout:5/304: creat d3/df/d2d/d3f/f5c x:0 0 0 2024-09-16T09:45:31.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/47: write fb [721836,82461] 0 2024-09-16T09:45:31.132 INFO:tasks.workunit.client.1.smithi114.stdout:3/383: rmdir dc/de/d10/d26 39 2024-09-16T09:45:31.132 INFO:tasks.workunit.client.1.smithi114.stdout:3/384: truncate dc/de/d10/f3c 4965300 0 2024-09-16T09:45:31.133 INFO:tasks.workunit.client.1.smithi114.stdout:9/274: symlink d3/da/l5c 0 2024-09-16T09:45:31.133 INFO:tasks.workunit.client.1.smithi114.stdout:2/314: sync 2024-09-16T09:45:31.133 INFO:tasks.workunit.client.1.smithi114.stdout:1/340: sync 2024-09-16T09:45:31.134 INFO:tasks.workunit.client.1.smithi114.stdout:2/315: chown d1/d8/d10/d16/d60 0 1 2024-09-16T09:45:31.136 INFO:tasks.workunit.client.1.smithi114.stdout:0/209: truncate d1f/d20/f29 937805 0 2024-09-16T09:45:31.136 INFO:tasks.workunit.client.1.smithi114.stdout:0/210: write d1f/d20/f3d [5975,67035] 0 2024-09-16T09:45:31.138 INFO:tasks.workunit.client.0.smithi111.stdout:0/76: dwrite d0/ff [0,4194304] 0 2024-09-16T09:45:31.138 INFO:tasks.workunit.client.0.smithi111.stdout:5/48: rename fb to ff 0 2024-09-16T09:45:31.139 INFO:tasks.workunit.client.1.smithi114.stdout:9/275: fsync d3/da/f55 0 2024-09-16T09:45:31.139 INFO:tasks.workunit.client.1.smithi114.stdout:9/276: chown d3/da/d10/d23/d43 12962930 1 2024-09-16T09:45:31.139 INFO:tasks.workunit.client.1.smithi114.stdout:7/351: dwrite d2/df/f3a [0,4194304] 0 2024-09-16T09:45:31.141 INFO:tasks.workunit.client.1.smithi114.stdout:5/305: rename d3/d11/d37/f53 to d3/df/d2d/d3f/f5d 0 2024-09-16T09:45:31.142 INFO:tasks.workunit.client.0.smithi111.stdout:0/77: getdents d0 0 2024-09-16T09:45:31.144 INFO:tasks.workunit.client.1.smithi114.stdout:3/385: mknod dc/de/d10/d26/c84 0 2024-09-16T09:45:31.144 INFO:tasks.workunit.client.0.smithi111.stdout:7/58: dread d1/d9/fe [4194304,4194304] 0 2024-09-16T09:45:31.144 INFO:tasks.workunit.client.0.smithi111.stdout:5/49: write f3 [1105373,64857] 0 2024-09-16T09:45:31.144 INFO:tasks.workunit.client.0.smithi111.stdout:7/59: dread - d1/f14 zero size 2024-09-16T09:45:31.145 INFO:tasks.workunit.client.0.smithi111.stdout:5/50: write ff [18553,74327] 0 2024-09-16T09:45:31.147 INFO:tasks.workunit.client.0.smithi111.stdout:0/78: rmdir d0 39 2024-09-16T09:45:31.148 INFO:tasks.workunit.client.1.smithi114.stdout:1/341: mkdir d4/d2b/d16/d71 0 2024-09-16T09:45:31.148 INFO:tasks.workunit.client.1.smithi114.stdout:1/342: stat d4/d2b/d2f/d3a/f4f 0 2024-09-16T09:45:31.148 INFO:tasks.workunit.client.1.smithi114.stdout:4/264: dwrite d0/d13/f4c [0,4194304] 0 2024-09-16T09:45:31.148 INFO:tasks.workunit.client.1.smithi114.stdout:8/324: mkdir d4/d6d 0 2024-09-16T09:45:31.149 INFO:tasks.workunit.client.0.smithi111.stdout:7/60: creat d1/d9/f15 x:0 0 0 2024-09-16T09:45:31.149 INFO:tasks.workunit.client.0.smithi111.stdout:7/61: fdatasync d1/d9/f15 0 2024-09-16T09:45:31.149 INFO:tasks.workunit.client.0.smithi111.stdout:7/62: fsync d1/d9/fa 0 2024-09-16T09:45:31.150 INFO:tasks.workunit.client.1.smithi114.stdout:0/211: creat d1f/d20/f51 x:0 0 0 2024-09-16T09:45:31.150 INFO:tasks.workunit.client.0.smithi111.stdout:5/51: creat f10 x:0 0 0 2024-09-16T09:45:31.151 INFO:tasks.workunit.client.1.smithi114.stdout:7/352: mknod d2/d9/d2b/d2e/d22/c70 0 2024-09-16T09:45:31.151 INFO:tasks.workunit.client.1.smithi114.stdout:7/353: fsync d2/f2c 0 2024-09-16T09:45:31.152 INFO:tasks.workunit.client.1.smithi114.stdout:5/306: mknod d3/df/d52/c5e 0 2024-09-16T09:45:31.153 INFO:tasks.workunit.client.1.smithi114.stdout:8/325: dread d4/f40 [0,4194304] 0 2024-09-16T09:45:31.153 INFO:tasks.workunit.client.1.smithi114.stdout:3/386: symlink dc/de/d10/d6a/l85 0 2024-09-16T09:45:31.154 INFO:tasks.workunit.client.1.smithi114.stdout:6/288: dwrite d6/da/d10/f16 [0,4194304] 0 2024-09-16T09:45:31.154 INFO:tasks.workunit.client.1.smithi114.stdout:6/289: chown d6/da/d48 25748 1 2024-09-16T09:45:31.155 INFO:tasks.workunit.client.0.smithi111.stdout:0/79: mkdir d0/d1d 0 2024-09-16T09:45:31.157 INFO:tasks.workunit.client.0.smithi111.stdout:7/63: mkdir d1/d16 0 2024-09-16T09:45:31.159 INFO:tasks.workunit.client.1.smithi114.stdout:0/212: rename d1f/d22/d2e/c44 to d1f/d22/d2e/c52 0 2024-09-16T09:45:31.159 INFO:tasks.workunit.client.1.smithi114.stdout:0/213: write f16 [1381103,79366] 0 2024-09-16T09:45:31.162 INFO:tasks.workunit.client.1.smithi114.stdout:7/354: mkdir d2/d9/d51/d71 0 2024-09-16T09:45:31.163 INFO:tasks.workunit.client.0.smithi111.stdout:0/80: symlink d0/d1d/l1e 0 2024-09-16T09:45:31.163 INFO:tasks.workunit.client.0.smithi111.stdout:0/81: truncate d0/f15 118405 0 2024-09-16T09:45:31.163 INFO:tasks.workunit.client.0.smithi111.stdout:0/82: write d0/f1c [420567,92857] 0 2024-09-16T09:45:31.163 INFO:tasks.workunit.client.0.smithi111.stdout:0/83: fsync d0/fd 0 2024-09-16T09:45:31.163 INFO:tasks.workunit.client.0.smithi111.stdout:0/84: chown d0/l19 8 1 2024-09-16T09:45:31.164 INFO:tasks.workunit.client.1.smithi114.stdout:7/355: dread d2/d9/d2b/d2e/d22/d27/f1f [0,4194304] 0 2024-09-16T09:45:31.164 INFO:tasks.workunit.client.1.smithi114.stdout:9/277: dwrite d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:31.164 INFO:tasks.workunit.client.1.smithi114.stdout:2/316: dwrite d1/f7b [0,4194304] 0 2024-09-16T09:45:31.164 INFO:tasks.workunit.client.1.smithi114.stdout:5/307: creat d3/df/d2d/d34/f5f x:0 0 0 2024-09-16T09:45:31.167 INFO:tasks.workunit.client.0.smithi111.stdout:5/52: link f7 f11 0 2024-09-16T09:45:31.168 INFO:tasks.workunit.client.1.smithi114.stdout:8/326: write d4/db/dd/f20 [1018464,121265] 0 2024-09-16T09:45:31.168 INFO:tasks.workunit.client.1.smithi114.stdout:8/327: truncate d4/db/df/f6c 380624 0 2024-09-16T09:45:31.169 INFO:tasks.workunit.client.1.smithi114.stdout:3/387: creat dc/de/d10/d6a/d77/d7f/f86 x:0 0 0 2024-09-16T09:45:31.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/53: creat f12 x:0 0 0 2024-09-16T09:45:31.175 INFO:tasks.workunit.client.0.smithi111.stdout:0/85: dread d0/f11 [0,4194304] 0 2024-09-16T09:45:31.175 INFO:tasks.workunit.client.1.smithi114.stdout:6/290: symlink d6/l55 0 2024-09-16T09:45:31.183 INFO:tasks.workunit.client.1.smithi114.stdout:0/214: dwrite d1f/f3f [0,4194304] 0 2024-09-16T09:45:31.185 INFO:tasks.workunit.client.0.smithi111.stdout:0/86: mknod d0/d1d/c1f 0 2024-09-16T09:45:31.185 INFO:tasks.workunit.client.0.smithi111.stdout:5/54: dwrite - open fd failed 14 2024-09-16T09:45:31.186 INFO:tasks.workunit.client.1.smithi114.stdout:2/317: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f7e x:0 0 0 2024-09-16T09:45:31.186 INFO:tasks.workunit.client.0.smithi111.stdout:0/87: rmdir d0 39 2024-09-16T09:45:31.189 INFO:tasks.workunit.client.0.smithi111.stdout:5/55: symlink l13 0 2024-09-16T09:45:31.189 INFO:tasks.workunit.client.0.smithi111.stdout:5/56: fdatasync fe 0 2024-09-16T09:45:31.190 INFO:tasks.workunit.client.1.smithi114.stdout:8/328: creat d4/db/f6e x:0 0 0 2024-09-16T09:45:31.193 INFO:tasks.workunit.client.1.smithi114.stdout:3/388: unlink dc/de/d10/l83 0 2024-09-16T09:45:31.194 INFO:tasks.workunit.client.1.smithi114.stdout:9/278: dwrite d3/da/d10/d23/d43/f33 [0,4194304] 0 2024-09-16T09:45:31.194 INFO:tasks.workunit.client.1.smithi114.stdout:9/279: fdatasync d3/da/fb 0 2024-09-16T09:45:31.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/57: creat f14 x:0 0 0 2024-09-16T09:45:31.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/58: truncate f14 802505 0 2024-09-16T09:45:31.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/59: chown f11 3 1 2024-09-16T09:45:31.197 INFO:tasks.workunit.client.0.smithi111.stdout:5/60: fsync f7 0 2024-09-16T09:45:31.198 INFO:tasks.workunit.client.0.smithi111.stdout:5/61: dread f14 [0,4194304] 0 2024-09-16T09:45:31.202 INFO:tasks.workunit.client.1.smithi114.stdout:6/291: creat d6/da/d10/f56 x:0 0 0 2024-09-16T09:45:31.202 INFO:tasks.workunit.client.1.smithi114.stdout:5/308: dread d3/d24/f2e [0,4194304] 0 2024-09-16T09:45:31.204 INFO:tasks.workunit.client.0.smithi111.stdout:5/62: link f10 f15 0 2024-09-16T09:45:31.205 INFO:tasks.workunit.client.1.smithi114.stdout:7/356: dwrite d2/df/f3a [0,4194304] 0 2024-09-16T09:45:31.205 INFO:tasks.workunit.client.1.smithi114.stdout:7/357: chown d2/d9/d2b/d2e/d22/d27/c35 218937907 1 2024-09-16T09:45:31.206 INFO:tasks.workunit.client.1.smithi114.stdout:9/280: write d3/f32 [3984236,56750] 0 2024-09-16T09:45:31.206 INFO:tasks.workunit.client.1.smithi114.stdout:5/309: write d3/df/d2d/d34/f3d [39196,77398] 0 2024-09-16T09:45:31.206 INFO:tasks.workunit.client.1.smithi114.stdout:5/310: fdatasync d3/f2c 0 2024-09-16T09:45:31.206 INFO:tasks.workunit.client.1.smithi114.stdout:9/281: write d3/da/d10/f20 [1053845,15098] 0 2024-09-16T09:45:31.206 INFO:tasks.workunit.client.1.smithi114.stdout:0/215: mknod d1f/d20/c53 0 2024-09-16T09:45:31.207 INFO:tasks.workunit.client.1.smithi114.stdout:2/318: symlink d1/d8/d10/d16/d1d/l7f 0 2024-09-16T09:45:31.207 INFO:tasks.workunit.client.1.smithi114.stdout:2/319: stat d1/d8/d10/d16 0 2024-09-16T09:45:31.208 INFO:tasks.workunit.client.1.smithi114.stdout:8/329: dwrite d4/db/dd/f13 [0,4194304] 0 2024-09-16T09:45:31.208 INFO:tasks.workunit.client.1.smithi114.stdout:3/389: symlink dc/de/d17/d2d/l87 0 2024-09-16T09:45:31.208 INFO:tasks.workunit.client.1.smithi114.stdout:3/390: dread - dc/d38/d3f/f5f zero size 2024-09-16T09:45:31.208 INFO:tasks.workunit.client.1.smithi114.stdout:3/391: fsync dc/f27 0 2024-09-16T09:45:31.208 INFO:tasks.workunit.client.0.smithi111.stdout:5/63: mknod c16 0 2024-09-16T09:45:31.209 INFO:tasks.workunit.client.1.smithi114.stdout:7/358: mkdir d2/d9/d2b/d2e/d22/d27/d4d/d72 0 2024-09-16T09:45:31.210 INFO:tasks.workunit.client.1.smithi114.stdout:7/359: readlink d2/d9/d2b/d2e/d22/d4c/l5b 0 2024-09-16T09:45:31.210 INFO:tasks.workunit.client.1.smithi114.stdout:9/282: mknod d3/da/d10/d23/d29/d2c/d45/c5d 0 2024-09-16T09:45:31.212 INFO:tasks.workunit.client.1.smithi114.stdout:0/216: rename d1f/d2d/f50 to d1f/d22/d2e/d46/f54 0 2024-09-16T09:45:31.212 INFO:tasks.workunit.client.1.smithi114.stdout:2/320: mknod d1/d8/d10/c80 0 2024-09-16T09:45:31.213 INFO:tasks.workunit.client.1.smithi114.stdout:5/311: dread d3/df/d2d/d34/f3d [0,4194304] 0 2024-09-16T09:45:31.215 INFO:tasks.workunit.client.1.smithi114.stdout:3/392: creat dc/de/d17/d2d/f88 x:0 0 0 2024-09-16T09:45:31.215 INFO:tasks.workunit.client.1.smithi114.stdout:3/393: dread - dc/de/d10/d6a/d77/d7f/f86 zero size 2024-09-16T09:45:31.217 INFO:tasks.workunit.client.1.smithi114.stdout:7/360: mknod d2/d9/d2b/d2e/d22/d27/d4d/c73 0 2024-09-16T09:45:31.218 INFO:tasks.workunit.client.1.smithi114.stdout:0/217: mkdir d1f/d27/d55 0 2024-09-16T09:45:31.218 INFO:tasks.workunit.client.1.smithi114.stdout:0/218: write d1f/d20/f29 [476772,7286] 0 2024-09-16T09:45:31.219 INFO:tasks.workunit.client.1.smithi114.stdout:9/283: rename d3/da/fd to d3/da/d10/d23/d43/d1e/f5e 0 2024-09-16T09:45:31.221 INFO:tasks.workunit.client.1.smithi114.stdout:2/321: link d1/d8/f2e d1/d8/d10/d16/d1d/d4a/d3e/d5b/f81 0 2024-09-16T09:45:31.221 INFO:tasks.workunit.client.1.smithi114.stdout:2/322: dread - d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f7e zero size 2024-09-16T09:45:31.221 INFO:tasks.workunit.client.1.smithi114.stdout:5/312: creat d3/df/d2d/d3f/d41/d5a/f60 x:0 0 0 2024-09-16T09:45:31.222 INFO:tasks.workunit.client.1.smithi114.stdout:3/394: truncate dc/d38/f66 636760 0 2024-09-16T09:45:31.223 INFO:tasks.workunit.client.1.smithi114.stdout:7/361: rename d2/d9/d2b/d2e/c4b to d2/d9/d2b/d59/c74 0 2024-09-16T09:45:31.224 INFO:tasks.workunit.client.1.smithi114.stdout:7/362: readlink d2/d9/d2b/d2e/d22/d27/d4d/l6d 0 2024-09-16T09:45:31.224 INFO:tasks.workunit.client.1.smithi114.stdout:7/363: readlink d2/d9/d2b/l46 0 2024-09-16T09:45:31.224 INFO:tasks.workunit.client.1.smithi114.stdout:9/284: rmdir d3/da/d10/d23/d42 39 2024-09-16T09:45:31.225 INFO:tasks.workunit.client.1.smithi114.stdout:2/323: mkdir d1/d8/d82 0 2024-09-16T09:45:31.226 INFO:tasks.workunit.client.1.smithi114.stdout:0/219: write f3 [3801285,128678] 0 2024-09-16T09:45:31.226 INFO:tasks.workunit.client.1.smithi114.stdout:0/220: write d1f/d20/d48/f4e [4830,4097] 0 2024-09-16T09:45:31.226 INFO:tasks.workunit.client.1.smithi114.stdout:5/313: unlink f0 0 2024-09-16T09:45:31.227 INFO:tasks.workunit.client.1.smithi114.stdout:3/395: symlink dc/de/d17/d72/l89 0 2024-09-16T09:45:31.227 INFO:tasks.workunit.client.1.smithi114.stdout:3/396: readlink dc/de/d17/l21 0 2024-09-16T09:45:31.228 INFO:tasks.workunit.client.1.smithi114.stdout:7/364: mknod d2/d9/d2b/d2e/d22/d4c/c75 0 2024-09-16T09:45:31.229 INFO:tasks.workunit.client.1.smithi114.stdout:9/285: rename d3/da/d10/d23/d29/f53 to d3/da/d10/d23/d42/f5f 0 2024-09-16T09:45:31.230 INFO:tasks.workunit.client.0.smithi111.stdout:5/64: getdents . 0 2024-09-16T09:45:31.230 INFO:tasks.workunit.client.0.smithi111.stdout:5/65: dread - f12 zero size 2024-09-16T09:45:31.230 INFO:tasks.workunit.client.0.smithi111.stdout:5/66: write fe [817965,31670] 0 2024-09-16T09:45:31.232 INFO:tasks.workunit.client.0.smithi111.stdout:5/67: mknod c17 0 2024-09-16T09:45:31.234 INFO:tasks.workunit.client.1.smithi114.stdout:2/324: mknod d1/d8/d10/d5a/c83 0 2024-09-16T09:45:31.234 INFO:tasks.workunit.client.0.smithi111.stdout:5/68: link f11 f18 0 2024-09-16T09:45:31.235 INFO:tasks.workunit.client.0.smithi111.stdout:5/69: truncate f15 899574 0 2024-09-16T09:45:31.235 INFO:tasks.workunit.client.0.smithi111.stdout:5/70: write ff [1476153,14409] 0 2024-09-16T09:45:31.235 INFO:tasks.workunit.client.1.smithi114.stdout:2/325: dread d1/d8/f2e [0,4194304] 0 2024-09-16T09:45:31.235 INFO:tasks.workunit.client.1.smithi114.stdout:2/326: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/d5e/c6b 226 1 2024-09-16T09:45:31.235 INFO:tasks.workunit.client.1.smithi114.stdout:3/397: write dc/de/d18/d78/d5c/d5d/f55 [3486878,62877] 0 2024-09-16T09:45:31.236 INFO:tasks.workunit.client.1.smithi114.stdout:3/398: read dc/de/d18/d78/f73 [1866064,85810] 0 2024-09-16T09:45:31.236 INFO:tasks.workunit.client.1.smithi114.stdout:3/399: write dc/de/d17/f1a [4378462,40205] 0 2024-09-16T09:45:31.236 INFO:tasks.workunit.client.1.smithi114.stdout:0/221: mkdir d1f/d27/d47/d56 0 2024-09-16T09:45:31.236 INFO:tasks.workunit.client.0.smithi111.stdout:5/71: mkdir d19 0 2024-09-16T09:45:31.238 INFO:tasks.workunit.client.1.smithi114.stdout:5/314: mkdir d3/df/d52/d61 0 2024-09-16T09:45:31.238 INFO:tasks.workunit.client.1.smithi114.stdout:5/315: getdents d3/df/d2d/d3f/d59 0 2024-09-16T09:45:31.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/286: unlink d3/da/l5c 0 2024-09-16T09:45:31.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/287: stat d3/da/fb 0 2024-09-16T09:45:31.242 INFO:tasks.workunit.client.1.smithi114.stdout:2/327: creat d1/f84 x:0 0 0 2024-09-16T09:45:31.245 INFO:tasks.workunit.client.1.smithi114.stdout:9/288: dread d3/da/d10/d23/d43/d1e/d25/f27 [0,4194304] 0 2024-09-16T09:45:31.246 INFO:tasks.workunit.client.1.smithi114.stdout:2/328: creat d1/d8/d10/f85 x:0 0 0 2024-09-16T09:45:31.247 INFO:tasks.workunit.client.1.smithi114.stdout:5/316: mknod d3/d1f/c62 0 2024-09-16T09:45:31.247 INFO:tasks.workunit.client.1.smithi114.stdout:0/222: dread f6 [0,4194304] 0 2024-09-16T09:45:31.247 INFO:tasks.workunit.client.1.smithi114.stdout:3/400: mkdir dc/de/d18/d78/d5c/d5d/d8a 0 2024-09-16T09:45:31.247 INFO:tasks.workunit.client.1.smithi114.stdout:7/365: getdents d2/d9/d2b/d59 0 2024-09-16T09:45:31.247 INFO:tasks.workunit.client.1.smithi114.stdout:7/366: stat d2/d9 0 2024-09-16T09:45:31.247 INFO:tasks.workunit.client.1.smithi114.stdout:7/367: stat d2/d9/d2b/d2e/d22/f49 0 2024-09-16T09:45:31.248 INFO:tasks.workunit.client.1.smithi114.stdout:2/329: creat d1/f86 x:0 0 0 2024-09-16T09:45:31.248 INFO:tasks.workunit.client.1.smithi114.stdout:2/330: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f6f 4770 1 2024-09-16T09:45:31.249 INFO:tasks.workunit.client.1.smithi114.stdout:5/317: getdents d3/d24 0 2024-09-16T09:45:31.249 INFO:tasks.workunit.client.1.smithi114.stdout:5/318: fsync d3/d11/f1a 0 2024-09-16T09:45:31.249 INFO:tasks.workunit.client.1.smithi114.stdout:5/319: chown d3/f20 380 1 2024-09-16T09:45:31.249 INFO:tasks.workunit.client.1.smithi114.stdout:5/320: getdents d3/df/d2d/d3f/d59 0 2024-09-16T09:45:31.251 INFO:tasks.workunit.client.1.smithi114.stdout:0/223: mknod d1f/d27/c57 0 2024-09-16T09:45:31.251 INFO:tasks.workunit.client.1.smithi114.stdout:0/224: write d1f/f4b [300538,82288] 0 2024-09-16T09:45:31.251 INFO:tasks.workunit.client.1.smithi114.stdout:0/225: truncate d1f/d22/f2b 1050458 0 2024-09-16T09:45:31.251 INFO:tasks.workunit.client.1.smithi114.stdout:0/226: chown d1f/d27/d47/d56 3 1 2024-09-16T09:45:31.252 INFO:tasks.workunit.client.1.smithi114.stdout:7/368: mknod d2/d9/d2b/d2e/d22/d66/c76 0 2024-09-16T09:45:31.254 INFO:tasks.workunit.client.1.smithi114.stdout:2/331: creat d1/d8/d10/d16/d1d/d4a/d3e/f87 x:0 0 0 2024-09-16T09:45:31.257 INFO:tasks.workunit.client.1.smithi114.stdout:7/369: unlink d2/df/l20 0 2024-09-16T09:45:31.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/72: dwrite f10 [0,4194304] 0 2024-09-16T09:45:31.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/73: chown f11 1958 1 2024-09-16T09:45:31.260 INFO:tasks.workunit.client.1.smithi114.stdout:2/332: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d78/f88 x:0 0 0 2024-09-16T09:45:31.262 INFO:tasks.workunit.client.1.smithi114.stdout:7/370: rename d2/d9/d2b/d2e/d22/d27/d50 to d2/d9/d2b/d2e/d77 0 2024-09-16T09:45:31.264 INFO:tasks.workunit.client.0.smithi111.stdout:5/74: symlink d19/l1a 0 2024-09-16T09:45:31.265 INFO:tasks.workunit.client.1.smithi114.stdout:3/401: dread dc/de/d10/f25 [0,4194304] 0 2024-09-16T09:45:31.266 INFO:tasks.workunit.client.1.smithi114.stdout:9/289: dwrite d3/da/d10/d23/d43/d1e/d25/d5a/f54 [0,4194304] 0 2024-09-16T09:45:31.267 INFO:tasks.workunit.client.1.smithi114.stdout:2/333: rename d1/d8/d10/d16/d1d/l3a to d1/d8/d10/d16/d1d/d4a/l89 0 2024-09-16T09:45:31.267 INFO:tasks.workunit.client.1.smithi114.stdout:2/334: write d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f7e [603596,61356] 0 2024-09-16T09:45:31.267 INFO:tasks.workunit.client.1.smithi114.stdout:2/335: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/f61 3 1 2024-09-16T09:45:31.267 INFO:tasks.workunit.client.1.smithi114.stdout:2/336: dread - d1/d8/d10/f25 zero size 2024-09-16T09:45:31.267 INFO:tasks.workunit.client.1.smithi114.stdout:2/337: truncate d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f65 753268 0 2024-09-16T09:45:31.268 INFO:tasks.workunit.client.1.smithi114.stdout:2/338: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/c58 3862 1 2024-09-16T09:45:31.268 INFO:tasks.workunit.client.0.smithi111.stdout:5/75: mkdir d19/d1b 0 2024-09-16T09:45:31.269 INFO:tasks.workunit.client.1.smithi114.stdout:0/227: dread d1f/d22/f3c [0,4194304] 0 2024-09-16T09:45:31.269 INFO:tasks.workunit.client.1.smithi114.stdout:7/371: stat d2/d9/d2b/d2e/d22/c54 0 2024-09-16T09:45:31.270 INFO:tasks.workunit.client.1.smithi114.stdout:0/228: dread d1f/d27/f3a [0,4194304] 0 2024-09-16T09:45:31.270 INFO:tasks.workunit.client.1.smithi114.stdout:3/402: mknod dc/c8b 0 2024-09-16T09:45:31.270 INFO:tasks.workunit.client.1.smithi114.stdout:3/403: chown dc/de/d10/f3c 9 1 2024-09-16T09:45:31.270 INFO:tasks.workunit.client.1.smithi114.stdout:3/404: chown dc/f65 1522137183 1 2024-09-16T09:45:31.272 INFO:tasks.workunit.client.0.smithi111.stdout:5/76: link fd d19/d1b/f1c 0 2024-09-16T09:45:31.276 INFO:tasks.workunit.client.0.smithi111.stdout:5/77: rename f3 to d19/f1d 0 2024-09-16T09:45:31.279 INFO:tasks.workunit.client.0.smithi111.stdout:5/78: mkdir d19/d1b/d1e 0 2024-09-16T09:45:31.280 INFO:tasks.workunit.client.1.smithi114.stdout:2/339: creat d1/f8a x:0 0 0 2024-09-16T09:45:31.282 INFO:tasks.workunit.client.0.smithi111.stdout:5/79: rmdir d19 39 2024-09-16T09:45:31.284 INFO:tasks.workunit.client.1.smithi114.stdout:9/290: dwrite d3/f59 [0,4194304] 0 2024-09-16T09:45:31.284 INFO:tasks.workunit.client.1.smithi114.stdout:9/291: dread - d3/da/f3a zero size 2024-09-16T09:45:31.285 INFO:tasks.workunit.client.0.smithi111.stdout:5/80: creat d19/f1f x:0 0 0 2024-09-16T09:45:31.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/372: rename d2/d9/d51/d71 to d2/d9/d2b/d78 0 2024-09-16T09:45:31.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/373: chown d2/d9/l6a 216855467 1 2024-09-16T09:45:31.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/374: fdatasync d2/d9/d2b/f57 0 2024-09-16T09:45:31.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/375: readlink d2/l28 0 2024-09-16T09:45:31.287 INFO:tasks.workunit.client.1.smithi114.stdout:0/229: creat d1f/d22/d2e/d46/f58 x:0 0 0 2024-09-16T09:45:31.288 INFO:tasks.workunit.client.0.smithi111.stdout:5/81: mkdir d19/d20 0 2024-09-16T09:45:31.291 INFO:tasks.workunit.client.1.smithi114.stdout:2/340: getdents d1/d8/d10/d16/d1d/d4a 0 2024-09-16T09:45:31.294 INFO:tasks.workunit.client.1.smithi114.stdout:7/376: mkdir d2/d9/d2b/d2e/d3e/d79 0 2024-09-16T09:45:31.294 INFO:tasks.workunit.client.1.smithi114.stdout:2/341: getdents d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68 0 2024-09-16T09:45:31.295 INFO:tasks.workunit.client.1.smithi114.stdout:1/343: sync 2024-09-16T09:45:31.296 INFO:tasks.workunit.client.1.smithi114.stdout:7/377: rename d2/d9/d2b/d2e/d22/d66/d68 to d2/d55/d7a 0 2024-09-16T09:45:31.297 INFO:tasks.workunit.client.1.smithi114.stdout:9/292: write d3/fc [5169151,68637] 0 2024-09-16T09:45:31.297 INFO:tasks.workunit.client.1.smithi114.stdout:2/342: creat d1/d8/f8b x:0 0 0 2024-09-16T09:45:31.297 INFO:tasks.workunit.client.1.smithi114.stdout:4/265: sync 2024-09-16T09:45:31.301 INFO:tasks.workunit.client.1.smithi114.stdout:1/344: mkdir d4/d2b/d16/d71/d72 0 2024-09-16T09:45:31.301 INFO:tasks.workunit.client.1.smithi114.stdout:9/293: symlink d3/da/d10/d23/d43/d1e/d4c/l60 0 2024-09-16T09:45:31.301 INFO:tasks.workunit.client.1.smithi114.stdout:2/343: write d1/d8/d10/d16/d1d/f1e [586648,67521] 0 2024-09-16T09:45:31.301 INFO:tasks.workunit.client.1.smithi114.stdout:7/378: creat d2/d9/f7b x:0 0 0 2024-09-16T09:45:31.301 INFO:tasks.workunit.client.1.smithi114.stdout:7/379: write d2/d9/d2b/d2e/d3e/f44 [1155844,130013] 0 2024-09-16T09:45:31.301 INFO:tasks.workunit.client.1.smithi114.stdout:9/294: creat d3/da/d10/d23/d29/d2c/d45/f61 x:0 0 0 2024-09-16T09:45:31.305 INFO:tasks.workunit.client.1.smithi114.stdout:9/295: creat d3/da/d10/d23/d29/d2c/f62 x:0 0 0 2024-09-16T09:45:31.315 INFO:tasks.workunit.client.1.smithi114.stdout:4/266: dread d0/d13/f4c [0,4194304] 0 2024-09-16T09:45:31.318 INFO:tasks.workunit.client.1.smithi114.stdout:4/267: rename d0/d26/d29/l41 to d0/d26/d3c/d3e/l4f 0 2024-09-16T09:45:31.318 INFO:tasks.workunit.client.1.smithi114.stdout:4/268: readlink d0/d26/d2e/l35 0 2024-09-16T09:45:31.319 INFO:tasks.workunit.client.1.smithi114.stdout:4/269: creat d0/d26/d3c/d45/f50 x:0 0 0 2024-09-16T09:45:31.319 INFO:tasks.workunit.client.1.smithi114.stdout:0/230: dwrite f3 [0,4194304] 0 2024-09-16T09:45:31.319 INFO:tasks.workunit.client.1.smithi114.stdout:0/231: write d1f/f45 [128984,55581] 0 2024-09-16T09:45:31.320 INFO:tasks.workunit.client.1.smithi114.stdout:0/232: dread d1f/d27/f3a [0,4194304] 0 2024-09-16T09:45:31.321 INFO:tasks.workunit.client.1.smithi114.stdout:4/270: rename d0/d26/d29/d2b/f36 to d0/d26/d3c/d3e/d4d/f51 0 2024-09-16T09:45:31.322 INFO:tasks.workunit.client.1.smithi114.stdout:4/271: link d0/l1a d0/d26/d29/l52 0 2024-09-16T09:45:31.333 INFO:tasks.workunit.client.0.smithi111.stdout:5/82: dwrite d19/f1d [0,4194304] 0 2024-09-16T09:45:31.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/83: read f14 [799285,82310] 0 2024-09-16T09:45:31.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/84: stat d19 0 2024-09-16T09:45:31.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/85: write fc [682349,43275] 0 2024-09-16T09:45:31.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/86: fdatasync f7 0 2024-09-16T09:45:31.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/87: fdatasync d19/f1f 0 2024-09-16T09:45:31.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/88: readlink l6 0 2024-09-16T09:45:31.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/89: mkdir d19/d1b/d1e/d21 0 2024-09-16T09:45:31.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/90: mknod d19/d1b/d1e/d21/c22 0 2024-09-16T09:45:31.336 INFO:tasks.workunit.client.0.smithi111.stdout:5/91: mknod d19/c23 0 2024-09-16T09:45:31.337 INFO:tasks.workunit.client.0.smithi111.stdout:5/92: link d19/d1b/f1c d19/d20/f24 0 2024-09-16T09:45:31.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/93: mkdir d19/d20/d25 0 2024-09-16T09:45:31.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/233: write f3 [3411104,39577] 0 2024-09-16T09:45:31.339 INFO:tasks.workunit.client.0.smithi111.stdout:5/94: rename f11 to d19/d20/d25/f26 0 2024-09-16T09:45:31.339 INFO:tasks.workunit.client.0.smithi111.stdout:5/95: chown ff 216022574 1 2024-09-16T09:45:31.339 INFO:tasks.workunit.client.1.smithi114.stdout:0/234: symlink d1f/d27/d47/d56/l59 0 2024-09-16T09:45:31.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/96: truncate f4 6131807 0 2024-09-16T09:45:31.341 INFO:tasks.workunit.client.1.smithi114.stdout:9/296: dwrite d3/da/f55 [0,4194304] 0 2024-09-16T09:45:31.341 INFO:tasks.workunit.client.1.smithi114.stdout:9/297: readlink d3/da/d10/d23/d43/l22 0 2024-09-16T09:45:31.341 INFO:tasks.workunit.client.1.smithi114.stdout:0/235: rename d1f/f4b to d1f/d22/d2e/f5a 0 2024-09-16T09:45:31.343 INFO:tasks.workunit.client.1.smithi114.stdout:9/298: creat d3/da/d10/d23/d42/f63 x:0 0 0 2024-09-16T09:45:31.343 INFO:tasks.workunit.client.1.smithi114.stdout:0/236: rmdir d1f/d22 39 2024-09-16T09:45:31.343 INFO:tasks.workunit.client.1.smithi114.stdout:0/237: stat f15 0 2024-09-16T09:45:31.344 INFO:tasks.workunit.client.1.smithi114.stdout:9/299: creat d3/da/d10/d23/d29/d2c/d45/f64 x:0 0 0 2024-09-16T09:45:31.345 INFO:tasks.workunit.client.1.smithi114.stdout:0/238: symlink d1f/d20/l5b 0 2024-09-16T09:45:31.346 INFO:tasks.workunit.client.1.smithi114.stdout:9/300: creat d3/da/d10/d23/d29/d2c/d45/f65 x:0 0 0 2024-09-16T09:45:31.346 INFO:tasks.workunit.client.1.smithi114.stdout:9/301: mknod d3/da/d10/d23/d43/c66 0 2024-09-16T09:45:31.348 INFO:tasks.workunit.client.1.smithi114.stdout:9/302: symlink d3/da/d10/d23/d43/d1e/d25/d5a/d5b/l67 0 2024-09-16T09:45:31.348 INFO:tasks.workunit.client.1.smithi114.stdout:9/303: getdents d3/da/d10/d23/d43/d1e 0 2024-09-16T09:45:31.349 INFO:tasks.workunit.client.1.smithi114.stdout:9/304: chown d3/da/d10/d23/d43/d1e/d25/d5a 158566493 1 2024-09-16T09:45:31.350 INFO:tasks.workunit.client.1.smithi114.stdout:9/305: mkdir d3/da/d10/d23/d42/d68 0 2024-09-16T09:45:31.350 INFO:tasks.workunit.client.1.smithi114.stdout:9/306: fsync d3/da/d10/f21 0 2024-09-16T09:45:31.351 INFO:tasks.workunit.client.1.smithi114.stdout:9/307: mknod d3/da/d10/d23/d29/c69 0 2024-09-16T09:45:31.352 INFO:tasks.workunit.client.1.smithi114.stdout:1/345: dwrite d4/d2b/d16/f65 [0,4194304] 0 2024-09-16T09:45:31.352 INFO:tasks.workunit.client.1.smithi114.stdout:7/380: dwrite d2/df/f10 [0,4194304] 0 2024-09-16T09:45:31.352 INFO:tasks.workunit.client.1.smithi114.stdout:7/381: write d2/d9/d2b/d2e/d3e/f65 [1023917,37002] 0 2024-09-16T09:45:31.353 INFO:tasks.workunit.client.1.smithi114.stdout:2/344: dwrite d1/d8/f12 [4194304,4194304] 0 2024-09-16T09:45:31.353 INFO:tasks.workunit.client.1.smithi114.stdout:4/272: dwrite d0/d26/d3c/f2d [0,4194304] 0 2024-09-16T09:45:31.355 INFO:tasks.workunit.client.1.smithi114.stdout:7/382: symlink d2/d9/d2b/d2e/l7c 0 2024-09-16T09:45:31.359 INFO:tasks.workunit.client.0.smithi111.stdout:5/97: dread f15 [0,4194304] 0 2024-09-16T09:45:31.360 INFO:tasks.workunit.client.1.smithi114.stdout:1/346: dread d4/d2b/d16/f1b [0,4194304] 0 2024-09-16T09:45:31.360 INFO:tasks.workunit.client.1.smithi114.stdout:1/347: chown d4/d2b/d16/d71 2062 1 2024-09-16T09:45:31.361 INFO:tasks.workunit.client.1.smithi114.stdout:1/348: write d4/d2b/d2f/d3a/d55/f63 [234543,98738] 0 2024-09-16T09:45:31.361 INFO:tasks.workunit.client.1.smithi114.stdout:1/349: stat d4/d2b/d16/d71 0 2024-09-16T09:45:31.362 INFO:tasks.workunit.client.1.smithi114.stdout:2/345: creat d1/d8/d10/d16/f8c x:0 0 0 2024-09-16T09:45:31.368 INFO:tasks.workunit.client.1.smithi114.stdout:7/383: symlink d2/d9/d2b/l7d 0 2024-09-16T09:45:31.369 INFO:tasks.workunit.client.1.smithi114.stdout:2/346: getdents d1/d8/d10 0 2024-09-16T09:45:31.370 INFO:tasks.workunit.client.1.smithi114.stdout:7/384: mknod d2/d9/d2b/d78/c7e 0 2024-09-16T09:45:31.371 INFO:tasks.workunit.client.1.smithi114.stdout:4/273: getdents d0/d26/d29 0 2024-09-16T09:45:31.371 INFO:tasks.workunit.client.1.smithi114.stdout:2/347: creat d1/d8/d82/f8d x:0 0 0 2024-09-16T09:45:31.372 INFO:tasks.workunit.client.1.smithi114.stdout:4/274: rmdir d0/d26/d3c/d3e/d4b/d46 39 2024-09-16T09:45:31.373 INFO:tasks.workunit.client.1.smithi114.stdout:9/308: dwrite d3/da/d10/d23/f36 [0,4194304] 0 2024-09-16T09:45:31.373 INFO:tasks.workunit.client.1.smithi114.stdout:4/275: mkdir d0/d53 0 2024-09-16T09:45:31.376 INFO:tasks.workunit.client.1.smithi114.stdout:9/309: getdents d3/da/d10/d23 0 2024-09-16T09:45:31.376 INFO:tasks.workunit.client.1.smithi114.stdout:9/310: write d3/da/f4d [4312408,17404] 0 2024-09-16T09:45:31.378 INFO:tasks.workunit.client.1.smithi114.stdout:4/276: creat d0/d26/d3c/d3e/d4d/f54 x:0 0 0 2024-09-16T09:45:31.379 INFO:tasks.workunit.client.1.smithi114.stdout:4/277: chown d0/d13 45 1 2024-09-16T09:45:31.379 INFO:tasks.workunit.client.1.smithi114.stdout:4/278: fsync d0/d26/d29/f14 0 2024-09-16T09:45:31.382 INFO:tasks.workunit.client.1.smithi114.stdout:9/311: mknod d3/da/d10/d23/d29/d3f/c6a 0 2024-09-16T09:45:31.386 INFO:tasks.workunit.client.1.smithi114.stdout:7/385: dwrite d2/d9/d2b/d2e/f45 [0,4194304] 0 2024-09-16T09:45:31.386 INFO:tasks.workunit.client.1.smithi114.stdout:7/386: fsync d2/d9/d2b/d2e/d3e/f44 0 2024-09-16T09:45:31.390 INFO:tasks.workunit.client.1.smithi114.stdout:6/292: sync 2024-09-16T09:45:31.391 INFO:tasks.workunit.client.1.smithi114.stdout:4/279: dread d0/d26/d2e/f33 [0,4194304] 0 2024-09-16T09:45:31.391 INFO:tasks.workunit.client.1.smithi114.stdout:4/280: write d0/d26/d3c/d3e/d4b/f4e [1012846,30423] 0 2024-09-16T09:45:31.391 INFO:tasks.workunit.client.1.smithi114.stdout:6/293: mknod d6/da/d10/c57 0 2024-09-16T09:45:31.392 INFO:tasks.workunit.client.1.smithi114.stdout:6/294: chown d6/da/d48 118010 1 2024-09-16T09:45:31.392 INFO:tasks.workunit.client.1.smithi114.stdout:4/281: rmdir d0/d26/d29/d2b 39 2024-09-16T09:45:31.393 INFO:tasks.workunit.client.1.smithi114.stdout:4/282: chown d0/d53 0 1 2024-09-16T09:45:31.394 INFO:tasks.workunit.client.1.smithi114.stdout:6/295: creat d6/da/d48/f58 x:0 0 0 2024-09-16T09:45:31.394 INFO:tasks.workunit.client.1.smithi114.stdout:6/296: chown d6/da/d10/c18 24678 1 2024-09-16T09:45:31.394 INFO:tasks.workunit.client.1.smithi114.stdout:6/297: chown d6/f1f 65354 1 2024-09-16T09:45:31.395 INFO:tasks.workunit.client.1.smithi114.stdout:4/283: mkdir d0/d26/d3c/d3e/d4d/d55 0 2024-09-16T09:45:31.396 INFO:tasks.workunit.client.1.smithi114.stdout:6/298: rename d6/f1f to d6/da/d10/f59 0 2024-09-16T09:45:31.397 INFO:tasks.workunit.client.1.smithi114.stdout:4/284: truncate d0/d26/d2e/f33 5891995 0 2024-09-16T09:45:31.398 INFO:tasks.workunit.client.1.smithi114.stdout:4/285: fsync d0/d13/f22 0 2024-09-16T09:45:31.398 INFO:tasks.workunit.client.1.smithi114.stdout:4/286: mkdir d0/d13/d56 0 2024-09-16T09:45:31.399 INFO:tasks.workunit.client.1.smithi114.stdout:4/287: mknod d0/d26/d40/c57 0 2024-09-16T09:45:31.401 INFO:tasks.workunit.client.1.smithi114.stdout:4/288: mkdir d0/d26/d29/d2b/d58 0 2024-09-16T09:45:31.401 INFO:tasks.workunit.client.1.smithi114.stdout:4/289: fsync d0/ff 0 2024-09-16T09:45:31.401 INFO:tasks.workunit.client.1.smithi114.stdout:4/290: chown d0/d13/c2c 53746969 1 2024-09-16T09:45:31.402 INFO:tasks.workunit.client.1.smithi114.stdout:6/299: dread d6/f22 [0,4194304] 0 2024-09-16T09:45:31.402 INFO:tasks.workunit.client.1.smithi114.stdout:7/387: dwrite d2/d9/d2b/d2e/d22/d27/f40 [4194304,4194304] 0 2024-09-16T09:45:31.402 INFO:tasks.workunit.client.1.smithi114.stdout:7/388: fsync d2/d9/d2b/d2e/f45 0 2024-09-16T09:45:31.402 INFO:tasks.workunit.client.1.smithi114.stdout:7/389: dread - d2/d9/d2b/d2e/d22/d4c/f69 zero size 2024-09-16T09:45:31.402 INFO:tasks.workunit.client.1.smithi114.stdout:9/312: truncate d3/da/f4d 4017581 0 2024-09-16T09:45:31.405 INFO:tasks.workunit.client.1.smithi114.stdout:9/313: getdents d3/da/d10/d23/d43/d1e/d25/d5a 0 2024-09-16T09:45:31.405 INFO:tasks.workunit.client.1.smithi114.stdout:4/291: read d0/d13/f4c [3490309,41350] 0 2024-09-16T09:45:31.405 INFO:tasks.workunit.client.1.smithi114.stdout:7/390: truncate d2/df/f30 3655634 0 2024-09-16T09:45:31.406 INFO:tasks.workunit.client.1.smithi114.stdout:7/391: mkdir d2/d9/d2b/d59/d7f 0 2024-09-16T09:45:31.407 INFO:tasks.workunit.client.1.smithi114.stdout:7/392: creat d2/d9/d2b/d2e/d22/d4c/f80 x:0 0 0 2024-09-16T09:45:31.408 INFO:tasks.workunit.client.1.smithi114.stdout:7/393: rmdir d2/d55/d7a 0 2024-09-16T09:45:31.410 INFO:tasks.workunit.client.1.smithi114.stdout:6/300: write d6/da/d10/d40/f43 [2539164,97827] 0 2024-09-16T09:45:31.410 INFO:tasks.workunit.client.1.smithi114.stdout:7/394: link d2/d9/d2b/d2e/cd d2/d9/d2b/d59/d7f/c81 0 2024-09-16T09:45:31.410 INFO:tasks.workunit.client.1.smithi114.stdout:7/395: chown d2/d9/d2b/f5a 106535196 1 2024-09-16T09:45:31.410 INFO:tasks.workunit.client.1.smithi114.stdout:7/396: write d2/d9/d2b/d2e/d77/f63 [184599,75446] 0 2024-09-16T09:45:31.412 INFO:tasks.workunit.client.1.smithi114.stdout:6/301: truncate d6/f7 2082615 0 2024-09-16T09:45:31.412 INFO:tasks.workunit.client.1.smithi114.stdout:8/330: sync 2024-09-16T09:45:31.413 INFO:tasks.workunit.client.1.smithi114.stdout:6/302: dread d6/da/f45 [0,4194304] 0 2024-09-16T09:45:31.413 INFO:tasks.workunit.client.1.smithi114.stdout:7/397: dread d2/d9/d2b/d2e/d3e/f65 [0,4194304] 0 2024-09-16T09:45:31.413 INFO:tasks.workunit.client.1.smithi114.stdout:7/398: readlink d2/df/l3f 0 2024-09-16T09:45:31.416 INFO:tasks.workunit.client.1.smithi114.stdout:4/292: dread d0/f3a [0,4194304] 0 2024-09-16T09:45:31.416 INFO:tasks.workunit.client.1.smithi114.stdout:6/303: creat d6/d2d/d46/f5a x:0 0 0 2024-09-16T09:45:31.417 INFO:tasks.workunit.client.1.smithi114.stdout:6/304: mknod d6/da/c5b 0 2024-09-16T09:45:31.422 INFO:tasks.workunit.client.1.smithi114.stdout:9/314: dwrite d3/da/d10/f21 [4194304,4194304] 0 2024-09-16T09:45:31.424 INFO:tasks.workunit.client.1.smithi114.stdout:4/293: read d0/d26/d29/f1d [2009248,65871] 0 2024-09-16T09:45:31.425 INFO:tasks.workunit.client.1.smithi114.stdout:9/315: rename d3/da/d10/d23/d42 to d3/da/d10/d23/d29/d2c/d6b 0 2024-09-16T09:45:31.425 INFO:tasks.workunit.client.1.smithi114.stdout:9/316: write d3/da/d10/d23/d29/d2c/d45/f61 [3094,62888] 0 2024-09-16T09:45:31.426 INFO:tasks.workunit.client.1.smithi114.stdout:9/317: symlink d3/da/d10/d23/d43/d1e/l6c 0 2024-09-16T09:45:31.427 INFO:tasks.workunit.client.1.smithi114.stdout:7/399: read d2/d9/d2b/d2e/f45 [3182871,13367] 0 2024-09-16T09:45:31.428 INFO:tasks.workunit.client.1.smithi114.stdout:7/400: fdatasync d2/d9/f12 0 2024-09-16T09:45:31.431 INFO:tasks.workunit.client.1.smithi114.stdout:4/294: dread d0/d26/d3c/d3e/d4b/f4e [0,4194304] 0 2024-09-16T09:45:31.433 INFO:tasks.workunit.client.1.smithi114.stdout:4/295: unlink d0/ff 0 2024-09-16T09:45:31.434 INFO:tasks.workunit.client.1.smithi114.stdout:8/331: dwrite d4/db/d3e/d47/f5e [0,4194304] 0 2024-09-16T09:45:31.434 INFO:tasks.workunit.client.1.smithi114.stdout:8/332: fsync d4/d1f/f42 0 2024-09-16T09:45:31.434 INFO:tasks.workunit.client.1.smithi114.stdout:8/333: truncate d4/db/d68/d28/f67 950107 0 2024-09-16T09:45:31.435 INFO:tasks.workunit.client.1.smithi114.stdout:4/296: mkdir d0/d26/d3c/d3e/d59 0 2024-09-16T09:45:31.437 INFO:tasks.workunit.client.1.smithi114.stdout:9/318: dread d3/da/d10/d23/d43/f18 [0,4194304] 0 2024-09-16T09:45:31.437 INFO:tasks.workunit.client.1.smithi114.stdout:8/334: rename d4/db/df/f6c to d4/db/dd/f6f 0 2024-09-16T09:45:31.437 INFO:tasks.workunit.client.1.smithi114.stdout:8/335: fsync d4/db/f4d 0 2024-09-16T09:45:31.439 INFO:tasks.workunit.client.1.smithi114.stdout:9/319: unlink d3/da/d10/d23/d29/f39 0 2024-09-16T09:45:31.442 INFO:tasks.workunit.client.1.smithi114.stdout:4/297: rename d0/d26/d3c/d3e/d4d/d55 to d0/d26/d3c/d3e/d5a 0 2024-09-16T09:45:31.442 INFO:tasks.workunit.client.1.smithi114.stdout:4/298: fsync d0/d26/d2e/f33 0 2024-09-16T09:45:31.443 INFO:tasks.workunit.client.1.smithi114.stdout:9/320: symlink d3/da/d10/d23/d43/l6d 0 2024-09-16T09:45:31.445 INFO:tasks.workunit.client.1.smithi114.stdout:9/321: rename d3/da/d10/d23/d43/d1e/d25/d5a/f52 to d3/da/d10/d23/d29/d2c/d6b/d68/f6e 0 2024-09-16T09:45:31.447 INFO:tasks.workunit.client.1.smithi114.stdout:9/322: creat d3/da/d10/d23/d43/d1e/d25/f6f x:0 0 0 2024-09-16T09:45:31.447 INFO:tasks.workunit.client.1.smithi114.stdout:9/323: chown d3/c3b 0 1 2024-09-16T09:45:31.447 INFO:tasks.workunit.client.1.smithi114.stdout:9/324: write d3/da/d10/d23/d43/d1e/f5e [3040458,105905] 0 2024-09-16T09:45:31.447 INFO:tasks.workunit.client.1.smithi114.stdout:9/325: readlink d3/da/d10/d23/l4e 0 2024-09-16T09:45:31.451 INFO:tasks.workunit.client.1.smithi114.stdout:6/305: dwrite d6/f7 [0,4194304] 0 2024-09-16T09:45:31.452 INFO:tasks.workunit.client.1.smithi114.stdout:6/306: rename d6/da/d10/d40/c49 to d6/da/d10/c5c 0 2024-09-16T09:45:31.453 INFO:tasks.workunit.client.1.smithi114.stdout:4/299: dread d0/fe [0,4194304] 0 2024-09-16T09:45:31.453 INFO:tasks.workunit.client.1.smithi114.stdout:6/307: mknod d6/da/d36/d51/c5d 0 2024-09-16T09:45:31.453 INFO:tasks.workunit.client.1.smithi114.stdout:4/300: truncate d0/d13/f22 5132037 0 2024-09-16T09:45:31.454 INFO:tasks.workunit.client.1.smithi114.stdout:6/308: creat d6/da/d10/d40/f5e x:0 0 0 2024-09-16T09:45:31.455 INFO:tasks.workunit.client.1.smithi114.stdout:6/309: symlink d6/da/d10/l5f 0 2024-09-16T09:45:31.456 INFO:tasks.workunit.client.1.smithi114.stdout:6/310: creat d6/da/d36/d51/f60 x:0 0 0 2024-09-16T09:45:31.457 INFO:tasks.workunit.client.1.smithi114.stdout:6/311: symlink d6/da/l61 0 2024-09-16T09:45:31.457 INFO:tasks.workunit.client.1.smithi114.stdout:6/312: fdatasync d6/f7 0 2024-09-16T09:45:31.457 INFO:tasks.workunit.client.1.smithi114.stdout:6/313: chown d6/da/d10/c57 1572402 1 2024-09-16T09:45:31.458 INFO:tasks.workunit.client.1.smithi114.stdout:6/314: mkdir d6/da/d36/d51/d62 0 2024-09-16T09:45:31.459 INFO:tasks.workunit.client.1.smithi114.stdout:6/315: truncate d6/da/d10/f1d 3263283 0 2024-09-16T09:45:31.461 INFO:tasks.workunit.client.1.smithi114.stdout:6/316: rename d6/da/d48/l4c to d6/d2d/d46/l63 0 2024-09-16T09:45:31.461 INFO:tasks.workunit.client.1.smithi114.stdout:6/317: dread - d6/da/d36/d51/f60 zero size 2024-09-16T09:45:31.461 INFO:tasks.workunit.client.1.smithi114.stdout:6/318: mkdir d6/d64 0 2024-09-16T09:45:31.464 INFO:tasks.workunit.client.1.smithi114.stdout:6/319: rename d6/f35 to d6/d64/f65 0 2024-09-16T09:45:31.468 INFO:tasks.workunit.client.1.smithi114.stdout:4/301: dwrite d0/f1f [0,4194304] 0 2024-09-16T09:45:31.468 INFO:tasks.workunit.client.1.smithi114.stdout:4/302: mknod d0/c5b 0 2024-09-16T09:45:31.469 INFO:tasks.workunit.client.1.smithi114.stdout:4/303: truncate d0/d26/d29/fd 4037723 0 2024-09-16T09:45:31.470 INFO:tasks.workunit.client.1.smithi114.stdout:4/304: creat d0/d13/d56/f5c x:0 0 0 2024-09-16T09:45:31.471 INFO:tasks.workunit.client.1.smithi114.stdout:4/305: truncate d0/d13/d56/f5c 549667 0 2024-09-16T09:45:31.471 INFO:tasks.workunit.client.1.smithi114.stdout:4/306: getdents d0/d26/d29 0 2024-09-16T09:45:31.472 INFO:tasks.workunit.client.1.smithi114.stdout:4/307: unlink d0/d13/l2a 0 2024-09-16T09:45:31.473 INFO:tasks.workunit.client.1.smithi114.stdout:4/308: rename d0/d26/d3c/d3e/d59 to d0/d26/d3c/d3e/d5a/d5d 0 2024-09-16T09:45:31.473 INFO:tasks.workunit.client.1.smithi114.stdout:4/309: dread - d0/d26/d29/f39 zero size 2024-09-16T09:45:31.473 INFO:tasks.workunit.client.1.smithi114.stdout:4/310: stat d0/l10 0 2024-09-16T09:45:31.473 INFO:tasks.workunit.client.1.smithi114.stdout:4/311: write d0/d26/d3c/d3e/d4b/f4e [1646570,34054] 0 2024-09-16T09:45:31.475 INFO:tasks.workunit.client.1.smithi114.stdout:4/312: mknod d0/d26/d40/c5e 0 2024-09-16T09:45:31.476 INFO:tasks.workunit.client.1.smithi114.stdout:6/320: getdents d6/d64 0 2024-09-16T09:45:31.478 INFO:tasks.workunit.client.1.smithi114.stdout:6/321: link d6/c27 d6/c66 0 2024-09-16T09:45:31.498 INFO:tasks.workunit.client.1.smithi114.stdout:6/322: dwrite d6/da/d36/f3b [0,4194304] 0 2024-09-16T09:45:31.501 INFO:tasks.workunit.client.1.smithi114.stdout:6/323: creat d6/da/f67 x:0 0 0 2024-09-16T09:45:31.501 INFO:tasks.workunit.client.1.smithi114.stdout:6/324: read d6/d2d/f3c [3038395,15826] 0 2024-09-16T09:45:31.501 INFO:tasks.workunit.client.1.smithi114.stdout:4/313: dwrite d0/fe [0,4194304] 0 2024-09-16T09:45:31.501 INFO:tasks.workunit.client.1.smithi114.stdout:4/314: mknod d0/c5f 0 2024-09-16T09:45:31.502 INFO:tasks.workunit.client.1.smithi114.stdout:4/315: stat d0/d26/d40/c57 0 2024-09-16T09:45:31.502 INFO:tasks.workunit.client.1.smithi114.stdout:4/316: rmdir d0/d26/d3c/d3e/d5a 39 2024-09-16T09:45:31.502 INFO:tasks.workunit.client.1.smithi114.stdout:4/317: write d0/d13/f4c [4394616,39528] 0 2024-09-16T09:45:31.513 INFO:tasks.workunit.client.1.smithi114.stdout:4/318: write d0/f1f [2609796,19466] 0 2024-09-16T09:45:31.515 INFO:tasks.workunit.client.1.smithi114.stdout:6/325: dwrite d6/da/f1e [0,4194304] 0 2024-09-16T09:45:31.516 INFO:tasks.workunit.client.1.smithi114.stdout:4/319: rename d0/d26/d2e/f33 to d0/d26/d3c/d3e/d5a/d5d/f60 0 2024-09-16T09:45:31.516 INFO:tasks.workunit.client.1.smithi114.stdout:4/320: readlink d0/l1a 0 2024-09-16T09:45:31.528 INFO:tasks.workunit.client.1.smithi114.stdout:5/321: sync 2024-09-16T09:45:31.529 INFO:tasks.workunit.client.1.smithi114.stdout:5/322: write d3/df/d2d/d3f/f55 [2889793,89282] 0 2024-09-16T09:45:31.529 INFO:tasks.workunit.client.1.smithi114.stdout:3/405: sync 2024-09-16T09:45:31.530 INFO:tasks.workunit.client.1.smithi114.stdout:5/323: symlink d3/df/d52/l63 0 2024-09-16T09:45:31.530 INFO:tasks.workunit.client.1.smithi114.stdout:3/406: symlink dc/de/d17/d79/l8c 0 2024-09-16T09:45:31.530 INFO:tasks.workunit.client.1.smithi114.stdout:3/407: write dc/de/d18/d78/d5c/d5d/f7a [866961,116936] 0 2024-09-16T09:45:31.531 INFO:tasks.workunit.client.1.smithi114.stdout:5/324: symlink d3/df/d2d/d34/l64 0 2024-09-16T09:45:31.531 INFO:tasks.workunit.client.1.smithi114.stdout:3/408: mkdir dc/de/d18/d78/d8d 0 2024-09-16T09:45:31.532 INFO:tasks.workunit.client.1.smithi114.stdout:3/409: dread dc/de/d10/d26/f4d [0,4194304] 0 2024-09-16T09:45:31.532 INFO:tasks.workunit.client.1.smithi114.stdout:5/325: rename d3/df/d2d/d34/l3b to d3/df/d52/d61/l65 0 2024-09-16T09:45:31.533 INFO:tasks.workunit.client.1.smithi114.stdout:3/410: read dc/de/d10/d26/f4d [143043,129519] 0 2024-09-16T09:45:31.533 INFO:tasks.workunit.client.1.smithi114.stdout:3/411: stat dc/de/d17/d2d/d41/c5b 0 2024-09-16T09:45:31.533 INFO:tasks.workunit.client.1.smithi114.stdout:3/412: mknod dc/de/d17/c8e 0 2024-09-16T09:45:31.534 INFO:tasks.workunit.client.1.smithi114.stdout:3/413: creat dc/de/d18/d78/d5c/f8f x:0 0 0 2024-09-16T09:45:31.535 INFO:tasks.workunit.client.1.smithi114.stdout:4/321: dwrite d0/d26/f48 [0,4194304] 0 2024-09-16T09:45:31.536 INFO:tasks.workunit.client.1.smithi114.stdout:3/414: rename dc/f27 to dc/de/d17/d72/f90 0 2024-09-16T09:45:31.537 INFO:tasks.workunit.client.1.smithi114.stdout:4/322: creat d0/d26/d29/d2b/f61 x:0 0 0 2024-09-16T09:45:31.537 INFO:tasks.workunit.client.1.smithi114.stdout:4/323: chown d0/d26/d29/c23 74418 1 2024-09-16T09:45:31.538 INFO:tasks.workunit.client.1.smithi114.stdout:4/324: dread - d0/d26/d29/f39 zero size 2024-09-16T09:45:31.538 INFO:tasks.workunit.client.1.smithi114.stdout:3/415: link dc/de/l7d dc/l91 0 2024-09-16T09:45:31.538 INFO:tasks.workunit.client.1.smithi114.stdout:3/416: chown dc/c1b 98298026 1 2024-09-16T09:45:31.539 INFO:tasks.workunit.client.1.smithi114.stdout:3/417: creat dc/d38/f92 x:0 0 0 2024-09-16T09:45:31.541 INFO:tasks.workunit.client.1.smithi114.stdout:3/418: link dc/de/d17/d2d/d41/f42 dc/de/d10/d6a/d77/f93 0 2024-09-16T09:45:31.542 INFO:tasks.workunit.client.1.smithi114.stdout:3/419: rename dc/de/d10/d6a/l85 to dc/de/d18/d78/d5c/d6e/l94 0 2024-09-16T09:45:31.544 INFO:tasks.workunit.client.1.smithi114.stdout:3/420: rename dc/de/d37/c44 to dc/de/d18/d78/c95 0 2024-09-16T09:45:31.545 INFO:tasks.workunit.client.1.smithi114.stdout:3/421: chown dc/c8b 725 1 2024-09-16T09:45:31.546 INFO:tasks.workunit.client.1.smithi114.stdout:3/422: rename dc/de/d17/f5e to dc/d38/d3f/f96 0 2024-09-16T09:45:31.547 INFO:tasks.workunit.client.1.smithi114.stdout:4/325: dread d0/f11 [0,4194304] 0 2024-09-16T09:45:31.548 INFO:tasks.workunit.client.1.smithi114.stdout:3/423: mknod dc/de/d17/d2d/d41/c97 0 2024-09-16T09:45:31.549 INFO:tasks.workunit.client.1.smithi114.stdout:4/326: rename d0/d13/d56/f5c to d0/d26/d2e/f62 0 2024-09-16T09:45:31.550 INFO:tasks.workunit.client.1.smithi114.stdout:3/424: mkdir dc/de/d37/d98 0 2024-09-16T09:45:31.552 INFO:tasks.workunit.client.1.smithi114.stdout:3/425: symlink dc/de/d1f/l99 0 2024-09-16T09:45:31.553 INFO:tasks.workunit.client.1.smithi114.stdout:3/426: getdents dc/de/d17/d2d 0 2024-09-16T09:45:31.554 INFO:tasks.workunit.client.1.smithi114.stdout:3/427: getdents dc/de/d17/d79 0 2024-09-16T09:45:31.554 INFO:tasks.workunit.client.1.smithi114.stdout:3/428: write dc/de/d10/f3c [5595993,71195] 0 2024-09-16T09:45:31.554 INFO:tasks.workunit.client.1.smithi114.stdout:3/429: chown dc/de/d10/f19 3904645 1 2024-09-16T09:45:31.554 INFO:tasks.workunit.client.1.smithi114.stdout:3/430: getdents dc/de/d37/d57 0 2024-09-16T09:45:31.554 INFO:tasks.workunit.client.1.smithi114.stdout:3/431: symlink dc/de/d17/d72/l9a 0 2024-09-16T09:45:31.555 INFO:tasks.workunit.client.1.smithi114.stdout:3/432: symlink dc/de/d37/d4e/l9b 0 2024-09-16T09:45:31.555 INFO:tasks.workunit.client.1.smithi114.stdout:3/433: fsync dc/de/d17/d2d/f88 0 2024-09-16T09:45:31.555 INFO:tasks.workunit.client.1.smithi114.stdout:3/434: write dc/de/f2f [4467922,48017] 0 2024-09-16T09:45:31.557 INFO:tasks.workunit.client.1.smithi114.stdout:5/326: dwrite d3/df/f10 [0,4194304] 0 2024-09-16T09:45:31.558 INFO:tasks.workunit.client.1.smithi114.stdout:5/327: write d3/f8 [2351125,25306] 0 2024-09-16T09:45:31.559 INFO:tasks.workunit.client.1.smithi114.stdout:5/328: mkdir d3/d66 0 2024-09-16T09:45:31.561 INFO:tasks.workunit.client.1.smithi114.stdout:5/329: creat d3/d11/d37/d43/d4c/f67 x:0 0 0 2024-09-16T09:45:31.561 INFO:tasks.workunit.client.1.smithi114.stdout:5/330: write d3/d11/d37/d43/f48 [2704653,128785] 0 2024-09-16T09:45:31.565 INFO:tasks.workunit.client.1.smithi114.stdout:4/327: read d0/fe [2036358,38883] 0 2024-09-16T09:45:31.565 INFO:tasks.workunit.client.1.smithi114.stdout:4/328: write d0/f7 [125053,11207] 0 2024-09-16T09:45:31.567 INFO:tasks.workunit.client.1.smithi114.stdout:4/329: symlink d0/d26/d29/d2b/d58/l63 0 2024-09-16T09:45:31.567 INFO:tasks.workunit.client.1.smithi114.stdout:4/330: readlink d0/d26/d3c/l30 0 2024-09-16T09:45:31.573 INFO:tasks.workunit.client.1.smithi114.stdout:4/331: write d0/f11 [6023775,112073] 0 2024-09-16T09:45:31.573 INFO:tasks.workunit.client.1.smithi114.stdout:4/332: write d0/f21 [3591554,125290] 0 2024-09-16T09:45:31.573 INFO:tasks.workunit.client.1.smithi114.stdout:4/333: dread - d0/d26/d3c/d3e/d4d/f54 zero size 2024-09-16T09:45:31.573 INFO:tasks.workunit.client.1.smithi114.stdout:4/334: fsync d0/d26/d3c/d3e/d4b/f4e 0 2024-09-16T09:45:31.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/435: dwrite dc/de/d18/f35 [0,4194304] 0 2024-09-16T09:45:31.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/436: stat dc/de/d10/d6a 0 2024-09-16T09:45:31.583 INFO:tasks.workunit.client.1.smithi114.stdout:5/331: dwrite d3/d24/f2e [0,4194304] 0 2024-09-16T09:45:31.583 INFO:tasks.workunit.client.1.smithi114.stdout:5/332: dread - d3/d11/d37/d43/d4c/f67 zero size 2024-09-16T09:45:31.583 INFO:tasks.workunit.client.1.smithi114.stdout:5/333: chown d3/df/d2d/d3f/f5d 119945 1 2024-09-16T09:45:31.584 INFO:tasks.workunit.client.1.smithi114.stdout:3/437: rename dc/de/d10/d26/f2b to dc/d38/f9c 0 2024-09-16T09:45:31.586 INFO:tasks.workunit.client.1.smithi114.stdout:5/334: symlink d3/df/d2d/d3f/d59/l68 0 2024-09-16T09:45:31.586 INFO:tasks.workunit.client.1.smithi114.stdout:5/335: chown d3/df 17007 1 2024-09-16T09:45:31.588 INFO:tasks.workunit.client.1.smithi114.stdout:3/438: creat dc/de/d10/d6a/d77/f9d x:0 0 0 2024-09-16T09:45:31.589 INFO:tasks.workunit.client.1.smithi114.stdout:5/336: symlink d3/df/d2d/d3f/d59/l69 0 2024-09-16T09:45:31.589 INFO:tasks.workunit.client.1.smithi114.stdout:5/337: write d3/d11/d37/d43/d4c/f54 [5140083,13270] 0 2024-09-16T09:45:31.590 INFO:tasks.workunit.client.1.smithi114.stdout:5/338: symlink d3/df/d2d/l6a 0 2024-09-16T09:45:31.590 INFO:tasks.workunit.client.1.smithi114.stdout:5/339: chown d3/df/d2d/d3f/d59/l69 49141412 1 2024-09-16T09:45:31.597 INFO:tasks.workunit.client.1.smithi114.stdout:3/439: dread dc/de/d10/f1e [0,4194304] 0 2024-09-16T09:45:31.605 INFO:tasks.workunit.client.1.smithi114.stdout:5/340: dwrite d3/f2c [0,4194304] 0 2024-09-16T09:45:31.607 INFO:tasks.workunit.client.1.smithi114.stdout:5/341: mknod d3/df/c6b 0 2024-09-16T09:45:31.608 INFO:tasks.workunit.client.1.smithi114.stdout:5/342: getdents d3/df/d2d/d3f/d41/d5a 0 2024-09-16T09:45:31.608 INFO:tasks.workunit.client.1.smithi114.stdout:5/343: truncate d3/df/d2d/d34/f5f 653484 0 2024-09-16T09:45:31.608 INFO:tasks.workunit.client.1.smithi114.stdout:3/440: dread dc/de/d10/d26/f54 [0,4194304] 0 2024-09-16T09:45:31.609 INFO:tasks.workunit.client.1.smithi114.stdout:5/344: symlink d3/l6c 0 2024-09-16T09:45:31.610 INFO:tasks.workunit.client.1.smithi114.stdout:3/441: mkdir dc/de/d17/d2d/d41/d9e 0 2024-09-16T09:45:31.611 INFO:tasks.workunit.client.1.smithi114.stdout:5/345: mkdir d3/d11/d37/d43/d4c/d6d 0 2024-09-16T09:45:31.611 INFO:tasks.workunit.client.1.smithi114.stdout:5/346: chown d3/d11/f1a 488743 1 2024-09-16T09:45:31.611 INFO:tasks.workunit.client.1.smithi114.stdout:5/347: stat d3/df/d2d/d34/f5f 0 2024-09-16T09:45:31.612 INFO:tasks.workunit.client.1.smithi114.stdout:3/442: creat dc/d38/d3f/f9f x:0 0 0 2024-09-16T09:45:31.613 INFO:tasks.workunit.client.1.smithi114.stdout:3/443: symlink dc/de/d18/d78/d5c/d6e/la0 0 2024-09-16T09:45:31.613 INFO:tasks.workunit.client.1.smithi114.stdout:3/444: write dc/de/d17/d2d/f88 [682966,112743] 0 2024-09-16T09:45:31.613 INFO:tasks.workunit.client.1.smithi114.stdout:3/445: truncate dc/de/d17/d2d/d41/f42 574412 0 2024-09-16T09:45:31.615 INFO:tasks.workunit.client.1.smithi114.stdout:3/446: dread dc/de/d18/d78/d5c/d5d/f7a [0,4194304] 0 2024-09-16T09:45:31.617 INFO:tasks.workunit.client.1.smithi114.stdout:3/447: getdents dc/de/d10/d6a/d77 0 2024-09-16T09:45:31.619 INFO:tasks.workunit.client.1.smithi114.stdout:3/448: mknod dc/de/d18/d78/d5c/d6e/ca1 0 2024-09-16T09:45:31.623 INFO:tasks.workunit.client.1.smithi114.stdout:0/239: sync 2024-09-16T09:45:31.623 INFO:tasks.workunit.client.1.smithi114.stdout:3/449: dread dc/de/d18/d78/d5c/d5d/f55 [0,4194304] 0 2024-09-16T09:45:31.624 INFO:tasks.workunit.client.1.smithi114.stdout:0/240: creat d1f/d20/d48/f5c x:0 0 0 2024-09-16T09:45:31.625 INFO:tasks.workunit.client.1.smithi114.stdout:3/450: link dc/de/d37/c49 dc/de/d10/d6a/ca2 0 2024-09-16T09:45:31.626 INFO:tasks.workunit.client.1.smithi114.stdout:0/241: creat d1f/d27/f5d x:0 0 0 2024-09-16T09:45:31.627 INFO:tasks.workunit.client.1.smithi114.stdout:0/242: stat d1f/d22/l43 0 2024-09-16T09:45:31.628 INFO:tasks.workunit.client.1.smithi114.stdout:0/243: unlink d1f/d22/d2e/l38 0 2024-09-16T09:45:31.629 INFO:tasks.workunit.client.1.smithi114.stdout:3/451: dread dc/de/d18/d78/d5c/d5d/f55 [0,4194304] 0 2024-09-16T09:45:31.629 INFO:tasks.workunit.client.1.smithi114.stdout:5/348: dwrite d3/d11/d37/d43/d4c/f54 [0,4194304] 0 2024-09-16T09:45:31.631 INFO:tasks.workunit.client.1.smithi114.stdout:5/349: mknod d3/df/d2d/d3f/d59/c6e 0 2024-09-16T09:45:31.632 INFO:tasks.workunit.client.1.smithi114.stdout:5/350: rename d3/f2c to d3/df/d2d/d3f/d59/f6f 0 2024-09-16T09:45:31.633 INFO:tasks.workunit.client.1.smithi114.stdout:5/351: write d3/d1f/f27 [511227,38495] 0 2024-09-16T09:45:31.635 INFO:tasks.workunit.client.1.smithi114.stdout:5/352: mknod d3/d11/d37/d43/d4c/d6d/c70 0 2024-09-16T09:45:31.635 INFO:tasks.workunit.client.1.smithi114.stdout:5/353: chown d3/d11 16393012 1 2024-09-16T09:45:31.637 INFO:tasks.workunit.client.1.smithi114.stdout:5/354: rmdir d3/d66 0 2024-09-16T09:45:31.638 INFO:tasks.workunit.client.1.smithi114.stdout:5/355: write d3/df/d2d/d34/f5f [62717,7154] 0 2024-09-16T09:45:31.640 INFO:tasks.workunit.client.1.smithi114.stdout:5/356: rename d3/df/d2d/d3f/d41 to d3/d11/d71 0 2024-09-16T09:45:31.640 INFO:tasks.workunit.client.1.smithi114.stdout:5/357: write d3/d11/f4f [462535,128175] 0 2024-09-16T09:45:31.641 INFO:tasks.workunit.client.1.smithi114.stdout:3/452: dread dc/de/d10/f25 [0,4194304] 0 2024-09-16T09:45:31.643 INFO:tasks.workunit.client.1.smithi114.stdout:3/453: dread dc/de/d18/d78/d5c/d5d/f7a [0,4194304] 0 2024-09-16T09:45:31.643 INFO:tasks.workunit.client.1.smithi114.stdout:3/454: dread - dc/de/d10/d6a/d77/d7f/f86 zero size 2024-09-16T09:45:31.647 INFO:tasks.workunit.client.1.smithi114.stdout:0/244: dwrite d1f/d22/d2e/f5a [0,4194304] 0 2024-09-16T09:45:31.647 INFO:tasks.workunit.client.1.smithi114.stdout:0/245: chown cd 12713481 1 2024-09-16T09:45:31.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/358: rename d3/df to d3/d11/d71/d72 0 2024-09-16T09:45:31.655 INFO:tasks.workunit.client.1.smithi114.stdout:0/246: truncate f6 3996110 0 2024-09-16T09:45:31.656 INFO:tasks.workunit.client.1.smithi114.stdout:5/359: mknod d3/d11/d71/d5a/c73 0 2024-09-16T09:45:31.657 INFO:tasks.workunit.client.1.smithi114.stdout:0/247: unlink d1f/d27/f3a 0 2024-09-16T09:45:31.657 INFO:tasks.workunit.client.1.smithi114.stdout:0/248: truncate d1f/d22/d2e/d46/f54 673033 0 2024-09-16T09:45:31.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/360: creat d3/d11/d37/d43/d58/f74 x:0 0 0 2024-09-16T09:45:31.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/361: dread - d3/d11/d71/d5a/f60 zero size 2024-09-16T09:45:31.660 INFO:tasks.workunit.client.1.smithi114.stdout:3/455: dwrite dc/d38/f45 [0,4194304] 0 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:8/336: sync 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:9/326: sync 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:7/401: sync 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:1/350: sync 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:7/402: chown d2/d9/d2b/d2e/d22 113744962 1 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:9/327: chown d3/da/d10/f21 15571 1 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:6/326: sync 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:2/348: sync 2024-09-16T09:45:31.661 INFO:tasks.workunit.client.1.smithi114.stdout:2/349: readlink d1/d8/l17 0 2024-09-16T09:45:31.662 INFO:tasks.workunit.client.1.smithi114.stdout:3/456: stat dc/de/d17/l21 0 2024-09-16T09:45:31.662 INFO:tasks.workunit.client.1.smithi114.stdout:8/337: truncate d4/db/df/f12 208783 0 2024-09-16T09:45:31.662 INFO:tasks.workunit.client.1.smithi114.stdout:8/338: write d4/d1f/f35 [876219,116108] 0 2024-09-16T09:45:31.663 INFO:tasks.workunit.client.1.smithi114.stdout:9/328: rename d3/da/d10/d23/d43/d1e/d25/d5a/d5b to d3/da/d10/d23/d29/d2c/d70 0 2024-09-16T09:45:31.663 INFO:tasks.workunit.client.1.smithi114.stdout:1/351: symlink d4/d2b/d16/d71/l73 0 2024-09-16T09:45:31.664 INFO:tasks.workunit.client.1.smithi114.stdout:6/327: mknod d6/da/d36/d51/c68 0 2024-09-16T09:45:31.664 INFO:tasks.workunit.client.1.smithi114.stdout:2/350: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f8e x:0 0 0 2024-09-16T09:45:31.665 INFO:tasks.workunit.client.1.smithi114.stdout:2/351: getdents d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68 0 2024-09-16T09:45:31.665 INFO:tasks.workunit.client.1.smithi114.stdout:2/352: dread - d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f73 zero size 2024-09-16T09:45:31.666 INFO:tasks.workunit.client.1.smithi114.stdout:8/339: creat d4/db/d68/d52/f70 x:0 0 0 2024-09-16T09:45:31.667 INFO:tasks.workunit.client.1.smithi114.stdout:9/329: unlink d3/da/d10/d23/f36 0 2024-09-16T09:45:31.667 INFO:tasks.workunit.client.1.smithi114.stdout:3/457: symlink dc/d38/d3f/la3 0 2024-09-16T09:45:31.668 INFO:tasks.workunit.client.1.smithi114.stdout:2/353: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d5e/d8f 0 2024-09-16T09:45:31.669 INFO:tasks.workunit.client.1.smithi114.stdout:9/330: truncate d3/da/d10/d23/d43/d1e/d25/f27 2696571 0 2024-09-16T09:45:31.669 INFO:tasks.workunit.client.1.smithi114.stdout:3/458: symlink dc/de/d1f/la4 0 2024-09-16T09:45:31.670 INFO:tasks.workunit.client.1.smithi114.stdout:9/331: symlink d3/da/l71 0 2024-09-16T09:45:31.672 INFO:tasks.workunit.client.1.smithi114.stdout:3/459: unlink dc/de/d10/f19 0 2024-09-16T09:45:31.674 INFO:tasks.workunit.client.1.smithi114.stdout:7/403: write d2/df/f10 [2165480,95478] 0 2024-09-16T09:45:31.674 INFO:tasks.workunit.client.1.smithi114.stdout:3/460: mkdir dc/de/d18/d78/d5c/da5 0 2024-09-16T09:45:31.674 INFO:tasks.workunit.client.1.smithi114.stdout:3/461: stat dc/de/f34 0 2024-09-16T09:45:31.674 INFO:tasks.workunit.client.1.smithi114.stdout:3/462: fsync dc/d38/f92 0 2024-09-16T09:45:31.675 INFO:tasks.workunit.client.1.smithi114.stdout:5/362: read d3/d11/d37/d43/d4c/f54 [3823841,129635] 0 2024-09-16T09:45:31.675 INFO:tasks.workunit.client.1.smithi114.stdout:3/463: write dc/de/d10/d6a/d77/f93 [380134,29406] 0 2024-09-16T09:45:31.676 INFO:tasks.workunit.client.1.smithi114.stdout:7/404: rename d2/d9/d2b/d2e/l7c to d2/d9/d2b/d78/l82 0 2024-09-16T09:45:31.676 INFO:tasks.workunit.client.1.smithi114.stdout:7/405: read d2/d9/d2b/d2e/d22/d27/f2a [30816,85903] 0 2024-09-16T09:45:31.676 INFO:tasks.workunit.client.1.smithi114.stdout:5/363: chown d3/d11/c13 82783 1 2024-09-16T09:45:31.677 INFO:tasks.workunit.client.1.smithi114.stdout:3/464: creat dc/de/d18/d78/d5c/d5d/fa6 x:0 0 0 2024-09-16T09:45:31.679 INFO:tasks.workunit.client.1.smithi114.stdout:7/406: unlink d2/d9/d2b/d2e/d22/d4c/c75 0 2024-09-16T09:45:31.679 INFO:tasks.workunit.client.1.smithi114.stdout:7/407: fdatasync d2/d9/d2b/d2e/d22/f49 0 2024-09-16T09:45:31.679 INFO:tasks.workunit.client.1.smithi114.stdout:2/354: dread d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:31.679 INFO:tasks.workunit.client.1.smithi114.stdout:5/364: mkdir d3/d11/d71/d72/d2d/d3f/d75 0 2024-09-16T09:45:31.679 INFO:tasks.workunit.client.1.smithi114.stdout:2/355: readlink d1/l2b 0 2024-09-16T09:45:31.680 INFO:tasks.workunit.client.1.smithi114.stdout:3/465: mkdir dc/de/d37/da7 0 2024-09-16T09:45:31.680 INFO:tasks.workunit.client.1.smithi114.stdout:3/466: truncate dc/de/d37/d4e/f67 100655 0 2024-09-16T09:45:31.680 INFO:tasks.workunit.client.1.smithi114.stdout:7/408: dread d2/d9/d2b/d2e/d3e/f65 [0,4194304] 0 2024-09-16T09:45:31.682 INFO:tasks.workunit.client.1.smithi114.stdout:2/356: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d90 0 2024-09-16T09:45:31.682 INFO:tasks.workunit.client.1.smithi114.stdout:3/467: mknod dc/de/d10/ca8 0 2024-09-16T09:45:31.683 INFO:tasks.workunit.client.1.smithi114.stdout:3/468: fsync f9 0 2024-09-16T09:45:31.683 INFO:tasks.workunit.client.1.smithi114.stdout:3/469: fsync dc/de/d10/f3c 0 2024-09-16T09:45:31.683 INFO:tasks.workunit.client.1.smithi114.stdout:5/365: dread d3/d11/d37/d43/d4c/f54 [0,4194304] 0 2024-09-16T09:45:31.683 INFO:tasks.workunit.client.1.smithi114.stdout:7/409: mknod d2/d9/d2b/d2e/d3e/d79/c83 0 2024-09-16T09:45:31.685 INFO:tasks.workunit.client.1.smithi114.stdout:2/357: symlink d1/d8/d10/l91 0 2024-09-16T09:45:31.685 INFO:tasks.workunit.client.1.smithi114.stdout:9/332: write d3/f59 [3245859,127689] 0 2024-09-16T09:45:31.685 INFO:tasks.workunit.client.1.smithi114.stdout:3/470: symlink dc/de/d17/d2d/d41/d9e/la9 0 2024-09-16T09:45:31.685 INFO:tasks.workunit.client.1.smithi114.stdout:3/471: readlink dc/de/d1f/l99 0 2024-09-16T09:45:31.686 INFO:tasks.workunit.client.1.smithi114.stdout:5/366: symlink d3/d11/d71/l76 0 2024-09-16T09:45:31.686 INFO:tasks.workunit.client.1.smithi114.stdout:4/335: sync 2024-09-16T09:45:31.686 INFO:tasks.workunit.client.1.smithi114.stdout:0/249: dwrite d1f/d2d/f2f [0,4194304] 0 2024-09-16T09:45:31.687 INFO:tasks.workunit.client.1.smithi114.stdout:7/410: mkdir d2/d9/d51/d84 0 2024-09-16T09:45:31.687 INFO:tasks.workunit.client.1.smithi114.stdout:7/411: write d2/d9/d2b/d2e/d22/d27/f2a [1245931,115918] 0 2024-09-16T09:45:31.688 INFO:tasks.workunit.client.1.smithi114.stdout:2/358: getdents d1/d8/d10/d16/d60 0 2024-09-16T09:45:31.688 INFO:tasks.workunit.client.1.smithi114.stdout:8/340: dread d4/db/dd/f44 [0,4194304] 0 2024-09-16T09:45:31.690 INFO:tasks.workunit.client.1.smithi114.stdout:9/333: creat d3/da/d10/d23/d43/d1e/f72 x:0 0 0 2024-09-16T09:45:31.690 INFO:tasks.workunit.client.1.smithi114.stdout:9/334: write d3/f6 [1820214,84917] 0 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/352: dwrite d4/d2b/f1e [0,4194304] 0 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/353: dread - d4/d2b/d16/d47/f6e zero size 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/354: fsync d4/d2b/f53 0 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/355: dread - d4/d2b/d29/f49 zero size 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/356: write d4/d2b/f27 [1423668,124686] 0 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/357: fdatasync d4/f25 0 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/358: truncate d4/f6f 345877 0 2024-09-16T09:45:31.692 INFO:tasks.workunit.client.1.smithi114.stdout:6/328: dwrite d6/da/d10/f16 [4194304,4194304] 0 2024-09-16T09:45:31.693 INFO:tasks.workunit.client.1.smithi114.stdout:3/472: mknod dc/de/d10/d6a/d77/caa 0 2024-09-16T09:45:31.693 INFO:tasks.workunit.client.1.smithi114.stdout:3/473: write dc/de/d17/d79/f7c [796387,121737] 0 2024-09-16T09:45:31.693 INFO:tasks.workunit.client.1.smithi114.stdout:3/474: fdatasync dc/de/d17/f74 0 2024-09-16T09:45:31.693 INFO:tasks.workunit.client.1.smithi114.stdout:3/475: fdatasync dc/de/d18/d78/d5c/d5d/f55 0 2024-09-16T09:45:31.694 INFO:tasks.workunit.client.1.smithi114.stdout:5/367: mknod d3/d11/d71/d72/d2d/d3f/d59/c77 0 2024-09-16T09:45:31.695 INFO:tasks.workunit.client.1.smithi114.stdout:4/336: creat d0/f64 x:0 0 0 2024-09-16T09:45:31.697 INFO:tasks.workunit.client.1.smithi114.stdout:0/250: read d1f/d22/d2e/f5a [1050815,62091] 0 2024-09-16T09:45:31.699 INFO:tasks.workunit.client.1.smithi114.stdout:7/412: write d2/f1c [3854236,84859] 0 2024-09-16T09:45:31.699 INFO:tasks.workunit.client.1.smithi114.stdout:7/413: write d2/d9/f7b [209803,4615] 0 2024-09-16T09:45:31.699 INFO:tasks.workunit.client.1.smithi114.stdout:8/341: rename d4/db/df to d4/db/d3e/d71 0 2024-09-16T09:45:31.699 INFO:tasks.workunit.client.1.smithi114.stdout:8/342: write d4/db/d68/d30/f33 [564060,63315] 0 2024-09-16T09:45:31.701 INFO:tasks.workunit.client.1.smithi114.stdout:1/359: mknod d4/d2b/d16/d71/d72/c74 0 2024-09-16T09:45:31.702 INFO:tasks.workunit.client.1.smithi114.stdout:6/329: symlink d6/da/d10/l69 0 2024-09-16T09:45:31.703 INFO:tasks.workunit.client.1.smithi114.stdout:3/476: getdents dc/de/d18/d78 0 2024-09-16T09:45:31.704 INFO:tasks.workunit.client.1.smithi114.stdout:4/337: mknod d0/d26/d3c/d3e/d4b/d46/c65 0 2024-09-16T09:45:31.705 INFO:tasks.workunit.client.1.smithi114.stdout:6/330: read d6/da/d36/f4f [175141,121340] 0 2024-09-16T09:45:31.705 INFO:tasks.workunit.client.1.smithi114.stdout:6/331: stat d6/da/f15 0 2024-09-16T09:45:31.705 INFO:tasks.workunit.client.1.smithi114.stdout:6/332: write d6/d2d/f37 [206583,23326] 0 2024-09-16T09:45:31.705 INFO:tasks.workunit.client.1.smithi114.stdout:6/333: chown d6/l2e 0 1 2024-09-16T09:45:31.705 INFO:tasks.workunit.client.1.smithi114.stdout:7/414: creat d2/d9/d2b/d2e/d22/d27/d4d/d72/f85 x:0 0 0 2024-09-16T09:45:31.706 INFO:tasks.workunit.client.1.smithi114.stdout:8/343: rename d4/db/d68/d30/d55 to d4/db/d3e/d47/d64/d72 0 2024-09-16T09:45:31.707 INFO:tasks.workunit.client.1.smithi114.stdout:2/359: dwrite d1/d8/d10/d16/d1d/d4a/d3e/f87 [0,4194304] 0 2024-09-16T09:45:31.708 INFO:tasks.workunit.client.1.smithi114.stdout:3/477: mkdir dc/de/d17/d79/dab 0 2024-09-16T09:45:31.708 INFO:tasks.workunit.client.1.smithi114.stdout:3/478: read - dc/de/d17/f74 zero size 2024-09-16T09:45:31.708 INFO:tasks.workunit.client.1.smithi114.stdout:4/338: stat d0/d26/d29/l15 0 2024-09-16T09:45:31.708 INFO:tasks.workunit.client.1.smithi114.stdout:4/339: fsync d0/d26/f48 0 2024-09-16T09:45:31.708 INFO:tasks.workunit.client.1.smithi114.stdout:4/340: dread - d0/d26/d29/f39 zero size 2024-09-16T09:45:31.709 INFO:tasks.workunit.client.1.smithi114.stdout:2/360: dread d1/d8/d10/f50 [0,4194304] 0 2024-09-16T09:45:31.709 INFO:tasks.workunit.client.1.smithi114.stdout:7/415: rmdir d2/d9/d2b/d59/d7f 39 2024-09-16T09:45:31.711 INFO:tasks.workunit.client.1.smithi114.stdout:1/360: dread d4/d2b/d16/f22 [0,4194304] 0 2024-09-16T09:45:31.711 INFO:tasks.workunit.client.1.smithi114.stdout:0/251: dread f9 [0,4194304] 0 2024-09-16T09:45:31.714 INFO:tasks.workunit.client.1.smithi114.stdout:9/335: rename d3/f59 to d3/da/d10/d23/f73 0 2024-09-16T09:45:31.715 INFO:tasks.workunit.client.1.smithi114.stdout:8/344: creat d4/db/d39/d3c/d4e/d62/f73 x:0 0 0 2024-09-16T09:45:31.716 INFO:tasks.workunit.client.1.smithi114.stdout:6/334: write f5 [2813700,61383] 0 2024-09-16T09:45:31.720 INFO:tasks.workunit.client.1.smithi114.stdout:3/479: symlink dc/de/d17/d79/dab/lac 0 2024-09-16T09:45:31.721 INFO:tasks.workunit.client.1.smithi114.stdout:2/361: mkdir d1/d8/d10/d16/d1d/d92 0 2024-09-16T09:45:31.721 INFO:tasks.workunit.client.1.smithi114.stdout:7/416: creat d2/d9/d2b/d2e/d3e/d79/f86 x:0 0 0 2024-09-16T09:45:31.722 INFO:tasks.workunit.client.1.smithi114.stdout:1/361: mkdir d4/d2b/d16/d71/d72/d75 0 2024-09-16T09:45:31.723 INFO:tasks.workunit.client.1.smithi114.stdout:0/252: rmdir d1f/d2d 39 2024-09-16T09:45:31.723 INFO:tasks.workunit.client.1.smithi114.stdout:0/253: read d1f/d22/f2b [744416,8559] 0 2024-09-16T09:45:31.723 INFO:tasks.workunit.client.1.smithi114.stdout:0/254: write d1f/d22/d2e/d46/f58 [946553,54881] 0 2024-09-16T09:45:31.723 INFO:tasks.workunit.client.1.smithi114.stdout:0/255: chown d1f/d20/f51 160 1 2024-09-16T09:45:31.724 INFO:tasks.workunit.client.1.smithi114.stdout:7/417: dread d2/f2c [0,4194304] 0 2024-09-16T09:45:31.725 INFO:tasks.workunit.client.1.smithi114.stdout:1/362: read d4/d2b/d2f/d3a/d56/f66 [728897,83714] 0 2024-09-16T09:45:31.725 INFO:tasks.workunit.client.1.smithi114.stdout:1/363: stat d4/d2b/d16/l31 0 2024-09-16T09:45:31.726 INFO:tasks.workunit.client.1.smithi114.stdout:4/341: rename d0/d26/d29/c1b to d0/d26/d29/d2b/d58/c66 0 2024-09-16T09:45:31.726 INFO:tasks.workunit.client.1.smithi114.stdout:4/342: chown d0/d26/d3c/f2d 1 1 2024-09-16T09:45:31.728 INFO:tasks.workunit.client.1.smithi114.stdout:8/345: creat d4/db/d68/d52/d54/f74 x:0 0 0 2024-09-16T09:45:31.728 INFO:tasks.workunit.client.1.smithi114.stdout:8/346: write d4/f15 [1524970,100609] 0 2024-09-16T09:45:31.729 INFO:tasks.workunit.client.1.smithi114.stdout:6/335: symlink d6/da/l6a 0 2024-09-16T09:45:31.736 INFO:tasks.workunit.client.1.smithi114.stdout:2/362: mknod d1/d8/d10/d16/d1d/d4a/d3e/d5b/c93 0 2024-09-16T09:45:31.736 INFO:tasks.workunit.client.1.smithi114.stdout:2/363: truncate d1/d8/d10/d16/d1d/f66 656576 0 2024-09-16T09:45:31.737 INFO:tasks.workunit.client.1.smithi114.stdout:0/256: mknod d1f/d22/d2e/d46/c5e 0 2024-09-16T09:45:31.737 INFO:tasks.workunit.client.1.smithi114.stdout:0/257: dread - d1f/d27/f3b zero size 2024-09-16T09:45:31.737 INFO:tasks.workunit.client.1.smithi114.stdout:0/258: readlink d1f/d27/d47/l4d 0 2024-09-16T09:45:31.739 INFO:tasks.workunit.client.1.smithi114.stdout:9/336: rename d3/l1a to d3/da/d10/d23/d43/d1e/d4c/l74 0 2024-09-16T09:45:31.739 INFO:tasks.workunit.client.1.smithi114.stdout:1/364: mknod d4/d2b/d2f/d3a/c76 0 2024-09-16T09:45:31.740 INFO:tasks.workunit.client.1.smithi114.stdout:4/343: creat d0/d26/d3c/d45/f67 x:0 0 0 2024-09-16T09:45:31.741 INFO:tasks.workunit.client.1.smithi114.stdout:2/364: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f94 x:0 0 0 2024-09-16T09:45:31.745 INFO:tasks.workunit.client.1.smithi114.stdout:7/418: rename d2/df/l3d to d2/d9/d51/l87 0 2024-09-16T09:45:31.746 INFO:tasks.workunit.client.1.smithi114.stdout:3/480: dwrite dc/de/d17/d79/f7c [0,4194304] 0 2024-09-16T09:45:31.749 INFO:tasks.workunit.client.1.smithi114.stdout:7/419: unlink d2/df/l3f 0 2024-09-16T09:45:31.749 INFO:tasks.workunit.client.1.smithi114.stdout:6/336: dwrite d6/da/d36/f38 [0,4194304] 0 2024-09-16T09:45:31.752 INFO:tasks.workunit.client.1.smithi114.stdout:3/481: mkdir dc/de/d17/d2d/d41/d9e/dad 0 2024-09-16T09:45:31.752 INFO:tasks.workunit.client.1.smithi114.stdout:3/482: fdatasync dc/d38/f9c 0 2024-09-16T09:45:31.752 INFO:tasks.workunit.client.1.smithi114.stdout:3/483: readlink dc/de/d17/l21 0 2024-09-16T09:45:31.757 INFO:tasks.workunit.client.1.smithi114.stdout:7/420: symlink d2/d9/l88 0 2024-09-16T09:45:31.757 INFO:tasks.workunit.client.1.smithi114.stdout:0/259: dwrite f1e [0,4194304] 0 2024-09-16T09:45:31.757 INFO:tasks.workunit.client.1.smithi114.stdout:0/260: write f16 [1389142,35679] 0 2024-09-16T09:45:31.758 INFO:tasks.workunit.client.1.smithi114.stdout:6/337: truncate d6/fc 2416137 0 2024-09-16T09:45:31.758 INFO:tasks.workunit.client.1.smithi114.stdout:6/338: readlink d6/l32 0 2024-09-16T09:45:31.761 INFO:tasks.workunit.client.1.smithi114.stdout:3/484: creat dc/de/d10/fae x:0 0 0 2024-09-16T09:45:31.764 INFO:tasks.workunit.client.1.smithi114.stdout:7/421: mkdir d2/d9/d2b/d2e/d3e/d89 0 2024-09-16T09:45:31.764 INFO:tasks.workunit.client.1.smithi114.stdout:7/422: write d2/df/f30 [4323290,22811] 0 2024-09-16T09:45:31.764 INFO:tasks.workunit.client.1.smithi114.stdout:3/485: truncate dc/de/f2f 439825 0 2024-09-16T09:45:31.764 INFO:tasks.workunit.client.1.smithi114.stdout:4/344: dread d0/d26/f48 [0,4194304] 0 2024-09-16T09:45:31.768 INFO:tasks.workunit.client.1.smithi114.stdout:7/423: creat d2/d9/d2b/d2e/d3e/d79/f8a x:0 0 0 2024-09-16T09:45:31.768 INFO:tasks.workunit.client.1.smithi114.stdout:3/486: creat dc/de/d18/d78/faf x:0 0 0 2024-09-16T09:45:31.769 INFO:tasks.workunit.client.1.smithi114.stdout:4/345: creat d0/d26/d3c/d3e/d4b/d46/f68 x:0 0 0 2024-09-16T09:45:31.769 INFO:tasks.workunit.client.1.smithi114.stdout:4/346: fsync d0/f20 0 2024-09-16T09:45:31.769 INFO:tasks.workunit.client.1.smithi114.stdout:4/347: read - d0/f64 zero size 2024-09-16T09:45:31.770 INFO:tasks.workunit.client.1.smithi114.stdout:7/424: getdents d2/d9/d2b/d2e/d22/d27 0 2024-09-16T09:45:31.771 INFO:tasks.workunit.client.1.smithi114.stdout:3/487: symlink dc/de/d37/d4e/lb0 0 2024-09-16T09:45:31.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/348: mknod d0/d26/d3c/d3e/d4b/d46/c69 0 2024-09-16T09:45:31.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/349: dread - d0/d26/d3c/d45/f67 zero size 2024-09-16T09:45:31.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/350: write d0/d26/d29/fd [128173,93205] 0 2024-09-16T09:45:31.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/351: chown d0/d13/f22 1 1 2024-09-16T09:45:31.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/352: readlink d0/d26/d3c/l30 0 2024-09-16T09:45:31.774 INFO:tasks.workunit.client.1.smithi114.stdout:9/337: dwrite d3/da/d10/d23/d43/d1e/f5e [0,4194304] 0 2024-09-16T09:45:31.780 INFO:tasks.workunit.client.1.smithi114.stdout:9/338: creat d3/da/d10/d23/d43/d1e/d25/d5a/f75 x:0 0 0 2024-09-16T09:45:31.780 INFO:tasks.workunit.client.1.smithi114.stdout:9/339: readlink d3/da/l2d 0 2024-09-16T09:45:31.781 INFO:tasks.workunit.client.1.smithi114.stdout:9/340: rmdir d3/da/d10/d23/d43 39 2024-09-16T09:45:31.787 INFO:tasks.workunit.client.1.smithi114.stdout:2/365: dwrite d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f65 [0,4194304] 0 2024-09-16T09:45:31.788 INFO:tasks.workunit.client.1.smithi114.stdout:2/366: rmdir d1/d8/d10/d16/d1d/d4a/d3e 39 2024-09-16T09:45:31.802 INFO:tasks.workunit.client.1.smithi114.stdout:2/367: dread d1/f7b [0,4194304] 0 2024-09-16T09:45:31.802 INFO:tasks.workunit.client.1.smithi114.stdout:2/368: write d1/d8/d10/f49 [519309,122564] 0 2024-09-16T09:45:31.804 INFO:tasks.workunit.client.1.smithi114.stdout:0/261: dwrite d1f/d22/d2e/f37 [0,4194304] 0 2024-09-16T09:45:31.805 INFO:tasks.workunit.client.1.smithi114.stdout:0/262: creat d1f/d22/d2e/d46/f5f x:0 0 0 2024-09-16T09:45:31.805 INFO:tasks.workunit.client.1.smithi114.stdout:0/263: chown d1f/d22/f3c 2 1 2024-09-16T09:45:31.806 INFO:tasks.workunit.client.1.smithi114.stdout:0/264: creat d1f/d27/d47/f60 x:0 0 0 2024-09-16T09:45:31.807 INFO:tasks.workunit.client.1.smithi114.stdout:0/265: symlink d1f/d22/d2e/d46/l61 0 2024-09-16T09:45:31.808 INFO:tasks.workunit.client.1.smithi114.stdout:4/353: dwrite d0/d26/d3c/f2d [0,4194304] 0 2024-09-16T09:45:31.808 INFO:tasks.workunit.client.1.smithi114.stdout:4/354: write d0/d26/d3c/d3e/d4d/f54 [407712,60281] 0 2024-09-16T09:45:31.809 INFO:tasks.workunit.client.1.smithi114.stdout:6/339: dwrite d6/d2d/f54 [0,4194304] 0 2024-09-16T09:45:31.809 INFO:tasks.workunit.client.1.smithi114.stdout:9/341: dwrite d3/da/f46 [0,4194304] 0 2024-09-16T09:45:31.810 INFO:tasks.workunit.client.1.smithi114.stdout:7/425: dwrite d2/d9/d2b/f61 [0,4194304] 0 2024-09-16T09:45:31.810 INFO:tasks.workunit.client.1.smithi114.stdout:7/426: chown d2/l25 6591302 1 2024-09-16T09:45:31.811 INFO:tasks.workunit.client.1.smithi114.stdout:2/369: write d1/d8/f12 [759495,108689] 0 2024-09-16T09:45:31.811 INFO:tasks.workunit.client.1.smithi114.stdout:2/370: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/c43 1702984 1 2024-09-16T09:45:31.812 INFO:tasks.workunit.client.1.smithi114.stdout:6/340: creat d6/da/d36/d51/f6b x:0 0 0 2024-09-16T09:45:31.815 INFO:tasks.workunit.client.1.smithi114.stdout:4/355: dread d0/d26/d3c/d3e/d4d/f54 [0,4194304] 0 2024-09-16T09:45:31.815 INFO:tasks.workunit.client.1.smithi114.stdout:4/356: fdatasync d0/d26/d2e/f62 0 2024-09-16T09:45:31.821 INFO:tasks.workunit.client.1.smithi114.stdout:9/342: dread d3/ff [0,4194304] 0 2024-09-16T09:45:31.821 INFO:tasks.workunit.client.1.smithi114.stdout:7/427: symlink d2/d9/d2b/l8b 0 2024-09-16T09:45:31.821 INFO:tasks.workunit.client.1.smithi114.stdout:9/343: chown d3/da/d10/d23/d43/d1e/d25/d5a/f3e 138 1 2024-09-16T09:45:31.821 INFO:tasks.workunit.client.1.smithi114.stdout:9/344: write d3/da/d10/f20 [1363226,109810] 0 2024-09-16T09:45:31.823 INFO:tasks.workunit.client.1.smithi114.stdout:2/371: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/f95 x:0 0 0 2024-09-16T09:45:31.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/341: creat d6/f6c x:0 0 0 2024-09-16T09:45:31.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/342: readlink d6/da/d10/l1b 0 2024-09-16T09:45:31.825 INFO:tasks.workunit.client.1.smithi114.stdout:6/343: truncate d6/d2d/d46/f5a 352040 0 2024-09-16T09:45:31.825 INFO:tasks.workunit.client.1.smithi114.stdout:6/344: write d6/d2d/d46/f5a [924942,2890] 0 2024-09-16T09:45:31.825 INFO:tasks.workunit.client.1.smithi114.stdout:4/357: rename d0/d26/d29/fd to d0/d26/d3c/d3e/f6a 0 2024-09-16T09:45:31.827 INFO:tasks.workunit.client.1.smithi114.stdout:0/266: dwrite d1f/d27/f3b [0,4194304] 0 2024-09-16T09:45:31.828 INFO:tasks.workunit.client.1.smithi114.stdout:9/345: creat d3/da/d10/d23/d29/d3f/f76 x:0 0 0 2024-09-16T09:45:31.829 INFO:tasks.workunit.client.1.smithi114.stdout:7/428: creat d2/d9/d2b/d2e/f8c x:0 0 0 2024-09-16T09:45:31.829 INFO:tasks.workunit.client.1.smithi114.stdout:6/345: unlink d6/da/d36/d51/f53 0 2024-09-16T09:45:31.832 INFO:tasks.workunit.client.1.smithi114.stdout:3/488: dread dc/de/d18/d78/f73 [0,4194304] 0 2024-09-16T09:45:31.835 INFO:tasks.workunit.client.1.smithi114.stdout:6/346: unlink d6/da/c21 0 2024-09-16T09:45:31.835 INFO:tasks.workunit.client.1.smithi114.stdout:6/347: chown d6/d64/f65 7 1 2024-09-16T09:45:31.835 INFO:tasks.workunit.client.1.smithi114.stdout:6/348: dread - d6/f6c zero size 2024-09-16T09:45:31.838 INFO:tasks.workunit.client.1.smithi114.stdout:3/489: mknod dc/de/d17/d2d/d41/cb1 0 2024-09-16T09:45:31.839 INFO:tasks.workunit.client.1.smithi114.stdout:7/429: read d2/d9/f12 [324151,5784] 0 2024-09-16T09:45:31.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/490: mkdir dc/de/d10/d6a/d77/db2 0 2024-09-16T09:45:31.841 INFO:tasks.workunit.client.1.smithi114.stdout:3/491: write dc/de/d10/fae [605050,10788] 0 2024-09-16T09:45:31.842 INFO:tasks.workunit.client.1.smithi114.stdout:3/492: creat dc/de/d18/d78/d5c/d6e/fb3 x:0 0 0 2024-09-16T09:45:31.846 INFO:tasks.workunit.client.1.smithi114.stdout:5/368: sync 2024-09-16T09:45:31.847 INFO:tasks.workunit.client.1.smithi114.stdout:2/372: dwrite d1/d8/d10/f50 [0,4194304] 0 2024-09-16T09:45:31.848 INFO:tasks.workunit.client.1.smithi114.stdout:2/373: dread - d1/d8/d10/d16/d1d/d4a/d3e/d5b/f71 zero size 2024-09-16T09:45:31.848 INFO:tasks.workunit.client.1.smithi114.stdout:5/369: truncate d3/d11/d71/d72/f10 3260570 0 2024-09-16T09:45:31.850 INFO:tasks.workunit.client.1.smithi114.stdout:5/370: unlink d3/d11/d37/d43/d4c/f67 0 2024-09-16T09:45:31.852 INFO:tasks.workunit.client.1.smithi114.stdout:5/371: mkdir d3/d11/d71/d72/d2d/d3f/d59/d78 0 2024-09-16T09:45:31.854 INFO:tasks.workunit.client.1.smithi114.stdout:5/372: mkdir d3/d11/d37/d43/d4c/d6d/d79 0 2024-09-16T09:45:31.854 INFO:tasks.workunit.client.1.smithi114.stdout:5/373: chown d3/d11/d37/d43/d4c/d6d/d79 55599445 1 2024-09-16T09:45:31.859 INFO:tasks.workunit.client.1.smithi114.stdout:3/493: rename dc/de/d10 to dc/de/d17/d2d/db4 0 2024-09-16T09:45:31.860 INFO:tasks.workunit.client.1.smithi114.stdout:4/358: dwrite d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:31.862 INFO:tasks.workunit.client.1.smithi114.stdout:3/494: mknod dc/de/d18/d78/d5c/da5/cb5 0 2024-09-16T09:45:31.862 INFO:tasks.workunit.client.1.smithi114.stdout:3/495: write dc/de/d17/d2d/f88 [1693603,14427] 0 2024-09-16T09:45:31.862 INFO:tasks.workunit.client.1.smithi114.stdout:3/496: write dc/de/d17/d2d/db4/d6a/d77/f9d [410724,62864] 0 2024-09-16T09:45:31.862 INFO:tasks.workunit.client.1.smithi114.stdout:3/497: stat dc 0 2024-09-16T09:45:31.862 INFO:tasks.workunit.client.1.smithi114.stdout:0/267: dwrite d1f/d27/f3b [0,4194304] 0 2024-09-16T09:45:31.863 INFO:tasks.workunit.client.1.smithi114.stdout:1/365: sync 2024-09-16T09:45:31.863 INFO:tasks.workunit.client.1.smithi114.stdout:8/347: sync 2024-09-16T09:45:31.864 INFO:tasks.workunit.client.1.smithi114.stdout:3/498: dread dc/de/f2f [0,4194304] 0 2024-09-16T09:45:31.864 INFO:tasks.workunit.client.1.smithi114.stdout:4/359: symlink d0/d26/d3c/d3e/l6b 0 2024-09-16T09:45:31.865 INFO:tasks.workunit.client.1.smithi114.stdout:8/348: unlink d4/db/d3e/d47/d64/d72/d59/f5f 0 2024-09-16T09:45:31.865 INFO:tasks.workunit.client.1.smithi114.stdout:8/349: fsync d4/db/dd/f6f 0 2024-09-16T09:45:31.866 INFO:tasks.workunit.client.1.smithi114.stdout:3/499: mknod dc/d38/cb6 0 2024-09-16T09:45:31.866 INFO:tasks.workunit.client.1.smithi114.stdout:3/500: write dc/de/d1f/f23 [1702656,94239] 0 2024-09-16T09:45:31.867 INFO:tasks.workunit.client.1.smithi114.stdout:3/501: creat dc/fb7 x:0 0 0 2024-09-16T09:45:31.867 INFO:tasks.workunit.client.1.smithi114.stdout:8/350: mknod d4/c75 0 2024-09-16T09:45:31.868 INFO:tasks.workunit.client.1.smithi114.stdout:8/351: fsync d4/db/f4d 0 2024-09-16T09:45:31.868 INFO:tasks.workunit.client.1.smithi114.stdout:3/502: symlink dc/de/d18/d78/d5c/d5d/d8a/lb8 0 2024-09-16T09:45:31.868 INFO:tasks.workunit.client.1.smithi114.stdout:3/503: chown dc/de/d37/l82 286 1 2024-09-16T09:45:31.869 INFO:tasks.workunit.client.1.smithi114.stdout:3/504: dread - dc/de/d17/d2d/db4/d6a/d77/d7f/f86 zero size 2024-09-16T09:45:31.869 INFO:tasks.workunit.client.1.smithi114.stdout:3/505: truncate dc/d38/f66 704728 0 2024-09-16T09:45:31.869 INFO:tasks.workunit.client.1.smithi114.stdout:8/352: link d4/db/d68/d30/l38 d4/db/d39/d3c/d4e/d62/l76 0 2024-09-16T09:45:31.870 INFO:tasks.workunit.client.1.smithi114.stdout:3/506: rmdir dc/de 39 2024-09-16T09:45:31.871 INFO:tasks.workunit.client.1.smithi114.stdout:8/353: creat d4/db/d68/d28/f77 x:0 0 0 2024-09-16T09:45:31.871 INFO:tasks.workunit.client.1.smithi114.stdout:8/354: readlink d4/db/d68/d52/d54/l57 0 2024-09-16T09:45:31.871 INFO:tasks.workunit.client.1.smithi114.stdout:8/355: write d4/f3f [8943838,60227] 0 2024-09-16T09:45:31.871 INFO:tasks.workunit.client.1.smithi114.stdout:4/360: read d0/d26/d3c/d3e/d5a/d5d/f60 [4647366,51723] 0 2024-09-16T09:45:31.871 INFO:tasks.workunit.client.1.smithi114.stdout:4/361: chown d0/d26/d2e/f62 2477899 1 2024-09-16T09:45:31.872 INFO:tasks.workunit.client.1.smithi114.stdout:3/507: mknod dc/de/d37/d3d/cb9 0 2024-09-16T09:45:31.872 INFO:tasks.workunit.client.1.smithi114.stdout:8/356: mkdir d4/db/d3e/d71/d78 0 2024-09-16T09:45:31.872 INFO:tasks.workunit.client.1.smithi114.stdout:4/362: creat d0/d13/d25/f6c x:0 0 0 2024-09-16T09:45:31.874 INFO:tasks.workunit.client.1.smithi114.stdout:3/508: rename dc/de/d37/d4e/f70 to dc/de/d17/d72/fba 0 2024-09-16T09:45:31.877 INFO:tasks.workunit.client.1.smithi114.stdout:0/268: dread f14 [0,4194304] 0 2024-09-16T09:45:31.877 INFO:tasks.workunit.client.1.smithi114.stdout:6/349: dwrite d6/d2d/d46/f5a [0,4194304] 0 2024-09-16T09:45:31.877 INFO:tasks.workunit.client.1.smithi114.stdout:0/269: write f15 [1606133,68057] 0 2024-09-16T09:45:31.877 INFO:tasks.workunit.client.1.smithi114.stdout:6/350: chown d6/f7 0 1 2024-09-16T09:45:31.878 INFO:tasks.workunit.client.1.smithi114.stdout:0/270: chown d1f/f3f 826 1 2024-09-16T09:45:31.878 INFO:tasks.workunit.client.1.smithi114.stdout:0/271: chown f15 3480130 1 2024-09-16T09:45:31.878 INFO:tasks.workunit.client.1.smithi114.stdout:3/509: dread dc/de/f34 [0,4194304] 0 2024-09-16T09:45:31.878 INFO:tasks.workunit.client.1.smithi114.stdout:3/510: read dc/de/f2f [242527,125536] 0 2024-09-16T09:45:31.879 INFO:tasks.workunit.client.1.smithi114.stdout:3/511: write dc/de/d18/d78/d5c/d5d/fa6 [54187,81807] 0 2024-09-16T09:45:31.879 INFO:tasks.workunit.client.1.smithi114.stdout:3/512: readlink dc/de/d18/d78/d5c/d6e/l94 0 2024-09-16T09:45:31.879 INFO:tasks.workunit.client.1.smithi114.stdout:1/366: write d4/d2b/f9 [9743674,124388] 0 2024-09-16T09:45:31.879 INFO:tasks.workunit.client.1.smithi114.stdout:1/367: fsync d4/d2b/d16/f1b 0 2024-09-16T09:45:31.881 INFO:tasks.workunit.client.1.smithi114.stdout:0/272: rename f2 to d1f/d27/d47/d56/f62 0 2024-09-16T09:45:31.882 INFO:tasks.workunit.client.1.smithi114.stdout:3/513: creat dc/de/d37/d3d/fbb x:0 0 0 2024-09-16T09:45:31.882 INFO:tasks.workunit.client.1.smithi114.stdout:3/514: chown dc/de/d37/d3d/fbb 141735 1 2024-09-16T09:45:31.882 INFO:tasks.workunit.client.1.smithi114.stdout:9/346: dwrite d3/da/d10/d23/d29/d2c/d45/f61 [0,4194304] 0 2024-09-16T09:45:31.883 INFO:tasks.workunit.client.1.smithi114.stdout:1/368: creat d4/d2b/d16/d71/d72/d75/f77 x:0 0 0 2024-09-16T09:45:31.883 INFO:tasks.workunit.client.1.smithi114.stdout:0/273: symlink d1f/d27/d47/d56/l63 0 2024-09-16T09:45:31.884 INFO:tasks.workunit.client.1.smithi114.stdout:3/515: symlink dc/d38/lbc 0 2024-09-16T09:45:31.885 INFO:tasks.workunit.client.1.smithi114.stdout:1/369: link d4/d2b/d16/d47/f70 d4/d2b/d2f/d3a/f78 0 2024-09-16T09:45:31.886 INFO:tasks.workunit.client.1.smithi114.stdout:0/274: link d1f/f3f d1f/d27/d47/f64 0 2024-09-16T09:45:31.887 INFO:tasks.workunit.client.1.smithi114.stdout:1/370: unlink d4/d3d/d41/f64 0 2024-09-16T09:45:31.887 INFO:tasks.workunit.client.1.smithi114.stdout:1/371: read d4/d3d/d41/d42/d58/f5c [434139,89360] 0 2024-09-16T09:45:31.888 INFO:tasks.workunit.client.1.smithi114.stdout:1/372: read - d4/d2b/d29/f49 zero size 2024-09-16T09:45:31.888 INFO:tasks.workunit.client.1.smithi114.stdout:2/374: dwrite d1/f7b [0,4194304] 0 2024-09-16T09:45:31.888 INFO:tasks.workunit.client.1.smithi114.stdout:4/363: dread d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:31.888 INFO:tasks.workunit.client.1.smithi114.stdout:0/275: creat d1f/f65 x:0 0 0 2024-09-16T09:45:31.890 INFO:tasks.workunit.client.1.smithi114.stdout:1/373: rmdir d4/d2b 39 2024-09-16T09:45:31.893 INFO:tasks.workunit.client.1.smithi114.stdout:2/375: creat d1/f96 x:0 0 0 2024-09-16T09:45:31.893 INFO:tasks.workunit.client.1.smithi114.stdout:7/430: dwrite d2/d9/d2b/d2e/d3e/f44 [4194304,4194304] 0 2024-09-16T09:45:31.893 INFO:tasks.workunit.client.1.smithi114.stdout:7/431: dread - d2/f4a zero size 2024-09-16T09:45:31.895 INFO:tasks.workunit.client.1.smithi114.stdout:4/364: mkdir d0/d26/d40/d6d 0 2024-09-16T09:45:31.897 INFO:tasks.workunit.client.1.smithi114.stdout:0/276: creat d1f/d27/d47/f66 x:0 0 0 2024-09-16T09:45:31.898 INFO:tasks.workunit.client.1.smithi114.stdout:5/374: rename d3/d11/d37 to d3/d11/d7a 0 2024-09-16T09:45:31.899 INFO:tasks.workunit.client.1.smithi114.stdout:5/375: dread - d3/d11/d7a/d43/d58/f74 zero size 2024-09-16T09:45:31.899 INFO:tasks.workunit.client.1.smithi114.stdout:1/374: mknod d4/d3d/d41/d42/c79 0 2024-09-16T09:45:31.902 INFO:tasks.workunit.client.1.smithi114.stdout:2/376: creat d1/d8/d10/d16/d1d/d4a/d3e/d5b/f97 x:0 0 0 2024-09-16T09:45:31.904 INFO:tasks.workunit.client.1.smithi114.stdout:7/432: rename d2/d9/d2b/d2e/d22/d4c/l52 to d2/d9/d2b/d2e/l8d 0 2024-09-16T09:45:31.904 INFO:tasks.workunit.client.1.smithi114.stdout:4/365: getdents d0/d26/d2e 0 2024-09-16T09:45:31.906 INFO:tasks.workunit.client.1.smithi114.stdout:0/277: rmdir d1f/d27/d47/d56 39 2024-09-16T09:45:31.908 INFO:tasks.workunit.client.1.smithi114.stdout:5/376: creat d3/d11/d7a/d43/d4c/f7b x:0 0 0 2024-09-16T09:45:31.908 INFO:tasks.workunit.client.1.smithi114.stdout:5/377: fdatasync d3/d11/d7a/d43/f48 0 2024-09-16T09:45:31.909 INFO:tasks.workunit.client.1.smithi114.stdout:1/375: truncate d4/d2b/d16/f19 3268992 0 2024-09-16T09:45:31.910 INFO:tasks.workunit.client.1.smithi114.stdout:2/377: mkdir d1/d8/d10/d16/d98 0 2024-09-16T09:45:31.910 INFO:tasks.workunit.client.1.smithi114.stdout:2/378: dread - d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f94 zero size 2024-09-16T09:45:31.911 INFO:tasks.workunit.client.1.smithi114.stdout:4/366: unlink d0/l49 0 2024-09-16T09:45:31.912 INFO:tasks.workunit.client.1.smithi114.stdout:0/278: rmdir d1f/d20/d48 39 2024-09-16T09:45:31.912 INFO:tasks.workunit.client.1.smithi114.stdout:0/279: chown d1f/d20/d48 0 1 2024-09-16T09:45:31.913 INFO:tasks.workunit.client.1.smithi114.stdout:5/378: creat d3/d11/d7a/d43/d58/f7c x:0 0 0 2024-09-16T09:45:31.913 INFO:tasks.workunit.client.1.smithi114.stdout:5/379: write d3/d11/d71/d72/d2d/d34/f5f [1404946,118713] 0 2024-09-16T09:45:31.913 INFO:tasks.workunit.client.1.smithi114.stdout:5/380: fdatasync d3/d11/d7a/d43/f51 0 2024-09-16T09:45:31.913 INFO:tasks.workunit.client.1.smithi114.stdout:5/381: read d3/d1f/f27 [523777,14470] 0 2024-09-16T09:45:31.914 INFO:tasks.workunit.client.1.smithi114.stdout:1/376: rmdir d4 39 2024-09-16T09:45:31.915 INFO:tasks.workunit.client.1.smithi114.stdout:2/379: symlink d1/d8/l99 0 2024-09-16T09:45:31.915 INFO:tasks.workunit.client.1.smithi114.stdout:0/280: symlink d1f/d22/l67 0 2024-09-16T09:45:31.919 INFO:tasks.workunit.client.1.smithi114.stdout:2/380: truncate d1/d8/d10/d16/d1d/f34 2537692 0 2024-09-16T09:45:31.919 INFO:tasks.workunit.client.1.smithi114.stdout:2/381: dread - d1/d8/d82/f8d zero size 2024-09-16T09:45:31.920 INFO:tasks.workunit.client.1.smithi114.stdout:8/357: dwrite d4/db/dd/f6f [0,4194304] 0 2024-09-16T09:45:31.920 INFO:tasks.workunit.client.1.smithi114.stdout:4/367: dread d0/f20 [0,4194304] 0 2024-09-16T09:45:31.920 INFO:tasks.workunit.client.1.smithi114.stdout:6/351: dwrite d6/d64/f65 [0,4194304] 0 2024-09-16T09:45:31.920 INFO:tasks.workunit.client.1.smithi114.stdout:9/347: dwrite d3/da/d10/d23/d43/d1e/d25/f6f [0,4194304] 0 2024-09-16T09:45:31.921 INFO:tasks.workunit.client.1.smithi114.stdout:6/352: write d6/da/d10/f25 [612707,57440] 0 2024-09-16T09:45:31.921 INFO:tasks.workunit.client.1.smithi114.stdout:3/516: dwrite dc/de/d17/f1a [0,4194304] 0 2024-09-16T09:45:31.922 INFO:tasks.workunit.client.1.smithi114.stdout:2/382: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d90/d9a 0 2024-09-16T09:45:31.922 INFO:tasks.workunit.client.1.smithi114.stdout:0/281: symlink d1f/d2d/l68 0 2024-09-16T09:45:31.927 INFO:tasks.workunit.client.1.smithi114.stdout:4/368: truncate d0/fe 7779056 0 2024-09-16T09:45:31.927 INFO:tasks.workunit.client.1.smithi114.stdout:5/382: dwrite d3/d11/f4f [0,4194304] 0 2024-09-16T09:45:31.928 INFO:tasks.workunit.client.1.smithi114.stdout:8/358: creat d4/db/d3e/d71/f79 x:0 0 0 2024-09-16T09:45:31.938 INFO:tasks.workunit.client.1.smithi114.stdout:6/353: creat d6/da/d10/d40/f6d x:0 0 0 2024-09-16T09:45:31.938 INFO:tasks.workunit.client.1.smithi114.stdout:6/354: fdatasync d6/da/d36/d51/f60 0 2024-09-16T09:45:31.938 INFO:tasks.workunit.client.1.smithi114.stdout:9/348: dwrite d3/da/d10/d23/d43/d1e/f72 [0,4194304] 0 2024-09-16T09:45:31.940 INFO:tasks.workunit.client.1.smithi114.stdout:5/383: write d3/d11/d71/d72/d2d/d3f/f4a [3026267,30973] 0 2024-09-16T09:45:31.940 INFO:tasks.workunit.client.1.smithi114.stdout:5/384: stat d3/f8 0 2024-09-16T09:45:31.940 INFO:tasks.workunit.client.1.smithi114.stdout:5/385: write d3/d11/d71/d72/f10 [3588758,92012] 0 2024-09-16T09:45:31.940 INFO:tasks.workunit.client.1.smithi114.stdout:1/377: rmdir d4/d3d/d41/d42/d62 0 2024-09-16T09:45:31.942 INFO:tasks.workunit.client.1.smithi114.stdout:2/383: creat d1/d8/d10/f9b x:0 0 0 2024-09-16T09:45:31.947 INFO:tasks.workunit.client.1.smithi114.stdout:0/282: symlink d1f/d20/d48/l69 0 2024-09-16T09:45:31.948 INFO:tasks.workunit.client.1.smithi114.stdout:4/369: rmdir d0 39 2024-09-16T09:45:31.948 INFO:tasks.workunit.client.1.smithi114.stdout:9/349: dread d3/da/d10/d23/f73 [0,4194304] 0 2024-09-16T09:45:31.953 INFO:tasks.workunit.client.1.smithi114.stdout:8/359: mkdir d4/db/d3e/d71/d78/d7a 0 2024-09-16T09:45:31.956 INFO:tasks.workunit.client.1.smithi114.stdout:1/378: link d4/d3d/c45 d4/d2b/d16/d71/d72/c7a 0 2024-09-16T09:45:31.956 INFO:tasks.workunit.client.1.smithi114.stdout:1/379: write d4/d2b/f37 [995830,85646] 0 2024-09-16T09:45:31.957 INFO:tasks.workunit.client.1.smithi114.stdout:6/355: dwrite d6/da/f67 [0,4194304] 0 2024-09-16T09:45:31.958 INFO:tasks.workunit.client.1.smithi114.stdout:2/384: unlink d1/d8/f2e 0 2024-09-16T09:45:31.959 INFO:tasks.workunit.client.1.smithi114.stdout:0/283: rename d1f/d20/f29 to d1f/d22/d2e/f6a 0 2024-09-16T09:45:31.961 INFO:tasks.workunit.client.1.smithi114.stdout:4/370: creat d0/d26/d3c/d45/f6e x:0 0 0 2024-09-16T09:45:31.961 INFO:tasks.workunit.client.1.smithi114.stdout:4/371: stat d0/f21 0 2024-09-16T09:45:31.962 INFO:tasks.workunit.client.1.smithi114.stdout:6/356: mknod d6/da/d36/c6e 0 2024-09-16T09:45:31.965 INFO:tasks.workunit.client.1.smithi114.stdout:2/385: rmdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d90/d9a 0 2024-09-16T09:45:31.966 INFO:tasks.workunit.client.1.smithi114.stdout:5/386: dwrite d3/d11/d7a/d43/f47 [0,4194304] 0 2024-09-16T09:45:31.966 INFO:tasks.workunit.client.1.smithi114.stdout:1/380: rename d4/d2b/d16/d47/f70 to d4/d2b/d16/d71/f7b 0 2024-09-16T09:45:31.966 INFO:tasks.workunit.client.1.smithi114.stdout:9/350: read d3/da/d10/f1b [570310,80212] 0 2024-09-16T09:45:31.966 INFO:tasks.workunit.client.1.smithi114.stdout:9/351: dread - d3/da/d10/d23/d29/d2c/d6b/f5f zero size 2024-09-16T09:45:31.967 INFO:tasks.workunit.client.1.smithi114.stdout:4/372: creat d0/d13/f6f x:0 0 0 2024-09-16T09:45:31.968 INFO:tasks.workunit.client.1.smithi114.stdout:6/357: creat d6/da/d36/d51/f6f x:0 0 0 2024-09-16T09:45:31.969 INFO:tasks.workunit.client.1.smithi114.stdout:2/386: symlink d1/d8/d10/d16/d1d/d4a/d3e/l9c 0 2024-09-16T09:45:31.969 INFO:tasks.workunit.client.1.smithi114.stdout:2/387: truncate d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f52 384034 0 2024-09-16T09:45:31.970 INFO:tasks.workunit.client.1.smithi114.stdout:2/388: dread d1/d8/d10/d16/d1d/f66 [0,4194304] 0 2024-09-16T09:45:31.970 INFO:tasks.workunit.client.1.smithi114.stdout:5/387: mkdir d3/d24/d7d 0 2024-09-16T09:45:31.971 INFO:tasks.workunit.client.1.smithi114.stdout:2/389: write d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f7e [520537,67932] 0 2024-09-16T09:45:31.972 INFO:tasks.workunit.client.1.smithi114.stdout:1/381: creat d4/d2b/d16/f7c x:0 0 0 2024-09-16T09:45:31.972 INFO:tasks.workunit.client.1.smithi114.stdout:1/382: fdatasync d4/d3d/f67 0 2024-09-16T09:45:31.972 INFO:tasks.workunit.client.1.smithi114.stdout:1/383: chown d4/cf 2508896 1 2024-09-16T09:45:31.972 INFO:tasks.workunit.client.1.smithi114.stdout:2/390: dread d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f52 [0,4194304] 0 2024-09-16T09:45:31.972 INFO:tasks.workunit.client.1.smithi114.stdout:4/373: mkdir d0/d26/d3c/d3e/d5a/d5d/d70 0 2024-09-16T09:45:31.973 INFO:tasks.workunit.client.1.smithi114.stdout:6/358: creat d6/d2d/f70 x:0 0 0 2024-09-16T09:45:31.976 INFO:tasks.workunit.client.1.smithi114.stdout:1/384: creat d4/d2b/d2f/d3a/d56/f7d x:0 0 0 2024-09-16T09:45:31.976 INFO:tasks.workunit.client.1.smithi114.stdout:9/352: dread d3/da/d10/d23/d43/d1e/d25/f27 [0,4194304] 0 2024-09-16T09:45:31.977 INFO:tasks.workunit.client.1.smithi114.stdout:2/391: unlink d1/l1c 0 2024-09-16T09:45:31.978 INFO:tasks.workunit.client.1.smithi114.stdout:2/392: dread - d1/d8/d10/f67 zero size 2024-09-16T09:45:31.978 INFO:tasks.workunit.client.1.smithi114.stdout:2/393: chown d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/c43 4014 1 2024-09-16T09:45:31.979 INFO:tasks.workunit.client.1.smithi114.stdout:4/374: rename d0/d26/d29/d2b/d58/c66 to d0/d26/d3c/d3e/d4d/c71 0 2024-09-16T09:45:31.979 INFO:tasks.workunit.client.1.smithi114.stdout:4/375: fsync d0/d13/d25/f6c 0 2024-09-16T09:45:31.979 INFO:tasks.workunit.client.1.smithi114.stdout:6/359: creat d6/da/d10/f71 x:0 0 0 2024-09-16T09:45:31.980 INFO:tasks.workunit.client.1.smithi114.stdout:5/388: symlink d3/d11/l7e 0 2024-09-16T09:45:31.981 INFO:tasks.workunit.client.1.smithi114.stdout:9/353: rmdir d3/da/d10/d23/d43/d1e/d4c 39 2024-09-16T09:45:31.982 INFO:tasks.workunit.client.1.smithi114.stdout:4/376: creat d0/d26/d3c/d3e/d4b/d46/f72 x:0 0 0 2024-09-16T09:45:31.982 INFO:tasks.workunit.client.1.smithi114.stdout:4/377: read d0/d26/d29/f1d [232632,103614] 0 2024-09-16T09:45:31.982 INFO:tasks.workunit.client.1.smithi114.stdout:6/360: creat d6/da/d10/d40/f72 x:0 0 0 2024-09-16T09:45:31.983 INFO:tasks.workunit.client.1.smithi114.stdout:6/361: chown d6/da/f3e 7027 1 2024-09-16T09:45:31.983 INFO:tasks.workunit.client.1.smithi114.stdout:6/362: read d6/da/d10/f39 [120646,123478] 0 2024-09-16T09:45:31.983 INFO:tasks.workunit.client.1.smithi114.stdout:3/517: truncate dc/d38/f66 45928 0 2024-09-16T09:45:31.984 INFO:tasks.workunit.client.1.smithi114.stdout:5/389: rename d3/d11/d71/l57 to d3/d11/d7a/d43/d4c/d6d/l7f 0 2024-09-16T09:45:31.984 INFO:tasks.workunit.client.1.smithi114.stdout:6/363: mknod d6/c73 0 2024-09-16T09:45:31.985 INFO:tasks.workunit.client.1.smithi114.stdout:3/518: rmdir dc/de/d37/d4e 39 2024-09-16T09:45:31.986 INFO:tasks.workunit.client.1.smithi114.stdout:8/360: dwrite d4/db/dd/f16 [8388608,4194304] 0 2024-09-16T09:45:31.986 INFO:tasks.workunit.client.1.smithi114.stdout:5/390: creat d3/d11/d71/d72/d2d/f80 x:0 0 0 2024-09-16T09:45:31.987 INFO:tasks.workunit.client.1.smithi114.stdout:9/354: write d3/da/d10/d23/d43/d1e/d25/f27 [2232277,106225] 0 2024-09-16T09:45:31.987 INFO:tasks.workunit.client.1.smithi114.stdout:6/364: truncate d6/d2d/f3c 2301550 0 2024-09-16T09:45:31.988 INFO:tasks.workunit.client.1.smithi114.stdout:8/361: creat d4/db/d68/d52/f7b x:0 0 0 2024-09-16T09:45:31.988 INFO:tasks.workunit.client.1.smithi114.stdout:0/284: dwrite d1f/d22/d2e/f5a [4194304,4194304] 0 2024-09-16T09:45:31.989 INFO:tasks.workunit.client.1.smithi114.stdout:9/355: unlink d3/da/d10/d23/d29/d2c/d6b/d68/f6e 0 2024-09-16T09:45:31.989 INFO:tasks.workunit.client.1.smithi114.stdout:9/356: dread - d3/da/d10/d23/d29/f4b zero size 2024-09-16T09:45:31.990 INFO:tasks.workunit.client.1.smithi114.stdout:8/362: creat d4/db/d3e/f7c x:0 0 0 2024-09-16T09:45:31.991 INFO:tasks.workunit.client.1.smithi114.stdout:2/394: write d1/d8/f12 [4379371,70059] 0 2024-09-16T09:45:31.993 INFO:tasks.workunit.client.1.smithi114.stdout:0/285: mknod d1f/d20/c6b 0 2024-09-16T09:45:31.993 INFO:tasks.workunit.client.1.smithi114.stdout:0/286: chown f14 172737080 1 2024-09-16T09:45:31.994 INFO:tasks.workunit.client.1.smithi114.stdout:8/363: symlink d4/db/d68/d52/d54/l7d 0 2024-09-16T09:45:31.997 INFO:tasks.workunit.client.1.smithi114.stdout:2/395: mknod d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d90/c9d 0 2024-09-16T09:45:31.997 INFO:tasks.workunit.client.1.smithi114.stdout:2/396: dread - d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/f74 zero size 2024-09-16T09:45:31.997 INFO:tasks.workunit.client.1.smithi114.stdout:2/397: fsync d1/d8/d10/f50 0 2024-09-16T09:45:32.000 INFO:tasks.workunit.client.1.smithi114.stdout:0/287: link f3 d1f/d22/d2e/f6c 0 2024-09-16T09:45:32.002 INFO:tasks.workunit.client.1.smithi114.stdout:2/398: getdents d1/d8/d82 0 2024-09-16T09:45:32.002 INFO:tasks.workunit.client.1.smithi114.stdout:2/399: readlink d1/d8/l7d 0 2024-09-16T09:45:32.002 INFO:tasks.workunit.client.1.smithi114.stdout:2/400: getdents d1/d8/d10/d16/d1d/d92 0 2024-09-16T09:45:32.003 INFO:tasks.workunit.client.1.smithi114.stdout:9/357: dread d3/da/d10/d23/d29/d2c/d45/f61 [0,4194304] 0 2024-09-16T09:45:32.005 INFO:tasks.workunit.client.1.smithi114.stdout:9/358: mknod d3/da/d10/d23/d29/d2c/d45/c77 0 2024-09-16T09:45:32.005 INFO:tasks.workunit.client.1.smithi114.stdout:9/359: chown d3/da/d10/d23/d43/f18 0 1 2024-09-16T09:45:32.005 INFO:tasks.workunit.client.1.smithi114.stdout:9/360: readlink d3/da/l2d 0 2024-09-16T09:45:32.014 INFO:tasks.workunit.client.1.smithi114.stdout:8/364: dread d4/db/dd/f13 [0,4194304] 0 2024-09-16T09:45:32.014 INFO:tasks.workunit.client.1.smithi114.stdout:6/365: dwrite d6/da/d36/f3b [8388608,4194304] 0 2024-09-16T09:45:32.014 INFO:tasks.workunit.client.1.smithi114.stdout:6/366: chown d6/da/d36/d51/c68 807 1 2024-09-16T09:45:32.017 INFO:tasks.workunit.client.1.smithi114.stdout:8/365: rename d4/db/d3e/d71/f1e to d4/db/d68/d28/f7e 0 2024-09-16T09:45:32.018 INFO:tasks.workunit.client.1.smithi114.stdout:6/367: creat d6/da/f74 x:0 0 0 2024-09-16T09:45:32.018 INFO:tasks.workunit.client.1.smithi114.stdout:6/368: chown d6/f6c 32545 1 2024-09-16T09:45:32.019 INFO:tasks.workunit.client.1.smithi114.stdout:8/366: creat d4/db/d3e/f7f x:0 0 0 2024-09-16T09:45:32.020 INFO:tasks.workunit.client.1.smithi114.stdout:5/391: dwrite d3/d11/d71/d72/d2d/d3f/f4a [0,4194304] 0 2024-09-16T09:45:32.020 INFO:tasks.workunit.client.1.smithi114.stdout:5/392: chown d3/d11/d71/d72/f10 10860215 1 2024-09-16T09:45:32.021 INFO:tasks.workunit.client.1.smithi114.stdout:8/367: rmdir d4/db/d68/d52 39 2024-09-16T09:45:32.023 INFO:tasks.workunit.client.1.smithi114.stdout:7/433: sync 2024-09-16T09:45:32.024 INFO:tasks.workunit.client.1.smithi114.stdout:7/434: mknod d2/d9/d2b/d59/c8e 0 2024-09-16T09:45:32.027 INFO:tasks.workunit.client.1.smithi114.stdout:0/288: dwrite f3 [0,4194304] 0 2024-09-16T09:45:32.027 INFO:tasks.workunit.client.1.smithi114.stdout:0/289: fsync d1f/d27/d47/f60 0 2024-09-16T09:45:32.029 INFO:tasks.workunit.client.1.smithi114.stdout:0/290: rename d1f/d22/l41 to d1f/d20/d48/l6d 0 2024-09-16T09:45:32.029 INFO:tasks.workunit.client.1.smithi114.stdout:0/291: dread - d1f/f65 zero size 2024-09-16T09:45:32.031 INFO:tasks.workunit.client.1.smithi114.stdout:8/368: dread d4/db/d68/d30/f41 [0,4194304] 0 2024-09-16T09:45:32.031 INFO:tasks.workunit.client.1.smithi114.stdout:8/369: write d4/d1f/f35 [1898415,33638] 0 2024-09-16T09:45:32.032 INFO:tasks.workunit.client.1.smithi114.stdout:8/370: creat d4/db/dd/f80 x:0 0 0 2024-09-16T09:45:32.032 INFO:tasks.workunit.client.1.smithi114.stdout:8/371: write d4/db/d3e/d47/d64/d72/d59/f69 [3845870,68424] 0 2024-09-16T09:45:32.032 INFO:tasks.workunit.client.1.smithi114.stdout:8/372: dread - d4/db/d3e/f7f zero size 2024-09-16T09:45:32.038 INFO:tasks.workunit.client.1.smithi114.stdout:5/393: dread d3/f4 [0,4194304] 0 2024-09-16T09:45:32.045 INFO:tasks.workunit.client.1.smithi114.stdout:0/292: dread f3 [0,4194304] 0 2024-09-16T09:45:32.045 INFO:tasks.workunit.client.1.smithi114.stdout:0/293: readlink d1f/d22/d2e/d46/l61 0 2024-09-16T09:45:32.046 INFO:tasks.workunit.client.1.smithi114.stdout:0/294: symlink d1f/d22/l6e 0 2024-09-16T09:45:32.046 INFO:tasks.workunit.client.1.smithi114.stdout:0/295: chown d1f/d27/d55 399 1 2024-09-16T09:45:32.047 INFO:tasks.workunit.client.1.smithi114.stdout:0/296: symlink d1f/l6f 0 2024-09-16T09:45:32.047 INFO:tasks.workunit.client.1.smithi114.stdout:0/297: fsync f14 0 2024-09-16T09:45:32.047 INFO:tasks.workunit.client.1.smithi114.stdout:0/298: mknod d1f/d22/d2e/c70 0 2024-09-16T09:45:32.048 INFO:tasks.workunit.client.1.smithi114.stdout:0/299: creat d1f/d27/d55/f71 x:0 0 0 2024-09-16T09:45:32.049 INFO:tasks.workunit.client.1.smithi114.stdout:5/394: write d3/d11/d7a/d43/f47 [1878071,97351] 0 2024-09-16T09:45:32.050 INFO:tasks.workunit.client.1.smithi114.stdout:5/395: read d3/d11/d71/d72/d2d/d34/f5f [851690,78806] 0 2024-09-16T09:45:32.050 INFO:tasks.workunit.client.1.smithi114.stdout:5/396: chown d3/d11/d7a/c4d 3641 1 2024-09-16T09:45:32.050 INFO:tasks.workunit.client.1.smithi114.stdout:0/300: symlink d1f/d2d/l72 0 2024-09-16T09:45:32.050 INFO:tasks.workunit.client.1.smithi114.stdout:5/397: write d3/d11/d71/d5a/f60 [846156,128475] 0 2024-09-16T09:45:32.050 INFO:tasks.workunit.client.1.smithi114.stdout:5/398: getdents d3/d11/d7a/d43/d4c/d6d/d79 0 2024-09-16T09:45:32.050 INFO:tasks.workunit.client.1.smithi114.stdout:5/399: write d3/d11/d7a/d43/f47 [2307566,57910] 0 2024-09-16T09:45:32.051 INFO:tasks.workunit.client.1.smithi114.stdout:0/301: creat d1f/d20/d48/f73 x:0 0 0 2024-09-16T09:45:32.051 INFO:tasks.workunit.client.1.smithi114.stdout:0/302: write f19 [8441470,53931] 0 2024-09-16T09:45:32.051 INFO:tasks.workunit.client.1.smithi114.stdout:0/303: stat d1f/d27/f5d 0 2024-09-16T09:45:32.051 INFO:tasks.workunit.client.1.smithi114.stdout:5/400: creat d3/d11/d71/d72/d2d/f81 x:0 0 0 2024-09-16T09:45:32.053 INFO:tasks.workunit.client.1.smithi114.stdout:0/304: creat d1f/f74 x:0 0 0 2024-09-16T09:45:32.053 INFO:tasks.workunit.client.1.smithi114.stdout:5/401: rmdir d3/d11/d71/d72/d2d 39 2024-09-16T09:45:32.054 INFO:tasks.workunit.client.1.smithi114.stdout:0/305: mkdir d1f/d20/d48/d75 0 2024-09-16T09:45:32.054 INFO:tasks.workunit.client.1.smithi114.stdout:0/306: readlink d1f/d2d/l72 0 2024-09-16T09:45:32.054 INFO:tasks.workunit.client.1.smithi114.stdout:0/307: readlink d1f/d22/d2e/l35 0 2024-09-16T09:45:32.054 INFO:tasks.workunit.client.1.smithi114.stdout:5/402: rmdir d3/d11/d7a 39 2024-09-16T09:45:32.054 INFO:tasks.workunit.client.1.smithi114.stdout:5/403: write d3/f4 [3948735,94061] 0 2024-09-16T09:45:32.055 INFO:tasks.workunit.client.1.smithi114.stdout:5/404: symlink d3/d11/d71/d72/d2d/l82 0 2024-09-16T09:45:32.055 INFO:tasks.workunit.client.1.smithi114.stdout:9/361: dwrite d3/da/f4d [0,4194304] 0 2024-09-16T09:45:32.056 INFO:tasks.workunit.client.1.smithi114.stdout:5/405: mkdir d3/d11/d7a/d43/d83 0 2024-09-16T09:45:32.061 INFO:tasks.workunit.client.1.smithi114.stdout:6/369: dwrite d6/da/d10/f47 [0,4194304] 0 2024-09-16T09:45:32.061 INFO:tasks.workunit.client.1.smithi114.stdout:8/373: dwrite d4/f15 [0,4194304] 0 2024-09-16T09:45:32.061 INFO:tasks.workunit.client.1.smithi114.stdout:6/370: fdatasync d6/da/d10/f4b 0 2024-09-16T09:45:32.061 INFO:tasks.workunit.client.1.smithi114.stdout:7/435: dwrite d2/f1c [0,4194304] 0 2024-09-16T09:45:32.061 INFO:tasks.workunit.client.1.smithi114.stdout:7/436: truncate d2/d9/d2b/d2e/f8c 579975 0 2024-09-16T09:45:32.062 INFO:tasks.workunit.client.1.smithi114.stdout:9/362: dread d3/f6 [0,4194304] 0 2024-09-16T09:45:32.066 INFO:tasks.workunit.client.1.smithi114.stdout:8/374: write d4/f40 [1805302,44118] 0 2024-09-16T09:45:32.066 INFO:tasks.workunit.client.1.smithi114.stdout:8/375: dread - d4/db/d68/d52/f7b zero size 2024-09-16T09:45:32.067 INFO:tasks.workunit.client.1.smithi114.stdout:6/371: link d6/d2d/f70 d6/da/d36/f75 0 2024-09-16T09:45:32.068 INFO:tasks.workunit.client.1.smithi114.stdout:6/372: stat d6/c4d 0 2024-09-16T09:45:32.070 INFO:tasks.workunit.client.1.smithi114.stdout:9/363: dread d3/da/d10/d23/d29/d2c/d45/f61 [0,4194304] 0 2024-09-16T09:45:32.073 INFO:tasks.workunit.client.1.smithi114.stdout:7/437: mknod d2/d9/d2b/d78/c8f 0 2024-09-16T09:45:32.075 INFO:tasks.workunit.client.1.smithi114.stdout:8/376: creat d4/db/d39/d3c/f81 x:0 0 0 2024-09-16T09:45:32.076 INFO:tasks.workunit.client.1.smithi114.stdout:5/406: dwrite d3/d11/d7a/d43/d58/f74 [0,4194304] 0 2024-09-16T09:45:32.076 INFO:tasks.workunit.client.1.smithi114.stdout:5/407: read - d3/d11/d71/d72/d2d/f81 zero size 2024-09-16T09:45:32.077 INFO:tasks.workunit.client.1.smithi114.stdout:6/373: mkdir d6/da/d76 0 2024-09-16T09:45:32.078 INFO:tasks.workunit.client.1.smithi114.stdout:9/364: mkdir d3/da/d10/d23/d43/d1e/d78 0 2024-09-16T09:45:32.078 INFO:tasks.workunit.client.1.smithi114.stdout:9/365: read d3/da/d10/d23/d43/d1e/d25/f27 [1198331,19948] 0 2024-09-16T09:45:32.078 INFO:tasks.workunit.client.1.smithi114.stdout:9/366: readlink d3/da/d10/d23/d43/d1e/l31 0 2024-09-16T09:45:32.078 INFO:tasks.workunit.client.1.smithi114.stdout:9/367: chown d3/da 206020707 1 2024-09-16T09:45:32.079 INFO:tasks.workunit.client.1.smithi114.stdout:0/308: truncate f19 3403721 0 2024-09-16T09:45:32.080 INFO:tasks.workunit.client.1.smithi114.stdout:8/377: rename d4/db/d3e/d47/d64 to d4/db/d39/d3c/d4e/d82 0 2024-09-16T09:45:32.080 INFO:tasks.workunit.client.1.smithi114.stdout:8/378: rename d4/db/d39/d3c to d4/db/d39/d3c/d4e/d83 22 2024-09-16T09:45:32.080 INFO:tasks.workunit.client.1.smithi114.stdout:8/379: truncate d4/db/d68/d52/d54/f5d 755950 0 2024-09-16T09:45:32.082 INFO:tasks.workunit.client.1.smithi114.stdout:6/374: mkdir d6/da/d36/d51/d62/d77 0 2024-09-16T09:45:32.082 INFO:tasks.workunit.client.1.smithi114.stdout:6/375: fdatasync d6/d2d/f3c 0 2024-09-16T09:45:32.083 INFO:tasks.workunit.client.1.smithi114.stdout:9/368: link d3/da/l44 d3/da/d10/d23/d29/d2c/d6b/d68/l79 0 2024-09-16T09:45:32.085 INFO:tasks.workunit.client.1.smithi114.stdout:6/376: rename d6/da/l61 to d6/da/d76/l78 0 2024-09-16T09:45:32.086 INFO:tasks.workunit.client.1.smithi114.stdout:9/369: symlink d3/da/l7a 0 2024-09-16T09:45:32.087 INFO:tasks.workunit.client.1.smithi114.stdout:5/408: read d3/d11/d7a/d43/f51 [4004539,27857] 0 2024-09-16T09:45:32.087 INFO:tasks.workunit.client.1.smithi114.stdout:0/309: link d1f/d2d/l42 d1f/d20/d48/d75/l76 0 2024-09-16T09:45:32.087 INFO:tasks.workunit.client.1.smithi114.stdout:0/310: chown d1f/c31 638497 1 2024-09-16T09:45:32.087 INFO:tasks.workunit.client.1.smithi114.stdout:0/311: chown d1f/d22/d2e/f40 3130868 1 2024-09-16T09:45:32.087 INFO:tasks.workunit.client.1.smithi114.stdout:0/312: dread - d1f/d22/f49 zero size 2024-09-16T09:45:32.088 INFO:tasks.workunit.client.1.smithi114.stdout:8/380: dread d4/f15 [0,4194304] 0 2024-09-16T09:45:32.088 INFO:tasks.workunit.client.1.smithi114.stdout:8/381: fdatasync d4/db/d3e/d71/f79 0 2024-09-16T09:45:32.089 INFO:tasks.workunit.client.1.smithi114.stdout:0/313: mknod d1f/d27/c77 0 2024-09-16T09:45:32.091 INFO:tasks.workunit.client.1.smithi114.stdout:8/382: mkdir d4/db/d39/d3c/d84 0 2024-09-16T09:45:32.092 INFO:tasks.workunit.client.1.smithi114.stdout:8/383: symlink d4/db/d3e/d71/d78/l85 0 2024-09-16T09:45:32.093 INFO:tasks.workunit.client.1.smithi114.stdout:0/314: dread d1f/d20/d48/f4e [0,4194304] 0 2024-09-16T09:45:32.093 INFO:tasks.workunit.client.1.smithi114.stdout:8/384: mkdir d4/db/d39/d3c/d86 0 2024-09-16T09:45:32.095 INFO:tasks.workunit.client.1.smithi114.stdout:0/315: creat d1f/d20/d48/f78 x:0 0 0 2024-09-16T09:45:32.095 INFO:tasks.workunit.client.1.smithi114.stdout:0/316: write d1f/d27/f5d [405223,95577] 0 2024-09-16T09:45:32.095 INFO:tasks.workunit.client.1.smithi114.stdout:0/317: readlink d1f/d20/d48/d75/l76 0 2024-09-16T09:45:32.095 INFO:tasks.workunit.client.1.smithi114.stdout:5/409: write d3/d11/d71/d72/d2d/d3f/d59/f6f [3277241,124498] 0 2024-09-16T09:45:32.096 INFO:tasks.workunit.client.1.smithi114.stdout:5/410: fsync d3/d11/d7a/d43/d58/f7c 0 2024-09-16T09:45:32.097 INFO:tasks.workunit.client.1.smithi114.stdout:8/385: creat d4/db/d3e/d71/f87 x:0 0 0 2024-09-16T09:45:32.097 INFO:tasks.workunit.client.1.smithi114.stdout:8/386: fsync d4/db/d3e/d71/f3d 0 2024-09-16T09:45:32.097 INFO:tasks.workunit.client.1.smithi114.stdout:8/387: write d4/db/d3e/f7c [1009286,29158] 0 2024-09-16T09:45:32.097 INFO:tasks.workunit.client.1.smithi114.stdout:8/388: stat d4/db/d39/d3c/f6b 0 2024-09-16T09:45:32.097 INFO:tasks.workunit.client.1.smithi114.stdout:0/318: symlink d1f/d27/d47/l79 0 2024-09-16T09:45:32.097 INFO:tasks.workunit.client.1.smithi114.stdout:8/389: read d4/db/d68/d30/f33 [386385,26532] 0 2024-09-16T09:45:32.099 INFO:tasks.workunit.client.1.smithi114.stdout:0/319: rmdir d1f/d27/d47/d56 39 2024-09-16T09:45:32.101 INFO:tasks.workunit.client.1.smithi114.stdout:8/390: rmdir d4/db/d39/d3c/d4e/d82/d72 39 2024-09-16T09:45:32.101 INFO:tasks.workunit.client.1.smithi114.stdout:5/411: write d3/d11/d71/d72/f10 [2612647,8279] 0 2024-09-16T09:45:32.102 INFO:tasks.workunit.client.1.smithi114.stdout:0/320: dread d1f/d22/d2e/f40 [0,4194304] 0 2024-09-16T09:45:32.103 INFO:tasks.workunit.client.1.smithi114.stdout:5/412: rename d3/d11 to d3/d24/d84 0 2024-09-16T09:45:32.105 INFO:tasks.workunit.client.1.smithi114.stdout:0/321: mkdir d1f/d2d/d7a 0 2024-09-16T09:45:32.105 INFO:tasks.workunit.client.1.smithi114.stdout:0/322: dread - d1f/d22/d2e/d46/f5f zero size 2024-09-16T09:45:32.106 INFO:tasks.workunit.client.1.smithi114.stdout:0/323: creat d1f/d22/d2e/d46/f7b x:0 0 0 2024-09-16T09:45:32.107 INFO:tasks.workunit.client.1.smithi114.stdout:6/377: getdents d6/da/d76 0 2024-09-16T09:45:32.110 INFO:tasks.workunit.client.1.smithi114.stdout:0/324: symlink d1f/d22/l7c 0 2024-09-16T09:45:32.110 INFO:tasks.workunit.client.1.smithi114.stdout:6/378: symlink d6/l79 0 2024-09-16T09:45:32.110 INFO:tasks.workunit.client.1.smithi114.stdout:6/379: chown d6/da/d36/f75 159 1 2024-09-16T09:45:32.111 INFO:tasks.workunit.client.1.smithi114.stdout:8/391: read d4/db/f22 [1228899,46044] 0 2024-09-16T09:45:32.111 INFO:tasks.workunit.client.1.smithi114.stdout:0/325: mknod d1f/d22/d2e/d46/c7d 0 2024-09-16T09:45:32.112 INFO:tasks.workunit.client.1.smithi114.stdout:6/380: link d6/c66 d6/da/d36/c7a 0 2024-09-16T09:45:32.112 INFO:tasks.workunit.client.1.smithi114.stdout:0/326: getdents d1f 0 2024-09-16T09:45:32.116 INFO:tasks.workunit.client.1.smithi114.stdout:6/381: dread d6/da/f15 [0,4194304] 0 2024-09-16T09:45:32.118 INFO:tasks.workunit.client.1.smithi114.stdout:6/382: mkdir d6/da/d36/d51/d62/d77/d7b 0 2024-09-16T09:45:32.120 INFO:tasks.workunit.client.1.smithi114.stdout:6/383: mknod d6/da/d36/d51/d62/d77/c7c 0 2024-09-16T09:45:32.121 INFO:tasks.workunit.client.1.smithi114.stdout:6/384: mknod d6/d2d/d46/c7d 0 2024-09-16T09:45:32.121 INFO:tasks.workunit.client.1.smithi114.stdout:6/385: chown d6/da/d36/d51/f6b 200511635 1 2024-09-16T09:45:32.121 INFO:tasks.workunit.client.1.smithi114.stdout:6/386: write d6/da/d36/d51/f6b [877646,10713] 0 2024-09-16T09:45:32.121 INFO:tasks.workunit.client.1.smithi114.stdout:6/387: creat d6/da/d36/d51/d62/f7e x:0 0 0 2024-09-16T09:45:32.121 INFO:tasks.workunit.client.1.smithi114.stdout:6/388: chown d6/da/d36/f3b 840847 1 2024-09-16T09:45:32.124 INFO:tasks.workunit.client.1.smithi114.stdout:6/389: mknod d6/d2d/c7f 0 2024-09-16T09:45:32.124 INFO:tasks.workunit.client.1.smithi114.stdout:6/390: dread - d6/da/d36/f75 zero size 2024-09-16T09:45:32.128 INFO:tasks.workunit.client.1.smithi114.stdout:8/392: dwrite d4/db/dd/f44 [0,4194304] 0 2024-09-16T09:45:32.149 INFO:tasks.workunit.client.1.smithi114.stdout:6/391: dwrite d6/d2d/f37 [0,4194304] 0 2024-09-16T09:45:32.149 INFO:tasks.workunit.client.1.smithi114.stdout:8/393: dwrite d4/db/d3e/d71/f87 [0,4194304] 0 2024-09-16T09:45:32.164 INFO:tasks.workunit.client.1.smithi114.stdout:6/392: dread d6/da/f67 [0,4194304] 0 2024-09-16T09:45:32.165 INFO:tasks.workunit.client.1.smithi114.stdout:6/393: symlink d6/da/d36/d51/d62/d77/l80 0 2024-09-16T09:45:32.169 INFO:tasks.workunit.client.1.smithi114.stdout:6/394: mknod d6/d2d/d46/c81 0 2024-09-16T09:45:32.169 INFO:tasks.workunit.client.1.smithi114.stdout:6/395: chown d6/da/d36/l41 67 1 2024-09-16T09:45:32.172 INFO:tasks.workunit.client.1.smithi114.stdout:1/385: sync 2024-09-16T09:45:32.172 INFO:tasks.workunit.client.1.smithi114.stdout:1/386: chown d4/d2b/f27 15571479 1 2024-09-16T09:45:32.172 INFO:tasks.workunit.client.1.smithi114.stdout:1/387: fdatasync d4/d2b/d16/d71/f7b 0 2024-09-16T09:45:32.172 INFO:tasks.workunit.client.1.smithi114.stdout:3/519: sync 2024-09-16T09:45:32.173 INFO:tasks.workunit.client.1.smithi114.stdout:2/401: sync 2024-09-16T09:45:32.173 INFO:tasks.workunit.client.1.smithi114.stdout:4/378: sync 2024-09-16T09:45:32.174 INFO:tasks.workunit.client.1.smithi114.stdout:6/396: dread d6/da/f15 [0,4194304] 0 2024-09-16T09:45:32.176 INFO:tasks.workunit.client.1.smithi114.stdout:3/520: rename dc/c1b to dc/de/d17/d2d/db4/cbd 0 2024-09-16T09:45:32.176 INFO:tasks.workunit.client.1.smithi114.stdout:3/521: truncate dc/de/d17/d2d/db4/d26/f4d 396870 0 2024-09-16T09:45:32.177 INFO:tasks.workunit.client.1.smithi114.stdout:4/379: rename d0/c1c to d0/d26/d3c/d3e/d5a/c73 0 2024-09-16T09:45:32.178 INFO:tasks.workunit.client.1.smithi114.stdout:3/522: creat dc/de/d17/d2d/db4/d6a/d77/d7f/fbe x:0 0 0 2024-09-16T09:45:32.179 INFO:tasks.workunit.client.1.smithi114.stdout:4/380: mkdir d0/d26/d3c/d74 0 2024-09-16T09:45:32.179 INFO:tasks.workunit.client.1.smithi114.stdout:4/381: chown d0/d26/d3c/d3e/d4b/d46/f68 10794 1 2024-09-16T09:45:32.180 INFO:tasks.workunit.client.1.smithi114.stdout:2/402: dread d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f56 [0,4194304] 0 2024-09-16T09:45:32.180 INFO:tasks.workunit.client.1.smithi114.stdout:3/523: write dc/de/d18/f30 [1267561,58832] 0 2024-09-16T09:45:32.180 INFO:tasks.workunit.client.1.smithi114.stdout:4/382: mkdir d0/d26/d40/d75 0 2024-09-16T09:45:32.181 INFO:tasks.workunit.client.1.smithi114.stdout:2/403: mkdir d1/d9e 0 2024-09-16T09:45:32.181 INFO:tasks.workunit.client.1.smithi114.stdout:2/404: dread - d1/d8/f8b zero size 2024-09-16T09:45:32.182 INFO:tasks.workunit.client.1.smithi114.stdout:3/524: dread dc/de/d1f/f29 [0,4194304] 0 2024-09-16T09:45:32.183 INFO:tasks.workunit.client.1.smithi114.stdout:3/525: chown dc/de/d17/c36 1 1 2024-09-16T09:45:32.183 INFO:tasks.workunit.client.1.smithi114.stdout:3/526: symlink dc/de/d1f/lbf 0 2024-09-16T09:45:32.186 INFO:tasks.workunit.client.1.smithi114.stdout:3/527: creat dc/de/d17/d2d/db4/d6a/d77/d7f/fc0 x:0 0 0 2024-09-16T09:45:32.187 INFO:tasks.workunit.client.1.smithi114.stdout:4/383: dread d0/d26/d3c/d3e/f6a [0,4194304] 0 2024-09-16T09:45:32.187 INFO:tasks.workunit.client.1.smithi114.stdout:3/528: unlink dc/de/d18/f2c 0 2024-09-16T09:45:32.190 INFO:tasks.workunit.client.1.smithi114.stdout:4/384: rename d0/d26/d3c/l43 to d0/d26/d2e/l76 0 2024-09-16T09:45:32.192 INFO:tasks.workunit.client.1.smithi114.stdout:4/385: symlink d0/l77 0 2024-09-16T09:45:32.194 INFO:tasks.workunit.client.1.smithi114.stdout:4/386: rename d0/l1a to d0/d26/d29/l78 0 2024-09-16T09:45:32.198 INFO:tasks.workunit.client.1.smithi114.stdout:4/387: dread d0/f20 [0,4194304] 0 2024-09-16T09:45:32.207 INFO:tasks.workunit.client.1.smithi114.stdout:1/388: dwrite d4/d2b/f9 [4194304,4194304] 0 2024-09-16T09:45:32.207 INFO:tasks.workunit.client.1.smithi114.stdout:1/389: chown d4/c3f 6423589 1 2024-09-16T09:45:32.207 INFO:tasks.workunit.client.1.smithi114.stdout:1/390: stat d4/c18 0 2024-09-16T09:45:32.207 INFO:tasks.workunit.client.1.smithi114.stdout:1/391: chown d4/d2b/d16/d71/d72/c7a 1839492745 1 2024-09-16T09:45:32.208 INFO:tasks.workunit.client.1.smithi114.stdout:1/392: creat d4/d2b/d2f/d3a/d55/f7e x:0 0 0 2024-09-16T09:45:32.208 INFO:tasks.workunit.client.1.smithi114.stdout:1/393: chown d4/d2b/d16/l31 328139 1 2024-09-16T09:45:32.208 INFO:tasks.workunit.client.1.smithi114.stdout:1/394: stat d4/d2b 0 2024-09-16T09:45:32.215 INFO:tasks.workunit.client.1.smithi114.stdout:6/397: dwrite f5 [8388608,4194304] 0 2024-09-16T09:45:32.217 INFO:tasks.workunit.client.1.smithi114.stdout:2/405: dwrite d1/d8/f12 [8388608,4194304] 0 2024-09-16T09:45:32.218 INFO:tasks.workunit.client.1.smithi114.stdout:3/529: dwrite dc/de/d18/f35 [0,4194304] 0 2024-09-16T09:45:32.218 INFO:tasks.workunit.client.1.smithi114.stdout:6/398: mkdir d6/da/d10/d40/d82 0 2024-09-16T09:45:32.220 INFO:tasks.workunit.client.1.smithi114.stdout:3/530: mkdir dc/de/d18/d78/d5c/d6e/dc1 0 2024-09-16T09:45:32.220 INFO:tasks.workunit.client.1.smithi114.stdout:3/531: write dc/de/d18/d78/d5c/d5d/f76 [969607,43169] 0 2024-09-16T09:45:32.220 INFO:tasks.workunit.client.1.smithi114.stdout:6/399: truncate d6/d2d/f37 4073270 0 2024-09-16T09:45:32.221 INFO:tasks.workunit.client.1.smithi114.stdout:6/400: write d6/da/d10/d40/f72 [987745,95955] 0 2024-09-16T09:45:32.221 INFO:tasks.workunit.client.1.smithi114.stdout:6/401: fdatasync d6/da/d10/d40/f50 0 2024-09-16T09:45:32.223 INFO:tasks.workunit.client.1.smithi114.stdout:3/532: mkdir dc/de/d18/d78/d5c/d6e/dc2 0 2024-09-16T09:45:32.225 INFO:tasks.workunit.client.1.smithi114.stdout:6/402: creat d6/d2d/d46/f83 x:0 0 0 2024-09-16T09:45:32.227 INFO:tasks.workunit.client.1.smithi114.stdout:6/403: dread d6/da/d36/f4f [0,4194304] 0 2024-09-16T09:45:32.229 INFO:tasks.workunit.client.1.smithi114.stdout:6/404: creat d6/d64/f84 x:0 0 0 2024-09-16T09:45:32.230 INFO:tasks.workunit.client.1.smithi114.stdout:6/405: truncate d6/da/d36/f3d 1072884 0 2024-09-16T09:45:32.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/395: dwrite d4/d2b/d2f/d3a/d56/f7d [0,4194304] 0 2024-09-16T09:45:32.237 INFO:tasks.workunit.client.1.smithi114.stdout:2/406: dwrite d1/f7b [0,4194304] 0 2024-09-16T09:45:32.238 INFO:tasks.workunit.client.1.smithi114.stdout:1/396: creat d4/d2b/d16/d71/d72/d75/f7f x:0 0 0 2024-09-16T09:45:32.243 INFO:tasks.workunit.client.1.smithi114.stdout:2/407: truncate d1/d8/f12 2859585 0 2024-09-16T09:45:32.246 INFO:tasks.workunit.client.1.smithi114.stdout:2/408: mkdir d1/d8/d10/d16/d1d/d4a/d3e/d5b/d78/d9f 0 2024-09-16T09:45:32.247 INFO:tasks.workunit.client.1.smithi114.stdout:2/409: creat d1/d8/d10/d16/d1d/d4a/d3e/fa0 x:0 0 0 2024-09-16T09:45:32.248 INFO:tasks.workunit.client.1.smithi114.stdout:3/533: dwrite dc/f65 [0,4194304] 0 2024-09-16T09:45:32.251 INFO:tasks.workunit.client.1.smithi114.stdout:3/534: getdents dc/de/d18/d78/d5c 0 2024-09-16T09:45:32.251 INFO:tasks.workunit.client.1.smithi114.stdout:3/535: dread - dc/de/d37/d3d/fbb zero size 2024-09-16T09:45:32.252 INFO:tasks.workunit.client.1.smithi114.stdout:6/406: rename d6/da/d36/f3d to d6/f85 0 2024-09-16T09:45:32.265 INFO:tasks.workunit.client.1.smithi114.stdout:1/397: dwrite d4/d2b/d16/f7c [0,4194304] 0 2024-09-16T09:45:32.268 INFO:tasks.workunit.client.1.smithi114.stdout:1/398: symlink d4/l80 0 2024-09-16T09:45:32.268 INFO:tasks.workunit.client.1.smithi114.stdout:1/399: read d4/d3d/d41/d42/d58/f5c [2703465,50710] 0 2024-09-16T09:45:32.268 INFO:tasks.workunit.client.1.smithi114.stdout:1/400: readlink d4/l15 0 2024-09-16T09:45:32.269 INFO:tasks.workunit.client.1.smithi114.stdout:1/401: unlink d4/d2b/d16/c60 0 2024-09-16T09:45:32.273 INFO:tasks.workunit.client.1.smithi114.stdout:2/410: dwrite d1/d8/d10/d16/d1d/d4a/d3e/d5b/d63/f56 [0,4194304] 0 2024-09-16T09:45:32.276 INFO:tasks.workunit.client.1.smithi114.stdout:6/407: dwrite d6/da/d36/d51/f6b [0,4194304] 0 2024-09-16T09:45:32.277 INFO:tasks.workunit.client.1.smithi114.stdout:2/411: symlink d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b/la1 0 2024-09-16T09:45:32.277 INFO:tasks.workunit.client.1.smithi114.stdout:2/412: write d1/d8/d10/f9b [120323,61973] 0 2024-09-16T09:45:32.301 INFO:tasks.workunit.client.1.smithi114.stdout:6/408: dwrite d6/da/d36/f38 [0,4194304] 0 2024-09-16T09:45:32.301 INFO:tasks.workunit.client.1.smithi114.stdout:2/413: dwrite d1/d8/f7a [0,4194304] 0 2024-09-16T09:45:32.301 INFO:tasks.workunit.client.1.smithi114.stdout:2/414: stat d1/d8/d10/d16/d1d/d4a/d3e/d5b/d68/d4b 0 2024-09-16T09:45:32.301 INFO:tasks.workunit.client.1.smithi114.stdout:1/402: dwrite d4/d2b/f14 [0,4194304] 0 2024-09-16T09:45:32.304 INFO:tasks.workunit.client.1.smithi114.stdout:2/415: rename d1/d8/l2a to d1/d8/d10/d16/d1d/d4a/d3e/d5b/d78/d9f/la2 0 2024-09-16T09:45:32.304 INFO:tasks.workunit.client.1.smithi114.stdout:1/403: mkdir d4/d2b/d16/d71/d81 0 2024-09-16T09:45:32.305 INFO:tasks.workunit.client.1.smithi114.stdout:2/416: mkdir d1/d8/d10/d16/d1d/d92/da3 0 2024-09-16T09:45:32.305 INFO:tasks.workunit.client.1.smithi114.stdout:2/417: chown d1/d9e 6282 1 2024-09-16T09:45:32.306 INFO:tasks.workunit.client.1.smithi114.stdout:1/404: mknod d4/d2b/d16/d47/c82 0 2024-09-16T09:45:32.307 INFO:tasks.workunit.client.1.smithi114.stdout:2/418: creat d1/d8/fa4 x:0 0 0 2024-09-16T09:45:32.307 INFO:tasks.workunit.client.1.smithi114.stdout:1/405: rmdir d4/d3d/d41/d42/d58 39 2024-09-16T09:45:32.307 INFO:tasks.workunit.client.1.smithi114.stdout:1/406: write d4/d2b/d29/f5e [796705,53346] 0 2024-09-16T09:45:32.309 INFO:tasks.workunit.client.1.smithi114.stdout:1/407: mkdir d4/d2b/d16/d47/d83 0 2024-09-16T09:45:32.310 INFO:tasks.workunit.client.1.smithi114.stdout:2/419: dread d1/d8/d10/d16/d1d/f1e [0,4194304] 0 2024-09-16T09:45:32.310 INFO:tasks.workunit.client.1.smithi114.stdout:2/420: chown d1/d8/l19 0 1 2024-09-16T09:45:32.310 INFO:tasks.workunit.client.1.smithi114.stdout:1/408: link d4/d2b/f3c d4/d2b/d16/f84 0 2024-09-16T09:45:32.310 INFO:tasks.workunit.client.1.smithi114.stdout:1/409: readlink d4/l11 0 2024-09-16T09:45:32.312 INFO:tasks.workunit.client.1.smithi114.stdout:1/410: dread d4/d2b/f3c [0,4194304] 0 2024-09-16T09:45:32.312 INFO:tasks.workunit.client.1.smithi114.stdout:1/411: mknod d4/d3d/d41/c85 0 2024-09-16T09:45:32.317 INFO:tasks.workunit.client.1.smithi114.stdout:7/438: sync 2024-09-16T09:45:32.317 INFO:tasks.workunit.client.1.smithi114.stdout:5/413: sync 2024-09-16T09:45:32.317 INFO:tasks.workunit.client.1.smithi114.stdout:9/370: sync 2024-09-16T09:45:32.317 INFO:tasks.workunit.client.1.smithi114.stdout:0/327: sync 2024-09-16T09:45:32.318 INFO:tasks.workunit.client.1.smithi114.stdout:0/328: mkdir d1f/d27/d47/d56/d7e 0 2024-09-16T09:45:32.319 INFO:tasks.workunit.client.1.smithi114.stdout:5/414: mknod d3/d24/d84/d7a/d43/d58/c85 0 2024-09-16T09:45:32.320 INFO:tasks.workunit.client.1.smithi114.stdout:0/329: write d1f/d20/d48/f4e [519733,87947] 0 2024-09-16T09:45:32.320 INFO:tasks.workunit.client.1.smithi114.stdout:0/330: chown d1f/d27/d47/l4d 858928532 1 2024-09-16T09:45:32.325 INFO:tasks.workunit.client.1.smithi114.stdout:6/409: dwrite d6/f44 [0,4194304] 0 2024-09-16T09:45:32.328 INFO:tasks.workunit.client.1.smithi114.stdout:7/439: dread d2/d9/d2b/d2e/d3e/f44 [0,4194304] 0 2024-09-16T09:45:32.330 INFO:tasks.workunit.client.1.smithi114.stdout:7/440: symlink d2/d9/d2b/d59/d7f/l90 0 2024-09-16T09:45:32.330 INFO:tasks.workunit.client.1.smithi114.stdout:7/441: fsync d2/d9/d2b/d2e/d3e/d79/f8a 0 2024-09-16T09:45:32.332 INFO:tasks.workunit.client.1.smithi114.stdout:2/421: dwrite d1/d8/d10/f25 [0,4194304] 0 2024-09-16T09:45:32.333 INFO:tasks.workunit.client.1.smithi114.stdout:5/415: dread d3/d24/d84/d71/d72/d2d/d3f/f55 [0,4194304] 0 2024-09-16T09:45:32.336 INFO:tasks.workunit.client.1.smithi114.stdout:2/422: creat d1/d8/d10/d16/d1d/d4a/d3e/fa5 x:0 0 0 2024-09-16T09:45:32.336 INFO:tasks.workunit.client.1.smithi114.stdout:2/423: stat d1/f2c 0 2024-09-16T09:45:32.338 INFO:tasks.workunit.client.1.smithi114.stdout:5/416: symlink d3/d24/d84/d7a/d43/d83/l86 0 2024-09-16T09:45:32.339 INFO:tasks.workunit.client.1.smithi114.stdout:2/424: mknod d1/d8/d10/d16/d98/ca6 0 2024-09-16T09:45:32.340 INFO:tasks.workunit.client.1.smithi114.stdout:5/417: mkdir d3/d24/d84/d71/d72/d2d/d87 0 2024-09-16T09:45:32.341 INFO:tasks.workunit.client.1.smithi114.stdout:0/331: dread f6 [0,4194304] 0 2024-09-16T09:45:32.341 INFO:tasks.workunit.client.1.smithi114.stdout:2/425: truncate d1/d8/d10/f35 7594084 0 2024-09-16T09:45:32.341 INFO:tasks.workunit.client.1.smithi114.stdout:0/332: mkdir d1f/d22/d2e/d46/d7f 0 2024-09-16T09:45:32.342 INFO:tasks.workunit.client.1.smithi114.stdout:0/333: chown d1f/d2d/l42 766 1 2024-09-16T09:45:32.343 INFO:tasks.workunit.client.1.smithi114.stdout:0/334: symlink d1f/d20/d48/d75/l80 0 2024-09-16T09:45:32.343 INFO:tasks.workunit.client.1.smithi114.stdout:0/335: chown d1f/d27/d47/l4d 115309479 1 2024-09-16T09:45:32.344 INFO:tasks.workunit.client.1.smithi114.stdout:5/418: dread d3/d1f/f27 [0,4194304] 0 2024-09-16T09:45:32.345 INFO:tasks.workunit.client.1.smithi114.stdout:5/419: creat d3/d24/d84/d7a/f88 x:0 0 0 2024-09-16T09:45:32.345 INFO:tasks.workunit.client.1.smithi114.stdout:5/420: mknod d3/d24/d84/d71/d72/d2d/d3f/d59/d78/c89 0 2024-09-16T09:45:32.347 INFO:tasks.workunit.client.1.smithi114.stdout:5/421: mknod d3/d24/d84/d71/d72/d52/c8a 0 2024-09-16T09:45:32.347 INFO:tasks.workunit.client.1.smithi114.stdout:5/422: stat d3/d24/d84/d71/l76 0 2024-09-16T09:45:32.347 INFO:tasks.workunit.client.1.smithi114.stdout:5/423: write d3/d24/d84/d71/d72/f10 [290859,65935] 0 2024-09-16T09:45:32.349 INFO:tasks.workunit.client.1.smithi114.stdout:2/426: rename d1/d8/d10/d16/d1d/d4a to d1/d8/d10/d16/d1d/d92/da7 0 2024-09-16T09:45:32.350 INFO:tasks.workunit.client.1.smithi114.stdout:1/412: dwrite d4/d2b/f1e [0,4194304] 0 2024-09-16T09:45:32.351 INFO:tasks.workunit.client.1.smithi114.stdout:5/424: dread d3/d24/d84/d71/d72/d2d/d34/f3d [0,4194304] 0 2024-09-16T09:45:32.352 INFO:tasks.workunit.client.1.smithi114.stdout:2/427: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f95 [103750,86537] 0 2024-09-16T09:45:32.352 INFO:tasks.workunit.client.1.smithi114.stdout:2/428: chown d1/d8/f8b 439536 1 2024-09-16T09:45:32.352 INFO:tasks.workunit.client.1.smithi114.stdout:2/429: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 zero size 2024-09-16T09:45:32.353 INFO:tasks.workunit.client.1.smithi114.stdout:5/425: creat d3/d24/d84/d71/f8b x:0 0 0 2024-09-16T09:45:32.354 INFO:tasks.workunit.client.1.smithi114.stdout:9/371: dwrite d3/da/d10/d23/f73 [0,4194304] 0 2024-09-16T09:45:32.354 INFO:tasks.workunit.client.1.smithi114.stdout:9/372: write d3/da/d10/d23/d29/d2c/f35 [1028808,124531] 0 2024-09-16T09:45:32.354 INFO:tasks.workunit.client.1.smithi114.stdout:9/373: write d3/da/d10/d23/d29/d2c/d45/f65 [715760,75336] 0 2024-09-16T09:45:32.358 INFO:tasks.workunit.client.1.smithi114.stdout:5/426: mkdir d3/d1f/d8c 0 2024-09-16T09:45:32.358 INFO:tasks.workunit.client.1.smithi114.stdout:1/413: dread d4/f25 [0,4194304] 0 2024-09-16T09:45:32.358 INFO:tasks.workunit.client.1.smithi114.stdout:6/410: dwrite d6/d2d/f54 [4194304,4194304] 0 2024-09-16T09:45:32.361 INFO:tasks.workunit.client.1.smithi114.stdout:9/374: mkdir d3/da/d10/d23/d43/d1e/d7b 0 2024-09-16T09:45:32.361 INFO:tasks.workunit.client.1.smithi114.stdout:2/430: getdents d1/d8/d10/d16/d1d/d92 0 2024-09-16T09:45:32.361 INFO:tasks.workunit.client.1.smithi114.stdout:5/427: chown d3/l3a 6 1 2024-09-16T09:45:32.362 INFO:tasks.workunit.client.1.smithi114.stdout:1/414: symlink d4/d2b/d2f/d3a/l86 0 2024-09-16T09:45:32.365 INFO:tasks.workunit.client.1.smithi114.stdout:0/336: dwrite d1f/d27/f3b [0,4194304] 0 2024-09-16T09:45:32.365 INFO:tasks.workunit.client.1.smithi114.stdout:2/431: symlink d1/d8/la8 0 2024-09-16T09:45:32.365 INFO:tasks.workunit.client.1.smithi114.stdout:2/432: getdents d1/d8/d10/d16/d60 0 2024-09-16T09:45:32.366 INFO:tasks.workunit.client.1.smithi114.stdout:9/375: rename d3/da/d10/f20 to d3/da/d10/d23/d29/d2c/d70/f7c 0 2024-09-16T09:45:32.367 INFO:tasks.workunit.client.1.smithi114.stdout:9/376: chown d3/da/d10/d23/d43/d1e/f5e 607 1 2024-09-16T09:45:32.367 INFO:tasks.workunit.client.1.smithi114.stdout:5/428: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/f8d x:0 0 0 2024-09-16T09:45:32.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/394: sync 2024-09-16T09:45:32.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/395: chown d4/db/d68/d28/f67 6549 1 2024-09-16T09:45:32.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/396: dread - d4/db/d3e/d71/f79 zero size 2024-09-16T09:45:32.367 INFO:tasks.workunit.client.1.smithi114.stdout:2/433: link d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f40 d1/d8/d10/d5a/fa9 0 2024-09-16T09:45:32.368 INFO:tasks.workunit.client.1.smithi114.stdout:8/397: creat d4/db/f88 x:0 0 0 2024-09-16T09:45:32.370 INFO:tasks.workunit.client.1.smithi114.stdout:2/434: rename d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/c43 to d1/caa 0 2024-09-16T09:45:32.371 INFO:tasks.workunit.client.1.smithi114.stdout:8/398: creat d4/db/d68/d28/f89 x:0 0 0 2024-09-16T09:45:32.377 INFO:tasks.workunit.client.1.smithi114.stdout:2/435: dread d1/d8/d10/d16/d1d/f34 [0,4194304] 0 2024-09-16T09:45:32.379 INFO:tasks.workunit.client.1.smithi114.stdout:2/436: mknod d1/d8/d10/d16/d1d/d92/da3/cab 0 2024-09-16T09:45:32.381 INFO:tasks.workunit.client.1.smithi114.stdout:2/437: dread d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f95 [0,4194304] 0 2024-09-16T09:45:32.382 INFO:tasks.workunit.client.1.smithi114.stdout:2/438: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/f48 0 2024-09-16T09:45:32.382 INFO:tasks.workunit.client.1.smithi114.stdout:9/377: write d3/da/d10/d23/d43/d1e/d25/f6f [3602956,48884] 0 2024-09-16T09:45:32.383 INFO:tasks.workunit.client.1.smithi114.stdout:9/378: mkdir d3/d7d 0 2024-09-16T09:45:32.383 INFO:tasks.workunit.client.1.smithi114.stdout:9/379: readlink d3/da/l7a 0 2024-09-16T09:45:32.384 INFO:tasks.workunit.client.1.smithi114.stdout:9/380: link d3/da/f2a d3/da/d10/d23/f7e 0 2024-09-16T09:45:32.385 INFO:tasks.workunit.client.1.smithi114.stdout:9/381: getdents d3/d7d 0 2024-09-16T09:45:32.385 INFO:tasks.workunit.client.1.smithi114.stdout:9/382: rmdir d3 39 2024-09-16T09:45:32.398 INFO:tasks.workunit.client.1.smithi114.stdout:6/411: dwrite d6/da/d10/f25 [0,4194304] 0 2024-09-16T09:45:32.398 INFO:tasks.workunit.client.1.smithi114.stdout:6/412: fsync d6/da/d10/f16 0 2024-09-16T09:45:32.398 INFO:tasks.workunit.client.1.smithi114.stdout:6/413: readlink d6/l79 0 2024-09-16T09:45:32.398 INFO:tasks.workunit.client.1.smithi114.stdout:1/415: dwrite d4/d2b/d2f/d3a/d55/f63 [0,4194304] 0 2024-09-16T09:45:32.400 INFO:tasks.workunit.client.1.smithi114.stdout:2/439: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f74 [0,4194304] 0 2024-09-16T09:45:32.401 INFO:tasks.workunit.client.1.smithi114.stdout:0/337: dwrite f3 [0,4194304] 0 2024-09-16T09:45:32.402 INFO:tasks.workunit.client.1.smithi114.stdout:0/338: write d1f/d22/f2b [2036906,14772] 0 2024-09-16T09:45:32.402 INFO:tasks.workunit.client.1.smithi114.stdout:6/414: truncate d6/da/d10/d40/f43 1750276 0 2024-09-16T09:45:32.402 INFO:tasks.workunit.client.1.smithi114.stdout:6/415: write d6/da/f2c [700212,82736] 0 2024-09-16T09:45:32.403 INFO:tasks.workunit.client.1.smithi114.stdout:5/429: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/f8d 0 2024-09-16T09:45:32.403 INFO:tasks.workunit.client.1.smithi114.stdout:5/430: read d3/d24/d84/d71/d72/d2d/d3f/d59/f6f [4079259,13206] 0 2024-09-16T09:45:32.405 INFO:tasks.workunit.client.1.smithi114.stdout:1/416: rename d4/d2b/d2f/d3a/c76 to d4/d2b/d2f/c87 0 2024-09-16T09:45:32.408 INFO:tasks.workunit.client.1.smithi114.stdout:6/416: rmdir d6/d64 39 2024-09-16T09:45:32.409 INFO:tasks.workunit.client.1.smithi114.stdout:6/417: write d6/da/d10/f33 [242866,57432] 0 2024-09-16T09:45:32.409 INFO:tasks.workunit.client.1.smithi114.stdout:6/418: write d6/da/d36/f75 [497835,59217] 0 2024-09-16T09:45:32.410 INFO:tasks.workunit.client.1.smithi114.stdout:6/419: write d6/d2d/f34 [2976703,55462] 0 2024-09-16T09:45:32.410 INFO:tasks.workunit.client.1.smithi114.stdout:5/431: creat d3/d24/d84/d71/d72/d2d/d87/f8e x:0 0 0 2024-09-16T09:45:32.411 INFO:tasks.workunit.client.1.smithi114.stdout:0/339: write f3 [1490002,12575] 0 2024-09-16T09:45:32.411 INFO:tasks.workunit.client.1.smithi114.stdout:0/340: fdatasync d1f/d20/f51 0 2024-09-16T09:45:32.412 INFO:tasks.workunit.client.1.smithi114.stdout:2/440: rename d1/d8/l17 to d1/d8/d82/lac 0 2024-09-16T09:45:32.412 INFO:tasks.workunit.client.1.smithi114.stdout:2/441: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f8e 3863 1 2024-09-16T09:45:32.412 INFO:tasks.workunit.client.1.smithi114.stdout:5/432: dread d3/d24/d84/d71/d5a/f60 [0,4194304] 0 2024-09-16T09:45:32.413 INFO:tasks.workunit.client.1.smithi114.stdout:6/420: symlink d6/da/d36/l86 0 2024-09-16T09:45:32.413 INFO:tasks.workunit.client.1.smithi114.stdout:6/421: fdatasync d6/da/f3e 0 2024-09-16T09:45:32.413 INFO:tasks.workunit.client.1.smithi114.stdout:6/422: readlink d6/l2e 0 2024-09-16T09:45:32.413 INFO:tasks.workunit.client.1.smithi114.stdout:6/423: chown d6/f85 46 1 2024-09-16T09:45:32.416 INFO:tasks.workunit.client.1.smithi114.stdout:0/341: getdents d1f/d22 0 2024-09-16T09:45:32.416 INFO:tasks.workunit.client.1.smithi114.stdout:0/342: write f15 [2631358,15536] 0 2024-09-16T09:45:32.417 INFO:tasks.workunit.client.1.smithi114.stdout:2/442: symlink d1/d8/d10/d16/d98/lad 0 2024-09-16T09:45:32.418 INFO:tasks.workunit.client.1.smithi114.stdout:5/433: symlink d3/d24/d84/d7a/d43/d58/l8f 0 2024-09-16T09:45:32.418 INFO:tasks.workunit.client.1.smithi114.stdout:5/434: stat d3/d24/d84/d71/d5a/f60 0 2024-09-16T09:45:32.418 INFO:tasks.workunit.client.1.smithi114.stdout:9/383: dwrite d3/da/d10/d23/d29/d2c/f35 [0,4194304] 0 2024-09-16T09:45:32.419 INFO:tasks.workunit.client.1.smithi114.stdout:9/384: fsync d3/da/d10/d23/d29/d2c/d6b/f56 0 2024-09-16T09:45:32.419 INFO:tasks.workunit.client.1.smithi114.stdout:6/424: creat d6/d2d/f87 x:0 0 0 2024-09-16T09:45:32.421 INFO:tasks.workunit.client.1.smithi114.stdout:0/343: mknod d1f/d2d/d7a/c81 0 2024-09-16T09:45:32.422 INFO:tasks.workunit.client.1.smithi114.stdout:5/435: mknod d3/d24/d84/d71/d72/d2d/d3f/d75/c90 0 2024-09-16T09:45:32.425 INFO:tasks.workunit.client.1.smithi114.stdout:9/385: creat d3/f7f x:0 0 0 2024-09-16T09:45:32.427 INFO:tasks.workunit.client.1.smithi114.stdout:6/425: rmdir d6/da/d36/d51 39 2024-09-16T09:45:32.427 INFO:tasks.workunit.client.1.smithi114.stdout:6/426: chown d6/d2d/d46/l63 96420 1 2024-09-16T09:45:32.427 INFO:tasks.workunit.client.1.smithi114.stdout:6/427: dread - d6/d2d/f87 zero size 2024-09-16T09:45:32.428 INFO:tasks.workunit.client.1.smithi114.stdout:0/344: creat d1f/d20/f82 x:0 0 0 2024-09-16T09:45:32.430 INFO:tasks.workunit.client.1.smithi114.stdout:6/428: creat d6/f88 x:0 0 0 2024-09-16T09:45:32.432 INFO:tasks.workunit.client.1.smithi114.stdout:0/345: unlink d1f/d20/d48/l6d 0 2024-09-16T09:45:32.433 INFO:tasks.workunit.client.1.smithi114.stdout:2/443: dwrite d1/f7b [0,4194304] 0 2024-09-16T09:45:32.434 INFO:tasks.workunit.client.1.smithi114.stdout:6/429: link d6/da/d36/d51/d62/d77/c7c d6/c89 0 2024-09-16T09:45:32.434 INFO:tasks.workunit.client.1.smithi114.stdout:4/388: sync 2024-09-16T09:45:32.434 INFO:tasks.workunit.client.1.smithi114.stdout:4/389: rename d0 to d0/d26/d40/d6d/d79 22 2024-09-16T09:45:32.435 INFO:tasks.workunit.client.1.smithi114.stdout:0/346: link d1f/d20/d48/d75/l80 d1f/d20/d48/d75/l83 0 2024-09-16T09:45:32.435 INFO:tasks.workunit.client.1.smithi114.stdout:3/536: sync 2024-09-16T09:45:32.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:32 smithi114 ceph-mon[35635]: pgmap v239: 65 pgs: 65 active+clean; 448 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 MiB/s rd, 41 MiB/s wr, 650 op/s 2024-09-16T09:45:32.437 INFO:tasks.workunit.client.1.smithi114.stdout:6/430: creat d6/da/d76/f8a x:0 0 0 2024-09-16T09:45:32.438 INFO:tasks.workunit.client.1.smithi114.stdout:6/431: readlink d6/d2d/l2f 0 2024-09-16T09:45:32.438 INFO:tasks.workunit.client.1.smithi114.stdout:6/432: chown d6/d2d/d46 959187881 1 2024-09-16T09:45:32.439 INFO:tasks.workunit.client.1.smithi114.stdout:0/347: link d1f/d27/d55/f71 d1f/f84 0 2024-09-16T09:45:32.441 INFO:tasks.workunit.client.1.smithi114.stdout:3/537: write dc/de/d17/d2d/db4/d26/f54 [796295,50665] 0 2024-09-16T09:45:32.441 INFO:tasks.workunit.client.1.smithi114.stdout:3/538: fsync dc/de/d17/d72/f90 0 2024-09-16T09:45:32.442 INFO:tasks.workunit.client.1.smithi114.stdout:6/433: symlink d6/da/d76/l8b 0 2024-09-16T09:45:32.443 INFO:tasks.workunit.client.1.smithi114.stdout:0/348: creat d1f/d27/d47/d56/d7e/f85 x:0 0 0 2024-09-16T09:45:32.443 INFO:tasks.workunit.client.1.smithi114.stdout:0/349: write d1f/d27/d47/f66 [1044777,1834] 0 2024-09-16T09:45:32.444 INFO:tasks.workunit.client.1.smithi114.stdout:6/434: mknod d6/da/c8c 0 2024-09-16T09:45:32.444 INFO:tasks.workunit.client.1.smithi114.stdout:6/435: fsync d6/da/d10/d40/f43 0 2024-09-16T09:45:32.444 INFO:tasks.workunit.client.1.smithi114.stdout:0/350: mknod d1f/d22/d2e/c86 0 2024-09-16T09:45:32.445 INFO:tasks.workunit.client.1.smithi114.stdout:0/351: write d1f/d22/d2e/f6a [1178517,70454] 0 2024-09-16T09:45:32.445 INFO:tasks.workunit.client.1.smithi114.stdout:0/352: chown d1f/d20/f3d 108 1 2024-09-16T09:45:32.446 INFO:tasks.workunit.client.1.smithi114.stdout:0/353: dread d1f/d22/d2e/d46/f54 [0,4194304] 0 2024-09-16T09:45:32.447 INFO:tasks.workunit.client.1.smithi114.stdout:4/390: dread d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:32.447 INFO:tasks.workunit.client.1.smithi114.stdout:4/391: readlink d0/l10 0 2024-09-16T09:45:32.447 INFO:tasks.workunit.client.1.smithi114.stdout:6/436: rename d6/da/d10/d40/f6d to d6/da/d10/d40/d82/f8d 0 2024-09-16T09:45:32.449 INFO:tasks.workunit.client.1.smithi114.stdout:4/392: dread d0/d26/d3c/d3e/d4d/f54 [0,4194304] 0 2024-09-16T09:45:32.449 INFO:tasks.workunit.client.1.smithi114.stdout:0/354: mknod d1f/d2d/d7a/c87 0 2024-09-16T09:45:32.449 INFO:tasks.workunit.client.1.smithi114.stdout:4/393: chown d0/c5f 0 1 2024-09-16T09:45:32.449 INFO:tasks.workunit.client.1.smithi114.stdout:9/386: dwrite d3/f6 [0,4194304] 0 2024-09-16T09:45:32.450 INFO:tasks.workunit.client.1.smithi114.stdout:6/437: creat d6/da/d36/d51/d62/d77/f8e x:0 0 0 2024-09-16T09:45:32.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/355: rmdir d1f/d27/d47 39 2024-09-16T09:45:32.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/356: chown c1a 14 1 2024-09-16T09:45:32.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/357: write d1f/d22/d2e/d46/f7b [467636,99388] 0 2024-09-16T09:45:32.453 INFO:tasks.workunit.client.1.smithi114.stdout:4/394: mknod d0/d26/d40/d6d/c7a 0 2024-09-16T09:45:32.453 INFO:tasks.workunit.client.1.smithi114.stdout:4/395: dread - d0/d26/d29/f39 zero size 2024-09-16T09:45:32.453 INFO:tasks.workunit.client.1.smithi114.stdout:4/396: fsync d0/d26/d29/f14 0 2024-09-16T09:45:32.453 INFO:tasks.workunit.client.1.smithi114.stdout:4/397: getdents d0/d53 0 2024-09-16T09:45:32.453 INFO:tasks.workunit.client.1.smithi114.stdout:5/436: dwrite d3/d24/d84/d71/d5a/f60 [0,4194304] 0 2024-09-16T09:45:32.454 INFO:tasks.workunit.client.1.smithi114.stdout:2/444: dwrite d1/d8/d10/d16/d1d/f5f [0,4194304] 0 2024-09-16T09:45:32.454 INFO:tasks.workunit.client.1.smithi114.stdout:2/445: read - d1/f96 zero size 2024-09-16T09:45:32.454 INFO:tasks.workunit.client.1.smithi114.stdout:9/387: symlink d3/da/d10/d23/l80 0 2024-09-16T09:45:32.455 INFO:tasks.workunit.client.1.smithi114.stdout:6/438: truncate d6/d2d/f37 2024371 0 2024-09-16T09:45:32.456 INFO:tasks.workunit.client.1.smithi114.stdout:6/439: fdatasync d6/da/d36/d51/f60 0 2024-09-16T09:45:32.458 INFO:tasks.workunit.client.1.smithi114.stdout:0/358: rmdir d1f/d27 39 2024-09-16T09:45:32.458 INFO:tasks.workunit.client.1.smithi114.stdout:0/359: fsync d1f/d20/f3d 0 2024-09-16T09:45:32.458 INFO:tasks.workunit.client.1.smithi114.stdout:0/360: chown d1f/d27/d55/f71 170 1 2024-09-16T09:45:32.458 INFO:tasks.workunit.client.1.smithi114.stdout:0/361: fdatasync d1f/d27/f3b 0 2024-09-16T09:45:32.459 INFO:tasks.workunit.client.1.smithi114.stdout:2/446: dread d1/d8/d10/d5a/fa9 [0,4194304] 0 2024-09-16T09:45:32.465 INFO:tasks.workunit.client.1.smithi114.stdout:6/440: symlink d6/da/l8f 0 2024-09-16T09:45:32.466 INFO:tasks.workunit.client.1.smithi114.stdout:6/441: fdatasync d6/f22 0 2024-09-16T09:45:32.466 INFO:tasks.workunit.client.1.smithi114.stdout:6/442: write d6/da/d36/f4f [722494,102590] 0 2024-09-16T09:45:32.467 INFO:tasks.workunit.client.1.smithi114.stdout:0/362: write d1f/d22/d2e/f37 [4089687,63411] 0 2024-09-16T09:45:32.467 INFO:tasks.workunit.client.1.smithi114.stdout:2/447: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/lae 0 2024-09-16T09:45:32.469 INFO:tasks.workunit.client.1.smithi114.stdout:2/448: dread d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f52 [0,4194304] 0 2024-09-16T09:45:32.469 INFO:tasks.workunit.client.1.smithi114.stdout:0/363: mknod d1f/d20/d48/d75/c88 0 2024-09-16T09:45:32.469 INFO:tasks.workunit.client.1.smithi114.stdout:0/364: chown d1f/d22/l43 3274437 1 2024-09-16T09:45:32.470 INFO:tasks.workunit.client.1.smithi114.stdout:2/449: truncate d1/fe 5499696 0 2024-09-16T09:45:32.471 INFO:tasks.workunit.client.1.smithi114.stdout:2/450: mkdir d1/d9e/daf 0 2024-09-16T09:45:32.473 INFO:tasks.workunit.client.1.smithi114.stdout:2/451: rename d1/d8/d10/d16/d98 to d1/d9e/db0 0 2024-09-16T09:45:32.474 INFO:tasks.workunit.client.1.smithi114.stdout:2/452: read - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f97 zero size 2024-09-16T09:45:32.475 INFO:tasks.workunit.client.1.smithi114.stdout:2/453: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/cb1 0 2024-09-16T09:45:32.477 INFO:tasks.workunit.client.1.smithi114.stdout:2/454: symlink d1/d8/d10/d16/lb2 0 2024-09-16T09:45:32.479 INFO:tasks.workunit.client.1.smithi114.stdout:2/455: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/fb3 x:0 0 0 2024-09-16T09:45:32.480 INFO:tasks.workunit.client.1.smithi114.stdout:2/456: creat d1/d8/d10/d16/d1d/d92/da7/d3e/fb4 x:0 0 0 2024-09-16T09:45:32.482 INFO:tasks.workunit.client.1.smithi114.stdout:4/398: dwrite d0/d13/d25/f6c [0,4194304] 0 2024-09-16T09:45:32.482 INFO:tasks.workunit.client.1.smithi114.stdout:3/539: dwrite dc/de/d37/d3d/fbb [0,4194304] 0 2024-09-16T09:45:32.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/457: unlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f73 0 2024-09-16T09:45:32.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/458: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f65 [4259208,85592] 0 2024-09-16T09:45:32.483 INFO:tasks.workunit.client.1.smithi114.stdout:5/437: dwrite d3/d24/d84/d7a/d43/d58/f74 [4194304,4194304] 0 2024-09-16T09:45:32.483 INFO:tasks.workunit.client.1.smithi114.stdout:5/438: write d3/d1f/f27 [1208670,110880] 0 2024-09-16T09:45:32.484 INFO:tasks.workunit.client.1.smithi114.stdout:4/399: creat d0/d26/d2e/f7b x:0 0 0 2024-09-16T09:45:32.487 INFO:tasks.workunit.client.1.smithi114.stdout:3/540: rename dc/de/d17/d72/fba to dc/de/d18/d78/d5c/d6e/dc1/fc3 0 2024-09-16T09:45:32.487 INFO:tasks.workunit.client.1.smithi114.stdout:3/541: readlink dc/de/l7d 0 2024-09-16T09:45:32.490 INFO:tasks.workunit.client.1.smithi114.stdout:6/443: dwrite d6/d2d/d46/f83 [0,4194304] 0 2024-09-16T09:45:32.492 INFO:tasks.workunit.client.1.smithi114.stdout:5/439: creat d3/d24/d84/d7a/d43/f91 x:0 0 0 2024-09-16T09:45:32.492 INFO:tasks.workunit.client.1.smithi114.stdout:5/440: readlink d3/d24/d84/d7a/l46 0 2024-09-16T09:45:32.492 INFO:tasks.workunit.client.1.smithi114.stdout:0/365: dwrite d1f/d22/f26 [4194304,4194304] 0 2024-09-16T09:45:32.493 INFO:tasks.workunit.client.1.smithi114.stdout:2/459: read d1/d8/f32 [4078944,117967] 0 2024-09-16T09:45:32.493 INFO:tasks.workunit.client.1.smithi114.stdout:3/542: mkdir dc/de/d18/d78/d5c/d6e/dc4 0 2024-09-16T09:45:32.495 INFO:tasks.workunit.client.1.smithi114.stdout:5/441: rmdir d3/d24/d84/d7a/d43 39 2024-09-16T09:45:32.496 INFO:tasks.workunit.client.1.smithi114.stdout:4/400: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:32.497 INFO:tasks.workunit.client.1.smithi114.stdout:0/366: mknod d1f/d27/d47/c89 0 2024-09-16T09:45:32.497 INFO:tasks.workunit.client.1.smithi114.stdout:3/543: read dc/de/d18/d78/d5c/d5d/f7a [104947,93844] 0 2024-09-16T09:45:32.497 INFO:tasks.workunit.client.1.smithi114.stdout:3/544: dread - dc/fb7 zero size 2024-09-16T09:45:32.498 INFO:tasks.workunit.client.1.smithi114.stdout:2/460: mknod d1/d8/d10/d16/d1d/d92/da3/cb5 0 2024-09-16T09:45:32.498 INFO:tasks.workunit.client.1.smithi114.stdout:5/442: fdatasync d3/f18 0 2024-09-16T09:45:32.498 INFO:tasks.workunit.client.1.smithi114.stdout:6/444: dread d6/fc [0,4194304] 0 2024-09-16T09:45:32.498 INFO:tasks.workunit.client.1.smithi114.stdout:4/401: symlink d0/d26/d2e/l7c 0 2024-09-16T09:45:32.501 INFO:tasks.workunit.client.1.smithi114.stdout:0/367: rename d1f/d27/f5d to d1f/d20/d48/d75/f8a 0 2024-09-16T09:45:32.501 INFO:tasks.workunit.client.1.smithi114.stdout:3/545: creat dc/de/d18/d78/d5c/d6e/dc1/fc5 x:0 0 0 2024-09-16T09:45:32.502 INFO:tasks.workunit.client.1.smithi114.stdout:2/461: mknod d1/d9e/db0/cb6 0 2024-09-16T09:45:32.503 INFO:tasks.workunit.client.1.smithi114.stdout:4/402: creat d0/d26/d2e/f7d x:0 0 0 2024-09-16T09:45:32.505 INFO:tasks.workunit.client.1.smithi114.stdout:5/443: rename d3/d24/d84/d71/d72/d2d/d3f/d59 to d3/d24/d84/d7a/d43/d4c/d92 0 2024-09-16T09:45:32.505 INFO:tasks.workunit.client.1.smithi114.stdout:5/444: write d3/d24/d84/d7a/f88 [939258,55695] 0 2024-09-16T09:45:32.506 INFO:tasks.workunit.client.1.smithi114.stdout:0/368: creat d1f/f8b x:0 0 0 2024-09-16T09:45:32.509 INFO:tasks.workunit.client.1.smithi114.stdout:3/546: creat dc/de/d18/d78/fc6 x:0 0 0 2024-09-16T09:45:32.510 INFO:tasks.workunit.client.1.smithi114.stdout:4/403: mkdir d0/d13/d56/d7e 0 2024-09-16T09:45:32.511 INFO:tasks.workunit.client.1.smithi114.stdout:5/445: write d3/f25 [91081,115620] 0 2024-09-16T09:45:32.511 INFO:tasks.workunit.client.1.smithi114.stdout:5/446: chown d3/d24/d84/d7a/d43/d4c/d92/l69 21808 1 2024-09-16T09:45:32.512 INFO:tasks.workunit.client.1.smithi114.stdout:5/447: dread - d3/d24/d84/d71/d72/d2d/d3f/f5c zero size 2024-09-16T09:45:32.512 INFO:tasks.workunit.client.1.smithi114.stdout:0/369: truncate d1f/d22/d2e/f6c 1931517 0 2024-09-16T09:45:32.512 INFO:tasks.workunit.client.1.smithi114.stdout:0/370: chown d1f/d20/d48/d75/f8a 6609912 1 2024-09-16T09:45:32.513 INFO:tasks.workunit.client.1.smithi114.stdout:3/547: creat dc/de/d37/da7/fc7 x:0 0 0 2024-09-16T09:45:32.515 INFO:tasks.workunit.client.1.smithi114.stdout:4/404: mkdir d0/d26/d40/d75/d7f 0 2024-09-16T09:45:32.517 INFO:tasks.workunit.client.1.smithi114.stdout:0/371: rename d1f/d27/d47/l79 to d1f/d22/l8c 0 2024-09-16T09:45:32.519 INFO:tasks.workunit.client.1.smithi114.stdout:3/548: creat dc/de/d17/d2d/db4/fc8 x:0 0 0 2024-09-16T09:45:32.519 INFO:tasks.workunit.client.1.smithi114.stdout:5/448: dread d3/d24/d84/d71/d72/d2d/d3f/f55 [0,4194304] 0 2024-09-16T09:45:32.522 INFO:tasks.workunit.client.1.smithi114.stdout:4/405: creat d0/d26/d3c/d3e/d4b/d46/f80 x:0 0 0 2024-09-16T09:45:32.523 INFO:tasks.workunit.client.1.smithi114.stdout:0/372: mkdir d1f/d22/d2e/d46/d7f/d8d 0 2024-09-16T09:45:32.523 INFO:tasks.workunit.client.1.smithi114.stdout:5/449: rmdir d3/d24/d84/d7a/d43/d4c/d92/d78 39 2024-09-16T09:45:32.525 INFO:tasks.workunit.client.1.smithi114.stdout:4/406: symlink d0/d26/d40/d75/l81 0 2024-09-16T09:45:32.525 INFO:tasks.workunit.client.1.smithi114.stdout:7/442: sync 2024-09-16T09:45:32.527 INFO:tasks.workunit.client.1.smithi114.stdout:5/450: symlink d3/d24/d84/d7a/d43/d4c/l93 0 2024-09-16T09:45:32.528 INFO:tasks.workunit.client.1.smithi114.stdout:2/462: dwrite d1/d8/d10/f35 [4194304,4194304] 0 2024-09-16T09:45:32.528 INFO:tasks.workunit.client.1.smithi114.stdout:2/463: dread - d1/f8a zero size 2024-09-16T09:45:32.528 INFO:tasks.workunit.client.1.smithi114.stdout:2/464: chown d1/d8/d10/f85 0 1 2024-09-16T09:45:32.528 INFO:tasks.workunit.client.1.smithi114.stdout:7/443: link d2/d9/d2b/d2e/d22/d27/f40 d2/d9/d2b/d2e/d22/d4c/f91 0 2024-09-16T09:45:32.529 INFO:tasks.workunit.client.1.smithi114.stdout:0/373: symlink d1f/d2d/l8e 0 2024-09-16T09:45:32.530 INFO:tasks.workunit.client.1.smithi114.stdout:0/374: read d1f/d22/d2e/f6a [898268,114298] 0 2024-09-16T09:45:32.530 INFO:tasks.workunit.client.1.smithi114.stdout:5/451: creat d3/d24/d84/d71/d72/d2d/d3f/f94 x:0 0 0 2024-09-16T09:45:32.531 INFO:tasks.workunit.client.1.smithi114.stdout:5/452: fdatasync d3/f4 0 2024-09-16T09:45:32.531 INFO:tasks.workunit.client.1.smithi114.stdout:5/453: readlink d3/d24/d84/d7a/d43/d4c/d92/l68 0 2024-09-16T09:45:32.531 INFO:tasks.workunit.client.1.smithi114.stdout:2/465: mkdir d1/d8/d10/d16/d60/db7 0 2024-09-16T09:45:32.532 INFO:tasks.workunit.client.1.smithi114.stdout:0/375: creat d1f/d22/d2e/d46/d7f/d8d/f8f x:0 0 0 2024-09-16T09:45:32.532 INFO:tasks.workunit.client.1.smithi114.stdout:0/376: readlink d1f/d22/d2e/l35 0 2024-09-16T09:45:32.533 INFO:tasks.workunit.client.1.smithi114.stdout:2/466: rmdir d1/d8/d10/d16/d1d/d92/da3 39 2024-09-16T09:45:32.533 INFO:tasks.workunit.client.1.smithi114.stdout:2/467: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/f48 0 2024-09-16T09:45:32.533 INFO:tasks.workunit.client.1.smithi114.stdout:2/468: stat d1/d8/d10/c80 0 2024-09-16T09:45:32.533 INFO:tasks.workunit.client.1.smithi114.stdout:0/377: truncate d1f/d22/d2e/d46/f7b 553284 0 2024-09-16T09:45:32.534 INFO:tasks.workunit.client.1.smithi114.stdout:2/469: stat d1/d8/d10/d16/d1d/d92/da7/c42 0 2024-09-16T09:45:32.535 INFO:tasks.workunit.client.1.smithi114.stdout:0/378: creat d1f/d22/d2e/f90 x:0 0 0 2024-09-16T09:45:32.536 INFO:tasks.workunit.client.1.smithi114.stdout:3/549: dwrite dc/de/d17/d2d/f63 [0,4194304] 0 2024-09-16T09:45:32.538 INFO:tasks.workunit.client.1.smithi114.stdout:7/444: read d2/f5 [2599995,60586] 0 2024-09-16T09:45:32.538 INFO:tasks.workunit.client.1.smithi114.stdout:2/470: rename d1/d8/l99 to d1/d8/d10/d16/d60/lb8 0 2024-09-16T09:45:32.538 INFO:tasks.workunit.client.1.smithi114.stdout:2/471: fdatasync d1/d8/d10/d16/d1d/d92/da7/d3e/f59 0 2024-09-16T09:45:32.538 INFO:tasks.workunit.client.1.smithi114.stdout:0/379: truncate d1f/d27/d47/d56/f62 751814 0 2024-09-16T09:45:32.542 INFO:tasks.workunit.client.1.smithi114.stdout:3/550: dread dc/de/d17/d2d/db4/f3c [4194304,4194304] 0 2024-09-16T09:45:32.543 INFO:tasks.workunit.client.1.smithi114.stdout:5/454: dread d3/d24/d84/d7a/d43/f48 [0,4194304] 0 2024-09-16T09:45:32.543 INFO:tasks.workunit.client.1.smithi114.stdout:5/455: chown d3/d24/d84/d71/d72/d52/d61 995 1 2024-09-16T09:45:32.543 INFO:tasks.workunit.client.1.smithi114.stdout:3/551: link dc/de/d17/d79/l8c dc/de/d18/d78/d5c/lc9 0 2024-09-16T09:45:32.545 INFO:tasks.workunit.client.1.smithi114.stdout:7/445: dread d2/d9/d2b/d2e/d22/d27/f1e [0,4194304] 0 2024-09-16T09:45:32.545 INFO:tasks.workunit.client.1.smithi114.stdout:7/446: fsync d2/d9/d2b/d2e/f45 0 2024-09-16T09:45:32.545 INFO:tasks.workunit.client.1.smithi114.stdout:7/447: truncate d2/f4a 278737 0 2024-09-16T09:45:32.546 INFO:tasks.workunit.client.1.smithi114.stdout:5/456: unlink d3/d24/d84/d71/d72/d2d/d34/f5f 0 2024-09-16T09:45:32.546 INFO:tasks.workunit.client.1.smithi114.stdout:5/457: read d3/d24/d84/d7a/d43/d4c/f54 [3601748,21617] 0 2024-09-16T09:45:32.547 INFO:tasks.workunit.client.1.smithi114.stdout:3/552: truncate dc/de/d18/d78/d5c/d5d/f55 3781280 0 2024-09-16T09:45:32.550 INFO:tasks.workunit.client.1.smithi114.stdout:7/448: link d2/d9/d2b/l7d d2/d9/d2b/d2e/d3e/d89/l92 0 2024-09-16T09:45:32.562 INFO:tasks.workunit.client.1.smithi114.stdout:7/449: write d2/d9/d2b/d2e/d22/d27/f40 [7051849,118698] 0 2024-09-16T09:45:32.563 INFO:tasks.workunit.client.1.smithi114.stdout:7/450: mkdir d2/d9/d2b/d2e/d93 0 2024-09-16T09:45:32.564 INFO:tasks.workunit.client.1.smithi114.stdout:7/451: symlink d2/d9/d2b/d2e/d93/l94 0 2024-09-16T09:45:32.564 INFO:tasks.workunit.client.1.smithi114.stdout:7/452: chown d2/d9/d2b/l4f 2 1 2024-09-16T09:45:32.565 INFO:tasks.workunit.client.1.smithi114.stdout:7/453: dread d2/f4a [0,4194304] 0 2024-09-16T09:45:32.567 INFO:tasks.workunit.client.1.smithi114.stdout:7/454: unlink d2/d9/d2b/d2e/f8c 0 2024-09-16T09:45:32.568 INFO:tasks.workunit.client.1.smithi114.stdout:7/455: creat d2/d9/d2b/f95 x:0 0 0 2024-09-16T09:45:32.569 INFO:tasks.workunit.client.1.smithi114.stdout:0/380: dwrite d1f/d22/f3c [0,4194304] 0 2024-09-16T09:45:32.569 INFO:tasks.workunit.client.1.smithi114.stdout:0/381: dread - d1f/f74 zero size 2024-09-16T09:45:32.570 INFO:tasks.workunit.client.1.smithi114.stdout:7/456: rename d2/d9/d2b/d2e/d22/d27/c35 to d2/df/c96 0 2024-09-16T09:45:32.571 INFO:tasks.workunit.client.1.smithi114.stdout:5/458: dwrite d3/d24/f2e [0,4194304] 0 2024-09-16T09:45:32.572 INFO:tasks.workunit.client.1.smithi114.stdout:3/553: dwrite dc/de/d18/f35 [0,4194304] 0 2024-09-16T09:45:32.575 INFO:tasks.workunit.client.1.smithi114.stdout:0/382: rename d1f/d20/d48/d75/f8a to d1f/d20/d48/f91 0 2024-09-16T09:45:32.576 INFO:tasks.workunit.client.1.smithi114.stdout:7/457: truncate d2/d9/d2b/d2e/d22/d27/f1e 2531210 0 2024-09-16T09:45:32.577 INFO:tasks.workunit.client.1.smithi114.stdout:5/459: unlink d3/d24/d84/d7a/d43/d4c/d92/c77 0 2024-09-16T09:45:32.578 INFO:tasks.workunit.client.1.smithi114.stdout:3/554: mknod dc/de/cca 0 2024-09-16T09:45:32.579 INFO:tasks.workunit.client.1.smithi114.stdout:0/383: link d1f/d20/c33 d1f/d22/c92 0 2024-09-16T09:45:32.581 INFO:tasks.workunit.client.1.smithi114.stdout:7/458: rename d2/d9/d2b/d2e/d22/d27/d4d/d72/f85 to d2/d9/d2b/d2e/d22/d27/d4d/f97 0 2024-09-16T09:45:32.582 INFO:tasks.workunit.client.1.smithi114.stdout:3/555: unlink dc/d38/d3f/f96 0 2024-09-16T09:45:32.583 INFO:tasks.workunit.client.1.smithi114.stdout:0/384: mknod d1f/d27/d47/c93 0 2024-09-16T09:45:32.583 INFO:tasks.workunit.client.1.smithi114.stdout:7/459: symlink d2/df/l98 0 2024-09-16T09:45:32.588 INFO:tasks.workunit.client.1.smithi114.stdout:3/556: unlink dc/de/d17/d79/f7c 0 2024-09-16T09:45:32.588 INFO:tasks.workunit.client.1.smithi114.stdout:0/385: stat cf 0 2024-09-16T09:45:32.589 INFO:tasks.workunit.client.1.smithi114.stdout:3/557: creat dc/de/d18/d78/d5c/d5d/fcb x:0 0 0 2024-09-16T09:45:32.589 INFO:tasks.workunit.client.1.smithi114.stdout:3/558: stat dc/de/d18/d78/d8d 0 2024-09-16T09:45:32.591 INFO:tasks.workunit.client.1.smithi114.stdout:3/559: rename f9 to dc/de/d17/d2d/db4/d26/fcc 0 2024-09-16T09:45:32.592 INFO:tasks.workunit.client.1.smithi114.stdout:3/560: write dc/d38/f66 [1029372,83797] 0 2024-09-16T09:45:32.592 INFO:tasks.workunit.client.1.smithi114.stdout:3/561: chown dc/de/d37/d3d/fbb 13541416 1 2024-09-16T09:45:32.592 INFO:tasks.workunit.client.1.smithi114.stdout:3/562: fdatasync dc/de/d18/d78/d5c/d5d/f7a 0 2024-09-16T09:45:32.592 INFO:tasks.workunit.client.1.smithi114.stdout:3/563: chown dc/de/d37/d98 103351 1 2024-09-16T09:45:32.592 INFO:tasks.workunit.client.1.smithi114.stdout:3/564: symlink dc/de/d17/d72/lcd 0 2024-09-16T09:45:32.595 INFO:tasks.workunit.client.1.smithi114.stdout:1/417: sync 2024-09-16T09:45:32.595 INFO:tasks.workunit.client.1.smithi114.stdout:8/399: sync 2024-09-16T09:45:32.598 INFO:tasks.workunit.client.1.smithi114.stdout:1/418: creat d4/d2b/d2f/d3a/d56/f88 x:0 0 0 2024-09-16T09:45:32.600 INFO:tasks.workunit.client.1.smithi114.stdout:8/400: link d4/c36 d4/db/d39/d3c/d86/c8a 0 2024-09-16T09:45:32.600 INFO:tasks.workunit.client.1.smithi114.stdout:8/401: fdatasync d4/db/d68/d52/f70 0 2024-09-16T09:45:32.602 INFO:tasks.workunit.client.1.smithi114.stdout:1/419: rename d4/d2b/d29/l24 to d4/d3d/d41/d42/l89 0 2024-09-16T09:45:32.602 INFO:tasks.workunit.client.1.smithi114.stdout:8/402: getdents d4/db/d68 0 2024-09-16T09:45:32.612 INFO:tasks.workunit.client.1.smithi114.stdout:3/565: dwrite dc/de/d17/d2d/db4/d6a/d77/d7f/fc0 [0,4194304] 0 2024-09-16T09:45:32.613 INFO:tasks.workunit.client.1.smithi114.stdout:8/403: dread d4/f15 [0,4194304] 0 2024-09-16T09:45:32.614 INFO:tasks.workunit.client.1.smithi114.stdout:7/460: dwrite d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:32.614 INFO:tasks.workunit.client.1.smithi114.stdout:7/461: fsync d2/df/f30 0 2024-09-16T09:45:32.614 INFO:tasks.workunit.client.1.smithi114.stdout:3/566: symlink dc/de/d37/d57/lce 0 2024-09-16T09:45:32.615 INFO:tasks.workunit.client.1.smithi114.stdout:8/404: symlink d4/db/d39/d3c/d4e/l8b 0 2024-09-16T09:45:32.616 INFO:tasks.workunit.client.1.smithi114.stdout:8/405: dread - d4/db/d39/d3c/d4e/d62/f73 zero size 2024-09-16T09:45:32.616 INFO:tasks.workunit.client.1.smithi114.stdout:7/462: mkdir d2/d9/d2b/d78/d99 0 2024-09-16T09:45:32.617 INFO:tasks.workunit.client.1.smithi114.stdout:1/420: dread d4/d3d/d41/d42/d58/f5c [0,4194304] 0 2024-09-16T09:45:32.617 INFO:tasks.workunit.client.1.smithi114.stdout:5/460: dwrite d3/d24/d84/d7a/d43/f51 [0,4194304] 0 2024-09-16T09:45:32.617 INFO:tasks.workunit.client.1.smithi114.stdout:5/461: truncate d3/d24/d84/d71/d72/d2d/d87/f8e 886261 0 2024-09-16T09:45:32.617 INFO:tasks.workunit.client.1.smithi114.stdout:8/406: link d4/db/d39/d3c/f6b d4/db/d39/d3c/d86/f8c 0 2024-09-16T09:45:32.618 INFO:tasks.workunit.client.1.smithi114.stdout:7/463: dread d2/d9/f19 [0,4194304] 0 2024-09-16T09:45:32.618 INFO:tasks.workunit.client.1.smithi114.stdout:1/421: rename d4/l20 to d4/d2b/d16/d47/l8a 0 2024-09-16T09:45:32.618 INFO:tasks.workunit.client.1.smithi114.stdout:1/422: truncate d4/d3d/f59 864139 0 2024-09-16T09:45:32.619 INFO:tasks.workunit.client.1.smithi114.stdout:5/462: mknod d3/d24/d84/d71/d72/d2d/d87/c95 0 2024-09-16T09:45:32.619 INFO:tasks.workunit.client.1.smithi114.stdout:5/463: write d3/d24/d84/d71/d72/f10 [424373,21271] 0 2024-09-16T09:45:32.620 INFO:tasks.workunit.client.1.smithi114.stdout:8/407: mkdir d4/db/d3e/d71/d78/d8d 0 2024-09-16T09:45:32.620 INFO:tasks.workunit.client.1.smithi114.stdout:8/408: write d4/db/f88 [213715,4769] 0 2024-09-16T09:45:32.620 INFO:tasks.workunit.client.1.smithi114.stdout:7/464: creat d2/d9/d2b/d78/d99/f9a x:0 0 0 2024-09-16T09:45:32.620 INFO:tasks.workunit.client.1.smithi114.stdout:7/465: chown d2/f1c 14844541 1 2024-09-16T09:45:32.621 INFO:tasks.workunit.client.1.smithi114.stdout:1/423: mkdir d4/d2b/d16/d71/d72/d8b 0 2024-09-16T09:45:32.623 INFO:tasks.workunit.client.1.smithi114.stdout:5/464: mkdir d3/d24/d7d/d96 0 2024-09-16T09:45:32.623 INFO:tasks.workunit.client.1.smithi114.stdout:5/465: write d3/f25 [399619,37366] 0 2024-09-16T09:45:32.623 INFO:tasks.workunit.client.1.smithi114.stdout:5/466: readlink d3/d24/d84/d71/d72/d2d/l82 0 2024-09-16T09:45:32.623 INFO:tasks.workunit.client.1.smithi114.stdout:5/467: write d3/d24/d84/d7a/d43/d58/f7c [87021,91589] 0 2024-09-16T09:45:32.623 INFO:tasks.workunit.client.1.smithi114.stdout:8/409: stat d4/d1f/c27 0 2024-09-16T09:45:32.623 INFO:tasks.workunit.client.1.smithi114.stdout:8/410: fdatasync d4/db/d3e/f4f 0 2024-09-16T09:45:32.624 INFO:tasks.workunit.client.1.smithi114.stdout:7/466: link d2/d9/d2b/d2e/d77/f63 d2/d9/d2b/d78/d99/f9b 0 2024-09-16T09:45:32.625 INFO:tasks.workunit.client.1.smithi114.stdout:7/467: write d2/d9/d51/f5f [282358,126203] 0 2024-09-16T09:45:32.626 INFO:tasks.workunit.client.1.smithi114.stdout:3/567: dread dc/de/d37/d3d/f6c [0,4194304] 0 2024-09-16T09:45:32.626 INFO:tasks.workunit.client.1.smithi114.stdout:3/568: truncate dc/de/d18/d78/d5c/d5d/fa6 1075434 0 2024-09-16T09:45:32.626 INFO:tasks.workunit.client.1.smithi114.stdout:3/569: fsync dc/de/d18/f28 0 2024-09-16T09:45:32.626 INFO:tasks.workunit.client.1.smithi114.stdout:3/570: fsync dc/de/d1f/f29 0 2024-09-16T09:45:32.627 INFO:tasks.workunit.client.1.smithi114.stdout:7/468: read d2/d9/d2b/d2e/d77/f56 [12101,57756] 0 2024-09-16T09:45:32.627 INFO:tasks.workunit.client.1.smithi114.stdout:1/424: creat d4/d2b/d16/d47/d83/f8c x:0 0 0 2024-09-16T09:45:32.627 INFO:tasks.workunit.client.1.smithi114.stdout:1/425: write d4/d2b/d2f/d3a/f78 [205015,37242] 0 2024-09-16T09:45:32.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:32 smithi111 ceph-mon[27997]: pgmap v239: 65 pgs: 65 active+clean; 448 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 28 MiB/s rd, 41 MiB/s wr, 650 op/s 2024-09-16T09:45:32.632 INFO:tasks.workunit.client.1.smithi114.stdout:5/468: dread d3/d1f/f16 [0,4194304] 0 2024-09-16T09:45:32.635 INFO:tasks.workunit.client.1.smithi114.stdout:9/388: sync 2024-09-16T09:45:32.635 INFO:tasks.workunit.client.1.smithi114.stdout:9/389: chown d3/da/d10/d23/d29/d2c/d70 277029209 1 2024-09-16T09:45:32.636 INFO:tasks.workunit.client.1.smithi114.stdout:7/469: write d2/df/f30 [6810521,105405] 0 2024-09-16T09:45:32.636 INFO:tasks.workunit.client.1.smithi114.stdout:9/390: rmdir d3/da/d10/d23/d29/d3f 39 2024-09-16T09:45:32.636 INFO:tasks.workunit.client.1.smithi114.stdout:9/391: stat d3/da/d10/d23/d29/d2c/d45/f65 0 2024-09-16T09:45:32.637 INFO:tasks.workunit.client.1.smithi114.stdout:7/470: symlink d2/d9/d2b/d2e/d77/l9c 0 2024-09-16T09:45:32.637 INFO:tasks.workunit.client.1.smithi114.stdout:7/471: write d2/f4a [1128913,12275] 0 2024-09-16T09:45:32.639 INFO:tasks.workunit.client.1.smithi114.stdout:9/392: mkdir d3/da/d10/d23/d29/d2c/d6b/d68/d81 0 2024-09-16T09:45:32.639 INFO:tasks.workunit.client.1.smithi114.stdout:6/445: sync 2024-09-16T09:45:32.639 INFO:tasks.workunit.client.1.smithi114.stdout:6/446: chown d6/da/d36/f75 1703 1 2024-09-16T09:45:32.640 INFO:tasks.workunit.client.1.smithi114.stdout:9/393: rename d3/da/d10/d23/d43/d1e/d25/d5a to d3/da/d10/d23/d43/d82 0 2024-09-16T09:45:32.640 INFO:tasks.workunit.client.1.smithi114.stdout:9/394: chown d3/da/f3a 34835 1 2024-09-16T09:45:32.640 INFO:tasks.workunit.client.1.smithi114.stdout:9/395: chown d3/c40 35 1 2024-09-16T09:45:32.640 INFO:tasks.workunit.client.1.smithi114.stdout:9/396: write d3/da/d10/d23/d29/d2c/f62 [972908,125359] 0 2024-09-16T09:45:32.641 INFO:tasks.workunit.client.1.smithi114.stdout:6/447: symlink d6/d64/l90 0 2024-09-16T09:45:32.642 INFO:tasks.workunit.client.1.smithi114.stdout:9/397: creat d3/da/d10/d23/d43/d1e/f83 x:0 0 0 2024-09-16T09:45:32.642 INFO:tasks.workunit.client.1.smithi114.stdout:9/398: getdents d3/da/d10/d23/d43/d1e/d78 0 2024-09-16T09:45:32.642 INFO:tasks.workunit.client.1.smithi114.stdout:9/399: read - d3/da/d10/d23/d29/d2c/d45/f64 zero size 2024-09-16T09:45:32.643 INFO:tasks.workunit.client.1.smithi114.stdout:6/448: creat d6/d64/f91 x:0 0 0 2024-09-16T09:45:32.643 INFO:tasks.workunit.client.1.smithi114.stdout:5/469: getdents d3/d24/d7d 0 2024-09-16T09:45:32.643 INFO:tasks.workunit.client.1.smithi114.stdout:5/470: truncate d3/d24/d84/d71/d72/d2d/d87/f8e 1688368 0 2024-09-16T09:45:32.645 INFO:tasks.workunit.client.1.smithi114.stdout:9/400: rmdir d3/da/d10/d23/d29/d3f 39 2024-09-16T09:45:32.645 INFO:tasks.workunit.client.1.smithi114.stdout:5/471: truncate d3/f4 2285936 0 2024-09-16T09:45:32.647 INFO:tasks.workunit.client.1.smithi114.stdout:9/401: symlink d3/da/d10/d23/d43/d1e/d25/l84 0 2024-09-16T09:45:32.649 INFO:tasks.workunit.client.1.smithi114.stdout:9/402: mkdir d3/da/d10/d23/d29/d3f/d85 0 2024-09-16T09:45:32.650 INFO:tasks.workunit.client.1.smithi114.stdout:9/403: symlink d3/da/d10/d23/d29/d2c/d70/l86 0 2024-09-16T09:45:32.650 INFO:tasks.workunit.client.1.smithi114.stdout:5/472: dread d3/d1f/f27 [0,4194304] 0 2024-09-16T09:45:32.652 INFO:tasks.workunit.client.1.smithi114.stdout:5/473: creat d3/d24/d84/d7a/d43/d4c/d92/f97 x:0 0 0 2024-09-16T09:45:32.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/474: mkdir d3/d24/d84/d71/d72/d2d/d3f/d75/d98 0 2024-09-16T09:45:32.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/475: readlink d3/d24/d84/d71/d72/d52/l63 0 2024-09-16T09:45:32.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/476: fsync d3/d24/d84/d7a/d43/f91 0 2024-09-16T09:45:32.657 INFO:tasks.workunit.client.1.smithi114.stdout:9/404: dread d3/da/d10/d23/d43/d1e/d25/f27 [0,4194304] 0 2024-09-16T09:45:32.657 INFO:tasks.workunit.client.1.smithi114.stdout:9/405: write d3/da/d10/d23/d29/d2c/d6b/f5f [808409,9962] 0 2024-09-16T09:45:32.657 INFO:tasks.workunit.client.1.smithi114.stdout:1/426: dwrite d4/d2b/d16/d47/d83/f8c [0,4194304] 0 2024-09-16T09:45:32.658 INFO:tasks.workunit.client.1.smithi114.stdout:7/472: dwrite d2/d9/d2b/d2e/d22/d27/f2a [0,4194304] 0 2024-09-16T09:45:32.658 INFO:tasks.workunit.client.1.smithi114.stdout:1/427: write d4/d3d/f59 [679820,130271] 0 2024-09-16T09:45:32.662 INFO:tasks.workunit.client.1.smithi114.stdout:7/473: creat d2/d9/d2b/d2e/d22/d27/d4d/f9d x:0 0 0 2024-09-16T09:45:32.662 INFO:tasks.workunit.client.1.smithi114.stdout:7/474: fdatasync d2/d9/d2b/d78/d99/f9a 0 2024-09-16T09:45:32.665 INFO:tasks.workunit.client.1.smithi114.stdout:6/449: dwrite d6/da/d10/d40/f5e [0,4194304] 0 2024-09-16T09:45:32.665 INFO:tasks.workunit.client.1.smithi114.stdout:6/450: write d6/da/d36/d51/d62/f7e [808786,67524] 0 2024-09-16T09:45:32.665 INFO:tasks.workunit.client.1.smithi114.stdout:1/428: mknod d4/d2b/d16/d71/d72/d75/c8d 0 2024-09-16T09:45:32.667 INFO:tasks.workunit.client.1.smithi114.stdout:7/475: creat d2/d9/d2b/d2e/d22/d4c/f9e x:0 0 0 2024-09-16T09:45:32.667 INFO:tasks.workunit.client.1.smithi114.stdout:9/406: read d3/da/d10/d23/d29/d2c/d45/f61 [3319508,91010] 0 2024-09-16T09:45:32.671 INFO:tasks.workunit.client.1.smithi114.stdout:5/477: truncate d3/d24/d84/d71/d72/d2d/d87/f8e 58002 0 2024-09-16T09:45:32.671 INFO:tasks.workunit.client.1.smithi114.stdout:5/478: read - d3/d24/d84/d7a/d43/d4c/d92/f97 zero size 2024-09-16T09:45:32.671 INFO:tasks.workunit.client.1.smithi114.stdout:5/479: truncate d3/d24/d84/d7a/d43/d4c/d92/f97 584359 0 2024-09-16T09:45:32.675 INFO:tasks.workunit.client.1.smithi114.stdout:6/451: rmdir d6/d64 39 2024-09-16T09:45:32.675 INFO:tasks.workunit.client.1.smithi114.stdout:9/407: read d3/ff [993559,41927] 0 2024-09-16T09:45:32.675 INFO:tasks.workunit.client.1.smithi114.stdout:1/429: truncate d4/d2b/d16/f7c 911262 0 2024-09-16T09:45:32.675 INFO:tasks.workunit.client.1.smithi114.stdout:1/430: write d4/d2b/d16/d71/d72/d75/f7f [965490,68762] 0 2024-09-16T09:45:32.676 INFO:tasks.workunit.client.1.smithi114.stdout:7/476: mkdir d2/d9/d2b/d78/d9f 0 2024-09-16T09:45:32.677 INFO:tasks.workunit.client.1.smithi114.stdout:7/477: truncate d2/d9/d2b/d2e/d22/d27/f1f 420345 0 2024-09-16T09:45:32.678 INFO:tasks.workunit.client.1.smithi114.stdout:5/480: creat d3/d24/d7d/f99 x:0 0 0 2024-09-16T09:45:32.679 INFO:tasks.workunit.client.1.smithi114.stdout:6/452: mkdir d6/da/d10/d92 0 2024-09-16T09:45:32.679 INFO:tasks.workunit.client.1.smithi114.stdout:6/453: fdatasync f5 0 2024-09-16T09:45:32.681 INFO:tasks.workunit.client.1.smithi114.stdout:9/408: mkdir d3/da/d10/d23/d29/d87 0 2024-09-16T09:45:32.682 INFO:tasks.workunit.client.1.smithi114.stdout:1/431: rename d4/d3d/f59 to d4/d3d/d41/f8e 0 2024-09-16T09:45:32.683 INFO:tasks.workunit.client.1.smithi114.stdout:5/481: creat d3/d24/d84/d71/d72/d2d/f9a x:0 0 0 2024-09-16T09:45:32.685 INFO:tasks.workunit.client.1.smithi114.stdout:9/409: mkdir d3/da/d10/d23/d43/d1e/d25/d88 0 2024-09-16T09:45:32.685 INFO:tasks.workunit.client.1.smithi114.stdout:9/410: chown d3/da/d10/d23/d43/d1e/d25 169 1 2024-09-16T09:45:32.686 INFO:tasks.workunit.client.1.smithi114.stdout:1/432: truncate d4/d2b/f9 2094003 0 2024-09-16T09:45:32.687 INFO:tasks.workunit.client.1.smithi114.stdout:7/478: dread d2/d9/d2b/f61 [0,4194304] 0 2024-09-16T09:45:32.688 INFO:tasks.workunit.client.1.smithi114.stdout:9/411: link d3/da/d10/d23/d29/d2c/l58 d3/da/d10/d23/d29/d87/l89 0 2024-09-16T09:45:32.689 INFO:tasks.workunit.client.1.smithi114.stdout:9/412: fsync d3/da/d10/d23/d43/d1e/f5e 0 2024-09-16T09:45:32.690 INFO:tasks.workunit.client.1.smithi114.stdout:2/472: sync 2024-09-16T09:45:32.690 INFO:tasks.workunit.client.1.smithi114.stdout:4/407: sync 2024-09-16T09:45:32.690 INFO:tasks.workunit.client.1.smithi114.stdout:2/473: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f 440 1 2024-09-16T09:45:32.690 INFO:tasks.workunit.client.1.smithi114.stdout:2/474: chown d1/d8/d10/d16/d1d/f1e 241235649 1 2024-09-16T09:45:32.690 INFO:tasks.workunit.client.1.smithi114.stdout:4/408: write d0/d13/d25/f6c [4404186,72512] 0 2024-09-16T09:45:32.692 INFO:tasks.workunit.client.1.smithi114.stdout:7/479: dread d2/d9/fc [0,4194304] 0 2024-09-16T09:45:32.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/433: rename d4/d2b/d2f/d3a/d55/f7e to d4/d2b/d16/d47/d83/f8f 0 2024-09-16T09:45:32.692 INFO:tasks.workunit.client.1.smithi114.stdout:1/434: chown d4/d2b/d16 0 1 2024-09-16T09:45:32.692 INFO:tasks.workunit.client.1.smithi114.stdout:9/413: creat d3/da/d10/d23/d29/d2c/d45/f8a x:0 0 0 2024-09-16T09:45:32.693 INFO:tasks.workunit.client.1.smithi114.stdout:2/475: rmdir d1/d9e 39 2024-09-16T09:45:32.693 INFO:tasks.workunit.client.1.smithi114.stdout:2/476: chown d1/d8/d10/d16/d1d/d92 45647479 1 2024-09-16T09:45:32.695 INFO:tasks.workunit.client.1.smithi114.stdout:1/435: link d4/d2b/d16/d71/d72/d75/f77 d4/d2b/f90 0 2024-09-16T09:45:32.695 INFO:tasks.workunit.client.1.smithi114.stdout:1/436: truncate d4/d2b/f27 2200519 0 2024-09-16T09:45:32.696 INFO:tasks.workunit.client.1.smithi114.stdout:9/414: truncate d3/da/d10/d23/d43/d1e/f5e 3814920 0 2024-09-16T09:45:32.699 INFO:tasks.workunit.client.1.smithi114.stdout:2/477: rename d1/d8/d10/c80 to d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/cb9 0 2024-09-16T09:45:32.699 INFO:tasks.workunit.client.1.smithi114.stdout:4/409: fsync d0/d13/d25/f6c 0 2024-09-16T09:45:32.700 INFO:tasks.workunit.client.1.smithi114.stdout:6/454: dwrite d6/da/d10/f39 [0,4194304] 0 2024-09-16T09:45:32.700 INFO:tasks.workunit.client.1.smithi114.stdout:1/437: creat d4/d2b/f91 x:0 0 0 2024-09-16T09:45:32.700 INFO:tasks.workunit.client.1.smithi114.stdout:1/438: write d4/d2b/d16/d71/f7b [425870,96824] 0 2024-09-16T09:45:32.700 INFO:tasks.workunit.client.1.smithi114.stdout:7/480: dread d2/f5 [0,4194304] 0 2024-09-16T09:45:32.700 INFO:tasks.workunit.client.1.smithi114.stdout:1/439: readlink d4/d2b/d2f/d3a/l86 0 2024-09-16T09:45:32.701 INFO:tasks.workunit.client.1.smithi114.stdout:9/415: symlink d3/da/d10/d23/d43/d1e/d25/l8b 0 2024-09-16T09:45:32.701 INFO:tasks.workunit.client.1.smithi114.stdout:9/416: chown d3/da/d10/d23/d29 207661892 1 2024-09-16T09:45:32.702 INFO:tasks.workunit.client.1.smithi114.stdout:2/478: rename d1/d8/la8 to d1/d9e/db0/lba 0 2024-09-16T09:45:32.703 INFO:tasks.workunit.client.1.smithi114.stdout:2/479: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f56 0 2024-09-16T09:45:32.703 INFO:tasks.workunit.client.1.smithi114.stdout:2/480: write d1/f84 [775363,126000] 0 2024-09-16T09:45:32.704 INFO:tasks.workunit.client.1.smithi114.stdout:4/410: mknod d0/d26/d29/c82 0 2024-09-16T09:45:32.708 INFO:tasks.workunit.client.1.smithi114.stdout:6/455: creat d6/da/d36/d51/d62/d77/f93 x:0 0 0 2024-09-16T09:45:32.709 INFO:tasks.workunit.client.1.smithi114.stdout:1/440: truncate d4/d2b/d2f/d3a/f40 2461790 0 2024-09-16T09:45:32.711 INFO:tasks.workunit.client.1.smithi114.stdout:7/481: mknod d2/d9/d2b/d2e/d22/d4c/ca0 0 2024-09-16T09:45:32.713 INFO:tasks.workunit.client.1.smithi114.stdout:9/417: mkdir d3/da/d10/d23/d43/d1e/d4c/d8c 0 2024-09-16T09:45:32.715 INFO:tasks.workunit.client.1.smithi114.stdout:2/481: creat d1/d8/d10/d16/d60/db7/fbb x:0 0 0 2024-09-16T09:45:32.715 INFO:tasks.workunit.client.1.smithi114.stdout:4/411: getdents d0/d26 0 2024-09-16T09:45:32.715 INFO:tasks.workunit.client.1.smithi114.stdout:4/412: truncate d0/d26/d3c/d3e/d4b/d46/f80 114532 0 2024-09-16T09:45:32.717 INFO:tasks.workunit.client.1.smithi114.stdout:7/482: symlink d2/d9/d2b/d2e/d22/d27/d4d/d72/la1 0 2024-09-16T09:45:32.717 INFO:tasks.workunit.client.1.smithi114.stdout:7/483: readlink d2/d9/d2b/l3c 0 2024-09-16T09:45:32.721 INFO:tasks.workunit.client.1.smithi114.stdout:2/482: dread d1/d8/f32 [0,4194304] 0 2024-09-16T09:45:32.721 INFO:tasks.workunit.client.1.smithi114.stdout:2/483: write d1/d8/f12 [2277126,82531] 0 2024-09-16T09:45:32.725 INFO:tasks.workunit.client.1.smithi114.stdout:0/386: sync 2024-09-16T09:45:32.725 INFO:tasks.workunit.client.1.smithi114.stdout:0/387: write d1f/d22/d2e/d46/d7f/d8d/f8f [157280,53105] 0 2024-09-16T09:45:32.726 INFO:tasks.workunit.client.1.smithi114.stdout:6/456: dwrite d6/da/d10/f71 [0,4194304] 0 2024-09-16T09:45:32.726 INFO:tasks.workunit.client.1.smithi114.stdout:6/457: fdatasync d6/da/d36/d51/f6b 0 2024-09-16T09:45:32.727 INFO:tasks.workunit.client.1.smithi114.stdout:0/388: truncate f19 984577 0 2024-09-16T09:45:32.731 INFO:tasks.workunit.client.1.smithi114.stdout:6/458: creat d6/da/d10/d40/f94 x:0 0 0 2024-09-16T09:45:32.732 INFO:tasks.workunit.client.1.smithi114.stdout:6/459: getdents d6/da/d36/d51/d62 0 2024-09-16T09:45:32.733 INFO:tasks.workunit.client.1.smithi114.stdout:9/418: dwrite d3/da/d10/d23/d29/d2c/d45/f61 [4194304,4194304] 0 2024-09-16T09:45:32.737 INFO:tasks.workunit.client.1.smithi114.stdout:6/460: creat d6/da/d10/d40/f95 x:0 0 0 2024-09-16T09:45:32.740 INFO:tasks.workunit.client.1.smithi114.stdout:9/419: mkdir d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d 0 2024-09-16T09:45:32.741 INFO:tasks.workunit.client.1.smithi114.stdout:6/461: symlink d6/d64/l96 0 2024-09-16T09:45:32.742 INFO:tasks.workunit.client.1.smithi114.stdout:9/420: creat d3/da/d10/d23/d29/d2c/f8e x:0 0 0 2024-09-16T09:45:32.744 INFO:tasks.workunit.client.1.smithi114.stdout:9/421: creat d3/da/d10/d23/d29/d2c/d6b/d68/d81/f8f x:0 0 0 2024-09-16T09:45:32.744 INFO:tasks.workunit.client.1.smithi114.stdout:9/422: fsync d3/ff 0 2024-09-16T09:45:32.746 INFO:tasks.workunit.client.1.smithi114.stdout:9/423: rename d3/da/c47 to d3/da/d10/d23/d29/d87/c90 0 2024-09-16T09:45:32.746 INFO:tasks.workunit.client.1.smithi114.stdout:6/462: write d6/d2d/f34 [2701247,100558] 0 2024-09-16T09:45:32.747 INFO:tasks.workunit.client.1.smithi114.stdout:6/463: mknod d6/da/d36/d51/d62/d77/d7b/c97 0 2024-09-16T09:45:32.747 INFO:tasks.workunit.client.1.smithi114.stdout:6/464: dread - d6/d64/f84 zero size 2024-09-16T09:45:32.747 INFO:tasks.workunit.client.1.smithi114.stdout:6/465: fdatasync d6/d64/f65 0 2024-09-16T09:45:32.747 INFO:tasks.workunit.client.1.smithi114.stdout:6/466: fdatasync d6/da/d36/d51/f6b 0 2024-09-16T09:45:32.747 INFO:tasks.workunit.client.1.smithi114.stdout:6/467: write d6/f88 [543485,123870] 0 2024-09-16T09:45:32.759 INFO:tasks.workunit.client.1.smithi114.stdout:2/484: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 [0,4194304] 0 2024-09-16T09:45:32.761 INFO:tasks.workunit.client.1.smithi114.stdout:7/484: dwrite d2/d9/d2b/d2e/d77/f63 [0,4194304] 0 2024-09-16T09:45:32.761 INFO:tasks.workunit.client.1.smithi114.stdout:7/485: fdatasync d2/df/f3a 0 2024-09-16T09:45:32.762 INFO:tasks.workunit.client.1.smithi114.stdout:4/413: dwrite d0/d26/d2e/f32 [8388608,4194304] 0 2024-09-16T09:45:32.763 INFO:tasks.workunit.client.1.smithi114.stdout:2/485: creat d1/d8/d10/fbc x:0 0 0 2024-09-16T09:45:32.772 INFO:tasks.workunit.client.1.smithi114.stdout:4/414: dread d0/fe [4194304,4194304] 0 2024-09-16T09:45:32.775 INFO:tasks.workunit.client.1.smithi114.stdout:7/486: dread d2/d9/d2b/d2e/d22/d27/f40 [0,4194304] 0 2024-09-16T09:45:32.776 INFO:tasks.workunit.client.1.smithi114.stdout:7/487: unlink d2/d9/d2b/f5a 0 2024-09-16T09:45:32.776 INFO:tasks.workunit.client.1.smithi114.stdout:7/488: write d2/d9/d2b/d2e/d22/d4c/f9e [716469,70654] 0 2024-09-16T09:45:32.777 INFO:tasks.workunit.client.1.smithi114.stdout:7/489: symlink d2/df/la2 0 2024-09-16T09:45:32.778 INFO:tasks.workunit.client.1.smithi114.stdout:7/490: mknod d2/d9/d2b/d2e/d22/d27/d4d/d72/ca3 0 2024-09-16T09:45:32.780 INFO:tasks.workunit.client.1.smithi114.stdout:7/491: creat d2/d9/d2b/d2e/d22/d27/d4d/fa4 x:0 0 0 2024-09-16T09:45:32.781 INFO:tasks.workunit.client.1.smithi114.stdout:7/492: rename d2/d9/d2b/d2e/d77/f63 to d2/d9/d2b/d59/fa5 0 2024-09-16T09:45:32.781 INFO:tasks.workunit.client.1.smithi114.stdout:7/493: write d2/d9/d2b/d2e/d22/d27/d4d/f97 [27481,92226] 0 2024-09-16T09:45:32.793 INFO:tasks.workunit.client.1.smithi114.stdout:6/468: dwrite d6/da/d36/d51/f60 [0,4194304] 0 2024-09-16T09:45:32.793 INFO:tasks.workunit.client.1.smithi114.stdout:6/469: readlink d6/l2e 0 2024-09-16T09:45:32.793 INFO:tasks.workunit.client.1.smithi114.stdout:2/486: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f74 [4194304,4194304] 0 2024-09-16T09:45:32.794 INFO:tasks.workunit.client.1.smithi114.stdout:4/415: dwrite d0/f21 [4194304,4194304] 0 2024-09-16T09:45:32.797 INFO:tasks.workunit.client.1.smithi114.stdout:6/470: unlink d6/f44 0 2024-09-16T09:45:32.797 INFO:tasks.workunit.client.1.smithi114.stdout:6/471: chown d6/d2d/l2f 11 1 2024-09-16T09:45:32.797 INFO:tasks.workunit.client.1.smithi114.stdout:6/472: dread - d6/da/d36/d51/f6f zero size 2024-09-16T09:45:32.797 INFO:tasks.workunit.client.1.smithi114.stdout:6/473: write d6/d2d/f70 [536634,52182] 0 2024-09-16T09:45:32.797 INFO:tasks.workunit.client.1.smithi114.stdout:7/494: truncate d2/d9/d2b/d59/fa5 2283986 0 2024-09-16T09:45:32.797 INFO:tasks.workunit.client.1.smithi114.stdout:7/495: chown d2/d9/d2b/d2e/f45 111452 1 2024-09-16T09:45:32.799 INFO:tasks.workunit.client.1.smithi114.stdout:2/487: rename d1/d8/d10/l91 to d1/d8/d10/d16/d1d/d92/lbd 0 2024-09-16T09:45:32.805 INFO:tasks.workunit.client.1.smithi114.stdout:4/416: mkdir d0/d26/d3c/d3e/d5a/d5d/d70/d83 0 2024-09-16T09:45:32.805 INFO:tasks.workunit.client.1.smithi114.stdout:6/474: mknod d6/d64/c98 0 2024-09-16T09:45:32.806 INFO:tasks.workunit.client.1.smithi114.stdout:7/496: truncate d2/f1c 1736941 0 2024-09-16T09:45:32.806 INFO:tasks.workunit.client.1.smithi114.stdout:6/475: read d6/da/d36/f75 [341585,59233] 0 2024-09-16T09:45:32.808 INFO:tasks.workunit.client.1.smithi114.stdout:2/488: mknod d1/d8/d10/d16/d1d/d92/da3/cbe 0 2024-09-16T09:45:32.808 INFO:tasks.workunit.client.1.smithi114.stdout:2/489: write d1/d8/d10/d16/d1d/d92/da7/d3e/f59 [2344915,88836] 0 2024-09-16T09:45:32.810 INFO:tasks.workunit.client.1.smithi114.stdout:7/497: creat d2/d55/fa6 x:0 0 0 2024-09-16T09:45:32.813 INFO:tasks.workunit.client.1.smithi114.stdout:6/476: symlink d6/da/d36/d51/d62/l99 0 2024-09-16T09:45:32.813 INFO:tasks.workunit.client.1.smithi114.stdout:7/498: creat d2/d9/fa7 x:0 0 0 2024-09-16T09:45:32.813 INFO:tasks.workunit.client.1.smithi114.stdout:3/571: sync 2024-09-16T09:45:32.813 INFO:tasks.workunit.client.1.smithi114.stdout:8/411: sync 2024-09-16T09:45:32.816 INFO:tasks.workunit.client.1.smithi114.stdout:8/412: link d4/db/d68/d28/f77 d4/d6d/f8e 0 2024-09-16T09:45:32.816 INFO:tasks.workunit.client.1.smithi114.stdout:8/413: write d4/d1f/f35 [2213285,85956] 0 2024-09-16T09:45:32.817 INFO:tasks.workunit.client.1.smithi114.stdout:7/499: dread d2/d9/d2b/d2e/d22/d4c/f9e [0,4194304] 0 2024-09-16T09:45:32.819 INFO:tasks.workunit.client.1.smithi114.stdout:7/500: creat d2/d9/d2b/d59/d7f/fa8 x:0 0 0 2024-09-16T09:45:32.822 INFO:tasks.workunit.client.1.smithi114.stdout:7/501: rename d2/d9/d2b/d59/d7f/l90 to d2/d9/d2b/d2e/d3e/la9 0 2024-09-16T09:45:32.824 INFO:tasks.workunit.client.1.smithi114.stdout:7/502: rename d2/df/l67 to d2/d9/d51/laa 0 2024-09-16T09:45:32.825 INFO:tasks.workunit.client.1.smithi114.stdout:4/417: dwrite d0/d13/f22 [4194304,4194304] 0 2024-09-16T09:45:32.825 INFO:tasks.workunit.client.1.smithi114.stdout:7/503: creat d2/fab x:0 0 0 2024-09-16T09:45:32.828 INFO:tasks.workunit.client.1.smithi114.stdout:4/418: truncate d0/d26/d3c/d3e/d4d/f51 5646866 0 2024-09-16T09:45:32.829 INFO:tasks.workunit.client.1.smithi114.stdout:7/504: mkdir d2/d9/d2b/d2e/d3e/d79/dac 0 2024-09-16T09:45:32.830 INFO:tasks.workunit.client.1.smithi114.stdout:8/414: read d4/db/dd/f44 [3132588,60396] 0 2024-09-16T09:45:32.830 INFO:tasks.workunit.client.1.smithi114.stdout:8/415: chown d4/db/d68/d52/d54/l57 57518 1 2024-09-16T09:45:32.831 INFO:tasks.workunit.client.1.smithi114.stdout:4/419: rmdir d0/d26/d3c/d3e/d5a/d5d 39 2024-09-16T09:45:32.831 INFO:tasks.workunit.client.1.smithi114.stdout:4/420: truncate d0/d26/d2e/f62 1308185 0 2024-09-16T09:45:32.832 INFO:tasks.workunit.client.1.smithi114.stdout:7/505: mknod d2/d9/d2b/d78/cad 0 2024-09-16T09:45:32.832 INFO:tasks.workunit.client.1.smithi114.stdout:7/506: write d2/d9/d2b/f95 [654691,49820] 0 2024-09-16T09:45:32.833 INFO:tasks.workunit.client.1.smithi114.stdout:4/421: rename d0/c5b to d0/d13/d56/d7e/c84 0 2024-09-16T09:45:32.834 INFO:tasks.workunit.client.1.smithi114.stdout:2/490: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/fb4 [0,4194304] 0 2024-09-16T09:45:32.834 INFO:tasks.workunit.client.1.smithi114.stdout:6/477: dwrite d6/da/f2c [0,4194304] 0 2024-09-16T09:45:32.834 INFO:tasks.workunit.client.1.smithi114.stdout:4/422: write d0/d26/d3c/d3e/d4d/f54 [364904,94581] 0 2024-09-16T09:45:32.834 INFO:tasks.workunit.client.1.smithi114.stdout:6/478: chown d6/da/d10/d40/d82/f8d 32172269 1 2024-09-16T09:45:32.834 INFO:tasks.workunit.client.1.smithi114.stdout:6/479: chown d6/d64/l96 859121 1 2024-09-16T09:45:32.835 INFO:tasks.workunit.client.1.smithi114.stdout:7/507: creat d2/d9/d2b/d2e/d22/d27/fae x:0 0 0 2024-09-16T09:45:32.837 INFO:tasks.workunit.client.1.smithi114.stdout:2/491: link d1/d8/d10/d16/d1d/d92/da7/l89 d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/lbf 0 2024-09-16T09:45:32.847 INFO:tasks.workunit.client.1.smithi114.stdout:6/480: symlink d6/da/d10/d92/l9a 0 2024-09-16T09:45:32.848 INFO:tasks.workunit.client.1.smithi114.stdout:7/508: symlink d2/d9/d2b/d2e/d22/d4c/laf 0 2024-09-16T09:45:32.848 INFO:tasks.workunit.client.1.smithi114.stdout:7/509: read - d2/d9/d2b/d2e/d3e/d79/f8a zero size 2024-09-16T09:45:32.849 INFO:tasks.workunit.client.1.smithi114.stdout:6/481: rename d6/da/d36/d51/d62/d77/f93 to d6/d2d/f9b 0 2024-09-16T09:45:32.849 INFO:tasks.workunit.client.1.smithi114.stdout:6/482: truncate d6/da/f74 49325 0 2024-09-16T09:45:32.850 INFO:tasks.workunit.client.1.smithi114.stdout:6/483: chown d6/da/d10/d40 70100720 1 2024-09-16T09:45:32.850 INFO:tasks.workunit.client.1.smithi114.stdout:6/484: write d6/f6c [528749,47615] 0 2024-09-16T09:45:32.850 INFO:tasks.workunit.client.1.smithi114.stdout:7/510: mkdir d2/d9/d2b/d2e/d22/d66/db0 0 2024-09-16T09:45:32.850 INFO:tasks.workunit.client.1.smithi114.stdout:2/492: read d1/d8/d10/f35 [2531774,42851] 0 2024-09-16T09:45:32.851 INFO:tasks.workunit.client.1.smithi114.stdout:6/485: mkdir d6/d2d/d46/d9c 0 2024-09-16T09:45:32.851 INFO:tasks.workunit.client.1.smithi114.stdout:6/486: chown d6/da/d36/f38 154442 1 2024-09-16T09:45:32.851 INFO:tasks.workunit.client.1.smithi114.stdout:6/487: chown d6/f85 28 1 2024-09-16T09:45:32.851 INFO:tasks.workunit.client.1.smithi114.stdout:2/493: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/fc0 x:0 0 0 2024-09-16T09:45:32.852 INFO:tasks.workunit.client.1.smithi114.stdout:6/488: creat d6/da/d10/f9d x:0 0 0 2024-09-16T09:45:32.852 INFO:tasks.workunit.client.1.smithi114.stdout:6/489: write d6/da/d10/f1d [1714693,116204] 0 2024-09-16T09:45:32.852 INFO:tasks.workunit.client.1.smithi114.stdout:2/494: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f81 1307635 0 2024-09-16T09:45:32.853 INFO:tasks.workunit.client.1.smithi114.stdout:6/490: symlink d6/da/d76/l9e 0 2024-09-16T09:45:32.854 INFO:tasks.workunit.client.1.smithi114.stdout:8/416: dwrite d4/f15 [0,4194304] 0 2024-09-16T09:45:32.855 INFO:tasks.workunit.client.1.smithi114.stdout:2/495: link d1/d8/d10/d16/d1d/d92/da7/d3e/l9c d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/lc1 0 2024-09-16T09:45:32.855 INFO:tasks.workunit.client.1.smithi114.stdout:2/496: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/f87 0 2024-09-16T09:45:32.855 INFO:tasks.workunit.client.1.smithi114.stdout:2/497: dread - d1/d8/fa4 zero size 2024-09-16T09:45:32.858 INFO:tasks.workunit.client.1.smithi114.stdout:8/417: creat d4/db/d39/f8f x:0 0 0 2024-09-16T09:45:32.858 INFO:tasks.workunit.client.1.smithi114.stdout:8/418: fsync d4/db/d39/d3c/d4e/d62/f73 0 2024-09-16T09:45:32.858 INFO:tasks.workunit.client.1.smithi114.stdout:8/419: truncate d4/db/d68/d52/d54/f74 461100 0 2024-09-16T09:45:32.858 INFO:tasks.workunit.client.1.smithi114.stdout:4/423: dwrite d0/d26/d3c/d3e/d4b/d46/f80 [0,4194304] 0 2024-09-16T09:45:32.859 INFO:tasks.workunit.client.1.smithi114.stdout:2/498: creat d1/d8/d10/d16/d1d/d92/da3/fc2 x:0 0 0 2024-09-16T09:45:32.864 INFO:tasks.workunit.client.1.smithi114.stdout:4/424: unlink d0/d26/d29/c82 0 2024-09-16T09:45:32.864 INFO:tasks.workunit.client.1.smithi114.stdout:5/482: sync 2024-09-16T09:45:32.864 INFO:tasks.workunit.client.1.smithi114.stdout:1/441: sync 2024-09-16T09:45:32.864 INFO:tasks.workunit.client.1.smithi114.stdout:7/511: dread d2/d9/d2b/d2e/d22/d27/f2a [0,4194304] 0 2024-09-16T09:45:32.864 INFO:tasks.workunit.client.1.smithi114.stdout:7/512: fsync d2/d9/d2b/f95 0 2024-09-16T09:45:32.864 INFO:tasks.workunit.client.1.smithi114.stdout:2/499: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 x:0 0 0 2024-09-16T09:45:32.865 INFO:tasks.workunit.client.1.smithi114.stdout:2/500: write d1/d8/d10/d16/d1d/d92/da7/d3e/fa5 [867369,100681] 0 2024-09-16T09:45:32.865 INFO:tasks.workunit.client.1.smithi114.stdout:2/501: truncate d1/f86 398375 0 2024-09-16T09:45:32.866 INFO:tasks.workunit.client.1.smithi114.stdout:4/425: rename d0/d26/d2e/f32 to d0/f85 0 2024-09-16T09:45:32.866 INFO:tasks.workunit.client.1.smithi114.stdout:4/426: chown d0/l28 38109595 1 2024-09-16T09:45:32.866 INFO:tasks.workunit.client.1.smithi114.stdout:5/483: unlink d3/d24/d84/d7a/c38 0 2024-09-16T09:45:32.867 INFO:tasks.workunit.client.1.smithi114.stdout:1/442: mkdir d4/d2b/d29/d92 0 2024-09-16T09:45:32.867 INFO:tasks.workunit.client.1.smithi114.stdout:1/443: write d4/d2b/d16/f84 [1132830,97809] 0 2024-09-16T09:45:32.868 INFO:tasks.workunit.client.1.smithi114.stdout:1/444: chown d4/d2b/d16/d47/d83/f8c 619202 1 2024-09-16T09:45:32.868 INFO:tasks.workunit.client.1.smithi114.stdout:1/445: chown d4/d3d/d41 319700 1 2024-09-16T09:45:32.868 INFO:tasks.workunit.client.1.smithi114.stdout:7/513: mkdir d2/d9/db1 0 2024-09-16T09:45:32.869 INFO:tasks.workunit.client.1.smithi114.stdout:4/427: creat d0/d13/f86 x:0 0 0 2024-09-16T09:45:32.871 INFO:tasks.workunit.client.1.smithi114.stdout:5/484: fsync d3/f5 0 2024-09-16T09:45:32.873 INFO:tasks.workunit.client.1.smithi114.stdout:4/428: truncate d0/d26/d29/f1d 4209659 0 2024-09-16T09:45:32.873 INFO:tasks.workunit.client.1.smithi114.stdout:4/429: dread - d0/d26/d3c/d45/f50 zero size 2024-09-16T09:45:32.873 INFO:tasks.workunit.client.1.smithi114.stdout:4/430: mkdir d0/d26/d40/d75/d7f/d87 0 2024-09-16T09:45:32.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/491: dwrite d6/da/f1e [0,4194304] 0 2024-09-16T09:45:32.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/492: readlink d6/da/d76/l9e 0 2024-09-16T09:45:32.882 INFO:tasks.workunit.client.1.smithi114.stdout:8/420: dwrite d4/db/dd/f16 [0,4194304] 0 2024-09-16T09:45:32.882 INFO:tasks.workunit.client.1.smithi114.stdout:8/421: fdatasync d4/db/dd/f20 0 2024-09-16T09:45:32.883 INFO:tasks.workunit.client.1.smithi114.stdout:5/485: dread d3/d24/d84/f2a [0,4194304] 0 2024-09-16T09:45:32.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/493: link d6/da/d36/f75 d6/d64/f9f 0 2024-09-16T09:45:32.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/494: dread - d6/da/d36/d51/f6f zero size 2024-09-16T09:45:32.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/495: fdatasync d6/f23 0 2024-09-16T09:45:32.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/496: write d6/da/d48/f58 [717947,12496] 0 2024-09-16T09:45:32.885 INFO:tasks.workunit.client.1.smithi114.stdout:4/431: dread d0/d26/f48 [0,4194304] 0 2024-09-16T09:45:32.886 INFO:tasks.workunit.client.1.smithi114.stdout:8/422: mknod d4/db/d39/d3c/d86/c90 0 2024-09-16T09:45:32.888 INFO:tasks.workunit.client.1.smithi114.stdout:5/486: creat d3/d24/d7d/f9b x:0 0 0 2024-09-16T09:45:32.889 INFO:tasks.workunit.client.1.smithi114.stdout:4/432: creat d0/d26/f88 x:0 0 0 2024-09-16T09:45:32.889 INFO:tasks.workunit.client.1.smithi114.stdout:8/423: getdents d4/db/d39/d3c 0 2024-09-16T09:45:32.891 INFO:tasks.workunit.client.1.smithi114.stdout:5/487: creat d3/d24/d84/d71/d72/f9c x:0 0 0 2024-09-16T09:45:32.892 INFO:tasks.workunit.client.1.smithi114.stdout:4/433: symlink d0/d26/d3c/d3e/d4b/d46/l89 0 2024-09-16T09:45:32.894 INFO:tasks.workunit.client.1.smithi114.stdout:5/488: unlink d3/f4 0 2024-09-16T09:45:32.894 INFO:tasks.workunit.client.1.smithi114.stdout:5/489: write d3/d24/d84/d71/d72/d2d/d3f/f5c [280966,61429] 0 2024-09-16T09:45:32.894 INFO:tasks.workunit.client.1.smithi114.stdout:6/497: read d6/da/d10/f39 [862825,130481] 0 2024-09-16T09:45:32.895 INFO:tasks.workunit.client.1.smithi114.stdout:5/490: creat d3/d24/d84/d71/d72/d2d/d87/f9d x:0 0 0 2024-09-16T09:45:32.897 INFO:tasks.workunit.client.1.smithi114.stdout:8/424: dread d4/db/dd/f13 [0,4194304] 0 2024-09-16T09:45:32.900 INFO:tasks.workunit.client.1.smithi114.stdout:8/425: unlink d4/db/d68/d52/d54/f74 0 2024-09-16T09:45:32.900 INFO:tasks.workunit.client.1.smithi114.stdout:8/426: dread - d4/db/d39/d3c/d86/f8c zero size 2024-09-16T09:45:32.901 INFO:tasks.workunit.client.1.smithi114.stdout:6/498: write d6/d2d/d46/f5a [3185892,43320] 0 2024-09-16T09:45:32.901 INFO:tasks.workunit.client.1.smithi114.stdout:8/427: mkdir d4/db/d91 0 2024-09-16T09:45:32.904 INFO:tasks.workunit.client.1.smithi114.stdout:6/499: unlink d6/da/d10/c18 0 2024-09-16T09:45:32.904 INFO:tasks.workunit.client.1.smithi114.stdout:9/424: sync 2024-09-16T09:45:32.904 INFO:tasks.workunit.client.1.smithi114.stdout:0/389: sync 2024-09-16T09:45:32.905 INFO:tasks.workunit.client.1.smithi114.stdout:8/428: creat d4/db/d39/d3c/d4e/f92 x:0 0 0 2024-09-16T09:45:32.907 INFO:tasks.workunit.client.1.smithi114.stdout:6/500: unlink d6/da/l6a 0 2024-09-16T09:45:32.908 INFO:tasks.workunit.client.1.smithi114.stdout:9/425: rename d3/da/d10/d23/d43/d1e/d4c/l60 to d3/da/d10/d23/d43/d1e/d4c/d8c/l91 0 2024-09-16T09:45:32.911 INFO:tasks.workunit.client.1.smithi114.stdout:9/426: creat d3/da/d10/d23/d29/d2c/d6b/f92 x:0 0 0 2024-09-16T09:45:32.912 INFO:tasks.workunit.client.1.smithi114.stdout:6/501: dread d6/da/f67 [0,4194304] 0 2024-09-16T09:45:32.916 INFO:tasks.workunit.client.1.smithi114.stdout:4/434: dwrite d0/d13/f6f [0,4194304] 0 2024-09-16T09:45:32.918 INFO:tasks.workunit.client.1.smithi114.stdout:0/390: write f6 [559306,100020] 0 2024-09-16T09:45:32.921 INFO:tasks.workunit.client.1.smithi114.stdout:4/435: creat d0/d26/d29/d2b/d58/f8a x:0 0 0 2024-09-16T09:45:32.923 INFO:tasks.workunit.client.1.smithi114.stdout:4/436: creat d0/d26/f8b x:0 0 0 2024-09-16T09:45:32.923 INFO:tasks.workunit.client.1.smithi114.stdout:4/437: write d0/d26/d3c/d3e/d4b/d46/f68 [585208,102604] 0 2024-09-16T09:45:32.928 INFO:tasks.workunit.client.1.smithi114.stdout:8/429: dwrite d4/f15 [0,4194304] 0 2024-09-16T09:45:32.928 INFO:tasks.workunit.client.1.smithi114.stdout:8/430: dread - d4/db/d39/d3c/d4e/d62/f73 zero size 2024-09-16T09:45:32.929 INFO:tasks.workunit.client.1.smithi114.stdout:8/431: creat d4/db/d39/d3c/d4e/f93 x:0 0 0 2024-09-16T09:45:32.930 INFO:tasks.workunit.client.1.smithi114.stdout:8/432: chown d4/db/d68/d52/d54 1391683 1 2024-09-16T09:45:32.930 INFO:tasks.workunit.client.1.smithi114.stdout:8/433: write d4/db/d68/d52/f7b [530999,65181] 0 2024-09-16T09:45:32.940 INFO:tasks.workunit.client.1.smithi114.stdout:6/502: dwrite d6/da/d10/f33 [0,4194304] 0 2024-09-16T09:45:32.940 INFO:tasks.workunit.client.1.smithi114.stdout:6/503: stat d6/da/d10/l1b 0 2024-09-16T09:45:32.940 INFO:tasks.workunit.client.1.smithi114.stdout:6/504: chown d6/da/d76/l8b 3 1 2024-09-16T09:45:32.940 INFO:tasks.workunit.client.1.smithi114.stdout:0/391: dwrite d1f/d27/d55/f71 [0,4194304] 0 2024-09-16T09:45:32.940 INFO:tasks.workunit.client.1.smithi114.stdout:0/392: fdatasync d1f/d22/d2e/f40 0 2024-09-16T09:45:32.940 INFO:tasks.workunit.client.1.smithi114.stdout:9/427: dwrite d3/da/d10/d23/d29/d2c/d45/f61 [0,4194304] 0 2024-09-16T09:45:32.942 INFO:tasks.workunit.client.1.smithi114.stdout:0/393: read f16 [1319485,111347] 0 2024-09-16T09:45:32.942 INFO:tasks.workunit.client.1.smithi114.stdout:6/505: creat d6/da/d10/d40/fa0 x:0 0 0 2024-09-16T09:45:32.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/506: truncate d6/d2d/f54 8378581 0 2024-09-16T09:45:32.946 INFO:tasks.workunit.client.1.smithi114.stdout:0/394: symlink d1f/d2d/l94 0 2024-09-16T09:45:32.947 INFO:tasks.workunit.client.1.smithi114.stdout:0/395: getdents d1f/d27/d47/d56 0 2024-09-16T09:45:32.951 INFO:tasks.workunit.client.1.smithi114.stdout:3/572: sync 2024-09-16T09:45:32.954 INFO:tasks.workunit.client.1.smithi114.stdout:0/396: dread f15 [0,4194304] 0 2024-09-16T09:45:32.954 INFO:tasks.workunit.client.1.smithi114.stdout:6/507: write d6/da/d10/f16 [7876615,23092] 0 2024-09-16T09:45:32.959 INFO:tasks.workunit.client.1.smithi114.stdout:9/428: dwrite d3/da/d10/d23/d29/d2c/f62 [0,4194304] 0 2024-09-16T09:45:32.959 INFO:tasks.workunit.client.1.smithi114.stdout:9/429: chown d3/da/d10/d23/l80 27686 1 2024-09-16T09:45:32.959 INFO:tasks.workunit.client.1.smithi114.stdout:6/508: dread d6/d2d/d46/f52 [0,4194304] 0 2024-09-16T09:45:32.959 INFO:tasks.workunit.client.1.smithi114.stdout:6/509: write d6/da/d36/d51/f6f [700365,104009] 0 2024-09-16T09:45:32.961 INFO:tasks.workunit.client.1.smithi114.stdout:9/430: mkdir d3/da/d10/d23/d29/d2c/d45/d93 0 2024-09-16T09:45:32.962 INFO:tasks.workunit.client.1.smithi114.stdout:9/431: getdents d3/da/d10/d23/d29/d3f 0 2024-09-16T09:45:32.963 INFO:tasks.workunit.client.1.smithi114.stdout:9/432: mknod d3/da/d10/d23/d29/d2c/c94 0 2024-09-16T09:45:32.965 INFO:tasks.workunit.client.1.smithi114.stdout:9/433: mknod d3/da/d10/d23/d29/d87/c95 0 2024-09-16T09:45:32.965 INFO:tasks.workunit.client.1.smithi114.stdout:9/434: fsync d3/da/d10/f21 0 2024-09-16T09:45:32.965 INFO:tasks.workunit.client.1.smithi114.stdout:9/435: chown d3/da/d10/d23/d43/f16 40 1 2024-09-16T09:45:32.973 INFO:tasks.workunit.client.1.smithi114.stdout:6/510: dwrite d6/da/d36/f3f [0,4194304] 0 2024-09-16T09:45:32.977 INFO:tasks.workunit.client.1.smithi114.stdout:6/511: creat d6/d2d/fa1 x:0 0 0 2024-09-16T09:45:32.977 INFO:tasks.workunit.client.1.smithi114.stdout:6/512: fsync d6/da/d36/f3b 0 2024-09-16T09:45:32.977 INFO:tasks.workunit.client.1.smithi114.stdout:0/397: dwrite d1f/d22/f26 [4194304,4194304] 0 2024-09-16T09:45:32.978 INFO:tasks.workunit.client.1.smithi114.stdout:6/513: creat d6/da/d10/d40/fa2 x:0 0 0 2024-09-16T09:45:32.980 INFO:tasks.workunit.client.1.smithi114.stdout:6/514: link d6/da/d10/d40/f72 d6/da/d10/fa3 0 2024-09-16T09:45:32.995 INFO:tasks.workunit.client.1.smithi114.stdout:9/436: dwrite d3/da/d10/d23/f4f [0,4194304] 0 2024-09-16T09:45:32.998 INFO:tasks.workunit.client.1.smithi114.stdout:9/437: unlink d3/da/d10/d23/f4f 0 2024-09-16T09:45:32.999 INFO:tasks.workunit.client.1.smithi114.stdout:0/398: dwrite d1f/d20/d48/f73 [0,4194304] 0 2024-09-16T09:45:33.000 INFO:tasks.workunit.client.1.smithi114.stdout:9/438: symlink d3/da/d10/d23/d29/d87/l96 0 2024-09-16T09:45:33.000 INFO:tasks.workunit.client.1.smithi114.stdout:9/439: getdents d3/da/d10/d23/d29/d3f 0 2024-09-16T09:45:33.001 INFO:tasks.workunit.client.1.smithi114.stdout:6/515: dwrite d6/d64/f91 [0,4194304] 0 2024-09-16T09:45:33.001 INFO:tasks.workunit.client.1.smithi114.stdout:6/516: write d6/da/d76/f8a [507289,80584] 0 2024-09-16T09:45:33.002 INFO:tasks.workunit.client.1.smithi114.stdout:9/440: truncate d3/da/d10/f1b 2750175 0 2024-09-16T09:45:33.002 INFO:tasks.workunit.client.1.smithi114.stdout:9/441: fdatasync d3/da/d10/d23/d29/d2c/d70/f7c 0 2024-09-16T09:45:33.004 INFO:tasks.workunit.client.1.smithi114.stdout:6/517: rename d6/da/d10/d40/f50 to d6/da/d36/fa4 0 2024-09-16T09:45:33.004 INFO:tasks.workunit.client.1.smithi114.stdout:9/442: rename d3/da/d10/d23/d29/d2c to d3/da/d10/d23/d29/d2c/d45/d97 22 2024-09-16T09:45:33.005 INFO:tasks.workunit.client.1.smithi114.stdout:6/518: symlink d6/da/d36/d51/la5 0 2024-09-16T09:45:33.007 INFO:tasks.workunit.client.1.smithi114.stdout:6/519: unlink d6/da/d10/f39 0 2024-09-16T09:45:33.008 INFO:tasks.workunit.client.1.smithi114.stdout:6/520: creat d6/da/d10/d40/fa6 x:0 0 0 2024-09-16T09:45:33.008 INFO:tasks.workunit.client.1.smithi114.stdout:6/521: chown d6/d2d/f37 46 1 2024-09-16T09:45:33.009 INFO:tasks.workunit.client.1.smithi114.stdout:2/502: sync 2024-09-16T09:45:33.010 INFO:tasks.workunit.client.1.smithi114.stdout:2/503: symlink d1/d9e/lc4 0 2024-09-16T09:45:33.010 INFO:tasks.workunit.client.1.smithi114.stdout:2/504: read - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f6f zero size 2024-09-16T09:45:33.010 INFO:tasks.workunit.client.1.smithi114.stdout:2/505: chown d1/f7b 1780707 1 2024-09-16T09:45:33.010 INFO:tasks.workunit.client.1.smithi114.stdout:2/506: write d1/d8/d10/f49 [596817,123348] 0 2024-09-16T09:45:33.011 INFO:tasks.workunit.client.1.smithi114.stdout:0/399: dread d1f/f3f [0,4194304] 0 2024-09-16T09:45:33.011 INFO:tasks.workunit.client.1.smithi114.stdout:2/507: creat d1/d8/d10/d16/d1d/d92/da3/fc5 x:0 0 0 2024-09-16T09:45:33.011 INFO:tasks.workunit.client.1.smithi114.stdout:2/508: read - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/f88 zero size 2024-09-16T09:45:33.013 INFO:tasks.workunit.client.1.smithi114.stdout:0/400: rename d1f/d22/d2e/d46/f58 to d1f/d22/d2e/d46/d7f/d8d/f95 0 2024-09-16T09:45:33.015 INFO:tasks.workunit.client.1.smithi114.stdout:2/509: rename d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f52 to d1/d8/d10/d16/d1d/d92/da3/fc6 0 2024-09-16T09:45:33.016 INFO:tasks.workunit.client.1.smithi114.stdout:6/522: dread d6/d2d/f34 [0,4194304] 0 2024-09-16T09:45:33.016 INFO:tasks.workunit.client.1.smithi114.stdout:6/523: chown d6/f85 5361 1 2024-09-16T09:45:33.016 INFO:tasks.workunit.client.1.smithi114.stdout:0/401: creat d1f/d27/f96 x:0 0 0 2024-09-16T09:45:33.016 INFO:tasks.workunit.client.1.smithi114.stdout:2/510: creat d1/d8/d10/d16/d1d/fc7 x:0 0 0 2024-09-16T09:45:33.017 INFO:tasks.workunit.client.1.smithi114.stdout:9/443: dread d3/da/fb [0,4194304] 0 2024-09-16T09:45:33.017 INFO:tasks.workunit.client.1.smithi114.stdout:9/444: chown d3/da/d10/d23/l4e 3389 1 2024-09-16T09:45:33.017 INFO:tasks.workunit.client.1.smithi114.stdout:9/445: fdatasync d3/da/d10/d23/d43/d1e/f5e 0 2024-09-16T09:45:33.018 INFO:tasks.workunit.client.1.smithi114.stdout:6/524: link d6/da/d36/d51/d62/d77/d7b/c97 d6/da/d36/d51/ca7 0 2024-09-16T09:45:33.018 INFO:tasks.workunit.client.1.smithi114.stdout:6/525: fdatasync d6/d2d/f3a 0 2024-09-16T09:45:33.020 INFO:tasks.workunit.client.1.smithi114.stdout:6/526: rename d6/f85 to d6/da/d36/fa8 0 2024-09-16T09:45:33.020 INFO:tasks.workunit.client.1.smithi114.stdout:6/527: chown d6/da/d36/f3b 1702 1 2024-09-16T09:45:33.020 INFO:tasks.workunit.client.1.smithi114.stdout:6/528: dread - d6/da/d10/d40/fa6 zero size 2024-09-16T09:45:33.020 INFO:tasks.workunit.client.1.smithi114.stdout:0/402: dread d1f/d22/f2b [0,4194304] 0 2024-09-16T09:45:33.020 INFO:tasks.workunit.client.1.smithi114.stdout:0/403: chown d1f/d27/d55/f71 397 1 2024-09-16T09:45:33.021 INFO:tasks.workunit.client.1.smithi114.stdout:6/529: creat d6/da/d36/fa9 x:0 0 0 2024-09-16T09:45:33.022 INFO:tasks.workunit.client.1.smithi114.stdout:0/404: getdents d1f/d22 0 2024-09-16T09:45:33.026 INFO:tasks.workunit.client.1.smithi114.stdout:6/530: creat d6/da/d36/d51/d62/faa x:0 0 0 2024-09-16T09:45:33.026 INFO:tasks.workunit.client.1.smithi114.stdout:0/405: mknod d1f/d22/d2e/c97 0 2024-09-16T09:45:33.027 INFO:tasks.workunit.client.1.smithi114.stdout:0/406: dread - d1f/f74 zero size 2024-09-16T09:45:33.027 INFO:tasks.workunit.client.1.smithi114.stdout:0/407: write d1f/d22/f49 [18506,93704] 0 2024-09-16T09:45:33.028 INFO:tasks.workunit.client.1.smithi114.stdout:0/408: symlink d1f/d27/d47/l98 0 2024-09-16T09:45:33.028 INFO:tasks.workunit.client.1.smithi114.stdout:0/409: dread - d1f/d20/f34 zero size 2024-09-16T09:45:33.030 INFO:tasks.workunit.client.1.smithi114.stdout:1/446: sync 2024-09-16T09:45:33.030 INFO:tasks.workunit.client.1.smithi114.stdout:5/491: sync 2024-09-16T09:45:33.032 INFO:tasks.workunit.client.1.smithi114.stdout:1/447: creat d4/d2b/d16/d47/f93 x:0 0 0 2024-09-16T09:45:33.034 INFO:tasks.workunit.client.1.smithi114.stdout:1/448: creat d4/f94 x:0 0 0 2024-09-16T09:45:33.034 INFO:tasks.workunit.client.1.smithi114.stdout:1/449: rmdir d4/d2b/d2f/d3a/d55 39 2024-09-16T09:45:33.036 INFO:tasks.workunit.client.1.smithi114.stdout:1/450: creat d4/d2b/d16/d47/f95 x:0 0 0 2024-09-16T09:45:33.036 INFO:tasks.workunit.client.1.smithi114.stdout:1/451: chown d4/d2b/c61 1 1 2024-09-16T09:45:33.038 INFO:tasks.workunit.client.1.smithi114.stdout:1/452: creat d4/d2b/d16/d71/f96 x:0 0 0 2024-09-16T09:45:33.038 INFO:tasks.workunit.client.1.smithi114.stdout:1/453: fsync d4/d2b/d2f/d3a/f4f 0 2024-09-16T09:45:33.038 INFO:tasks.workunit.client.1.smithi114.stdout:1/454: creat d4/d2b/d16/d47/d83/f97 x:0 0 0 2024-09-16T09:45:33.040 INFO:tasks.workunit.client.1.smithi114.stdout:1/455: rmdir d4 39 2024-09-16T09:45:33.040 INFO:tasks.workunit.client.1.smithi114.stdout:1/456: dread - d4/d2b/d2f/d3a/d56/f88 zero size 2024-09-16T09:45:33.041 INFO:tasks.workunit.client.1.smithi114.stdout:1/457: symlink d4/d2b/d2f/d3a/d56/l98 0 2024-09-16T09:45:33.046 INFO:tasks.workunit.client.1.smithi114.stdout:9/446: dwrite d3/da/d10/d23/d29/d2c/d6b/f56 [0,4194304] 0 2024-09-16T09:45:33.047 INFO:tasks.workunit.client.1.smithi114.stdout:9/447: symlink d3/da/d10/d23/d43/d1e/d7b/l98 0 2024-09-16T09:45:33.048 INFO:tasks.workunit.client.1.smithi114.stdout:9/448: symlink d3/da/d10/d23/d43/d1e/d4c/d8c/l99 0 2024-09-16T09:45:33.053 INFO:tasks.workunit.client.1.smithi114.stdout:0/410: dwrite d1f/d20/d48/f5c [0,4194304] 0 2024-09-16T09:45:33.053 INFO:tasks.workunit.client.1.smithi114.stdout:5/492: dwrite d3/d24/d84/d71/d72/d2d/d3f/f4a [4194304,4194304] 0 2024-09-16T09:45:33.056 INFO:tasks.workunit.client.1.smithi114.stdout:5/493: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d9e 0 2024-09-16T09:45:33.056 INFO:tasks.workunit.client.1.smithi114.stdout:5/494: stat d3/d24/d84/d7a/d43/f48 0 2024-09-16T09:45:33.072 INFO:tasks.workunit.client.1.smithi114.stdout:9/449: dwrite d3/f7f [0,4194304] 0 2024-09-16T09:45:33.072 INFO:tasks.workunit.client.1.smithi114.stdout:0/411: dwrite f14 [0,4194304] 0 2024-09-16T09:45:33.072 INFO:tasks.workunit.client.1.smithi114.stdout:0/412: fsync f15 0 2024-09-16T09:45:33.072 INFO:tasks.workunit.client.1.smithi114.stdout:0/413: write d1f/d27/f96 [391541,74533] 0 2024-09-16T09:45:33.074 INFO:tasks.workunit.client.1.smithi114.stdout:9/450: rename d3/da/d10/d23/d43/d82/f54 to d3/da/d10/d23/d29/d2c/d6b/d68/f9a 0 2024-09-16T09:45:33.075 INFO:tasks.workunit.client.1.smithi114.stdout:0/414: creat d1f/d27/d47/d56/f99 x:0 0 0 2024-09-16T09:45:33.075 INFO:tasks.workunit.client.1.smithi114.stdout:0/415: fdatasync d1f/d22/d2e/d46/d7f/d8d/f8f 0 2024-09-16T09:45:33.075 INFO:tasks.workunit.client.1.smithi114.stdout:0/416: rmdir d1f/d22/d2e/d46 39 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/417: creat d1f/d27/d55/f9a x:0 0 0 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/418: write d1f/d20/d48/f78 [279423,28223] 0 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/419: fdatasync d1f/f3f 0 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/420: fdatasync f6 0 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/421: chown d1f/d27/d47/l4d 0 1 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/422: getdents d1f/d22/d2e/d46/d7f 0 2024-09-16T09:45:33.077 INFO:tasks.workunit.client.1.smithi114.stdout:0/423: chown f6 287 1 2024-09-16T09:45:33.082 INFO:tasks.workunit.client.1.smithi114.stdout:0/424: dread d1f/d22/d2e/d46/d7f/d8d/f95 [0,4194304] 0 2024-09-16T09:45:33.083 INFO:tasks.workunit.client.1.smithi114.stdout:0/425: symlink d1f/d2d/l9b 0 2024-09-16T09:45:33.086 INFO:tasks.workunit.client.1.smithi114.stdout:9/451: dwrite d3/da/fb [4194304,4194304] 0 2024-09-16T09:45:33.089 INFO:tasks.workunit.client.1.smithi114.stdout:0/426: getdents d1f/d27/d47/d56 0 2024-09-16T09:45:33.105 INFO:tasks.workunit.client.1.smithi114.stdout:0/427: dwrite d1f/f74 [0,4194304] 0 2024-09-16T09:45:33.105 INFO:tasks.workunit.client.1.smithi114.stdout:0/428: fsync d1f/d22/d2e/d46/d7f/d8d/f95 0 2024-09-16T09:45:33.105 INFO:tasks.workunit.client.1.smithi114.stdout:0/429: fdatasync d1f/d22/d2e/d46/d7f/d8d/f95 0 2024-09-16T09:45:33.106 INFO:tasks.workunit.client.1.smithi114.stdout:0/430: mknod d1f/d22/c9c 0 2024-09-16T09:45:33.129 INFO:tasks.workunit.client.1.smithi114.stdout:8/434: sync 2024-09-16T09:45:33.129 INFO:tasks.workunit.client.1.smithi114.stdout:4/438: sync 2024-09-16T09:45:33.129 INFO:tasks.workunit.client.1.smithi114.stdout:7/514: sync 2024-09-16T09:45:33.129 INFO:tasks.workunit.client.1.smithi114.stdout:3/573: sync 2024-09-16T09:45:33.129 INFO:tasks.workunit.client.1.smithi114.stdout:0/431: dwrite d1f/d22/d2e/d46/f54 [0,4194304] 0 2024-09-16T09:45:33.129 INFO:tasks.workunit.client.1.smithi114.stdout:3/574: write dc/de/d37/d4e/f67 [532254,82833] 0 2024-09-16T09:45:33.130 INFO:tasks.workunit.client.1.smithi114.stdout:8/435: getdents d4/d1f 0 2024-09-16T09:45:33.133 INFO:tasks.workunit.client.1.smithi114.stdout:8/436: dread d4/db/d3e/f4f [0,4194304] 0 2024-09-16T09:45:33.134 INFO:tasks.workunit.client.1.smithi114.stdout:7/515: read d2/f1c [948129,102276] 0 2024-09-16T09:45:33.136 INFO:tasks.workunit.client.1.smithi114.stdout:7/516: link d2/df/f3a d2/d9/d2b/d2e/d22/fb2 0 2024-09-16T09:45:33.136 INFO:tasks.workunit.client.1.smithi114.stdout:7/517: write d2/df/f30 [3430438,106773] 0 2024-09-16T09:45:33.136 INFO:tasks.workunit.client.1.smithi114.stdout:7/518: write d2/d9/d2b/d2e/d22/d4c/f91 [6399943,129032] 0 2024-09-16T09:45:33.139 INFO:tasks.workunit.client.1.smithi114.stdout:4/439: read d0/d13/d25/f6c [1113540,27724] 0 2024-09-16T09:45:33.147 INFO:tasks.workunit.client.1.smithi114.stdout:0/432: dread d1f/d27/d55/f71 [0,4194304] 0 2024-09-16T09:45:33.147 INFO:tasks.workunit.client.1.smithi114.stdout:0/433: readlink d1f/d27/d47/l98 0 2024-09-16T09:45:33.148 INFO:tasks.workunit.client.1.smithi114.stdout:0/434: link d1f/d22/l43 d1f/d2d/d7a/l9d 0 2024-09-16T09:45:33.148 INFO:tasks.workunit.client.1.smithi114.stdout:0/435: dread - d1f/d27/d47/d56/f99 zero size 2024-09-16T09:45:33.149 INFO:tasks.workunit.client.1.smithi114.stdout:0/436: read d1f/d22/d2e/d46/f7b [429923,91181] 0 2024-09-16T09:45:33.150 INFO:tasks.workunit.client.1.smithi114.stdout:7/519: write d2/d9/d2b/f57 [859501,100838] 0 2024-09-16T09:45:33.150 INFO:tasks.workunit.client.1.smithi114.stdout:7/520: write d2/d9/f23 [5100926,115861] 0 2024-09-16T09:45:33.151 INFO:tasks.workunit.client.1.smithi114.stdout:0/437: mkdir d1f/d9e 0 2024-09-16T09:45:33.151 INFO:tasks.workunit.client.1.smithi114.stdout:0/438: write d1f/d22/d2e/f6a [2173369,90273] 0 2024-09-16T09:45:33.151 INFO:tasks.workunit.client.1.smithi114.stdout:7/521: rename d2/d9/d2b/d2e/d3e/d79/f8a to d2/d9/d2b/fb3 0 2024-09-16T09:45:33.152 INFO:tasks.workunit.client.1.smithi114.stdout:0/439: symlink d1f/d9e/l9f 0 2024-09-16T09:45:33.153 INFO:tasks.workunit.client.1.smithi114.stdout:0/440: creat d1f/d22/fa0 x:0 0 0 2024-09-16T09:45:33.154 INFO:tasks.workunit.client.1.smithi114.stdout:0/441: chown c13 1753 1 2024-09-16T09:45:33.171 INFO:tasks.workunit.client.1.smithi114.stdout:3/575: dwrite dc/fb7 [0,4194304] 0 2024-09-16T09:45:33.171 INFO:tasks.workunit.client.1.smithi114.stdout:8/437: dwrite d4/db/d39/d3c/d4e/f66 [0,4194304] 0 2024-09-16T09:45:33.171 INFO:tasks.workunit.client.1.smithi114.stdout:8/438: write d4/db/d3e/f7f [242091,101360] 0 2024-09-16T09:45:33.173 INFO:tasks.workunit.client.1.smithi114.stdout:3/576: unlink dc/de/d17/d2d/db4/d26/f4d 0 2024-09-16T09:45:33.173 INFO:tasks.workunit.client.1.smithi114.stdout:3/577: fsync dc/de/d17/d2d/db4/f3c 0 2024-09-16T09:45:33.173 INFO:tasks.workunit.client.1.smithi114.stdout:3/578: truncate dc/de/d18/d78/d5c/d6e/fb3 123596 0 2024-09-16T09:45:33.173 INFO:tasks.workunit.client.1.smithi114.stdout:3/579: write dc/de/d1f/f23 [1910115,80878] 0 2024-09-16T09:45:33.174 INFO:tasks.workunit.client.1.smithi114.stdout:8/439: mkdir d4/db/d39/d94 0 2024-09-16T09:45:33.175 INFO:tasks.workunit.client.1.smithi114.stdout:3/580: creat dc/d38/fcf x:0 0 0 2024-09-16T09:45:33.175 INFO:tasks.workunit.client.1.smithi114.stdout:8/440: creat d4/db/d39/d3c/f95 x:0 0 0 2024-09-16T09:45:33.176 INFO:tasks.workunit.client.1.smithi114.stdout:3/581: creat dc/de/d18/d78/d5c/d5d/d50/fd0 x:0 0 0 2024-09-16T09:45:33.176 INFO:tasks.workunit.client.1.smithi114.stdout:3/582: readlink dc/de/d17/l7b 0 2024-09-16T09:45:33.177 INFO:tasks.workunit.client.1.smithi114.stdout:4/440: dwrite d0/f1f [0,4194304] 0 2024-09-16T09:45:33.177 INFO:tasks.workunit.client.1.smithi114.stdout:7/522: dwrite d2/d9/fa7 [0,4194304] 0 2024-09-16T09:45:33.178 INFO:tasks.workunit.client.1.smithi114.stdout:3/583: dread dc/de/d17/d2d/db4/fae [0,4194304] 0 2024-09-16T09:45:33.179 INFO:tasks.workunit.client.1.smithi114.stdout:4/441: mknod d0/d13/c8c 0 2024-09-16T09:45:33.182 INFO:tasks.workunit.client.1.smithi114.stdout:3/584: creat dc/de/d17/d2d/db4/d6a/fd1 x:0 0 0 2024-09-16T09:45:33.183 INFO:tasks.workunit.client.1.smithi114.stdout:4/442: truncate d0/d26/d3c/d3e/d5a/d5d/f60 2920005 0 2024-09-16T09:45:33.185 INFO:tasks.workunit.client.1.smithi114.stdout:4/443: rename d0/d26/d3c/d3e/d4b/f4e to d0/d26/d40/d75/d7f/d87/f8d 0 2024-09-16T09:45:33.186 INFO:tasks.workunit.client.1.smithi114.stdout:0/442: dwrite d1f/d2d/f2f [4194304,4194304] 0 2024-09-16T09:45:33.186 INFO:tasks.workunit.client.1.smithi114.stdout:0/443: write f6 [1219696,31211] 0 2024-09-16T09:45:33.188 INFO:tasks.workunit.client.1.smithi114.stdout:4/444: symlink d0/d26/d40/d75/l8e 0 2024-09-16T09:45:33.188 INFO:tasks.workunit.client.1.smithi114.stdout:4/445: truncate d0/f21 8917375 0 2024-09-16T09:45:33.188 INFO:tasks.workunit.client.1.smithi114.stdout:8/441: write d4/fa [2343847,14749] 0 2024-09-16T09:45:33.191 INFO:tasks.workunit.client.1.smithi114.stdout:8/442: dread d4/db/f88 [0,4194304] 0 2024-09-16T09:45:33.191 INFO:tasks.workunit.client.1.smithi114.stdout:8/443: dread - d4/db/d39/d3c/d4e/f92 zero size 2024-09-16T09:45:33.192 INFO:tasks.workunit.client.1.smithi114.stdout:4/446: creat d0/d26/d3c/d3e/d4b/f8f x:0 0 0 2024-09-16T09:45:33.195 INFO:tasks.workunit.client.1.smithi114.stdout:8/444: mknod d4/db/d3e/d71/c96 0 2024-09-16T09:45:33.196 INFO:tasks.workunit.client.1.smithi114.stdout:4/447: rmdir d0 39 2024-09-16T09:45:33.196 INFO:tasks.workunit.client.1.smithi114.stdout:8/445: chown d4/c2f 105 1 2024-09-16T09:45:33.200 INFO:tasks.workunit.client.1.smithi114.stdout:4/448: rename d0/f20 to d0/d26/f90 0 2024-09-16T09:45:33.200 INFO:tasks.workunit.client.1.smithi114.stdout:0/444: write f9 [4425242,31045] 0 2024-09-16T09:45:33.200 INFO:tasks.workunit.client.1.smithi114.stdout:4/449: symlink d0/d26/l91 0 2024-09-16T09:45:33.200 INFO:tasks.workunit.client.1.smithi114.stdout:7/523: dwrite d2/d9/d2b/d2e/d22/d27/f1e [0,4194304] 0 2024-09-16T09:45:33.202 INFO:tasks.workunit.client.1.smithi114.stdout:4/450: creat d0/d26/d3c/d3e/d4b/f92 x:0 0 0 2024-09-16T09:45:33.202 INFO:tasks.workunit.client.1.smithi114.stdout:4/451: chown d0/fe 2171 1 2024-09-16T09:45:33.203 INFO:tasks.workunit.client.1.smithi114.stdout:4/452: getdents d0/d26/d40/d75/d7f 0 2024-09-16T09:45:33.206 INFO:tasks.workunit.client.1.smithi114.stdout:4/453: mknod d0/d26/d40/d75/d7f/c93 0 2024-09-16T09:45:33.206 INFO:tasks.workunit.client.1.smithi114.stdout:4/454: read - d0/d26/d2e/f7d zero size 2024-09-16T09:45:33.206 INFO:tasks.workunit.client.1.smithi114.stdout:3/585: dwrite dc/d38/d3f/f9f [0,4194304] 0 2024-09-16T09:45:33.206 INFO:tasks.workunit.client.1.smithi114.stdout:4/455: truncate d0/d26/d29/f39 213897 0 2024-09-16T09:45:33.206 INFO:tasks.workunit.client.1.smithi114.stdout:3/586: truncate dc/de/d18/d78/d5c/d6e/dc1/fc5 578510 0 2024-09-16T09:45:33.210 INFO:tasks.workunit.client.1.smithi114.stdout:2/511: sync 2024-09-16T09:45:33.210 INFO:tasks.workunit.client.1.smithi114.stdout:2/512: chown d1/d8/d82/f8d 4266 1 2024-09-16T09:45:33.214 INFO:tasks.workunit.client.1.smithi114.stdout:2/513: truncate d1/d8/f12 1668776 0 2024-09-16T09:45:33.214 INFO:tasks.workunit.client.1.smithi114.stdout:2/514: write d1/d8/d10/d16/d1d/f5c [780346,70125] 0 2024-09-16T09:45:33.215 INFO:tasks.workunit.client.1.smithi114.stdout:2/515: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f36 5271671 0 2024-09-16T09:45:33.216 INFO:tasks.workunit.client.1.smithi114.stdout:2/516: truncate d1/d8/d10/d16/f51 2939709 0 2024-09-16T09:45:33.217 INFO:tasks.workunit.client.1.smithi114.stdout:2/517: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/dc8 0 2024-09-16T09:45:33.218 INFO:tasks.workunit.client.1.smithi114.stdout:2/518: getdents d1/d8/d10/d16/d1d/d92/da7/d3e 0 2024-09-16T09:45:33.221 INFO:tasks.workunit.client.1.smithi114.stdout:1/458: sync 2024-09-16T09:45:33.221 INFO:tasks.workunit.client.1.smithi114.stdout:6/531: sync 2024-09-16T09:45:33.222 INFO:tasks.workunit.client.1.smithi114.stdout:1/459: dread - d4/d2b/d16/d47/f6e zero size 2024-09-16T09:45:33.222 INFO:tasks.workunit.client.1.smithi114.stdout:6/532: write d6/f23 [9000187,111307] 0 2024-09-16T09:45:33.222 INFO:tasks.workunit.client.1.smithi114.stdout:1/460: getdents d4/d3d/d41/d42/d58 0 2024-09-16T09:45:33.223 INFO:tasks.workunit.client.1.smithi114.stdout:1/461: symlink d4/d2b/d16/d47/l99 0 2024-09-16T09:45:33.232 INFO:tasks.workunit.client.1.smithi114.stdout:0/445: dwrite d1f/d22/d2e/f6c [0,4194304] 0 2024-09-16T09:45:33.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/462: dread d4/d2b/d16/d71/f7b [0,4194304] 0 2024-09-16T09:45:33.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/463: chown d4/d2b/d16/f65 3059983 1 2024-09-16T09:45:33.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/464: dread - d4/d2b/d2f/f5d zero size 2024-09-16T09:45:33.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/465: chown d4/d2b/d16/l68 55928190 1 2024-09-16T09:45:33.237 INFO:tasks.workunit.client.1.smithi114.stdout:7/524: dwrite d2/d9/d2b/d2e/d22/d27/d4d/f97 [0,4194304] 0 2024-09-16T09:45:33.237 INFO:tasks.workunit.client.1.smithi114.stdout:7/525: stat d2/d9/d2b/d2e/d22/d27/d4d/f9d 0 2024-09-16T09:45:33.237 INFO:tasks.workunit.client.1.smithi114.stdout:4/456: dwrite d0/d26/d3c/d45/f6e [0,4194304] 0 2024-09-16T09:45:33.237 INFO:tasks.workunit.client.1.smithi114.stdout:1/466: creat d4/d2b/d16/f9a x:0 0 0 2024-09-16T09:45:33.238 INFO:tasks.workunit.client.1.smithi114.stdout:6/533: read d6/da/d10/d40/f5e [4029796,103935] 0 2024-09-16T09:45:33.238 INFO:tasks.workunit.client.1.smithi114.stdout:6/534: write d6/da/d10/d40/f43 [2708694,116529] 0 2024-09-16T09:45:33.238 INFO:tasks.workunit.client.1.smithi114.stdout:6/535: readlink d6/da/d10/l1b 0 2024-09-16T09:45:33.238 INFO:tasks.workunit.client.1.smithi114.stdout:8/446: dwrite d4/db/dd/f80 [0,4194304] 0 2024-09-16T09:45:33.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/452: sync 2024-09-16T09:45:33.240 INFO:tasks.workunit.client.1.smithi114.stdout:5/495: sync 2024-09-16T09:45:33.240 INFO:tasks.workunit.client.1.smithi114.stdout:5/496: chown d3/d24/c42 0 1 2024-09-16T09:45:33.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/453: write d3/da/d10/d23/d29/d2c/d45/f64 [629679,18304] 0 2024-09-16T09:45:33.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/454: chown d3/da/d10/d23/d43/d1e/l6c 1268 1 2024-09-16T09:45:33.241 INFO:tasks.workunit.client.1.smithi114.stdout:2/519: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f65 [0,4194304] 0 2024-09-16T09:45:33.241 INFO:tasks.workunit.client.1.smithi114.stdout:1/467: dread d4/d2b/d16/d71/d72/d75/f7f [0,4194304] 0 2024-09-16T09:45:33.241 INFO:tasks.workunit.client.1.smithi114.stdout:3/587: write dc/d38/d3f/f9f [5020135,122454] 0 2024-09-16T09:45:33.242 INFO:tasks.workunit.client.1.smithi114.stdout:7/526: symlink d2/d9/d2b/d2e/d3e/d79/lb4 0 2024-09-16T09:45:33.242 INFO:tasks.workunit.client.1.smithi114.stdout:4/457: truncate d0/d26/f90 3090633 0 2024-09-16T09:45:33.245 INFO:tasks.workunit.client.1.smithi114.stdout:6/536: link d6/d64/l90 d6/da/d10/d40/lab 0 2024-09-16T09:45:33.249 INFO:tasks.workunit.client.1.smithi114.stdout:8/447: rename d4/db/d68/d52/d54/f5d to d4/db/d3e/f97 0 2024-09-16T09:45:33.251 INFO:tasks.workunit.client.1.smithi114.stdout:9/455: mkdir d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b 0 2024-09-16T09:45:33.251 INFO:tasks.workunit.client.1.smithi114.stdout:9/456: dread - d3/da/d10/d23/d29/d2c/d6b/f63 zero size 2024-09-16T09:45:33.252 INFO:tasks.workunit.client.1.smithi114.stdout:7/527: dread d2/d9/d2b/d2e/d3e/f65 [0,4194304] 0 2024-09-16T09:45:33.252 INFO:tasks.workunit.client.1.smithi114.stdout:7/528: write d2/d9/fc [1262335,56133] 0 2024-09-16T09:45:33.252 INFO:tasks.workunit.client.1.smithi114.stdout:7/529: chown d2/d9/d2b/d2e/d22/d27/d4d/fa4 93576935 1 2024-09-16T09:45:33.253 INFO:tasks.workunit.client.1.smithi114.stdout:2/520: getdents d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f 0 2024-09-16T09:45:33.257 INFO:tasks.workunit.client.1.smithi114.stdout:4/458: unlink d0/d26/d3c/d3e/d4b/d46/l89 0 2024-09-16T09:45:33.257 INFO:tasks.workunit.client.1.smithi114.stdout:6/537: dread d6/f22 [0,4194304] 0 2024-09-16T09:45:33.260 INFO:tasks.workunit.client.1.smithi114.stdout:8/448: symlink d4/db/d3e/d71/d78/d8d/l98 0 2024-09-16T09:45:33.261 INFO:tasks.workunit.client.1.smithi114.stdout:8/449: read d4/f40 [1695237,25911] 0 2024-09-16T09:45:33.261 INFO:tasks.workunit.client.1.smithi114.stdout:9/457: creat d3/da/d10/d23/d29/d3f/d85/f9c x:0 0 0 2024-09-16T09:45:33.262 INFO:tasks.workunit.client.1.smithi114.stdout:1/468: dwrite d4/d2b/f37 [0,4194304] 0 2024-09-16T09:45:33.262 INFO:tasks.workunit.client.1.smithi114.stdout:7/530: symlink d2/d9/d2b/lb5 0 2024-09-16T09:45:33.263 INFO:tasks.workunit.client.1.smithi114.stdout:7/531: chown d2/d9/d2b/d2e/d22/d27/d4d/l6d 246326407 1 2024-09-16T09:45:33.264 INFO:tasks.workunit.client.1.smithi114.stdout:2/521: symlink d1/d8/d10/d16/d1d/d92/lc9 0 2024-09-16T09:45:33.264 INFO:tasks.workunit.client.1.smithi114.stdout:2/522: read - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/fc0 zero size 2024-09-16T09:45:33.265 INFO:tasks.workunit.client.1.smithi114.stdout:3/588: dwrite dc/de/d18/f40 [0,4194304] 0 2024-09-16T09:45:33.265 INFO:tasks.workunit.client.1.smithi114.stdout:3/589: chown dc/de/d18/d78/d5c/d6e/c7e 328 1 2024-09-16T09:45:33.265 INFO:tasks.workunit.client.1.smithi114.stdout:4/459: unlink d0/d13/d25/f6c 0 2024-09-16T09:45:33.267 INFO:tasks.workunit.client.1.smithi114.stdout:6/538: creat d6/da/d36/d51/d62/d77/fac x:0 0 0 2024-09-16T09:45:33.267 INFO:tasks.workunit.client.1.smithi114.stdout:6/539: truncate d6/da/d10/d40/fa6 751096 0 2024-09-16T09:45:33.267 INFO:tasks.workunit.client.1.smithi114.stdout:6/540: fsync d6/f88 0 2024-09-16T09:45:33.267 INFO:tasks.workunit.client.1.smithi114.stdout:6/541: write d6/da/d10/f9d [282207,81178] 0 2024-09-16T09:45:33.277 INFO:tasks.workunit.client.1.smithi114.stdout:1/469: rename d4/c28 to d4/d2b/d16/d71/d72/c9b 0 2024-09-16T09:45:33.279 INFO:tasks.workunit.client.1.smithi114.stdout:7/532: rmdir d2/d9/d2b/d2e/d3e/d79/dac 0 2024-09-16T09:45:33.282 INFO:tasks.workunit.client.1.smithi114.stdout:6/542: mkdir d6/da/d36/d51/dad 0 2024-09-16T09:45:33.282 INFO:tasks.workunit.client.1.smithi114.stdout:6/543: write d6/f22 [4200418,14883] 0 2024-09-16T09:45:33.284 INFO:tasks.workunit.client.1.smithi114.stdout:3/590: rename dc/de/d17/d72/l9a to dc/de/d37/d4e/ld2 0 2024-09-16T09:45:33.284 INFO:tasks.workunit.client.1.smithi114.stdout:3/591: chown dc/de/d17/d79/dab/lac 25091 1 2024-09-16T09:45:33.285 INFO:tasks.workunit.client.1.smithi114.stdout:1/470: creat d4/d2b/d2f/d3a/d56/f9c x:0 0 0 2024-09-16T09:45:33.286 INFO:tasks.workunit.client.1.smithi114.stdout:6/544: creat d6/da/d36/d51/dad/fae x:0 0 0 2024-09-16T09:45:33.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/533: rename d2/d9/d2b/d2e/d22/d4c/f80 to d2/d9/d2b/d78/fb6 0 2024-09-16T09:45:33.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/534: fdatasync d2/d9/d2b/f61 0 2024-09-16T09:45:33.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/535: readlink d2/d9/d2b/d2e/d3e/la9 0 2024-09-16T09:45:33.288 INFO:tasks.workunit.client.1.smithi114.stdout:7/536: write d2/d9/d2b/d2e/d3e/d79/f86 [922134,85977] 0 2024-09-16T09:45:33.288 INFO:tasks.workunit.client.1.smithi114.stdout:7/537: fsync d2/d9/d2b/d2e/d22/fb2 0 2024-09-16T09:45:33.289 INFO:tasks.workunit.client.1.smithi114.stdout:3/592: link dc/de/f2f dc/de/d18/d78/d8d/fd3 0 2024-09-16T09:45:33.289 INFO:tasks.workunit.client.1.smithi114.stdout:3/593: fsync dc/de/d17/d2d/f88 0 2024-09-16T09:45:33.289 INFO:tasks.workunit.client.1.smithi114.stdout:6/545: getdents d6/da/d36/d51/d62/d77/d7b 0 2024-09-16T09:45:33.289 INFO:tasks.workunit.client.1.smithi114.stdout:6/546: fdatasync f5 0 2024-09-16T09:45:33.291 INFO:tasks.workunit.client.1.smithi114.stdout:7/538: unlink d2/df/c13 0 2024-09-16T09:45:33.292 INFO:tasks.workunit.client.1.smithi114.stdout:7/539: mknod d2/d9/cb7 0 2024-09-16T09:45:33.292 INFO:tasks.workunit.client.1.smithi114.stdout:7/540: chown d2/d55/c58 31356 1 2024-09-16T09:45:33.292 INFO:tasks.workunit.client.1.smithi114.stdout:7/541: chown d2/c34 88388807 1 2024-09-16T09:45:33.292 INFO:tasks.workunit.client.1.smithi114.stdout:7/542: stat d2/d9/d2b/d59/c8e 0 2024-09-16T09:45:33.293 INFO:tasks.workunit.client.1.smithi114.stdout:7/543: symlink d2/d9/d51/lb8 0 2024-09-16T09:45:33.295 INFO:tasks.workunit.client.1.smithi114.stdout:8/450: dwrite d4/db/d39/d3c/d4e/f93 [0,4194304] 0 2024-09-16T09:45:33.308 INFO:tasks.workunit.client.1.smithi114.stdout:8/451: dread d4/db/dd/f16 [4194304,4194304] 0 2024-09-16T09:45:33.308 INFO:tasks.workunit.client.1.smithi114.stdout:2/523: dwrite d1/d8/d10/d5a/fa9 [0,4194304] 0 2024-09-16T09:45:33.308 INFO:tasks.workunit.client.1.smithi114.stdout:8/452: fsync d4/db/dd/f44 0 2024-09-16T09:45:33.309 INFO:tasks.workunit.client.1.smithi114.stdout:8/453: fdatasync d4/db/d39/d3c/d4e/f92 0 2024-09-16T09:45:33.309 INFO:tasks.workunit.client.1.smithi114.stdout:9/458: dwrite d3/da/d10/d23/d43/d1e/f72 [0,4194304] 0 2024-09-16T09:45:33.311 INFO:tasks.workunit.client.1.smithi114.stdout:2/524: creat d1/d9e/db0/fca x:0 0 0 2024-09-16T09:45:33.311 INFO:tasks.workunit.client.1.smithi114.stdout:2/525: truncate d1/d8/d10/f67 184028 0 2024-09-16T09:45:33.312 INFO:tasks.workunit.client.1.smithi114.stdout:2/526: rmdir d1/d8/d10 39 2024-09-16T09:45:33.315 INFO:tasks.workunit.client.1.smithi114.stdout:1/471: dwrite d4/d2b/d2f/f5d [0,4194304] 0 2024-09-16T09:45:33.316 INFO:tasks.workunit.client.1.smithi114.stdout:4/460: dwrite d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:33.316 INFO:tasks.workunit.client.1.smithi114.stdout:3/594: dwrite dc/de/d18/d78/d5c/d5d/d50/fd0 [0,4194304] 0 2024-09-16T09:45:33.320 INFO:tasks.workunit.client.1.smithi114.stdout:1/472: rename d4/d3d to d4/d2b/d2f/d3a/d9d 0 2024-09-16T09:45:33.320 INFO:tasks.workunit.client.1.smithi114.stdout:1/473: write d4/d2b/d2f/f4c [673144,75619] 0 2024-09-16T09:45:33.324 INFO:tasks.workunit.client.1.smithi114.stdout:4/461: mknod d0/d13/c94 0 2024-09-16T09:45:33.325 INFO:tasks.workunit.client.1.smithi114.stdout:6/547: truncate d6/f22 2272530 0 2024-09-16T09:45:33.325 INFO:tasks.workunit.client.1.smithi114.stdout:6/548: fsync d6/da/d10/f56 0 2024-09-16T09:45:33.328 INFO:tasks.workunit.client.1.smithi114.stdout:3/595: symlink dc/de/d17/d2d/db4/ld4 0 2024-09-16T09:45:33.329 INFO:tasks.workunit.client.1.smithi114.stdout:1/474: mknod d4/d2b/d2f/c9e 0 2024-09-16T09:45:33.330 INFO:tasks.workunit.client.1.smithi114.stdout:7/544: getdents d2/d9 0 2024-09-16T09:45:33.331 INFO:tasks.workunit.client.1.smithi114.stdout:4/462: link d0/d26/d2e/c37 d0/d13/d56/c95 0 2024-09-16T09:45:33.332 INFO:tasks.workunit.client.1.smithi114.stdout:6/549: creat d6/da/d10/d40/d82/faf x:0 0 0 2024-09-16T09:45:33.332 INFO:tasks.workunit.client.1.smithi114.stdout:6/550: truncate d6/d2d/f54 8629515 0 2024-09-16T09:45:33.332 INFO:tasks.workunit.client.1.smithi114.stdout:6/551: chown d6/da/c26 81554393 1 2024-09-16T09:45:33.333 INFO:tasks.workunit.client.1.smithi114.stdout:3/596: symlink dc/de/d18/d78/d5c/da5/ld5 0 2024-09-16T09:45:33.334 INFO:tasks.workunit.client.1.smithi114.stdout:8/454: dwrite d4/d6d/f8e [0,4194304] 0 2024-09-16T09:45:33.334 INFO:tasks.workunit.client.1.smithi114.stdout:8/455: chown d4/db/d68/d52/l6a 83950469 1 2024-09-16T09:45:33.334 INFO:tasks.workunit.client.1.smithi114.stdout:8/456: readlink d4/db/d68/l26 0 2024-09-16T09:45:33.336 INFO:tasks.workunit.client.1.smithi114.stdout:1/475: mknod d4/d2b/d16/d71/d81/c9f 0 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:1/476: write d4/d2b/d16/d47/f6e [501879,93531] 0 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:1/477: read - d4/d2b/d16/d47/d83/f8f zero size 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:7/545: mknod d2/d9/db1/cb9 0 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:3/597: mkdir dc/de/d18/d78/d5c/d5d/d50/dd6 0 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:3/598: chown dc/de/d17/f1a 0 1 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:3/599: write dc/de/d18/d78/fc6 [808681,72542] 0 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:3/600: write dc/de/d18/d78/d5c/d6e/dc1/fc5 [1616845,76075] 0 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:3/601: chown dc/de/d17/c8e 23933128 1 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:3/602: chown dc/de/d17/d79/dab/lac 98406 1 2024-09-16T09:45:33.337 INFO:tasks.workunit.client.1.smithi114.stdout:9/459: dwrite d3/da/d10/d23/d29/d2c/d45/f64 [0,4194304] 0 2024-09-16T09:45:33.338 INFO:tasks.workunit.client.1.smithi114.stdout:2/527: dwrite d1/d8/f46 [0,4194304] 0 2024-09-16T09:45:33.338 INFO:tasks.workunit.client.1.smithi114.stdout:2/528: fdatasync d1/d8/d10/f67 0 2024-09-16T09:45:33.338 INFO:tasks.workunit.client.1.smithi114.stdout:2/529: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f81 0 2024-09-16T09:45:33.338 INFO:tasks.workunit.client.1.smithi114.stdout:7/546: mkdir d2/d9/d2b/d2e/d22/d27/d4d/dba 0 2024-09-16T09:45:33.338 INFO:tasks.workunit.client.1.smithi114.stdout:4/463: symlink d0/d26/d40/d75/d7f/l96 0 2024-09-16T09:45:33.340 INFO:tasks.workunit.client.1.smithi114.stdout:1/478: dread d4/d2b/d2f/d3a/d9d/f67 [0,4194304] 0 2024-09-16T09:45:33.341 INFO:tasks.workunit.client.1.smithi114.stdout:1/479: stat d4/d2b/d16/d47/f95 0 2024-09-16T09:45:33.341 INFO:tasks.workunit.client.1.smithi114.stdout:1/480: chown d4/d2b/d16/d71/d72/d75 181 1 2024-09-16T09:45:33.341 INFO:tasks.workunit.client.1.smithi114.stdout:9/460: mkdir d3/da/d10/d23/d29/d2c/d6b/d9d 0 2024-09-16T09:45:33.347 INFO:tasks.workunit.client.1.smithi114.stdout:2/530: rmdir d1/d8/d10/d16/d1d/d92 39 2024-09-16T09:45:33.349 INFO:tasks.workunit.client.1.smithi114.stdout:7/547: creat d2/d9/d2b/d59/d7f/fbb x:0 0 0 2024-09-16T09:45:33.349 INFO:tasks.workunit.client.1.smithi114.stdout:7/548: chown d2/d9/d2b/d2e/d3e/d79/lb4 5530 1 2024-09-16T09:45:33.349 INFO:tasks.workunit.client.1.smithi114.stdout:3/603: dread dc/f65 [0,4194304] 0 2024-09-16T09:45:33.349 INFO:tasks.workunit.client.1.smithi114.stdout:4/464: symlink d0/d26/d29/d2b/l97 0 2024-09-16T09:45:33.349 INFO:tasks.workunit.client.1.smithi114.stdout:1/481: dread d4/d2b/d2f/d3a/d9d/d41/d42/f4a [0,4194304] 0 2024-09-16T09:45:33.350 INFO:tasks.workunit.client.1.smithi114.stdout:9/461: truncate d3/da/d10/d23/d43/f33 1289260 0 2024-09-16T09:45:33.350 INFO:tasks.workunit.client.1.smithi114.stdout:9/462: write d3/da/d10/d23/d29/d2c/d70/f7c [2146716,115609] 0 2024-09-16T09:45:33.350 INFO:tasks.workunit.client.1.smithi114.stdout:9/463: dread - d3/da/d10/f26 zero size 2024-09-16T09:45:33.351 INFO:tasks.workunit.client.1.smithi114.stdout:2/531: mknod d1/d8/d10/d16/d1d/d92/da7/ccb 0 2024-09-16T09:45:33.351 INFO:tasks.workunit.client.1.smithi114.stdout:2/532: write d1/d8/d10/d16/d1d/d92/da3/fc5 [322112,52209] 0 2024-09-16T09:45:33.351 INFO:tasks.workunit.client.1.smithi114.stdout:2/533: fsync d1/d8/d10/d16/f1b 0 2024-09-16T09:45:33.351 INFO:tasks.workunit.client.1.smithi114.stdout:7/549: symlink d2/d9/d2b/d2e/d3e/d89/lbc 0 2024-09-16T09:45:33.351 INFO:tasks.workunit.client.1.smithi114.stdout:7/550: chown d2/d9/f12 6132 1 2024-09-16T09:45:33.353 INFO:tasks.workunit.client.1.smithi114.stdout:4/465: link d0/d26/d40/c57 d0/d13/d56/d7e/c98 0 2024-09-16T09:45:33.353 INFO:tasks.workunit.client.1.smithi114.stdout:4/466: chown d0/d26/d3c/d3e/d4d/f51 45548428 1 2024-09-16T09:45:33.354 INFO:tasks.workunit.client.1.smithi114.stdout:1/482: mkdir d4/d2b/d29/da0 0 2024-09-16T09:45:33.354 INFO:tasks.workunit.client.1.smithi114.stdout:1/483: stat d4/d2b/d16 0 2024-09-16T09:45:33.354 INFO:tasks.workunit.client.1.smithi114.stdout:1/484: truncate d4/d2b/d16/d71/d72/d75/f7f 1598747 0 2024-09-16T09:45:33.355 INFO:tasks.workunit.client.1.smithi114.stdout:7/551: write d2/d9/d2b/d2e/d22/d27/f2a [3188629,57084] 0 2024-09-16T09:45:33.356 INFO:tasks.workunit.client.1.smithi114.stdout:2/534: unlink d1/d8/d10/d16/d1d/d92/da7/d3e/fa5 0 2024-09-16T09:45:33.357 INFO:tasks.workunit.client.1.smithi114.stdout:1/485: symlink d4/d2b/d2f/d3a/d55/la1 0 2024-09-16T09:45:33.357 INFO:tasks.workunit.client.1.smithi114.stdout:1/486: readlink d4/d2b/d2f/d3a/d56/l98 0 2024-09-16T09:45:33.359 INFO:tasks.workunit.client.1.smithi114.stdout:8/457: dwrite d4/db/d39/d3c/f95 [0,4194304] 0 2024-09-16T09:45:33.359 INFO:tasks.workunit.client.1.smithi114.stdout:7/552: mkdir d2/d9/d2b/d2e/d22/d4c/dbd 0 2024-09-16T09:45:33.360 INFO:tasks.workunit.client.1.smithi114.stdout:6/552: dwrite d6/da/d10/d40/d82/f8d [0,4194304] 0 2024-09-16T09:45:33.362 INFO:tasks.workunit.client.1.smithi114.stdout:2/535: unlink d1/l2b 0 2024-09-16T09:45:33.363 INFO:tasks.workunit.client.1.smithi114.stdout:1/487: rename d4/d2b/d2f/d3a/f78 to d4/d2b/d2f/d3a/d9d/d41/fa2 0 2024-09-16T09:45:33.363 INFO:tasks.workunit.client.1.smithi114.stdout:1/488: stat d4/d2b/d2f/d3a/d56 0 2024-09-16T09:45:33.366 INFO:tasks.workunit.client.1.smithi114.stdout:8/458: symlink d4/db/dd/l99 0 2024-09-16T09:45:33.369 INFO:tasks.workunit.client.1.smithi114.stdout:4/467: dread d0/d13/f6f [0,4194304] 0 2024-09-16T09:45:33.369 INFO:tasks.workunit.client.1.smithi114.stdout:7/553: write d2/d9/fa7 [1361353,1088] 0 2024-09-16T09:45:33.370 INFO:tasks.workunit.client.1.smithi114.stdout:2/536: link d1/d8/d10/d16/d1d/d92/da7/c42 d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/ccc 0 2024-09-16T09:45:33.371 INFO:tasks.workunit.client.1.smithi114.stdout:1/489: truncate d4/d2b/f27 2039315 0 2024-09-16T09:45:33.371 INFO:tasks.workunit.client.1.smithi114.stdout:3/604: dwrite dc/de/d17/d2d/db4/d6a/d77/f9d [0,4194304] 0 2024-09-16T09:45:33.371 INFO:tasks.workunit.client.1.smithi114.stdout:3/605: truncate dc/de/d17/d2d/f63 4775208 0 2024-09-16T09:45:33.373 INFO:tasks.workunit.client.1.smithi114.stdout:4/468: creat d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 x:0 0 0 2024-09-16T09:45:33.374 INFO:tasks.workunit.client.1.smithi114.stdout:7/554: symlink d2/d9/d51/d84/lbe 0 2024-09-16T09:45:33.374 INFO:tasks.workunit.client.1.smithi114.stdout:7/555: chown d2/d9/d2b/d2e/c48 8502669 1 2024-09-16T09:45:33.374 INFO:tasks.workunit.client.1.smithi114.stdout:7/556: write d2/d9/d2b/d2e/d3e/f65 [1064350,42450] 0 2024-09-16T09:45:33.377 INFO:tasks.workunit.client.1.smithi114.stdout:4/469: rmdir d0/d13/d56 39 2024-09-16T09:45:33.381 INFO:tasks.workunit.client.1.smithi114.stdout:7/557: mknod d2/df/cbf 0 2024-09-16T09:45:33.381 INFO:tasks.workunit.client.1.smithi114.stdout:3/606: dread dc/de/d18/d78/d5c/d5d/f55 [0,4194304] 0 2024-09-16T09:45:33.381 INFO:tasks.workunit.client.1.smithi114.stdout:8/459: dread d4/db/d3e/d47/f5e [0,4194304] 0 2024-09-16T09:45:33.382 INFO:tasks.workunit.client.1.smithi114.stdout:4/470: getdents d0/d26 0 2024-09-16T09:45:33.383 INFO:tasks.workunit.client.1.smithi114.stdout:3/607: creat dc/de/d18/fd7 x:0 0 0 2024-09-16T09:45:33.383 INFO:tasks.workunit.client.1.smithi114.stdout:3/608: readlink dc/d38/l39 0 2024-09-16T09:45:33.384 INFO:tasks.workunit.client.1.smithi114.stdout:3/609: chown dc/de/d17/d2d/db4/d26/f54 10 1 2024-09-16T09:45:33.384 INFO:tasks.workunit.client.1.smithi114.stdout:3/610: fsync dc/de/d18/d78/d5c/f8f 0 2024-09-16T09:45:33.384 INFO:tasks.workunit.client.1.smithi114.stdout:9/464: dwrite d3/f6 [4194304,4194304] 0 2024-09-16T09:45:33.386 INFO:tasks.workunit.client.1.smithi114.stdout:4/471: unlink d0/d26/d3c/d3e/d4d/f51 0 2024-09-16T09:45:33.386 INFO:tasks.workunit.client.1.smithi114.stdout:3/611: mkdir dc/de/d17/d2d/db4/d6a/d77/db2/dd8 0 2024-09-16T09:45:33.389 INFO:tasks.workunit.client.1.smithi114.stdout:9/465: link d3/da/d10/d23/d43/d1e/f72 d3/da/d10/d23/d43/d1e/d25/d88/f9e 0 2024-09-16T09:45:33.389 INFO:tasks.workunit.client.1.smithi114.stdout:9/466: truncate d3/da/f3a 308367 0 2024-09-16T09:45:33.389 INFO:tasks.workunit.client.1.smithi114.stdout:4/472: symlink d0/d13/d56/d7e/l9a 0 2024-09-16T09:45:33.390 INFO:tasks.workunit.client.1.smithi114.stdout:5/497: sync 2024-09-16T09:45:33.390 INFO:tasks.workunit.client.1.smithi114.stdout:3/612: creat dc/de/d37/fd9 x:0 0 0 2024-09-16T09:45:33.391 INFO:tasks.workunit.client.1.smithi114.stdout:3/613: write dc/d38/fcf [998417,25593] 0 2024-09-16T09:45:33.391 INFO:tasks.workunit.client.1.smithi114.stdout:0/446: sync 2024-09-16T09:45:33.392 INFO:tasks.workunit.client.1.smithi114.stdout:7/558: dread d2/d9/d2b/d2e/d3e/d79/f86 [0,4194304] 0 2024-09-16T09:45:33.392 INFO:tasks.workunit.client.1.smithi114.stdout:2/537: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 [0,4194304] 0 2024-09-16T09:45:33.394 INFO:tasks.workunit.client.1.smithi114.stdout:9/467: rename d3/da/d10/d23/d43/d1e/c50 to d3/da/d10/d23/d29/d2c/d45/c9f 0 2024-09-16T09:45:33.395 INFO:tasks.workunit.client.1.smithi114.stdout:4/473: link d0/d26/d3c/d3e/d4b/d46/f72 d0/d13/d25/f9b 0 2024-09-16T09:45:33.395 INFO:tasks.workunit.client.1.smithi114.stdout:4/474: chown d0/d26/d3c 243922 1 2024-09-16T09:45:33.396 INFO:tasks.workunit.client.1.smithi114.stdout:5/498: mkdir d3/d24/d84/d7a/d43/d83/d9f 0 2024-09-16T09:45:33.399 INFO:tasks.workunit.client.1.smithi114.stdout:3/614: mknod dc/de/d17/d2d/d41/d9e/cda 0 2024-09-16T09:45:33.402 INFO:tasks.workunit.client.1.smithi114.stdout:7/559: mkdir d2/d9/d2b/d2e/d22/d27/d64/dc0 0 2024-09-16T09:45:33.403 INFO:tasks.workunit.client.1.smithi114.stdout:7/560: fsync d2/d9/d2b/d59/fa5 0 2024-09-16T09:45:33.405 INFO:tasks.workunit.client.1.smithi114.stdout:9/468: mkdir d3/da/d10/d23/d43/d1e/da0 0 2024-09-16T09:45:33.406 INFO:tasks.workunit.client.1.smithi114.stdout:4/475: getdents d0/d13/d56 0 2024-09-16T09:45:33.407 INFO:tasks.workunit.client.1.smithi114.stdout:1/490: link d4/d2b/d2f/d3a/d9d/d41/fa2 d4/d2b/d16/d71/d72/fa3 0 2024-09-16T09:45:33.408 INFO:tasks.workunit.client.1.smithi114.stdout:1/491: read - d4/d2b/d2f/d3a/d9d/d41/d42/d58/f6d zero size 2024-09-16T09:45:33.408 INFO:tasks.workunit.client.1.smithi114.stdout:3/615: mkdir dc/de/d18/ddb 0 2024-09-16T09:45:33.412 INFO:tasks.workunit.client.1.smithi114.stdout:7/561: creat d2/d9/d2b/d2e/d22/d66/db0/fc1 x:0 0 0 2024-09-16T09:45:33.414 INFO:tasks.workunit.client.1.smithi114.stdout:0/447: dwrite d1f/d22/d2e/d46/d7f/d8d/f95 [0,4194304] 0 2024-09-16T09:45:33.414 INFO:tasks.workunit.client.1.smithi114.stdout:2/538: dwrite d1/d8/d10/d16/f1b [0,4194304] 0 2024-09-16T09:45:33.414 INFO:tasks.workunit.client.1.smithi114.stdout:9/469: rmdir d3/da/d10/d23/d29/d2c/d6b 39 2024-09-16T09:45:33.415 INFO:tasks.workunit.client.1.smithi114.stdout:1/492: rmdir d4/d2b/d16/d71/d72/d8b 0 2024-09-16T09:45:33.415 INFO:tasks.workunit.client.1.smithi114.stdout:1/493: fsync d4/d2b/f91 0 2024-09-16T09:45:33.416 INFO:tasks.workunit.client.1.smithi114.stdout:3/616: creat dc/de/d37/d98/fdc x:0 0 0 2024-09-16T09:45:33.417 INFO:tasks.workunit.client.1.smithi114.stdout:3/617: write dc/de/d1f/f80 [820217,28556] 0 2024-09-16T09:45:33.417 INFO:tasks.workunit.client.1.smithi114.stdout:7/562: symlink d2/lc2 0 2024-09-16T09:45:33.417 INFO:tasks.workunit.client.1.smithi114.stdout:3/618: read dc/de/d37/d4e/f67 [222027,5460] 0 2024-09-16T09:45:33.420 INFO:tasks.workunit.client.1.smithi114.stdout:0/448: truncate d1f/d22/f3c 3357011 0 2024-09-16T09:45:33.421 INFO:tasks.workunit.client.1.smithi114.stdout:2/539: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/ccd 0 2024-09-16T09:45:33.422 INFO:tasks.workunit.client.1.smithi114.stdout:9/470: creat d3/da/d10/d23/d43/fa1 x:0 0 0 2024-09-16T09:45:33.423 INFO:tasks.workunit.client.1.smithi114.stdout:1/494: read d4/d2b/d2f/d3a/d55/f63 [759056,40049] 0 2024-09-16T09:45:33.423 INFO:tasks.workunit.client.1.smithi114.stdout:1/495: fsync d4/d2b/d16/d47/d83/f8f 0 2024-09-16T09:45:33.423 INFO:tasks.workunit.client.1.smithi114.stdout:6/553: truncate d6/f22 95656 0 2024-09-16T09:45:33.424 INFO:tasks.workunit.client.1.smithi114.stdout:7/563: creat d2/d9/d2b/d2e/d22/d66/fc3 x:0 0 0 2024-09-16T09:45:33.426 INFO:tasks.workunit.client.1.smithi114.stdout:3/619: symlink dc/de/d1f/ldd 0 2024-09-16T09:45:33.428 INFO:tasks.workunit.client.1.smithi114.stdout:0/449: creat d1f/d27/fa1 x:0 0 0 2024-09-16T09:45:33.429 INFO:tasks.workunit.client.1.smithi114.stdout:2/540: creat d1/d8/d10/d5a/fce x:0 0 0 2024-09-16T09:45:33.431 INFO:tasks.workunit.client.1.smithi114.stdout:1/496: creat d4/fa4 x:0 0 0 2024-09-16T09:45:33.432 INFO:tasks.workunit.client.1.smithi114.stdout:6/554: unlink d6/d2d/fa1 0 2024-09-16T09:45:33.434 INFO:tasks.workunit.client.1.smithi114.stdout:7/564: mknod d2/d9/d2b/d2e/d93/cc4 0 2024-09-16T09:45:33.434 INFO:tasks.workunit.client.1.smithi114.stdout:7/565: truncate d2/d9/d2b/d2e/d3e/d79/f86 1283615 0 2024-09-16T09:45:33.436 INFO:tasks.workunit.client.1.smithi114.stdout:0/450: creat d1f/d22/d2e/fa2 x:0 0 0 2024-09-16T09:45:33.437 INFO:tasks.workunit.client.1.smithi114.stdout:2/541: creat d1/d8/d10/d16/fcf x:0 0 0 2024-09-16T09:45:33.437 INFO:tasks.workunit.client.1.smithi114.stdout:2/542: write d1/f96 [127268,92129] 0 2024-09-16T09:45:33.439 INFO:tasks.workunit.client.1.smithi114.stdout:6/555: mkdir d6/da/d48/db0 0 2024-09-16T09:45:33.442 INFO:tasks.workunit.client.1.smithi114.stdout:0/451: rename d1f/d22/f2b to d1f/d20/fa3 0 2024-09-16T09:45:33.444 INFO:tasks.workunit.client.1.smithi114.stdout:2/543: link d1/f96 d1/d8/d10/d16/d1d/fd0 0 2024-09-16T09:45:33.445 INFO:tasks.workunit.client.1.smithi114.stdout:9/471: dwrite d3/da/f11 [0,4194304] 0 2024-09-16T09:45:33.448 INFO:tasks.workunit.client.1.smithi114.stdout:7/566: getdents d2 0 2024-09-16T09:45:33.449 INFO:tasks.workunit.client.1.smithi114.stdout:7/567: dread - d2/d9/d2b/d2e/d22/d27/d4d/fa4 zero size 2024-09-16T09:45:33.452 INFO:tasks.workunit.client.1.smithi114.stdout:3/620: dwrite dc/de/d18/f30 [0,4194304] 0 2024-09-16T09:45:33.452 INFO:tasks.workunit.client.1.smithi114.stdout:3/621: stat dc/de/d17/d2d/db4/d6a/d77/d7f/fbe 0 2024-09-16T09:45:33.454 INFO:tasks.workunit.client.1.smithi114.stdout:3/622: truncate dc/de/d18/f28 265594 0 2024-09-16T09:45:33.456 INFO:tasks.workunit.client.1.smithi114.stdout:0/452: write d1f/f74 [2976821,125358] 0 2024-09-16T09:45:33.456 INFO:tasks.workunit.client.1.smithi114.stdout:3/623: getdents dc/de/d17/d2d/d41/d9e 0 2024-09-16T09:45:33.456 INFO:tasks.workunit.client.1.smithi114.stdout:3/624: dread - dc/de/d18/d78/faf zero size 2024-09-16T09:45:33.459 INFO:tasks.workunit.client.1.smithi114.stdout:0/453: symlink d1f/d22/d2e/la4 0 2024-09-16T09:45:33.460 INFO:tasks.workunit.client.1.smithi114.stdout:0/454: symlink d1f/d20/d48/d75/la5 0 2024-09-16T09:45:33.460 INFO:tasks.workunit.client.1.smithi114.stdout:0/455: getdents d1f/d2d/d7a 0 2024-09-16T09:45:33.461 INFO:tasks.workunit.client.1.smithi114.stdout:9/472: dread d3/da/f46 [0,4194304] 0 2024-09-16T09:45:33.461 INFO:tasks.workunit.client.1.smithi114.stdout:0/456: rename d1f/d22/l7c to d1f/d27/d47/la6 0 2024-09-16T09:45:33.462 INFO:tasks.workunit.client.1.smithi114.stdout:0/457: dread - d1f/d22/fa0 zero size 2024-09-16T09:45:33.464 INFO:tasks.workunit.client.1.smithi114.stdout:9/473: creat d3/da/d10/d23/d29/d2c/fa2 x:0 0 0 2024-09-16T09:45:33.464 INFO:tasks.workunit.client.1.smithi114.stdout:9/474: truncate d3/da/d10/d23/f7e 2839146 0 2024-09-16T09:45:33.464 INFO:tasks.workunit.client.1.smithi114.stdout:9/475: write d3/da/d10/d23/d43/d82/f75 [658448,56197] 0 2024-09-16T09:45:33.464 INFO:tasks.workunit.client.1.smithi114.stdout:0/458: creat d1f/d20/d48/fa7 x:0 0 0 2024-09-16T09:45:33.465 INFO:tasks.workunit.client.1.smithi114.stdout:9/476: creat d3/da/d10/d23/d43/d1e/d7b/fa3 x:0 0 0 2024-09-16T09:45:33.466 INFO:tasks.workunit.client.1.smithi114.stdout:0/459: symlink d1f/d20/d48/la8 0 2024-09-16T09:45:33.466 INFO:tasks.workunit.client.1.smithi114.stdout:0/460: fdatasync d1f/d22/f3c 0 2024-09-16T09:45:33.466 INFO:tasks.workunit.client.1.smithi114.stdout:1/497: dwrite d4/d2b/d2f/d3a/d56/f66 [0,4194304] 0 2024-09-16T09:45:33.467 INFO:tasks.workunit.client.1.smithi114.stdout:2/544: dwrite d1/d8/d10/f35 [8388608,4194304] 0 2024-09-16T09:45:33.467 INFO:tasks.workunit.client.1.smithi114.stdout:2/545: fdatasync d1/d8/d10/f25 0 2024-09-16T09:45:33.467 INFO:tasks.workunit.client.1.smithi114.stdout:7/568: dwrite d2/df/f30 [4194304,4194304] 0 2024-09-16T09:45:33.467 INFO:tasks.workunit.client.1.smithi114.stdout:9/477: unlink d3/da/d10/d23/d29/d2c/d70/l86 0 2024-09-16T09:45:33.468 INFO:tasks.workunit.client.1.smithi114.stdout:0/461: rmdir d1f/d22/d2e 39 2024-09-16T09:45:33.470 INFO:tasks.workunit.client.1.smithi114.stdout:1/498: symlink d4/la5 0 2024-09-16T09:45:33.472 INFO:tasks.workunit.client.1.smithi114.stdout:2/546: link d1/d8/d10/d16/d1d/f62 d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/fd1 0 2024-09-16T09:45:33.472 INFO:tasks.workunit.client.1.smithi114.stdout:2/547: dread - d1/f8a zero size 2024-09-16T09:45:33.473 INFO:tasks.workunit.client.1.smithi114.stdout:7/569: creat d2/d9/d2b/d78/d99/fc5 x:0 0 0 2024-09-16T09:45:33.474 INFO:tasks.workunit.client.1.smithi114.stdout:9/478: link d3/da/d10/d23/f7e d3/da/d10/d23/d29/d87/fa4 0 2024-09-16T09:45:33.476 INFO:tasks.workunit.client.1.smithi114.stdout:2/548: mknod d1/d9e/daf/cd2 0 2024-09-16T09:45:33.476 INFO:tasks.workunit.client.1.smithi114.stdout:2/549: write d1/d8/d10/d16/d60/db7/fbb [806684,68457] 0 2024-09-16T09:45:33.476 INFO:tasks.workunit.client.1.smithi114.stdout:2/550: chown d1/d8/d10/d16/d1d/d92/da7/l89 0 1 2024-09-16T09:45:33.476 INFO:tasks.workunit.client.1.smithi114.stdout:3/625: dwrite dc/de/d18/d78/f64 [0,4194304] 0 2024-09-16T09:45:33.477 INFO:tasks.workunit.client.1.smithi114.stdout:7/570: symlink d2/d9/db1/lc6 0 2024-09-16T09:45:33.477 INFO:tasks.workunit.client.1.smithi114.stdout:7/571: dread - d2/d9/d2b/d78/d99/f9a zero size 2024-09-16T09:45:33.478 INFO:tasks.workunit.client.1.smithi114.stdout:0/462: write d1f/d22/f3c [2389601,116986] 0 2024-09-16T09:45:33.478 INFO:tasks.workunit.client.1.smithi114.stdout:0/463: dread - d1f/d22/fa0 zero size 2024-09-16T09:45:33.479 INFO:tasks.workunit.client.1.smithi114.stdout:9/479: mkdir d3/da/d10/d23/d29/d2c/d45/da5 0 2024-09-16T09:45:33.480 INFO:tasks.workunit.client.1.smithi114.stdout:1/499: write d4/d2b/d2f/d3a/f40 [1676500,119090] 0 2024-09-16T09:45:33.481 INFO:tasks.workunit.client.1.smithi114.stdout:2/551: creat d1/d9e/fd3 x:0 0 0 2024-09-16T09:45:33.481 INFO:tasks.workunit.client.1.smithi114.stdout:2/552: write d1/d8/d10/f85 [798,89257] 0 2024-09-16T09:45:33.487 INFO:tasks.workunit.client.1.smithi114.stdout:3/626: truncate dc/de/d18/d78/d5c/d5d/f76 386486 0 2024-09-16T09:45:33.495 INFO:tasks.workunit.client.1.smithi114.stdout:7/572: unlink d2/d9/d2b/d2e/d3e/c60 0 2024-09-16T09:45:33.496 INFO:tasks.workunit.client.1.smithi114.stdout:7/573: dread - d2/d9/d2b/d59/d7f/fa8 zero size 2024-09-16T09:45:33.497 INFO:tasks.workunit.client.1.smithi114.stdout:0/464: mknod d1f/d22/d2e/ca9 0 2024-09-16T09:45:33.498 INFO:tasks.workunit.client.1.smithi114.stdout:9/480: truncate d3/da/d10/d23/d29/d2c/f62 857369 0 2024-09-16T09:45:33.499 INFO:tasks.workunit.client.1.smithi114.stdout:9/481: write d3/da/d10/d23/d29/d87/fa4 [2121155,126617] 0 2024-09-16T09:45:33.499 INFO:tasks.workunit.client.1.smithi114.stdout:1/500: dwrite d4/d2b/d2f/d3a/d9d/d41/d42/d58/f5c [0,4194304] 0 2024-09-16T09:45:33.501 INFO:tasks.workunit.client.1.smithi114.stdout:2/553: creat d1/d9e/fd4 x:0 0 0 2024-09-16T09:45:33.502 INFO:tasks.workunit.client.1.smithi114.stdout:1/501: dread d4/d2b/d16/f84 [0,4194304] 0 2024-09-16T09:45:33.502 INFO:tasks.workunit.client.1.smithi114.stdout:1/502: chown d4/d2b/d2f/d3a/d56/f88 637726142 1 2024-09-16T09:45:33.503 INFO:tasks.workunit.client.1.smithi114.stdout:3/627: creat dc/de/d17/d2d/d41/d9e/fde x:0 0 0 2024-09-16T09:45:33.503 INFO:tasks.workunit.client.1.smithi114.stdout:3/628: fdatasync dc/de/f34 0 2024-09-16T09:45:33.504 INFO:tasks.workunit.client.1.smithi114.stdout:0/465: creat d1f/d22/faa x:0 0 0 2024-09-16T09:45:33.504 INFO:tasks.workunit.client.1.smithi114.stdout:7/574: write d2/d9/d2b/d78/d99/f9b [918188,61392] 0 2024-09-16T09:45:33.506 INFO:tasks.workunit.client.1.smithi114.stdout:9/482: creat d3/da/d10/d23/d43/fa6 x:0 0 0 2024-09-16T09:45:33.510 INFO:tasks.workunit.client.1.smithi114.stdout:2/554: symlink d1/d8/d10/d16/d60/ld5 0 2024-09-16T09:45:33.510 INFO:tasks.workunit.client.1.smithi114.stdout:2/555: write d1/d8/f32 [4697058,28947] 0 2024-09-16T09:45:33.510 INFO:tasks.workunit.client.1.smithi114.stdout:2/556: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f6f zero size 2024-09-16T09:45:33.512 INFO:tasks.workunit.client.1.smithi114.stdout:1/503: creat d4/d2b/d2f/d3a/d56/fa6 x:0 0 0 2024-09-16T09:45:33.514 INFO:tasks.workunit.client.1.smithi114.stdout:3/629: rename dc/de/d17/c48 to dc/de/d17/d79/dab/cdf 0 2024-09-16T09:45:33.514 INFO:tasks.workunit.client.1.smithi114.stdout:3/630: chown dc/de/d18/d78/d5c/d5d/d50/fd0 24545 1 2024-09-16T09:45:33.515 INFO:tasks.workunit.client.1.smithi114.stdout:0/466: symlink d1f/d27/d47/d56/lab 0 2024-09-16T09:45:33.515 INFO:tasks.workunit.client.1.smithi114.stdout:9/483: rmdir d3/da/d10/d23/d29/d2c/d6b/d68/d81 39 2024-09-16T09:45:33.519 INFO:tasks.workunit.client.1.smithi114.stdout:2/557: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/ld6 0 2024-09-16T09:45:33.519 INFO:tasks.workunit.client.1.smithi114.stdout:2/558: stat d1/d9e/lc4 0 2024-09-16T09:45:33.519 INFO:tasks.workunit.client.1.smithi114.stdout:2/559: stat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/f88 0 2024-09-16T09:45:33.519 INFO:tasks.workunit.client.1.smithi114.stdout:1/504: getdents d4/d2b/d2f 0 2024-09-16T09:45:33.522 INFO:tasks.workunit.client.1.smithi114.stdout:9/484: link d3/da/d10/d23/l48 d3/da/d10/d23/d43/d1e/la7 0 2024-09-16T09:45:33.522 INFO:tasks.workunit.client.1.smithi114.stdout:2/560: getdents d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f 0 2024-09-16T09:45:33.523 INFO:tasks.workunit.client.1.smithi114.stdout:2/561: write d1/d8/d10/d16/d1d/fc7 [13724,24546] 0 2024-09-16T09:45:33.525 INFO:tasks.workunit.client.1.smithi114.stdout:9/485: mkdir d3/da/d10/d23/d29/d2c/da8 0 2024-09-16T09:45:33.528 INFO:tasks.workunit.client.1.smithi114.stdout:2/562: unlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f81 0 2024-09-16T09:45:33.529 INFO:tasks.workunit.client.1.smithi114.stdout:2/563: dread d1/d8/d10/f67 [0,4194304] 0 2024-09-16T09:45:33.529 INFO:tasks.workunit.client.1.smithi114.stdout:9/486: creat d3/da/d10/d23/d43/d82/fa9 x:0 0 0 2024-09-16T09:45:33.530 INFO:tasks.workunit.client.1.smithi114.stdout:7/575: dwrite d2/f2c [0,4194304] 0 2024-09-16T09:45:33.531 INFO:tasks.workunit.client.1.smithi114.stdout:2/564: creat d1/d8/d10/d16/d1d/d92/da3/fd7 x:0 0 0 2024-09-16T09:45:33.532 INFO:tasks.workunit.client.1.smithi114.stdout:2/565: read - d1/d8/d10/d16/f8c zero size 2024-09-16T09:45:33.532 INFO:tasks.workunit.client.1.smithi114.stdout:9/487: mkdir d3/daa 0 2024-09-16T09:45:33.537 INFO:tasks.workunit.client.1.smithi114.stdout:7/576: symlink d2/d9/d2b/d2e/d3e/lc7 0 2024-09-16T09:45:33.538 INFO:tasks.workunit.client.1.smithi114.stdout:2/566: getdents d1/d8/d10/d5a 0 2024-09-16T09:45:33.538 INFO:tasks.workunit.client.1.smithi114.stdout:9/488: dread d3/da/f2a [0,4194304] 0 2024-09-16T09:45:33.539 INFO:tasks.workunit.client.1.smithi114.stdout:7/577: symlink d2/d9/d2b/d2e/d93/lc8 0 2024-09-16T09:45:33.540 INFO:tasks.workunit.client.1.smithi114.stdout:0/467: dwrite f16 [0,4194304] 0 2024-09-16T09:45:33.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/567: unlink d1/d8/d10/d16/d1d/f62 0 2024-09-16T09:45:33.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/568: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f97 286158 0 2024-09-16T09:45:33.541 INFO:tasks.workunit.client.1.smithi114.stdout:2/569: write d1/d8/d10/d16/d1d/f34 [539704,59779] 0 2024-09-16T09:45:33.541 INFO:tasks.workunit.client.1.smithi114.stdout:7/578: getdents d2/d9/d2b/d2e/d3e/d89 0 2024-09-16T09:45:33.541 INFO:tasks.workunit.client.1.smithi114.stdout:7/579: write d2/d9/d2b/d2e/d22/d4c/f91 [8345139,118536] 0 2024-09-16T09:45:33.543 INFO:tasks.workunit.client.1.smithi114.stdout:0/468: unlink d1f/l4f 0 2024-09-16T09:45:33.548 INFO:tasks.workunit.client.1.smithi114.stdout:7/580: rename d2/d55/c58 to d2/d9/db1/cc9 0 2024-09-16T09:45:33.550 INFO:tasks.workunit.client.1.smithi114.stdout:2/570: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f36 [3985135,72944] 0 2024-09-16T09:45:33.550 INFO:tasks.workunit.client.1.smithi114.stdout:3/631: dwrite dc/de/d17/d2d/d41/d9e/fde [0,4194304] 0 2024-09-16T09:45:33.550 INFO:tasks.workunit.client.1.smithi114.stdout:2/571: dread - d1/d9e/fd4 zero size 2024-09-16T09:45:33.551 INFO:tasks.workunit.client.1.smithi114.stdout:7/581: mkdir d2/d9/d2b/d59/dca 0 2024-09-16T09:45:33.556 INFO:tasks.workunit.client.1.smithi114.stdout:2/572: rmdir d1/d8/d10/d16/d60/db7 39 2024-09-16T09:45:33.558 INFO:tasks.workunit.client.1.smithi114.stdout:9/489: dwrite d3/da/d10/d23/d29/d2c/d6b/f63 [0,4194304] 0 2024-09-16T09:45:33.561 INFO:tasks.workunit.client.1.smithi114.stdout:9/490: getdents d3/da/d10/d23/d43/d1e/d7b 0 2024-09-16T09:45:33.561 INFO:tasks.workunit.client.1.smithi114.stdout:9/491: chown d3/da/f46 0 1 2024-09-16T09:45:33.563 INFO:tasks.workunit.client.1.smithi114.stdout:8/460: sync 2024-09-16T09:45:33.563 INFO:tasks.workunit.client.1.smithi114.stdout:8/461: chown d4/db/d39/d3c 441977961 1 2024-09-16T09:45:33.574 INFO:tasks.workunit.client.1.smithi114.stdout:0/469: dwrite d1f/d22/f49 [0,4194304] 0 2024-09-16T09:45:33.574 INFO:tasks.workunit.client.1.smithi114.stdout:0/470: readlink d1f/d22/l8c 0 2024-09-16T09:45:33.574 INFO:tasks.workunit.client.1.smithi114.stdout:0/471: dread - d1f/d20/f34 zero size 2024-09-16T09:45:33.574 INFO:tasks.workunit.client.1.smithi114.stdout:9/492: dread d3/da/d10/d23/d29/d2c/d6b/f56 [0,4194304] 0 2024-09-16T09:45:33.575 INFO:tasks.workunit.client.1.smithi114.stdout:0/472: creat d1f/d27/fac x:0 0 0 2024-09-16T09:45:33.577 INFO:tasks.workunit.client.1.smithi114.stdout:8/462: dread d4/db/d39/d3c/f95 [0,4194304] 0 2024-09-16T09:45:33.577 INFO:tasks.workunit.client.1.smithi114.stdout:8/463: write d4/db/d39/d3c/f6b [361117,34135] 0 2024-09-16T09:45:33.578 INFO:tasks.workunit.client.1.smithi114.stdout:8/464: mkdir d4/db/d39/d94/d9a 0 2024-09-16T09:45:33.580 INFO:tasks.workunit.client.1.smithi114.stdout:8/465: link d4/db/d39/d3c/d4e/d82/d72/d59/f69 d4/db/d68/d52/f9b 0 2024-09-16T09:45:33.582 INFO:tasks.workunit.client.1.smithi114.stdout:8/466: mkdir d4/db/d68/d52/d9c 0 2024-09-16T09:45:33.584 INFO:tasks.workunit.client.1.smithi114.stdout:8/467: rename d4/db/d3e/d71/f12 to d4/db/d68/d52/d9c/f9d 0 2024-09-16T09:45:33.584 INFO:tasks.workunit.client.1.smithi114.stdout:8/468: write d4/db/d68/d28/f31 [436295,72152] 0 2024-09-16T09:45:33.585 INFO:tasks.workunit.client.1.smithi114.stdout:9/493: dread d3/da/d10/d23/d29/d2c/d6b/d68/f9a [0,4194304] 0 2024-09-16T09:45:33.585 INFO:tasks.workunit.client.1.smithi114.stdout:3/632: dwrite dc/de/d17/f74 [0,4194304] 0 2024-09-16T09:45:33.586 INFO:tasks.workunit.client.1.smithi114.stdout:8/469: dread d4/db/d3e/f7f [0,4194304] 0 2024-09-16T09:45:33.586 INFO:tasks.workunit.client.1.smithi114.stdout:8/470: chown d4/db/dd/f20 133204 1 2024-09-16T09:45:33.586 INFO:tasks.workunit.client.1.smithi114.stdout:9/494: rename d3/da/d10/d23/f73 to d3/da/d10/d23/d29/d2c/d45/d93/fab 0 2024-09-16T09:45:33.588 INFO:tasks.workunit.client.1.smithi114.stdout:4/476: sync 2024-09-16T09:45:33.588 INFO:tasks.workunit.client.1.smithi114.stdout:5/499: sync 2024-09-16T09:45:33.588 INFO:tasks.workunit.client.1.smithi114.stdout:3/633: symlink dc/d38/d3f/le0 0 2024-09-16T09:45:33.588 INFO:tasks.workunit.client.1.smithi114.stdout:3/634: truncate dc/de/d17/d2d/db4/d6a/d77/d7f/f86 943345 0 2024-09-16T09:45:33.589 INFO:tasks.workunit.client.1.smithi114.stdout:8/471: rename d4/c2f to d4/db/d39/d3c/d4e/d62/c9e 0 2024-09-16T09:45:33.590 INFO:tasks.workunit.client.1.smithi114.stdout:5/500: mkdir d3/d24/d84/d7a/d43/d58/da0 0 2024-09-16T09:45:33.590 INFO:tasks.workunit.client.1.smithi114.stdout:5/501: chown d3/d24/d84/d71/d72/d2d/d3f/d75 12603 1 2024-09-16T09:45:33.591 INFO:tasks.workunit.client.1.smithi114.stdout:4/477: mkdir d0/d26/d3c/d74/d9c 0 2024-09-16T09:45:33.591 INFO:tasks.workunit.client.1.smithi114.stdout:6/556: sync 2024-09-16T09:45:33.592 INFO:tasks.workunit.client.1.smithi114.stdout:7/582: dwrite d2/d9/f5c [0,4194304] 0 2024-09-16T09:45:33.592 INFO:tasks.workunit.client.1.smithi114.stdout:7/583: chown d2/d9/d2b/l43 3544 1 2024-09-16T09:45:33.592 INFO:tasks.workunit.client.1.smithi114.stdout:7/584: readlink d2/d9/d51/lb8 0 2024-09-16T09:45:33.592 INFO:tasks.workunit.client.1.smithi114.stdout:3/635: link dc/de/d17/d2d/db4/d6a/d77/caa dc/de/d37/ce1 0 2024-09-16T09:45:33.592 INFO:tasks.workunit.client.1.smithi114.stdout:2/573: dwrite d1/d8/d10/d16/d1d/fc7 [0,4194304] 0 2024-09-16T09:45:33.593 INFO:tasks.workunit.client.1.smithi114.stdout:8/472: read d4/db/d68/d52/d9c/f9d [205760,88315] 0 2024-09-16T09:45:33.593 INFO:tasks.workunit.client.1.smithi114.stdout:5/502: rename d3/d24/d84/d71/d72/d2d to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1 0 2024-09-16T09:45:33.594 INFO:tasks.workunit.client.1.smithi114.stdout:0/473: dwrite d1f/d20/d48/f91 [0,4194304] 0 2024-09-16T09:45:33.595 INFO:tasks.workunit.client.1.smithi114.stdout:6/557: symlink d6/d2d/lb1 0 2024-09-16T09:45:33.601 INFO:tasks.workunit.client.1.smithi114.stdout:7/585: mknod d2/d9/d2b/d59/dca/ccb 0 2024-09-16T09:45:33.603 INFO:tasks.workunit.client.1.smithi114.stdout:2/574: truncate d1/d8/d10/d16/d1d/d92/da3/fc5 195822 0 2024-09-16T09:45:33.604 INFO:tasks.workunit.client.1.smithi114.stdout:9/495: write d3/da/d10/d23/d29/d2c/d45/d93/fab [134779,57583] 0 2024-09-16T09:45:33.604 INFO:tasks.workunit.client.1.smithi114.stdout:9/496: readlink d3/da/d10/d23/d43/d1e/d4c/d8c/l91 0 2024-09-16T09:45:33.604 INFO:tasks.workunit.client.1.smithi114.stdout:5/503: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/fa2 x:0 0 0 2024-09-16T09:45:33.605 INFO:tasks.workunit.client.1.smithi114.stdout:8/473: dread d4/db/d68/d28/f7e [0,4194304] 0 2024-09-16T09:45:33.606 INFO:tasks.workunit.client.1.smithi114.stdout:0/474: link f3 d1f/d20/fad 0 2024-09-16T09:45:33.608 INFO:tasks.workunit.client.1.smithi114.stdout:6/558: mknod d6/da/d76/cb2 0 2024-09-16T09:45:33.608 INFO:tasks.workunit.client.1.smithi114.stdout:6/559: chown d6/da/l8f 449 1 2024-09-16T09:45:33.608 INFO:tasks.workunit.client.1.smithi114.stdout:6/560: write d6/fc [2452745,67379] 0 2024-09-16T09:45:33.608 INFO:tasks.workunit.client.1.smithi114.stdout:6/561: chown d6/da/f15 4 1 2024-09-16T09:45:33.609 INFO:tasks.workunit.client.1.smithi114.stdout:9/497: mknod d3/da/d10/d23/d29/d2c/d45/cac 0 2024-09-16T09:45:33.610 INFO:tasks.workunit.client.1.smithi114.stdout:5/504: rmdir d3/d24/d84/d7a/d43/d4c/d6d/d79 39 2024-09-16T09:45:33.611 INFO:tasks.workunit.client.1.smithi114.stdout:8/474: rmdir d4/db/d39/d3c/d4e/d82/d72/d59 39 2024-09-16T09:45:33.613 INFO:tasks.workunit.client.1.smithi114.stdout:2/575: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/ld8 0 2024-09-16T09:45:33.614 INFO:tasks.workunit.client.1.smithi114.stdout:6/562: mkdir d6/da/db3 0 2024-09-16T09:45:33.615 INFO:tasks.workunit.client.1.smithi114.stdout:6/563: write d6/d2d/f70 [248330,3317] 0 2024-09-16T09:45:33.615 INFO:tasks.workunit.client.1.smithi114.stdout:6/564: readlink d6/l32 0 2024-09-16T09:45:33.617 INFO:tasks.workunit.client.1.smithi114.stdout:3/636: dwrite dc/de/d37/d4e/f67 [0,4194304] 0 2024-09-16T09:45:33.617 INFO:tasks.workunit.client.1.smithi114.stdout:8/475: link d4/db/d68/d28/f31 d4/db/d3e/d71/d78/d7a/f9f 0 2024-09-16T09:45:33.617 INFO:tasks.workunit.client.1.smithi114.stdout:3/637: write dc/de/d17/d2d/d41/f47 [388374,94841] 0 2024-09-16T09:45:33.617 INFO:tasks.workunit.client.1.smithi114.stdout:3/638: fdatasync dc/de/d17/d2d/db4/d6a/d77/f93 0 2024-09-16T09:45:33.618 INFO:tasks.workunit.client.1.smithi114.stdout:2/576: mkdir d1/d8/d10/d16/dd9 0 2024-09-16T09:45:33.620 INFO:tasks.workunit.client.1.smithi114.stdout:6/565: truncate d6/da/f67 1860405 0 2024-09-16T09:45:33.623 INFO:tasks.workunit.client.1.smithi114.stdout:4/478: dwrite d0/d26/d40/d75/d7f/d87/f8d [0,4194304] 0 2024-09-16T09:45:33.630 INFO:tasks.workunit.client.1.smithi114.stdout:4/479: link d0/d13/d25/c3b d0/d26/d40/d75/c9d 0 2024-09-16T09:45:33.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:33 smithi111 ceph-mon[27997]: pgmap v240: 65 pgs: 65 active+clean; 876 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 75 MiB/s rd, 105 MiB/s wr, 794 op/s 2024-09-16T09:45:33.633 INFO:tasks.workunit.client.1.smithi114.stdout:4/480: symlink d0/d13/d56/d7e/l9e 0 2024-09-16T09:45:33.633 INFO:tasks.workunit.client.1.smithi114.stdout:4/481: write d0/d26/d3c/d3e/f6a [1473454,94949] 0 2024-09-16T09:45:33.633 INFO:tasks.workunit.client.1.smithi114.stdout:6/566: dread f5 [0,4194304] 0 2024-09-16T09:45:33.633 INFO:tasks.workunit.client.1.smithi114.stdout:6/567: chown d6/da/d10/l1b 5 1 2024-09-16T09:45:33.633 INFO:tasks.workunit.client.1.smithi114.stdout:6/568: dread - d6/d64/f84 zero size 2024-09-16T09:45:33.633 INFO:tasks.workunit.client.1.smithi114.stdout:3/639: read dc/de/d17/f1a [574426,60640] 0 2024-09-16T09:45:33.636 INFO:tasks.workunit.client.1.smithi114.stdout:4/482: unlink d0/d26/d3c/l30 0 2024-09-16T09:45:33.638 INFO:tasks.workunit.client.1.smithi114.stdout:6/569: creat d6/da/fb4 x:0 0 0 2024-09-16T09:45:33.638 INFO:tasks.workunit.client.1.smithi114.stdout:7/586: dwrite d2/fab [0,4194304] 0 2024-09-16T09:45:33.639 INFO:tasks.workunit.client.1.smithi114.stdout:3/640: link dc/de/d17/c36 dc/de/d17/d2d/ce2 0 2024-09-16T09:45:33.641 INFO:tasks.workunit.client.1.smithi114.stdout:6/570: getdents d6/d64 0 2024-09-16T09:45:33.643 INFO:tasks.workunit.client.1.smithi114.stdout:7/587: truncate d2/d9/f23 2513165 0 2024-09-16T09:45:33.643 INFO:tasks.workunit.client.1.smithi114.stdout:7/588: read - d2/d9/d2b/d59/d7f/fbb zero size 2024-09-16T09:45:33.644 INFO:tasks.workunit.client.1.smithi114.stdout:3/641: creat dc/de/d18/d78/d5c/fe3 x:0 0 0 2024-09-16T09:45:33.645 INFO:tasks.workunit.client.1.smithi114.stdout:6/571: symlink d6/da/d10/d40/d82/lb5 0 2024-09-16T09:45:33.646 INFO:tasks.workunit.client.1.smithi114.stdout:7/589: mkdir d2/d9/d2b/dcc 0 2024-09-16T09:45:33.646 INFO:tasks.workunit.client.1.smithi114.stdout:7/590: chown d2/l25 3 1 2024-09-16T09:45:33.646 INFO:tasks.workunit.client.1.smithi114.stdout:7/591: chown d2/d9/d2b/d78/fb6 0 1 2024-09-16T09:45:33.646 INFO:tasks.workunit.client.1.smithi114.stdout:3/642: mkdir dc/de/d17/d2d/d41/de4 0 2024-09-16T09:45:33.647 INFO:tasks.workunit.client.1.smithi114.stdout:7/592: link d2/d9/d2b/d59/c8e d2/d9/d2b/d2e/d3e/d79/ccd 0 2024-09-16T09:45:33.649 INFO:tasks.workunit.client.1.smithi114.stdout:3/643: creat dc/de/d17/d79/dab/fe5 x:0 0 0 2024-09-16T09:45:33.657 INFO:tasks.workunit.client.1.smithi114.stdout:0/475: dwrite d1f/d22/d2e/f5a [0,4194304] 0 2024-09-16T09:45:33.658 INFO:tasks.workunit.client.1.smithi114.stdout:2/577: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f61 [0,4194304] 0 2024-09-16T09:45:33.658 INFO:tasks.workunit.client.1.smithi114.stdout:2/578: chown d1/f2c 63410365 1 2024-09-16T09:45:33.658 INFO:tasks.workunit.client.1.smithi114.stdout:2/579: fdatasync d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 0 2024-09-16T09:45:33.659 INFO:tasks.workunit.client.1.smithi114.stdout:6/572: write d6/da/d36/d51/f6b [453453,125818] 0 2024-09-16T09:45:33.659 INFO:tasks.workunit.client.1.smithi114.stdout:6/573: fsync d6/d2d/f37 0 2024-09-16T09:45:33.659 INFO:tasks.workunit.client.1.smithi114.stdout:6/574: chown d6/c2a 88677 1 2024-09-16T09:45:33.659 INFO:tasks.workunit.client.1.smithi114.stdout:5/505: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f5c [0,4194304] 0 2024-09-16T09:45:33.659 INFO:tasks.workunit.client.1.smithi114.stdout:9/498: dwrite d3/da/d10/d23/d43/f33 [0,4194304] 0 2024-09-16T09:45:33.659 INFO:tasks.workunit.client.1.smithi114.stdout:8/476: dwrite d4/db/d68/d28/f77 [0,4194304] 0 2024-09-16T09:45:33.660 INFO:tasks.workunit.client.1.smithi114.stdout:0/476: symlink d1f/d20/lae 0 2024-09-16T09:45:33.663 INFO:tasks.workunit.client.1.smithi114.stdout:2/580: mknod d1/d8/d10/d16/dd9/cda 0 2024-09-16T09:45:33.663 INFO:tasks.workunit.client.1.smithi114.stdout:4/483: dwrite d0/d26/d3c/d3e/d4d/f54 [0,4194304] 0 2024-09-16T09:45:33.664 INFO:tasks.workunit.client.1.smithi114.stdout:6/575: mknod d6/da/d10/cb6 0 2024-09-16T09:45:33.668 INFO:tasks.workunit.client.1.smithi114.stdout:5/506: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/fa3 x:0 0 0 2024-09-16T09:45:33.671 INFO:tasks.workunit.client.1.smithi114.stdout:3/644: dwrite dc/d38/f45 [0,4194304] 0 2024-09-16T09:45:33.671 INFO:tasks.workunit.client.1.smithi114.stdout:2/581: read d1/d8/d10/f18 [5168492,44768] 0 2024-09-16T09:45:33.671 INFO:tasks.workunit.client.1.smithi114.stdout:3/645: truncate dc/de/d17/d2d/db4/d6a/d77/d7f/fbe 451514 0 2024-09-16T09:45:33.671 INFO:tasks.workunit.client.1.smithi114.stdout:8/477: write d4/db/d3e/d71/d78/d7a/f9f [185197,66946] 0 2024-09-16T09:45:33.679 INFO:tasks.workunit.client.1.smithi114.stdout:9/499: rename d3/da/d10/d23/d29/d2c/d70/l67 to d3/lad 0 2024-09-16T09:45:33.680 INFO:tasks.workunit.client.1.smithi114.stdout:4/484: dwrite d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:33.681 INFO:tasks.workunit.client.1.smithi114.stdout:0/477: mkdir d1f/d22/d2e/d46/d7f/daf 0 2024-09-16T09:45:33.681 INFO:tasks.workunit.client.1.smithi114.stdout:0/478: chown d1f/d22/d2e/d46/d7f/d8d/f8f 23 1 2024-09-16T09:45:33.684 INFO:tasks.workunit.client.1.smithi114.stdout:5/507: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fa4 x:0 0 0 2024-09-16T09:45:33.685 INFO:tasks.workunit.client.1.smithi114.stdout:2/582: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/fdb x:0 0 0 2024-09-16T09:45:33.686 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:33 smithi114 ceph-mon[35635]: pgmap v240: 65 pgs: 65 active+clean; 876 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 75 MiB/s rd, 105 MiB/s wr, 794 op/s 2024-09-16T09:45:33.691 INFO:tasks.workunit.client.1.smithi114.stdout:9/500: creat d3/da/d10/d23/d29/d2c/d6b/d68/d81/fae x:0 0 0 2024-09-16T09:45:33.692 INFO:tasks.workunit.client.1.smithi114.stdout:3/646: dwrite dc/de/d18/d78/fc6 [0,4194304] 0 2024-09-16T09:45:33.692 INFO:tasks.workunit.client.1.smithi114.stdout:3/647: fdatasync dc/de/d17/d2d/d41/f47 0 2024-09-16T09:45:33.692 INFO:tasks.workunit.client.1.smithi114.stdout:3/648: readlink dc/de/d37/d57/lce 0 2024-09-16T09:45:33.694 INFO:tasks.workunit.client.1.smithi114.stdout:4/485: mkdir d0/d26/d29/d9f 0 2024-09-16T09:45:33.695 INFO:tasks.workunit.client.1.smithi114.stdout:0/479: mknod d1f/d20/d48/cb0 0 2024-09-16T09:45:33.696 INFO:tasks.workunit.client.1.smithi114.stdout:5/508: symlink d3/d24/d84/d7a/la5 0 2024-09-16T09:45:33.697 INFO:tasks.workunit.client.1.smithi114.stdout:9/501: dread d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:33.697 INFO:tasks.workunit.client.1.smithi114.stdout:9/502: fdatasync d3/da/d10/d23/d43/d82/fa9 0 2024-09-16T09:45:33.699 INFO:tasks.workunit.client.1.smithi114.stdout:8/478: dwrite d4/db/d39/d3c/f6b [0,4194304] 0 2024-09-16T09:45:33.701 INFO:tasks.workunit.client.1.smithi114.stdout:4/486: mkdir d0/d26/d29/d9f/da0 0 2024-09-16T09:45:33.702 INFO:tasks.workunit.client.1.smithi114.stdout:2/583: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/fc0 [0,4194304] 0 2024-09-16T09:45:33.703 INFO:tasks.workunit.client.1.smithi114.stdout:0/480: mknod d1f/d22/d2e/d46/d7f/cb1 0 2024-09-16T09:45:33.703 INFO:tasks.workunit.client.1.smithi114.stdout:0/481: write d1f/d20/f34 [941226,62927] 0 2024-09-16T09:45:33.705 INFO:tasks.workunit.client.1.smithi114.stdout:9/503: creat d3/da/d10/d23/d43/d1e/d4c/d8c/faf x:0 0 0 2024-09-16T09:45:33.705 INFO:tasks.workunit.client.1.smithi114.stdout:9/504: fdatasync d3/da/f55 0 2024-09-16T09:45:33.706 INFO:tasks.workunit.client.1.smithi114.stdout:4/487: creat d0/d26/d3c/d3e/d5a/fa1 x:0 0 0 2024-09-16T09:45:33.707 INFO:tasks.workunit.client.1.smithi114.stdout:4/488: chown d0/d26/f90 6747 1 2024-09-16T09:45:33.710 INFO:tasks.workunit.client.1.smithi114.stdout:2/584: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/fdc x:0 0 0 2024-09-16T09:45:33.710 INFO:tasks.workunit.client.1.smithi114.stdout:2/585: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/ld6 10 1 2024-09-16T09:45:33.714 INFO:tasks.workunit.client.1.smithi114.stdout:2/586: rename d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/c7c to d1/d8/d10/d16/d1d/d92/da3/cdd 0 2024-09-16T09:45:33.714 INFO:tasks.workunit.client.1.smithi114.stdout:2/587: stat d1/d8/d10/d16/dd9 0 2024-09-16T09:45:33.715 INFO:tasks.workunit.client.1.smithi114.stdout:1/505: sync 2024-09-16T09:45:33.716 INFO:tasks.workunit.client.1.smithi114.stdout:4/489: write d0/d13/f6f [2904193,55424] 0 2024-09-16T09:45:33.719 INFO:tasks.workunit.client.1.smithi114.stdout:4/490: truncate d0/d26/d29/f1d 104692 0 2024-09-16T09:45:33.726 INFO:tasks.workunit.client.1.smithi114.stdout:1/506: dread d4/d2b/f1e [0,4194304] 0 2024-09-16T09:45:33.728 INFO:tasks.workunit.client.1.smithi114.stdout:1/507: rename d4/d2b/d2f/d3a/d55 to d4/d2b/d16/d47/da7 0 2024-09-16T09:45:33.728 INFO:tasks.workunit.client.1.smithi114.stdout:1/508: getdents d4/d2b/d16/d47/d83 0 2024-09-16T09:45:33.729 INFO:tasks.workunit.client.1.smithi114.stdout:1/509: mknod d4/d2b/d16/ca8 0 2024-09-16T09:45:33.729 INFO:tasks.workunit.client.1.smithi114.stdout:1/510: rename d4/l15 to d4/la9 0 2024-09-16T09:45:33.730 INFO:tasks.workunit.client.1.smithi114.stdout:3/649: dwrite dc/de/d17/d2d/db4/fae [0,4194304] 0 2024-09-16T09:45:33.731 INFO:tasks.workunit.client.1.smithi114.stdout:1/511: dread d4/d2b/d16/f84 [0,4194304] 0 2024-09-16T09:45:33.733 INFO:tasks.workunit.client.1.smithi114.stdout:3/650: link dc/c75 dc/de/d18/d78/d5c/ce6 0 2024-09-16T09:45:33.734 INFO:tasks.workunit.client.1.smithi114.stdout:3/651: symlink dc/de/d17/d2d/db4/d6a/d77/db2/le7 0 2024-09-16T09:45:33.734 INFO:tasks.workunit.client.1.smithi114.stdout:0/482: dwrite d1f/d27/d55/f9a [0,4194304] 0 2024-09-16T09:45:33.735 INFO:tasks.workunit.client.1.smithi114.stdout:9/505: dwrite d3/da/d10/d23/d29/d2c/fa2 [0,4194304] 0 2024-09-16T09:45:33.735 INFO:tasks.workunit.client.1.smithi114.stdout:9/506: readlink d3/da/d10/d23/d29/d87/l89 0 2024-09-16T09:45:33.736 INFO:tasks.workunit.client.1.smithi114.stdout:3/652: rename dc/de/d1f/c81 to dc/de/d17/d2d/db4/d6a/d77/db2/ce8 0 2024-09-16T09:45:33.738 INFO:tasks.workunit.client.1.smithi114.stdout:5/509: dwrite d3/d24/d84/d7a/d43/f48 [0,4194304] 0 2024-09-16T09:45:33.742 INFO:tasks.workunit.client.1.smithi114.stdout:5/510: mkdir d3/d24/d7d/da6 0 2024-09-16T09:45:33.742 INFO:tasks.workunit.client.1.smithi114.stdout:5/511: write d3/d24/d84/d7a/d43/d4c/d6d/d79/f8d [818449,55688] 0 2024-09-16T09:45:33.745 INFO:tasks.workunit.client.1.smithi114.stdout:5/512: mknod d3/d24/d84/d7a/d43/d58/ca7 0 2024-09-16T09:45:33.757 INFO:tasks.workunit.client.1.smithi114.stdout:3/653: dread dc/f65 [0,4194304] 0 2024-09-16T09:45:33.772 INFO:tasks.workunit.client.1.smithi114.stdout:3/654: write dc/de/d17/d2d/db4/fae [1851183,78744] 0 2024-09-16T09:45:33.772 INFO:tasks.workunit.client.1.smithi114.stdout:3/655: chown dc/de/d17/d79/dab/cdf 1915 1 2024-09-16T09:45:33.773 INFO:tasks.workunit.client.1.smithi114.stdout:3/656: link dc/de/d18/fd7 dc/de/d17/d79/fe9 0 2024-09-16T09:45:33.774 INFO:tasks.workunit.client.1.smithi114.stdout:3/657: mkdir dc/de/d18/d78/d5c/d5d/d50/dea 0 2024-09-16T09:45:33.776 INFO:tasks.workunit.client.1.smithi114.stdout:1/512: dwrite d4/f6f [0,4194304] 0 2024-09-16T09:45:33.776 INFO:tasks.workunit.client.1.smithi114.stdout:0/483: dwrite f16 [0,4194304] 0 2024-09-16T09:45:33.776 INFO:tasks.workunit.client.1.smithi114.stdout:4/491: dwrite d0/d13/f6f [4194304,4194304] 0 2024-09-16T09:45:33.778 INFO:tasks.workunit.client.1.smithi114.stdout:3/658: dread dc/de/d18/d78/d5c/d6e/dc1/fc5 [0,4194304] 0 2024-09-16T09:45:33.778 INFO:tasks.workunit.client.1.smithi114.stdout:5/513: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f5d [0,4194304] 0 2024-09-16T09:45:33.779 INFO:tasks.workunit.client.1.smithi114.stdout:1/513: truncate d4/d2b/d16/f65 2945040 0 2024-09-16T09:45:33.779 INFO:tasks.workunit.client.1.smithi114.stdout:1/514: readlink d4/d2b/d2f/d3a/l86 0 2024-09-16T09:45:33.782 INFO:tasks.workunit.client.1.smithi114.stdout:5/514: symlink d3/d24/d84/d7a/d43/d4c/d92/d78/la8 0 2024-09-16T09:45:33.785 INFO:tasks.workunit.client.1.smithi114.stdout:1/515: link d4/d2b/d2f/d3a/f40 d4/d2b/d2f/d3a/d56/faa 0 2024-09-16T09:45:33.786 INFO:tasks.workunit.client.1.smithi114.stdout:5/515: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fa9 x:0 0 0 2024-09-16T09:45:33.788 INFO:tasks.workunit.client.1.smithi114.stdout:1/516: creat d4/d2b/d2f/d3a/fab x:0 0 0 2024-09-16T09:45:33.790 INFO:tasks.workunit.client.1.smithi114.stdout:5/516: creat d3/d24/d84/d7a/d43/d58/da0/faa x:0 0 0 2024-09-16T09:45:33.792 INFO:tasks.workunit.client.1.smithi114.stdout:4/492: dread d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:33.793 INFO:tasks.workunit.client.1.smithi114.stdout:1/517: symlink d4/d2b/d16/lac 0 2024-09-16T09:45:33.793 INFO:tasks.workunit.client.1.smithi114.stdout:5/517: rename d3/d24/d84/d7a/d43/d83 to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab 0 2024-09-16T09:45:33.794 INFO:tasks.workunit.client.1.smithi114.stdout:4/493: creat d0/d26/d40/d75/fa2 x:0 0 0 2024-09-16T09:45:33.794 INFO:tasks.workunit.client.1.smithi114.stdout:4/494: chown d0/d13/d25/f9b 4780283 1 2024-09-16T09:45:33.794 INFO:tasks.workunit.client.1.smithi114.stdout:4/495: chown d0/d26/d29/f14 3696544 1 2024-09-16T09:45:33.794 INFO:tasks.workunit.client.1.smithi114.stdout:1/518: dread d4/d2b/d16/d71/f7b [0,4194304] 0 2024-09-16T09:45:33.795 INFO:tasks.workunit.client.1.smithi114.stdout:5/518: rename d3/d24/d84/c13 to d3/d24/d84/d7a/d43/d58/da0/cac 0 2024-09-16T09:45:33.795 INFO:tasks.workunit.client.1.smithi114.stdout:5/519: chown d3/d24/d84/d71/f8b 0 1 2024-09-16T09:45:33.796 INFO:tasks.workunit.client.1.smithi114.stdout:5/520: truncate d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/f3d 319821 0 2024-09-16T09:45:33.799 INFO:tasks.workunit.client.1.smithi114.stdout:5/521: rename d3/d24/d84/d71/d72/d52/c8a to d3/d24/d84/d7a/d43/d58/cad 0 2024-09-16T09:45:33.805 INFO:tasks.workunit.client.1.smithi114.stdout:1/519: dread d4/d2b/f14 [0,4194304] 0 2024-09-16T09:45:33.807 INFO:tasks.workunit.client.1.smithi114.stdout:1/520: creat d4/d2b/d2f/fad x:0 0 0 2024-09-16T09:45:33.807 INFO:tasks.workunit.client.1.smithi114.stdout:1/521: chown d4/d2b/d16/f1b 1 1 2024-09-16T09:45:33.808 INFO:tasks.workunit.client.1.smithi114.stdout:1/522: creat d4/d2b/d16/d47/d83/fae x:0 0 0 2024-09-16T09:45:33.809 INFO:tasks.workunit.client.1.smithi114.stdout:1/523: write d4/d2b/d16/d71/d72/fa3 [1228500,102151] 0 2024-09-16T09:45:33.809 INFO:tasks.workunit.client.1.smithi114.stdout:1/524: chown d4/d2b/d16/d47/d83 5078 1 2024-09-16T09:45:33.810 INFO:tasks.workunit.client.1.smithi114.stdout:5/522: dread d3/d24/d84/f4f [0,4194304] 0 2024-09-16T09:45:33.810 INFO:tasks.workunit.client.1.smithi114.stdout:1/525: mknod d4/d2b/d2f/d3a/d9d/d41/d42/d58/caf 0 2024-09-16T09:45:33.810 INFO:tasks.workunit.client.1.smithi114.stdout:1/526: stat d4/d2b/d16/d71/d72/d75/c8d 0 2024-09-16T09:45:33.810 INFO:tasks.workunit.client.1.smithi114.stdout:1/527: fdatasync d4/d2b/f27 0 2024-09-16T09:45:33.811 INFO:tasks.workunit.client.1.smithi114.stdout:5/523: creat d3/d24/d84/d71/fae x:0 0 0 2024-09-16T09:45:33.812 INFO:tasks.workunit.client.1.smithi114.stdout:0/484: dwrite d1f/f3f [0,4194304] 0 2024-09-16T09:45:33.812 INFO:tasks.workunit.client.1.smithi114.stdout:0/485: chown d1f/d27/d47/l4d 126388828 1 2024-09-16T09:45:33.812 INFO:tasks.workunit.client.1.smithi114.stdout:0/486: dread - d1f/d22/d2e/fa2 zero size 2024-09-16T09:45:33.812 INFO:tasks.workunit.client.1.smithi114.stdout:1/528: mkdir d4/d2b/d2f/d3a/db0 0 2024-09-16T09:45:33.813 INFO:tasks.workunit.client.1.smithi114.stdout:4/496: dwrite d0/d26/d40/f44 [0,4194304] 0 2024-09-16T09:45:33.813 INFO:tasks.workunit.client.1.smithi114.stdout:4/497: stat d0/d26/d29/f14 0 2024-09-16T09:45:33.814 INFO:tasks.workunit.client.1.smithi114.stdout:0/487: link d1f/d22/c9c d1f/d27/cb2 0 2024-09-16T09:45:33.814 INFO:tasks.workunit.client.1.smithi114.stdout:0/488: chown d1f/d27/d47/d56/l59 168950 1 2024-09-16T09:45:33.815 INFO:tasks.workunit.client.1.smithi114.stdout:0/489: rename d1f/d22 to d1f/d22/d2e/db3 22 2024-09-16T09:45:33.815 INFO:tasks.workunit.client.1.smithi114.stdout:0/490: write d1f/d27/d47/d56/d7e/f85 [750260,50453] 0 2024-09-16T09:45:33.815 INFO:tasks.workunit.client.1.smithi114.stdout:4/498: truncate d0/d26/d3c/d3e/d4b/d46/f80 248665 0 2024-09-16T09:45:33.818 INFO:tasks.workunit.client.1.smithi114.stdout:0/491: creat d1f/d27/d55/fb4 x:0 0 0 2024-09-16T09:45:33.820 INFO:tasks.workunit.client.1.smithi114.stdout:4/499: creat d0/d26/d3c/d3e/d4b/d46/fa3 x:0 0 0 2024-09-16T09:45:33.820 INFO:tasks.workunit.client.1.smithi114.stdout:4/500: chown d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 0 1 2024-09-16T09:45:33.821 INFO:tasks.workunit.client.1.smithi114.stdout:0/492: creat d1f/d22/fb5 x:0 0 0 2024-09-16T09:45:33.821 INFO:tasks.workunit.client.1.smithi114.stdout:1/529: dread d4/d2b/d2f/d3a/f40 [0,4194304] 0 2024-09-16T09:45:33.824 INFO:tasks.workunit.client.1.smithi114.stdout:4/501: rmdir d0/d26/d3c/d3e/d5a/d5d/d70/d83 39 2024-09-16T09:45:33.824 INFO:tasks.workunit.client.1.smithi114.stdout:4/502: write d0/d26/d3c/d3e/d4b/f8f [447144,47788] 0 2024-09-16T09:45:33.825 INFO:tasks.workunit.client.1.smithi114.stdout:0/493: truncate d1f/f74 3422547 0 2024-09-16T09:45:33.826 INFO:tasks.workunit.client.1.smithi114.stdout:0/494: dread - d1f/d22/d2e/fa2 zero size 2024-09-16T09:45:33.826 INFO:tasks.workunit.client.1.smithi114.stdout:1/530: mkdir d4/d2b/d29/da0/db1 0 2024-09-16T09:45:33.827 INFO:tasks.workunit.client.1.smithi114.stdout:4/503: mknod d0/d26/d3c/d3e/d5a/ca4 0 2024-09-16T09:45:33.828 INFO:tasks.workunit.client.1.smithi114.stdout:4/504: readlink d0/d26/d40/d75/l8e 0 2024-09-16T09:45:33.828 INFO:tasks.workunit.client.1.smithi114.stdout:0/495: getdents d1f/d27/d47 0 2024-09-16T09:45:33.828 INFO:tasks.workunit.client.1.smithi114.stdout:0/496: chown d1f/f74 866570 1 2024-09-16T09:45:33.830 INFO:tasks.workunit.client.1.smithi114.stdout:1/531: creat d4/d2b/d16/d47/fb2 x:0 0 0 2024-09-16T09:45:33.830 INFO:tasks.workunit.client.1.smithi114.stdout:1/532: chown d4/d2b/f37 14173 1 2024-09-16T09:45:33.830 INFO:tasks.workunit.client.1.smithi114.stdout:1/533: fdatasync d4/d2b/d2f/d3a/d9d/d41/d42/d58/f6d 0 2024-09-16T09:45:33.832 INFO:tasks.workunit.client.1.smithi114.stdout:4/505: creat d0/d13/d25/fa5 x:0 0 0 2024-09-16T09:45:33.832 INFO:tasks.workunit.client.1.smithi114.stdout:4/506: truncate d0/f64 484549 0 2024-09-16T09:45:33.833 INFO:tasks.workunit.client.1.smithi114.stdout:7/593: sync 2024-09-16T09:45:33.834 INFO:tasks.workunit.client.1.smithi114.stdout:6/576: sync 2024-09-16T09:45:33.834 INFO:tasks.workunit.client.1.smithi114.stdout:7/594: fdatasync d2/df/f30 0 2024-09-16T09:45:33.834 INFO:tasks.workunit.client.1.smithi114.stdout:6/577: fsync d6/da/d48/f58 0 2024-09-16T09:45:33.834 INFO:tasks.workunit.client.1.smithi114.stdout:7/595: fdatasync d2/d9/d2b/fb3 0 2024-09-16T09:45:33.834 INFO:tasks.workunit.client.1.smithi114.stdout:7/596: fdatasync d2/d9/d2b/f61 0 2024-09-16T09:45:33.837 INFO:tasks.workunit.client.1.smithi114.stdout:6/578: creat d6/da/d10/d40/fb7 x:0 0 0 2024-09-16T09:45:33.837 INFO:tasks.workunit.client.1.smithi114.stdout:6/579: readlink d6/da/l20 0 2024-09-16T09:45:33.839 INFO:tasks.workunit.client.1.smithi114.stdout:6/580: mknod d6/da/d10/cb8 0 2024-09-16T09:45:33.840 INFO:tasks.workunit.client.1.smithi114.stdout:6/581: chown d6/da/d10/f9d 156 1 2024-09-16T09:45:33.843 INFO:tasks.workunit.client.1.smithi114.stdout:4/507: dread d0/d26/d40/d75/d7f/d87/f8d [0,4194304] 0 2024-09-16T09:45:33.845 INFO:tasks.workunit.client.1.smithi114.stdout:4/508: rename d0/d26/d40/d6d to d0/d26/d40/da6 0 2024-09-16T09:45:33.846 INFO:tasks.workunit.client.1.smithi114.stdout:7/597: dread d2/f2c [0,4194304] 0 2024-09-16T09:45:33.847 INFO:tasks.workunit.client.1.smithi114.stdout:4/509: mknod d0/d26/d29/d2b/d58/ca7 0 2024-09-16T09:45:33.847 INFO:tasks.workunit.client.1.smithi114.stdout:4/510: fdatasync d0/f21 0 2024-09-16T09:45:33.848 INFO:tasks.workunit.client.1.smithi114.stdout:7/598: rmdir d2/d9/d2b/d2e/d22/d4c 39 2024-09-16T09:45:33.849 INFO:tasks.workunit.client.1.smithi114.stdout:4/511: truncate d0/f85 3503465 0 2024-09-16T09:45:33.858 INFO:tasks.workunit.client.1.smithi114.stdout:0/497: dwrite d1f/d27/d47/d56/f62 [0,4194304] 0 2024-09-16T09:45:33.859 INFO:tasks.workunit.client.1.smithi114.stdout:0/498: mknod d1f/d20/cb6 0 2024-09-16T09:45:33.860 INFO:tasks.workunit.client.1.smithi114.stdout:1/534: dwrite d4/d2b/d16/f7c [0,4194304] 0 2024-09-16T09:45:33.861 INFO:tasks.workunit.client.1.smithi114.stdout:0/499: dread d1f/d20/fa3 [0,4194304] 0 2024-09-16T09:45:33.871 INFO:tasks.workunit.client.1.smithi114.stdout:6/582: dwrite d6/d64/f91 [0,4194304] 0 2024-09-16T09:45:33.873 INFO:tasks.workunit.client.1.smithi114.stdout:6/583: symlink d6/da/d10/d40/d82/lb9 0 2024-09-16T09:45:33.873 INFO:tasks.workunit.client.1.smithi114.stdout:7/599: dwrite d2/df/f10 [0,4194304] 0 2024-09-16T09:45:33.876 INFO:tasks.workunit.client.1.smithi114.stdout:6/584: creat d6/d2d/d46/d9c/fba x:0 0 0 2024-09-16T09:45:33.879 INFO:tasks.workunit.client.1.smithi114.stdout:6/585: dread d6/da/f45 [0,4194304] 0 2024-09-16T09:45:33.881 INFO:tasks.workunit.client.1.smithi114.stdout:6/586: mkdir d6/da/dbb 0 2024-09-16T09:45:33.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/587: unlink d6/da/f74 0 2024-09-16T09:45:33.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/588: write d6/da/d36/f3f [5091964,77394] 0 2024-09-16T09:45:33.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/589: chown d6/d64 183 1 2024-09-16T09:45:33.883 INFO:tasks.workunit.client.1.smithi114.stdout:6/590: symlink d6/da/d36/d51/dad/lbc 0 2024-09-16T09:45:33.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/591: truncate d6/d2d/f3c 639338 0 2024-09-16T09:45:33.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/592: readlink d6/da/d10/l69 0 2024-09-16T09:45:33.886 INFO:tasks.workunit.client.1.smithi114.stdout:6/593: unlink d6/da/d10/d40/d82/faf 0 2024-09-16T09:45:33.886 INFO:tasks.workunit.client.1.smithi114.stdout:6/594: readlink d6/da/d10/l1b 0 2024-09-16T09:45:33.886 INFO:tasks.workunit.client.1.smithi114.stdout:6/595: stat d6/da/d10/d92 0 2024-09-16T09:45:33.890 INFO:tasks.workunit.client.1.smithi114.stdout:4/512: dwrite d0/d26/d3c/d3e/d4b/d46/f68 [0,4194304] 0 2024-09-16T09:45:33.892 INFO:tasks.workunit.client.1.smithi114.stdout:4/513: creat d0/d26/d3c/d3e/d4d/fa8 x:0 0 0 2024-09-16T09:45:33.892 INFO:tasks.workunit.client.1.smithi114.stdout:4/514: chown d0/d13 55 1 2024-09-16T09:45:33.893 INFO:tasks.workunit.client.1.smithi114.stdout:1/535: dwrite d4/d2b/d2f/d3a/d9d/d41/d42/d58/f6d [0,4194304] 0 2024-09-16T09:45:33.893 INFO:tasks.workunit.client.1.smithi114.stdout:1/536: fsync d4/d2b/d16/d47/f4b 0 2024-09-16T09:45:33.894 INFO:tasks.workunit.client.1.smithi114.stdout:1/537: rmdir d4/d2b 39 2024-09-16T09:45:33.894 INFO:tasks.workunit.client.1.smithi114.stdout:1/538: dread - d4/d2b/d16/d47/d83/fae zero size 2024-09-16T09:45:33.894 INFO:tasks.workunit.client.1.smithi114.stdout:1/539: write d4/d2b/f90 [78871,68345] 0 2024-09-16T09:45:33.894 INFO:tasks.workunit.client.1.smithi114.stdout:1/540: stat d4/d2b/d29/da0/db1 0 2024-09-16T09:45:33.898 INFO:tasks.workunit.client.1.smithi114.stdout:6/596: dread d6/da/d36/d51/f60 [0,4194304] 0 2024-09-16T09:45:33.899 INFO:tasks.workunit.client.1.smithi114.stdout:7/600: dwrite d2/d9/d2b/d2e/d22/d66/fc3 [0,4194304] 0 2024-09-16T09:45:33.900 INFO:tasks.workunit.client.1.smithi114.stdout:6/597: creat d6/da/d48/fbd x:0 0 0 2024-09-16T09:45:33.901 INFO:tasks.workunit.client.1.smithi114.stdout:0/500: dwrite d1f/d27/d47/f60 [0,4194304] 0 2024-09-16T09:45:33.904 INFO:tasks.workunit.client.1.smithi114.stdout:6/598: symlink d6/da/db3/lbe 0 2024-09-16T09:45:33.913 INFO:tasks.workunit.client.1.smithi114.stdout:0/501: rename d1f/d20/d48/f5c to d1f/d27/d47/d56/fb7 0 2024-09-16T09:45:33.913 INFO:tasks.workunit.client.1.smithi114.stdout:0/502: truncate d1f/d22/d2e/f40 1690637 0 2024-09-16T09:45:33.919 INFO:tasks.workunit.client.1.smithi114.stdout:6/599: read d6/da/f2c [2561088,78937] 0 2024-09-16T09:45:33.919 INFO:tasks.workunit.client.1.smithi114.stdout:0/503: dread d1f/f45 [0,4194304] 0 2024-09-16T09:45:33.919 INFO:tasks.workunit.client.1.smithi114.stdout:0/504: stat d1f/d22/d2e/d46/f5f 0 2024-09-16T09:45:33.920 INFO:tasks.workunit.client.1.smithi114.stdout:8/479: sync 2024-09-16T09:45:33.920 INFO:tasks.workunit.client.1.smithi114.stdout:8/480: getdents d4/db/d91 0 2024-09-16T09:45:33.920 INFO:tasks.workunit.client.1.smithi114.stdout:9/507: sync 2024-09-16T09:45:33.920 INFO:tasks.workunit.client.1.smithi114.stdout:2/588: sync 2024-09-16T09:45:33.920 INFO:tasks.workunit.client.1.smithi114.stdout:9/508: write d3/da/d10/d23/d43/fa6 [419565,97367] 0 2024-09-16T09:45:33.923 INFO:tasks.workunit.client.1.smithi114.stdout:2/589: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/dc8 0 2024-09-16T09:45:33.923 INFO:tasks.workunit.client.1.smithi114.stdout:0/505: dread d1f/d27/f96 [0,4194304] 0 2024-09-16T09:45:33.923 INFO:tasks.workunit.client.1.smithi114.stdout:0/506: stat d1f/d20 0 2024-09-16T09:45:33.927 INFO:tasks.workunit.client.1.smithi114.stdout:4/515: dwrite d0/d26/d3c/d45/f50 [0,4194304] 0 2024-09-16T09:45:33.928 INFO:tasks.workunit.client.1.smithi114.stdout:1/541: dwrite d4/d2b/d2f/d3a/f4f [4194304,4194304] 0 2024-09-16T09:45:33.931 INFO:tasks.workunit.client.1.smithi114.stdout:7/601: dwrite d2/df/f3a [0,4194304] 0 2024-09-16T09:45:33.933 INFO:tasks.workunit.client.1.smithi114.stdout:7/602: truncate d2/f2c 1697718 0 2024-09-16T09:45:33.934 INFO:tasks.workunit.client.1.smithi114.stdout:7/603: getdents d2/d9/d2b/d2e/d22/d27/d4d 0 2024-09-16T09:45:33.938 INFO:tasks.workunit.client.1.smithi114.stdout:1/542: dread d4/d2b/f9 [0,4194304] 0 2024-09-16T09:45:33.941 INFO:tasks.workunit.client.1.smithi114.stdout:4/516: dread d0/f1f [0,4194304] 0 2024-09-16T09:45:33.941 INFO:tasks.workunit.client.1.smithi114.stdout:1/543: dread d4/d2b/d16/d47/f6e [0,4194304] 0 2024-09-16T09:45:33.941 INFO:tasks.workunit.client.1.smithi114.stdout:4/517: truncate d0/f1f 3467417 0 2024-09-16T09:45:33.943 INFO:tasks.workunit.client.1.smithi114.stdout:1/544: dread d4/d2b/d2f/d3a/d9d/f67 [0,4194304] 0 2024-09-16T09:45:33.943 INFO:tasks.workunit.client.1.smithi114.stdout:4/518: symlink d0/d26/d3c/d3e/la9 0 2024-09-16T09:45:33.943 INFO:tasks.workunit.client.1.smithi114.stdout:7/604: dread d2/d9/d2b/d2e/d22/d27/f2a [0,4194304] 0 2024-09-16T09:45:33.944 INFO:tasks.workunit.client.1.smithi114.stdout:7/605: read d2/d9/d2b/d2e/d3e/f65 [526772,54388] 0 2024-09-16T09:45:33.944 INFO:tasks.workunit.client.1.smithi114.stdout:7/606: fdatasync d2/d9/fa7 0 2024-09-16T09:45:33.944 INFO:tasks.workunit.client.1.smithi114.stdout:1/545: creat d4/fb3 x:0 0 0 2024-09-16T09:45:33.944 INFO:tasks.workunit.client.1.smithi114.stdout:4/519: creat d0/d13/faa x:0 0 0 2024-09-16T09:45:33.944 INFO:tasks.workunit.client.1.smithi114.stdout:7/607: creat d2/df/fce x:0 0 0 2024-09-16T09:45:33.945 INFO:tasks.workunit.client.1.smithi114.stdout:7/608: creat d2/d9/d2b/d2e/d22/d66/db0/fcf x:0 0 0 2024-09-16T09:45:33.946 INFO:tasks.workunit.client.1.smithi114.stdout:7/609: creat d2/d9/d2b/d2e/d22/d66/fd0 x:0 0 0 2024-09-16T09:45:33.947 INFO:tasks.workunit.client.1.smithi114.stdout:7/610: symlink d2/d9/d2b/d2e/d22/d66/db0/ld1 0 2024-09-16T09:45:33.949 INFO:tasks.workunit.client.1.smithi114.stdout:7/611: creat d2/d9/d2b/d2e/d22/fd2 x:0 0 0 2024-09-16T09:45:33.950 INFO:tasks.workunit.client.1.smithi114.stdout:7/612: creat d2/d9/fd3 x:0 0 0 2024-09-16T09:45:33.950 INFO:tasks.workunit.client.1.smithi114.stdout:7/613: stat d2/d9/d2b/d59 0 2024-09-16T09:45:33.961 INFO:tasks.workunit.client.1.smithi114.stdout:7/614: dread d2/d9/f12 [0,4194304] 0 2024-09-16T09:45:33.962 INFO:tasks.workunit.client.1.smithi114.stdout:7/615: creat d2/d9/d2b/d78/d9f/fd4 x:0 0 0 2024-09-16T09:45:33.963 INFO:tasks.workunit.client.1.smithi114.stdout:7/616: dread d2/d9/f19 [0,4194304] 0 2024-09-16T09:45:33.964 INFO:tasks.workunit.client.1.smithi114.stdout:7/617: truncate d2/d9/d2b/d2e/d3e/f65 908528 0 2024-09-16T09:45:33.964 INFO:tasks.workunit.client.1.smithi114.stdout:7/618: truncate d2/d9/d2b/d2e/d22/d66/fd0 905392 0 2024-09-16T09:45:33.965 INFO:tasks.workunit.client.1.smithi114.stdout:7/619: unlink d2/c7 0 2024-09-16T09:45:33.966 INFO:tasks.workunit.client.1.smithi114.stdout:7/620: mknod d2/cd5 0 2024-09-16T09:45:33.967 INFO:tasks.workunit.client.1.smithi114.stdout:6/600: dwrite d6/da/d10/d40/fa6 [0,4194304] 0 2024-09-16T09:45:33.967 INFO:tasks.workunit.client.1.smithi114.stdout:6/601: chown d6/d2d/d46/d9c/fba 1838189 1 2024-09-16T09:45:33.967 INFO:tasks.workunit.client.1.smithi114.stdout:0/507: dwrite d1f/d20/fad [4194304,4194304] 0 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:0/508: chown f3 27 1 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:0/509: write d1f/d27/d47/d56/fb7 [4988955,66329] 0 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:4/520: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:0/510: read - d1f/d20/f51 zero size 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:0/511: fsync d1f/d27/d47/f66 0 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:2/590: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/fb3 [0,4194304] 0 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:9/509: dwrite d3/da/d10/d23/d43/f2f [0,4194304] 0 2024-09-16T09:45:33.968 INFO:tasks.workunit.client.1.smithi114.stdout:7/621: rename d2/d9/d2b/l8b to d2/d9/d2b/d2e/d22/ld6 0 2024-09-16T09:45:33.972 INFO:tasks.workunit.client.1.smithi114.stdout:6/602: creat d6/da/dbb/fbf x:0 0 0 2024-09-16T09:45:33.975 INFO:tasks.workunit.client.1.smithi114.stdout:0/512: getdents d1f/d9e 0 2024-09-16T09:45:33.977 INFO:tasks.workunit.client.1.smithi114.stdout:5/524: sync 2024-09-16T09:45:33.977 INFO:tasks.workunit.client.1.smithi114.stdout:3/659: sync 2024-09-16T09:45:33.977 INFO:tasks.workunit.client.1.smithi114.stdout:3/660: write dc/de/d18/f22 [665099,89947] 0 2024-09-16T09:45:33.977 INFO:tasks.workunit.client.1.smithi114.stdout:4/521: creat d0/d26/d40/d75/d7f/d87/fab x:0 0 0 2024-09-16T09:45:33.981 INFO:tasks.workunit.client.1.smithi114.stdout:2/591: dwrite d1/d8/d10/d16/f27 [0,4194304] 0 2024-09-16T09:45:33.982 INFO:tasks.workunit.client.1.smithi114.stdout:9/510: mkdir d3/da/d10/d23/d43/d1e/d25/d88/db0 0 2024-09-16T09:45:33.983 INFO:tasks.workunit.client.1.smithi114.stdout:7/622: mkdir d2/d9/d2b/d2e/d77/dd7 0 2024-09-16T09:45:33.984 INFO:tasks.workunit.client.1.smithi114.stdout:6/603: creat d6/da/d10/d92/fc0 x:0 0 0 2024-09-16T09:45:33.984 INFO:tasks.workunit.client.1.smithi114.stdout:6/604: write d6/da/f45 [1517967,120923] 0 2024-09-16T09:45:33.984 INFO:tasks.workunit.client.1.smithi114.stdout:6/605: dread - d6/d2d/f87 zero size 2024-09-16T09:45:33.985 INFO:tasks.workunit.client.1.smithi114.stdout:0/513: creat d1f/d20/d48/fb8 x:0 0 0 2024-09-16T09:45:33.986 INFO:tasks.workunit.client.1.smithi114.stdout:5/525: mknod d3/d24/d84/d7a/d43/d4c/d6d/caf 0 2024-09-16T09:45:33.987 INFO:tasks.workunit.client.1.smithi114.stdout:5/526: write d3/d24/d84/d7a/d43/d58/f7c [1129478,37860] 0 2024-09-16T09:45:33.988 INFO:tasks.workunit.client.1.smithi114.stdout:3/661: link dc/de/d37/d4e/ld2 dc/de/d18/d78/leb 0 2024-09-16T09:45:33.989 INFO:tasks.workunit.client.1.smithi114.stdout:4/522: rename d0/d26/d3c/d3e/d4b/d46/f72 to d0/d13/fac 0 2024-09-16T09:45:33.991 INFO:tasks.workunit.client.1.smithi114.stdout:9/511: creat d3/da/d10/d23/d29/d2c/d45/da5/fb1 x:0 0 0 2024-09-16T09:45:33.993 INFO:tasks.workunit.client.1.smithi114.stdout:5/527: link d3/f8 d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 0 2024-09-16T09:45:33.993 INFO:tasks.workunit.client.1.smithi114.stdout:5/528: read d3/d24/d84/d7a/d43/f47 [2016687,97274] 0 2024-09-16T09:45:33.993 INFO:tasks.workunit.client.1.smithi114.stdout:5/529: truncate d3/d24/d84/d7a/d43/d4c/d92/f6f 4215570 0 2024-09-16T09:45:33.994 INFO:tasks.workunit.client.1.smithi114.stdout:2/592: dread d1/d8/d10/f18 [0,4194304] 0 2024-09-16T09:45:33.997 INFO:tasks.workunit.client.1.smithi114.stdout:3/662: creat dc/de/d17/d2d/d41/d9e/fec x:0 0 0 2024-09-16T09:45:33.997 INFO:tasks.workunit.client.1.smithi114.stdout:3/663: stat dc/de/d37/d4e/l9b 0 2024-09-16T09:45:33.998 INFO:tasks.workunit.client.1.smithi114.stdout:3/664: fsync dc/de/d17/d2d/db4/d26/fcc 0 2024-09-16T09:45:33.998 INFO:tasks.workunit.client.1.smithi114.stdout:3/665: stat dc/de/d17/f74 0 2024-09-16T09:45:33.998 INFO:tasks.workunit.client.1.smithi114.stdout:4/523: creat d0/d26/d3c/d74/d9c/fad x:0 0 0 2024-09-16T09:45:34.002 INFO:tasks.workunit.client.1.smithi114.stdout:9/512: dread d3/f32 [0,4194304] 0 2024-09-16T09:45:34.002 INFO:tasks.workunit.client.1.smithi114.stdout:9/513: write d3/da/d10/d23/d29/d2c/d6b/d68/d81/f8f [999324,42609] 0 2024-09-16T09:45:34.003 INFO:tasks.workunit.client.1.smithi114.stdout:3/666: unlink dc/l60 0 2024-09-16T09:45:34.003 INFO:tasks.workunit.client.1.smithi114.stdout:3/667: write dc/de/d18/d78/d5c/d6e/dc1/fc5 [2204984,103623] 0 2024-09-16T09:45:34.003 INFO:tasks.workunit.client.1.smithi114.stdout:0/514: dwrite d1f/d22/d2e/f40 [0,4194304] 0 2024-09-16T09:45:34.004 INFO:tasks.workunit.client.1.smithi114.stdout:4/524: mkdir d0/d26/dae 0 2024-09-16T09:45:34.007 INFO:tasks.workunit.client.1.smithi114.stdout:9/514: mkdir d3/da/d10/d23/d43/d1e/d78/db2 0 2024-09-16T09:45:34.007 INFO:tasks.workunit.client.1.smithi114.stdout:9/515: chown d3/da/d10/d23/d43/d82/c57 2 1 2024-09-16T09:45:34.007 INFO:tasks.workunit.client.1.smithi114.stdout:9/516: stat d3/da/f2a 0 2024-09-16T09:45:34.008 INFO:tasks.workunit.client.1.smithi114.stdout:9/517: fdatasync d3/da/d10/d23/d29/d3f/d85/f9c 0 2024-09-16T09:45:34.008 INFO:tasks.workunit.client.1.smithi114.stdout:3/668: unlink dc/de/d18/d78/faf 0 2024-09-16T09:45:34.008 INFO:tasks.workunit.client.1.smithi114.stdout:3/669: write dc/de/d17/d2d/db4/d6a/d77/f93 [800459,17007] 0 2024-09-16T09:45:34.008 INFO:tasks.workunit.client.1.smithi114.stdout:3/670: readlink dc/de/d1f/la4 0 2024-09-16T09:45:34.010 INFO:tasks.workunit.client.1.smithi114.stdout:2/593: write d1/d8/d10/d16/f27 [316340,76134] 0 2024-09-16T09:45:34.010 INFO:tasks.workunit.client.1.smithi114.stdout:0/515: mkdir d1f/d27/db9 0 2024-09-16T09:45:34.012 INFO:tasks.workunit.client.1.smithi114.stdout:4/525: unlink d0/d26/d40/d75/d7f/c93 0 2024-09-16T09:45:34.013 INFO:tasks.workunit.client.1.smithi114.stdout:4/526: chown d0/d26/d40/f44 43 1 2024-09-16T09:45:34.013 INFO:tasks.workunit.client.1.smithi114.stdout:9/518: creat d3/da/d10/fb3 x:0 0 0 2024-09-16T09:45:34.015 INFO:tasks.workunit.client.1.smithi114.stdout:2/594: link d1/d8/d10/d16/d1d/f5f d1/d8/d10/d16/d1d/d92/fde 0 2024-09-16T09:45:34.017 INFO:tasks.workunit.client.1.smithi114.stdout:0/516: getdents d1f/d2d 0 2024-09-16T09:45:34.021 INFO:tasks.workunit.client.1.smithi114.stdout:9/519: rmdir d3/da/d10/d23/d43/d1e/d25/d88/db0 0 2024-09-16T09:45:34.026 INFO:tasks.workunit.client.1.smithi114.stdout:2/595: creat d1/d9e/db0/fdf x:0 0 0 2024-09-16T09:45:34.027 INFO:tasks.workunit.client.1.smithi114.stdout:0/517: creat d1f/d22/fba x:0 0 0 2024-09-16T09:45:34.028 INFO:tasks.workunit.client.1.smithi114.stdout:9/520: getdents d3/da/d10/d23/d29/d2c/d6b/d68/d81 0 2024-09-16T09:45:34.028 INFO:tasks.workunit.client.1.smithi114.stdout:9/521: fsync d3/da/d10/d23/d29/d2c/f35 0 2024-09-16T09:45:34.028 INFO:tasks.workunit.client.1.smithi114.stdout:9/522: write d3/da/d10/d23/d43/d82/fa9 [304132,80811] 0 2024-09-16T09:45:34.029 INFO:tasks.workunit.client.1.smithi114.stdout:0/518: mkdir d1f/d22/d2e/d46/d7f/d8d/dbb 0 2024-09-16T09:45:34.029 INFO:tasks.workunit.client.1.smithi114.stdout:0/519: write d1f/d22/d2e/fa2 [241797,40459] 0 2024-09-16T09:45:34.030 INFO:tasks.workunit.client.1.smithi114.stdout:5/530: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f55 [4194304,4194304] 0 2024-09-16T09:45:34.030 INFO:tasks.workunit.client.1.smithi114.stdout:0/520: creat d1f/d9e/fbc x:0 0 0 2024-09-16T09:45:34.034 INFO:tasks.workunit.client.1.smithi114.stdout:0/521: link d1f/d20/l24 d1f/d20/d48/lbd 0 2024-09-16T09:45:34.034 INFO:tasks.workunit.client.1.smithi114.stdout:0/522: chown d1f/f3f 0 1 2024-09-16T09:45:34.036 INFO:tasks.workunit.client.1.smithi114.stdout:0/523: creat d1f/d27/d47/fbe x:0 0 0 2024-09-16T09:45:34.036 INFO:tasks.workunit.client.1.smithi114.stdout:0/524: chown d1f/d22/f49 94 1 2024-09-16T09:45:34.039 INFO:tasks.workunit.client.1.smithi114.stdout:0/525: mknod d1f/d22/d2e/d46/d7f/daf/cbf 0 2024-09-16T09:45:34.039 INFO:tasks.workunit.client.1.smithi114.stdout:4/527: dwrite d0/d26/d29/f14 [4194304,4194304] 0 2024-09-16T09:45:34.041 INFO:tasks.workunit.client.1.smithi114.stdout:0/526: rename d1f/d20/c33 to d1f/d22/cc0 0 2024-09-16T09:45:34.045 INFO:tasks.workunit.client.1.smithi114.stdout:4/528: mkdir d0/d26/d29/d2b/d58/daf 0 2024-09-16T09:45:34.045 INFO:tasks.workunit.client.1.smithi114.stdout:4/529: fdatasync d0/fe 0 2024-09-16T09:45:34.045 INFO:tasks.workunit.client.1.smithi114.stdout:2/596: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f65 [1837526,54750] 0 2024-09-16T09:45:34.046 INFO:tasks.workunit.client.1.smithi114.stdout:0/527: creat d1f/d9e/fc1 x:0 0 0 2024-09-16T09:45:34.047 INFO:tasks.workunit.client.1.smithi114.stdout:9/523: dread d3/da/f55 [0,4194304] 0 2024-09-16T09:45:34.047 INFO:tasks.workunit.client.1.smithi114.stdout:3/671: dwrite dc/de/d18/d78/f73 [0,4194304] 0 2024-09-16T09:45:34.047 INFO:tasks.workunit.client.1.smithi114.stdout:3/672: write dc/de/d17/d2d/db4/d6a/d77/d7f/fbe [1119646,128283] 0 2024-09-16T09:45:34.048 INFO:tasks.workunit.client.1.smithi114.stdout:9/524: rmdir d3/da/d10/d23/d43/d1e/d25/d88 39 2024-09-16T09:45:34.050 INFO:tasks.workunit.client.1.smithi114.stdout:9/525: rmdir d3/da/d10/d23/d29/d2c/d45/da5 39 2024-09-16T09:45:34.051 INFO:tasks.workunit.client.1.smithi114.stdout:9/526: fdatasync d3/da/d10/d23/d43/fa1 0 2024-09-16T09:45:34.052 INFO:tasks.workunit.client.1.smithi114.stdout:9/527: symlink d3/da/d10/d23/d43/lb4 0 2024-09-16T09:45:34.054 INFO:tasks.workunit.client.1.smithi114.stdout:5/531: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/f8e [0,4194304] 0 2024-09-16T09:45:34.054 INFO:tasks.workunit.client.1.smithi114.stdout:2/597: dread d1/d8/d10/f50 [0,4194304] 0 2024-09-16T09:45:34.056 INFO:tasks.workunit.client.1.smithi114.stdout:0/528: read d1f/d20/d48/f91 [424935,35337] 0 2024-09-16T09:45:34.056 INFO:tasks.workunit.client.1.smithi114.stdout:0/529: fsync d1f/d22/d2e/f90 0 2024-09-16T09:45:34.057 INFO:tasks.workunit.client.1.smithi114.stdout:9/528: mkdir d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/db5 0 2024-09-16T09:45:34.057 INFO:tasks.workunit.client.1.smithi114.stdout:4/530: dread d0/d26/d3c/d45/f50 [0,4194304] 0 2024-09-16T09:45:34.061 INFO:tasks.workunit.client.1.smithi114.stdout:3/673: dread dc/de/d37/d4e/f67 [0,4194304] 0 2024-09-16T09:45:34.062 INFO:tasks.workunit.client.1.smithi114.stdout:3/674: write dc/de/d1f/f29 [673240,6593] 0 2024-09-16T09:45:34.063 INFO:tasks.workunit.client.1.smithi114.stdout:2/598: creat d1/d8/d10/d16/d1d/d92/da7/fe0 x:0 0 0 2024-09-16T09:45:34.065 INFO:tasks.workunit.client.1.smithi114.stdout:0/530: unlink d1f/d20/d48/d75/l76 0 2024-09-16T09:45:34.067 INFO:tasks.workunit.client.1.smithi114.stdout:9/529: creat d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/db5/fb6 x:0 0 0 2024-09-16T09:45:34.067 INFO:tasks.workunit.client.1.smithi114.stdout:9/530: chown d3/da/d10/d23/d29/d3f/f76 60 1 2024-09-16T09:45:34.069 INFO:tasks.workunit.client.1.smithi114.stdout:4/531: rename d0/d26/dae to d0/d13/db0 0 2024-09-16T09:45:34.072 INFO:tasks.workunit.client.1.smithi114.stdout:3/675: rmdir dc/de/d18/d78/d5c/d6e/dc2 0 2024-09-16T09:45:34.072 INFO:tasks.workunit.client.1.smithi114.stdout:5/532: dwrite d3/d24/f2e [0,4194304] 0 2024-09-16T09:45:34.072 INFO:tasks.workunit.client.1.smithi114.stdout:5/533: fsync d3/d24/d84/f4f 0 2024-09-16T09:45:34.072 INFO:tasks.workunit.client.1.smithi114.stdout:2/599: stat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/ccd 0 2024-09-16T09:45:34.074 INFO:tasks.workunit.client.1.smithi114.stdout:4/532: getdents d0/d13/d56/d7e 0 2024-09-16T09:45:34.076 INFO:tasks.workunit.client.1.smithi114.stdout:9/531: write d3/da/d10/d23/d29/d2c/fa2 [1927211,124936] 0 2024-09-16T09:45:34.076 INFO:tasks.workunit.client.1.smithi114.stdout:9/532: chown d3/da/d10/d23/d43/f33 3083 1 2024-09-16T09:45:34.076 INFO:tasks.workunit.client.1.smithi114.stdout:9/533: readlink d3/da/d10/d23/d43/d1e/d4c/d8c/l91 0 2024-09-16T09:45:34.076 INFO:tasks.workunit.client.1.smithi114.stdout:3/676: creat dc/de/d18/d78/d5c/d6e/dc1/fed x:0 0 0 2024-09-16T09:45:34.076 INFO:tasks.workunit.client.1.smithi114.stdout:3/677: chown dc/de/d18/d78/d5c/d5d/fa6 72091 1 2024-09-16T09:45:34.078 INFO:tasks.workunit.client.1.smithi114.stdout:5/534: unlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fa4 0 2024-09-16T09:45:34.079 INFO:tasks.workunit.client.1.smithi114.stdout:2/600: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f8e zero size 2024-09-16T09:45:34.080 INFO:tasks.workunit.client.1.smithi114.stdout:0/531: dwrite d1f/d27/d55/f9a [4194304,4194304] 0 2024-09-16T09:45:34.081 INFO:tasks.workunit.client.1.smithi114.stdout:4/533: mknod d0/d26/d3c/d3e/d5a/d5d/d70/cb1 0 2024-09-16T09:45:34.081 INFO:tasks.workunit.client.1.smithi114.stdout:4/534: write d0/d26/d29/d2b/f61 [722899,113713] 0 2024-09-16T09:45:34.081 INFO:tasks.workunit.client.1.smithi114.stdout:4/535: chown d0/d26/d29/d9f/da0 222124 1 2024-09-16T09:45:34.084 INFO:tasks.workunit.client.1.smithi114.stdout:9/534: rmdir d3/da/d10/d23/d43/d1e/d4c 39 2024-09-16T09:45:34.084 INFO:tasks.workunit.client.1.smithi114.stdout:9/535: truncate d3/da/d10/d23/d29/f4b 144050 0 2024-09-16T09:45:34.084 INFO:tasks.workunit.client.1.smithi114.stdout:9/536: stat d3/da/d10/d23/d43/fa6 0 2024-09-16T09:45:34.084 INFO:tasks.workunit.client.1.smithi114.stdout:9/537: chown d3/da/d10/d23/d29/d2c/d45/c9f 0 1 2024-09-16T09:45:34.085 INFO:tasks.workunit.client.1.smithi114.stdout:3/678: creat dc/de/d17/fee x:0 0 0 2024-09-16T09:45:34.085 INFO:tasks.workunit.client.1.smithi114.stdout:3/679: fsync dc/d38/d3f/f5f 0 2024-09-16T09:45:34.085 INFO:tasks.workunit.client.1.smithi114.stdout:3/680: stat dc/de/d18/d78/d8d 0 2024-09-16T09:45:34.086 INFO:tasks.workunit.client.1.smithi114.stdout:1/546: sync 2024-09-16T09:45:34.086 INFO:tasks.workunit.client.1.smithi114.stdout:8/481: sync 2024-09-16T09:45:34.088 INFO:tasks.workunit.client.1.smithi114.stdout:4/536: dread d0/d26/d29/f1d [0,4194304] 0 2024-09-16T09:45:34.091 INFO:tasks.workunit.client.1.smithi114.stdout:9/538: rmdir d3/da/d10/d23/d29/d2c/da8 0 2024-09-16T09:45:34.092 INFO:tasks.workunit.client.1.smithi114.stdout:2/601: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/ce1 0 2024-09-16T09:45:34.092 INFO:tasks.workunit.client.1.smithi114.stdout:2/602: write d1/d8/d10/d16/f27 [4605059,11861] 0 2024-09-16T09:45:34.093 INFO:tasks.workunit.client.1.smithi114.stdout:4/537: mknod d0/d26/d29/d9f/da0/cb2 0 2024-09-16T09:45:34.093 INFO:tasks.workunit.client.1.smithi114.stdout:9/539: write d3/da/d10/d23/d29/d2c/d6b/f5f [475159,114123] 0 2024-09-16T09:45:34.094 INFO:tasks.workunit.client.1.smithi114.stdout:9/540: fsync d3/da/d10/d23/d43/fa6 0 2024-09-16T09:45:34.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/538: rename d0/d26/d3c/d3e/d4d to d0/d26/d3c/d3e/d4b/d46/db3 0 2024-09-16T09:45:34.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/539: read d0/d26/d29/f1d [19789,522] 0 2024-09-16T09:45:34.097 INFO:tasks.workunit.client.1.smithi114.stdout:4/540: symlink d0/d26/d3c/d3e/d5a/lb4 0 2024-09-16T09:45:34.113 INFO:tasks.workunit.client.1.smithi114.stdout:7/623: sync 2024-09-16T09:45:34.118 INFO:tasks.workunit.client.1.smithi114.stdout:4/541: dread d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:34.118 INFO:tasks.workunit.client.1.smithi114.stdout:0/532: dwrite f16 [0,4194304] 0 2024-09-16T09:45:34.118 INFO:tasks.workunit.client.1.smithi114.stdout:4/542: mknod d0/d13/d56/d7e/cb5 0 2024-09-16T09:45:34.118 INFO:tasks.workunit.client.1.smithi114.stdout:4/543: dread - d0/d26/d40/d75/d7f/d87/fab zero size 2024-09-16T09:45:34.119 INFO:tasks.workunit.client.1.smithi114.stdout:4/544: link d0/d26/l91 d0/d26/d3c/d74/d9c/lb6 0 2024-09-16T09:45:34.125 INFO:tasks.workunit.client.1.smithi114.stdout:7/624: read d2/d9/d2b/d2e/d22/d27/f1e [1769877,78831] 0 2024-09-16T09:45:34.125 INFO:tasks.workunit.client.1.smithi114.stdout:3/681: dwrite dc/de/d17/d2d/db4/d26/fcc [0,4194304] 0 2024-09-16T09:45:34.127 INFO:tasks.workunit.client.1.smithi114.stdout:3/682: rename dc/d38/d3f/l58 to dc/de/d37/d3d/lef 0 2024-09-16T09:45:34.127 INFO:tasks.workunit.client.1.smithi114.stdout:3/683: symlink dc/de/d37/lf0 0 2024-09-16T09:45:34.132 INFO:tasks.workunit.client.1.smithi114.stdout:3/684: symlink dc/de/d17/d79/dab/lf1 0 2024-09-16T09:45:34.132 INFO:tasks.workunit.client.1.smithi114.stdout:0/533: write d1f/d20/d48/f73 [2371454,129214] 0 2024-09-16T09:45:34.132 INFO:tasks.workunit.client.1.smithi114.stdout:0/534: write d1f/d20/d48/fa7 [741264,97223] 0 2024-09-16T09:45:34.133 INFO:tasks.workunit.client.1.smithi114.stdout:0/535: mknod d1f/d22/d2e/d46/d7f/daf/cc2 0 2024-09-16T09:45:34.133 INFO:tasks.workunit.client.1.smithi114.stdout:4/545: dread d0/d26/f48 [0,4194304] 0 2024-09-16T09:45:34.134 INFO:tasks.workunit.client.1.smithi114.stdout:8/482: dwrite d4/db/d68/d52/f70 [0,4194304] 0 2024-09-16T09:45:34.134 INFO:tasks.workunit.client.1.smithi114.stdout:3/685: write dc/de/d17/d2d/db4/f3c [4573020,104856] 0 2024-09-16T09:45:34.134 INFO:tasks.workunit.client.1.smithi114.stdout:1/547: dwrite d4/d2b/d16/d71/d72/d75/f77 [0,4194304] 0 2024-09-16T09:45:34.135 INFO:tasks.workunit.client.1.smithi114.stdout:0/536: symlink d1f/d20/d48/lc3 0 2024-09-16T09:45:34.135 INFO:tasks.workunit.client.1.smithi114.stdout:4/546: creat d0/d13/d25/fb7 x:0 0 0 2024-09-16T09:45:34.136 INFO:tasks.workunit.client.1.smithi114.stdout:2/603: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/f59 [0,4194304] 0 2024-09-16T09:45:34.137 INFO:tasks.workunit.client.1.smithi114.stdout:8/483: mkdir d4/db/d39/d3c/d4e/d82/d72/d59/da0 0 2024-09-16T09:45:34.137 INFO:tasks.workunit.client.1.smithi114.stdout:3/686: truncate dc/de/d18/f35 4123056 0 2024-09-16T09:45:34.138 INFO:tasks.workunit.client.1.smithi114.stdout:0/537: creat d1f/fc4 x:0 0 0 2024-09-16T09:45:34.138 INFO:tasks.workunit.client.1.smithi114.stdout:0/538: chown d1f/d27/d47/l4d 5776970 1 2024-09-16T09:45:34.138 INFO:tasks.workunit.client.1.smithi114.stdout:0/539: read - d1f/d27/d47/d56/f99 zero size 2024-09-16T09:45:34.139 INFO:tasks.workunit.client.1.smithi114.stdout:1/548: dread d4/d2b/d29/f5e [0,4194304] 0 2024-09-16T09:45:34.139 INFO:tasks.workunit.client.1.smithi114.stdout:4/547: mkdir d0/d26/d3c/d3e/d4b/d46/db3/db8 0 2024-09-16T09:45:34.140 INFO:tasks.workunit.client.1.smithi114.stdout:2/604: rename d1/d8/d10/d16/l4f to d1/d8/d10/d16/dd9/le2 0 2024-09-16T09:45:34.140 INFO:tasks.workunit.client.1.smithi114.stdout:8/484: mkdir d4/db/dd/da1 0 2024-09-16T09:45:34.141 INFO:tasks.workunit.client.1.smithi114.stdout:3/687: symlink dc/de/d18/lf2 0 2024-09-16T09:45:34.141 INFO:tasks.workunit.client.1.smithi114.stdout:3/688: readlink dc/de/d1f/la4 0 2024-09-16T09:45:34.142 INFO:tasks.workunit.client.1.smithi114.stdout:0/540: creat d1f/d22/d2e/d46/d7f/d8d/fc5 x:0 0 0 2024-09-16T09:45:34.143 INFO:tasks.workunit.client.1.smithi114.stdout:1/549: mkdir d4/d2b/d16/d71/d72/d75/db4 0 2024-09-16T09:45:34.143 INFO:tasks.workunit.client.1.smithi114.stdout:1/550: chown d4/d2b/d16/d71/d72/c7a 2946326 1 2024-09-16T09:45:34.144 INFO:tasks.workunit.client.1.smithi114.stdout:3/689: rename dc/de/d17/d72/lcd to dc/de/d17/d2d/d41/lf3 0 2024-09-16T09:45:34.144 INFO:tasks.workunit.client.1.smithi114.stdout:3/690: write dc/de/d17/d2d/db4/fc8 [763706,28022] 0 2024-09-16T09:45:34.144 INFO:tasks.workunit.client.1.smithi114.stdout:3/691: write dc/de/d17/d2d/db4/d6a/fd1 [405424,97222] 0 2024-09-16T09:45:34.146 INFO:tasks.workunit.client.1.smithi114.stdout:3/692: mknod dc/de/d18/d78/d5c/cf4 0 2024-09-16T09:45:34.146 INFO:tasks.workunit.client.1.smithi114.stdout:3/693: chown dc/de/d18/d78/d5c/d6e/dc1/fed 27038587 1 2024-09-16T09:45:34.146 INFO:tasks.workunit.client.1.smithi114.stdout:3/694: mknod dc/de/d37/d4e/cf5 0 2024-09-16T09:45:34.146 INFO:tasks.workunit.client.1.smithi114.stdout:3/695: dread - dc/de/d18/d78/d5c/fe3 zero size 2024-09-16T09:45:34.149 INFO:tasks.workunit.client.1.smithi114.stdout:7/625: dwrite d2/d9/d2b/d2e/d22/d27/f1e [0,4194304] 0 2024-09-16T09:45:34.150 INFO:tasks.workunit.client.1.smithi114.stdout:3/696: dread dc/de/d1f/f80 [0,4194304] 0 2024-09-16T09:45:34.155 INFO:tasks.workunit.client.1.smithi114.stdout:3/697: creat dc/de/d18/d78/d8d/ff6 x:0 0 0 2024-09-16T09:45:34.155 INFO:tasks.workunit.client.1.smithi114.stdout:2/605: read d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f40 [2002985,52255] 0 2024-09-16T09:45:34.158 INFO:tasks.workunit.client.1.smithi114.stdout:8/485: write d4/f15 [1747603,130593] 0 2024-09-16T09:45:34.162 INFO:tasks.workunit.client.1.smithi114.stdout:8/486: rename d4/db/d3e/d71/f79 to d4/db/d3e/d47/fa2 0 2024-09-16T09:45:34.162 INFO:tasks.workunit.client.1.smithi114.stdout:8/487: readlink d4/db/d68/l25 0 2024-09-16T09:45:34.170 INFO:tasks.workunit.client.1.smithi114.stdout:7/626: write d2/fab [2292136,76817] 0 2024-09-16T09:45:34.170 INFO:tasks.workunit.client.1.smithi114.stdout:7/627: truncate d2/d9/d2b/d2e/d77/f56 1566200 0 2024-09-16T09:45:34.172 INFO:tasks.workunit.client.1.smithi114.stdout:7/628: mknod d2/d9/d51/cd8 0 2024-09-16T09:45:34.172 INFO:tasks.workunit.client.1.smithi114.stdout:7/629: chown d2/d9/d2b/f95 316779 1 2024-09-16T09:45:34.172 INFO:tasks.workunit.client.1.smithi114.stdout:7/630: dread - d2/df/fce zero size 2024-09-16T09:45:34.173 INFO:tasks.workunit.client.1.smithi114.stdout:2/606: write d1/d8/d10/d16/d1d/fc7 [123467,49380] 0 2024-09-16T09:45:34.174 INFO:tasks.workunit.client.1.smithi114.stdout:0/541: dwrite d1f/d22/d2e/f6c [4194304,4194304] 0 2024-09-16T09:45:34.174 INFO:tasks.workunit.client.1.smithi114.stdout:2/607: mknod d1/d9e/daf/ce3 0 2024-09-16T09:45:34.174 INFO:tasks.workunit.client.1.smithi114.stdout:7/631: write d2/d9/d2b/d2e/d22/d4c/f9e [119333,89662] 0 2024-09-16T09:45:34.175 INFO:tasks.workunit.client.1.smithi114.stdout:4/548: dwrite d0/d26/d3c/d3e/d4b/d46/f80 [0,4194304] 0 2024-09-16T09:45:34.176 INFO:tasks.workunit.client.1.smithi114.stdout:1/551: dwrite d4/d2b/d16/d71/f96 [0,4194304] 0 2024-09-16T09:45:34.177 INFO:tasks.workunit.client.1.smithi114.stdout:0/542: mknod d1f/d27/d47/d56/cc6 0 2024-09-16T09:45:34.179 INFO:tasks.workunit.client.1.smithi114.stdout:4/549: getdents d0/d26/d3c/d3e/d5a/d5d/d70 0 2024-09-16T09:45:34.185 INFO:tasks.workunit.client.1.smithi114.stdout:8/488: dwrite d4/db/d39/d3c/f6b [0,4194304] 0 2024-09-16T09:45:34.188 INFO:tasks.workunit.client.1.smithi114.stdout:1/552: rmdir d4/d2b/d2f/d3a 39 2024-09-16T09:45:34.189 INFO:tasks.workunit.client.1.smithi114.stdout:0/543: rmdir d1f/d22 39 2024-09-16T09:45:34.189 INFO:tasks.workunit.client.1.smithi114.stdout:1/553: chown d4/d2b/d2f/d3a/d56/faa 576 1 2024-09-16T09:45:34.189 INFO:tasks.workunit.client.1.smithi114.stdout:1/554: dread - d4/d2b/d16/d47/f93 zero size 2024-09-16T09:45:34.190 INFO:tasks.workunit.client.1.smithi114.stdout:4/550: link d0/d26/d3c/d3e/d4b/d46/l47 d0/d13/db0/lb9 0 2024-09-16T09:45:34.190 INFO:tasks.workunit.client.1.smithi114.stdout:3/698: dwrite dc/de/d37/da7/fc7 [0,4194304] 0 2024-09-16T09:45:34.190 INFO:tasks.workunit.client.1.smithi114.stdout:3/699: fdatasync dc/de/d1f/f80 0 2024-09-16T09:45:34.191 INFO:tasks.workunit.client.1.smithi114.stdout:8/489: symlink d4/db/d39/d3c/d86/la3 0 2024-09-16T09:45:34.192 INFO:tasks.workunit.client.1.smithi114.stdout:0/544: creat d1f/fc7 x:0 0 0 2024-09-16T09:45:34.193 INFO:tasks.workunit.client.1.smithi114.stdout:1/555: creat d4/d2b/d16/d71/d72/fb5 x:0 0 0 2024-09-16T09:45:34.194 INFO:tasks.workunit.client.1.smithi114.stdout:1/556: dread - d4/d2b/d16/d47/fb2 zero size 2024-09-16T09:45:34.197 INFO:tasks.workunit.client.1.smithi114.stdout:3/700: rename dc/de/d18/d78/d5c/d6e/ca1 to dc/de/d17/d2d/d41/de4/cf7 0 2024-09-16T09:45:34.201 INFO:tasks.workunit.client.1.smithi114.stdout:0/545: rename c1b to d1f/d27/cc8 0 2024-09-16T09:45:34.201 INFO:tasks.workunit.client.1.smithi114.stdout:0/546: getdents d1f/d27/db9 0 2024-09-16T09:45:34.202 INFO:tasks.workunit.client.1.smithi114.stdout:3/701: mkdir dc/de/d37/d4e/df8 0 2024-09-16T09:45:34.203 INFO:tasks.workunit.client.1.smithi114.stdout:0/547: creat d1f/d20/fc9 x:0 0 0 2024-09-16T09:45:34.205 INFO:tasks.workunit.client.1.smithi114.stdout:3/702: mkdir dc/d38/d3f/df9 0 2024-09-16T09:45:34.206 INFO:tasks.workunit.client.1.smithi114.stdout:0/548: getdents d1f/d9e 0 2024-09-16T09:45:34.209 INFO:tasks.workunit.client.1.smithi114.stdout:0/549: creat d1f/fca x:0 0 0 2024-09-16T09:45:34.209 INFO:tasks.workunit.client.1.smithi114.stdout:8/490: dread d4/d1f/f42 [0,4194304] 0 2024-09-16T09:45:34.209 INFO:tasks.workunit.client.1.smithi114.stdout:8/491: chown d4/f15 9 1 2024-09-16T09:45:34.209 INFO:tasks.workunit.client.1.smithi114.stdout:0/550: creat d1f/d27/d47/d56/fcb x:0 0 0 2024-09-16T09:45:34.209 INFO:tasks.workunit.client.1.smithi114.stdout:8/492: creat d4/db/fa4 x:0 0 0 2024-09-16T09:45:34.213 INFO:tasks.workunit.client.1.smithi114.stdout:8/493: dread d4/db/d39/d3c/f95 [0,4194304] 0 2024-09-16T09:45:34.214 INFO:tasks.workunit.client.1.smithi114.stdout:8/494: rename d4/db/d68/c2d to d4/db/d39/d3c/d86/ca5 0 2024-09-16T09:45:34.216 INFO:tasks.workunit.client.1.smithi114.stdout:8/495: mknod d4/db/d39/d3c/d84/ca6 0 2024-09-16T09:45:34.216 INFO:tasks.workunit.client.1.smithi114.stdout:8/496: write d4/db/d39/d3c/f81 [22328,54433] 0 2024-09-16T09:45:34.216 INFO:tasks.workunit.client.1.smithi114.stdout:6/606: sync 2024-09-16T09:45:34.221 INFO:tasks.workunit.client.1.smithi114.stdout:8/497: creat d4/db/d39/d3c/fa7 x:0 0 0 2024-09-16T09:45:34.221 INFO:tasks.workunit.client.1.smithi114.stdout:6/607: creat d6/da/d76/fc1 x:0 0 0 2024-09-16T09:45:34.222 INFO:tasks.workunit.client.1.smithi114.stdout:6/608: fdatasync d6/d2d/f9b 0 2024-09-16T09:45:34.222 INFO:tasks.workunit.client.1.smithi114.stdout:3/703: write dc/de/d18/d78/f64 [2326443,37892] 0 2024-09-16T09:45:34.222 INFO:tasks.workunit.client.1.smithi114.stdout:2/608: dwrite d1/d8/f7a [0,4194304] 0 2024-09-16T09:45:34.222 INFO:tasks.workunit.client.1.smithi114.stdout:3/704: creat dc/de/d37/da7/ffa x:0 0 0 2024-09-16T09:45:34.223 INFO:tasks.workunit.client.1.smithi114.stdout:4/551: dwrite d0/d13/faa [0,4194304] 0 2024-09-16T09:45:34.224 INFO:tasks.workunit.client.1.smithi114.stdout:3/705: rename dc/de/d17/d2d/f88 to dc/de/d17/d2d/db4/d6a/d77/ffb 0 2024-09-16T09:45:34.224 INFO:tasks.workunit.client.1.smithi114.stdout:0/551: dread d1f/d22/d2e/d46/f54 [0,4194304] 0 2024-09-16T09:45:34.225 INFO:tasks.workunit.client.1.smithi114.stdout:7/632: dwrite d2/d9/d2b/d59/fa5 [0,4194304] 0 2024-09-16T09:45:34.225 INFO:tasks.workunit.client.1.smithi114.stdout:1/557: dwrite d4/d2b/d29/f49 [0,4194304] 0 2024-09-16T09:45:34.230 INFO:tasks.workunit.client.1.smithi114.stdout:6/609: read d6/da/d10/f33 [1433489,39448] 0 2024-09-16T09:45:34.231 INFO:tasks.workunit.client.1.smithi114.stdout:4/552: unlink d0/l10 0 2024-09-16T09:45:34.240 INFO:tasks.workunit.client.1.smithi114.stdout:6/610: mknod d6/da/d10/d40/cc2 0 2024-09-16T09:45:34.240 INFO:tasks.workunit.client.1.smithi114.stdout:6/611: dread - d6/da/d10/d40/f94 zero size 2024-09-16T09:45:34.241 INFO:tasks.workunit.client.1.smithi114.stdout:4/553: rmdir d0/d26/d3c 39 2024-09-16T09:45:34.242 INFO:tasks.workunit.client.1.smithi114.stdout:4/554: creat d0/d26/d3c/d3e/d4b/fba x:0 0 0 2024-09-16T09:45:34.243 INFO:tasks.workunit.client.1.smithi114.stdout:4/555: write d0/d26/f88 [862242,90648] 0 2024-09-16T09:45:34.244 INFO:tasks.workunit.client.1.smithi114.stdout:3/706: write dc/de/d17/d2d/f63 [3645993,99041] 0 2024-09-16T09:45:34.244 INFO:tasks.workunit.client.1.smithi114.stdout:4/556: creat d0/d26/d3c/d74/d9c/fbb x:0 0 0 2024-09-16T09:45:34.245 INFO:tasks.workunit.client.1.smithi114.stdout:3/707: mkdir dc/de/d17/d79/dfc 0 2024-09-16T09:45:34.246 INFO:tasks.workunit.client.1.smithi114.stdout:0/552: dwrite d1f/d22/fba [0,4194304] 0 2024-09-16T09:45:34.246 INFO:tasks.workunit.client.1.smithi114.stdout:4/557: truncate d0/d26/d3c/d3e/d4b/f8f 56612 0 2024-09-16T09:45:34.248 INFO:tasks.workunit.client.1.smithi114.stdout:3/708: creat dc/de/d18/d78/d5c/d6e/ffd x:0 0 0 2024-09-16T09:45:34.248 INFO:tasks.workunit.client.1.smithi114.stdout:3/709: truncate dc/d38/f66 1338860 0 2024-09-16T09:45:34.249 INFO:tasks.workunit.client.1.smithi114.stdout:3/710: write dc/de/d18/fd7 [365089,112869] 0 2024-09-16T09:45:34.249 INFO:tasks.workunit.client.1.smithi114.stdout:3/711: stat dc/de/d17/d72/f90 0 2024-09-16T09:45:34.249 INFO:tasks.workunit.client.1.smithi114.stdout:3/712: readlink dc/de/d17/d2d/db4/d26/l43 0 2024-09-16T09:45:34.252 INFO:tasks.workunit.client.1.smithi114.stdout:4/558: dread d0/d26/d3c/d45/f50 [0,4194304] 0 2024-09-16T09:45:34.252 INFO:tasks.workunit.client.1.smithi114.stdout:0/553: creat d1f/d2d/d7a/fcc x:0 0 0 2024-09-16T09:45:34.253 INFO:tasks.workunit.client.1.smithi114.stdout:0/554: truncate d1f/fca 269103 0 2024-09-16T09:45:34.253 INFO:tasks.workunit.client.1.smithi114.stdout:0/555: write d1f/d22/fb5 [146437,115536] 0 2024-09-16T09:45:34.254 INFO:tasks.workunit.client.1.smithi114.stdout:6/612: write d6/da/d10/f47 [4037973,14196] 0 2024-09-16T09:45:34.255 INFO:tasks.workunit.client.1.smithi114.stdout:6/613: readlink l0 0 2024-09-16T09:45:34.255 INFO:tasks.workunit.client.1.smithi114.stdout:2/609: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f97 [0,4194304] 0 2024-09-16T09:45:34.255 INFO:tasks.workunit.client.1.smithi114.stdout:2/610: truncate d1/d8/d10/d16/d1d/d92/da3/fd7 982589 0 2024-09-16T09:45:34.255 INFO:tasks.workunit.client.1.smithi114.stdout:3/713: unlink dc/de/d18/d78/d5c/d5d/f55 0 2024-09-16T09:45:34.255 INFO:tasks.workunit.client.1.smithi114.stdout:2/611: read d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f95 [53304,44377] 0 2024-09-16T09:45:34.256 INFO:tasks.workunit.client.1.smithi114.stdout:1/558: dwrite d4/d2b/d16/f19 [0,4194304] 0 2024-09-16T09:45:34.256 INFO:tasks.workunit.client.1.smithi114.stdout:4/559: creat d0/d13/d56/d7e/fbc x:0 0 0 2024-09-16T09:45:34.259 INFO:tasks.workunit.client.1.smithi114.stdout:0/556: rename d1f/d27/d47/f66 to d1f/d20/d48/d75/fcd 0 2024-09-16T09:45:34.263 INFO:tasks.workunit.client.1.smithi114.stdout:3/714: truncate dc/de/d17/d2d/db4/d6a/d77/f9d 3799574 0 2024-09-16T09:45:34.263 INFO:tasks.workunit.client.1.smithi114.stdout:3/715: readlink dc/de/d17/l21 0 2024-09-16T09:45:34.263 INFO:tasks.workunit.client.1.smithi114.stdout:2/612: symlink d1/d9e/daf/le4 0 2024-09-16T09:45:34.265 INFO:tasks.workunit.client.1.smithi114.stdout:1/559: creat d4/d2b/d2f/d3a/d9d/d41/d42/fb6 x:0 0 0 2024-09-16T09:45:34.266 INFO:tasks.workunit.client.1.smithi114.stdout:5/535: sync 2024-09-16T09:45:34.266 INFO:tasks.workunit.client.1.smithi114.stdout:9/541: sync 2024-09-16T09:45:34.267 INFO:tasks.workunit.client.1.smithi114.stdout:0/557: mkdir d1f/d27/d55/dce 0 2024-09-16T09:45:34.267 INFO:tasks.workunit.client.1.smithi114.stdout:0/558: dread - d1f/d20/f82 zero size 2024-09-16T09:45:34.269 INFO:tasks.workunit.client.1.smithi114.stdout:1/560: symlink d4/d2b/d16/d71/d72/lb7 0 2024-09-16T09:45:34.270 INFO:tasks.workunit.client.1.smithi114.stdout:1/561: readlink d4/d2b/d16/d47/l54 0 2024-09-16T09:45:34.271 INFO:tasks.workunit.client.1.smithi114.stdout:5/536: mkdir d3/d24/d84/d71/d72/d52/db1 0 2024-09-16T09:45:34.271 INFO:tasks.workunit.client.1.smithi114.stdout:5/537: chown d3/d24/d84/d7a/d43/d4c/d92/l69 13 1 2024-09-16T09:45:34.272 INFO:tasks.workunit.client.1.smithi114.stdout:5/538: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f94 0 1 2024-09-16T09:45:34.272 INFO:tasks.workunit.client.1.smithi114.stdout:0/559: getdents d1f/d22/d2e/d46/d7f/d8d 0 2024-09-16T09:45:34.272 INFO:tasks.workunit.client.1.smithi114.stdout:0/560: write d1f/d20/fad [8957537,11860] 0 2024-09-16T09:45:34.272 INFO:tasks.workunit.client.1.smithi114.stdout:0/561: chown d1f/d2d/d7a/fcc 4987 1 2024-09-16T09:45:34.274 INFO:tasks.workunit.client.1.smithi114.stdout:1/562: creat d4/d2b/d2f/d3a/d9d/d41/d42/d58/fb8 x:0 0 0 2024-09-16T09:45:34.275 INFO:tasks.workunit.client.1.smithi114.stdout:6/614: dwrite d6/da/d10/d40/fa2 [0,4194304] 0 2024-09-16T09:45:34.275 INFO:tasks.workunit.client.1.smithi114.stdout:6/615: dread - d6/da/d76/fc1 zero size 2024-09-16T09:45:34.275 INFO:tasks.workunit.client.1.smithi114.stdout:6/616: write d6/da/d10/d40/f95 [107615,114259] 0 2024-09-16T09:45:34.275 INFO:tasks.workunit.client.1.smithi114.stdout:6/617: read - d6/da/d48/fbd zero size 2024-09-16T09:45:34.275 INFO:tasks.workunit.client.1.smithi114.stdout:5/539: mkdir d3/d24/d84/d7a/d43/d4c/db2 0 2024-09-16T09:45:34.276 INFO:tasks.workunit.client.1.smithi114.stdout:0/562: rmdir d1f/d27/d47/d56/d7e 39 2024-09-16T09:45:34.276 INFO:tasks.workunit.client.1.smithi114.stdout:0/563: stat d1f/d22/d2e/f37 0 2024-09-16T09:45:34.277 INFO:tasks.workunit.client.1.smithi114.stdout:1/563: mkdir d4/d2b/d29/d92/db9 0 2024-09-16T09:45:34.280 INFO:tasks.workunit.client.1.smithi114.stdout:6/618: mknod d6/da/d10/d40/d82/cc3 0 2024-09-16T09:45:34.280 INFO:tasks.workunit.client.1.smithi114.stdout:1/564: dread d4/d2b/d2f/d3a/d9d/d41/f8e [0,4194304] 0 2024-09-16T09:45:34.280 INFO:tasks.workunit.client.1.smithi114.stdout:6/619: write d6/d2d/d46/f5a [2366804,30974] 0 2024-09-16T09:45:34.283 INFO:tasks.workunit.client.1.smithi114.stdout:6/620: truncate d6/da/f45 369679 0 2024-09-16T09:45:34.283 INFO:tasks.workunit.client.1.smithi114.stdout:6/621: read - d6/da/d76/fc1 zero size 2024-09-16T09:45:34.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/716: rename dc/de/d17/d2d/db4/d6a/d77 to dc/de/d18/dfe 0 2024-09-16T09:45:34.287 INFO:tasks.workunit.client.1.smithi114.stdout:2/613: rename d1/d8/d10/d16/d1d/d92/fde to d1/d8/d10/d5a/fe5 0 2024-09-16T09:45:34.287 INFO:tasks.workunit.client.1.smithi114.stdout:2/614: fdatasync d1/d8/d10/d16/d60/db7/fbb 0 2024-09-16T09:45:34.288 INFO:tasks.workunit.client.1.smithi114.stdout:3/717: creat dc/de/d18/d78/d8d/fff x:0 0 0 2024-09-16T09:45:34.289 INFO:tasks.workunit.client.1.smithi114.stdout:5/540: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/c95 to d3/d24/d84/d71/d72/d52/cb3 0 2024-09-16T09:45:34.290 INFO:tasks.workunit.client.1.smithi114.stdout:2/615: creat d1/fe6 x:0 0 0 2024-09-16T09:45:34.291 INFO:tasks.workunit.client.1.smithi114.stdout:3/718: unlink dc/de/d18/f40 0 2024-09-16T09:45:34.292 INFO:tasks.workunit.client.1.smithi114.stdout:0/564: rename d1f/d20/l24 to d1f/d27/d47/lcf 0 2024-09-16T09:45:34.299 INFO:tasks.workunit.client.1.smithi114.stdout:6/622: dread d6/da/d10/f71 [0,4194304] 0 2024-09-16T09:45:34.300 INFO:tasks.workunit.client.1.smithi114.stdout:6/623: creat d6/da/d10/fc4 x:0 0 0 2024-09-16T09:45:34.302 INFO:tasks.workunit.client.1.smithi114.stdout:4/560: dwrite d0/d26/d40/d75/d7f/d87/fab [0,4194304] 0 2024-09-16T09:45:34.302 INFO:tasks.workunit.client.1.smithi114.stdout:4/561: stat d0/d13/f4c 0 2024-09-16T09:45:34.302 INFO:tasks.workunit.client.1.smithi114.stdout:6/624: creat d6/da/d36/d51/fc5 x:0 0 0 2024-09-16T09:45:34.302 INFO:tasks.workunit.client.1.smithi114.stdout:6/625: readlink d6/da/d10/l1b 0 2024-09-16T09:45:34.302 INFO:tasks.workunit.client.1.smithi114.stdout:6/626: readlink d6/d2d/d46/l63 0 2024-09-16T09:45:34.308 INFO:tasks.workunit.client.1.smithi114.stdout:6/627: dread d6/fc [0,4194304] 0 2024-09-16T09:45:34.308 INFO:tasks.workunit.client.1.smithi114.stdout:9/542: dwrite d3/da/d10/d23/d43/d1e/d25/d88/f9e [0,4194304] 0 2024-09-16T09:45:34.309 INFO:tasks.workunit.client.1.smithi114.stdout:1/565: dwrite d4/d2b/d2f/d3a/d9d/d41/fa2 [0,4194304] 0 2024-09-16T09:45:34.311 INFO:tasks.workunit.client.1.smithi114.stdout:3/719: dwrite dc/de/d18/d78/d5c/d6e/dc1/fed [0,4194304] 0 2024-09-16T09:45:34.312 INFO:tasks.workunit.client.1.smithi114.stdout:0/565: dread d1f/d22/fb5 [0,4194304] 0 2024-09-16T09:45:34.312 INFO:tasks.workunit.client.1.smithi114.stdout:0/566: readlink d1f/d20/l5b 0 2024-09-16T09:45:34.313 INFO:tasks.workunit.client.1.smithi114.stdout:9/543: creat d3/da/d10/d23/d43/d1e/d4c/fb7 x:0 0 0 2024-09-16T09:45:34.313 INFO:tasks.workunit.client.1.smithi114.stdout:9/544: chown d3/da/fb 243 1 2024-09-16T09:45:34.313 INFO:tasks.workunit.client.1.smithi114.stdout:9/545: write d3/da/d10/d23/d29/d2c/d45/f65 [1461123,76193] 0 2024-09-16T09:45:34.313 INFO:tasks.workunit.client.1.smithi114.stdout:1/566: symlink d4/d2b/d2f/d3a/lba 0 2024-09-16T09:45:34.313 INFO:tasks.workunit.client.1.smithi114.stdout:1/567: fdatasync d4/d2b/d2f/d3a/d56/f88 0 2024-09-16T09:45:34.319 INFO:tasks.workunit.client.1.smithi114.stdout:5/541: rename d3/d24/d84/d71 to d3/d24/d84/d7a/d43/d4c/d6d/d79/db4 0 2024-09-16T09:45:34.321 INFO:tasks.workunit.client.1.smithi114.stdout:2/616: getdents d1 0 2024-09-16T09:45:34.321 INFO:tasks.workunit.client.1.smithi114.stdout:2/617: chown d1/d8/d10/d16/d1d/f5f 331307 1 2024-09-16T09:45:34.321 INFO:tasks.workunit.client.1.smithi114.stdout:2/618: read d1/f96 [189595,113681] 0 2024-09-16T09:45:34.328 INFO:tasks.workunit.client.1.smithi114.stdout:3/720: symlink dc/de/d17/d79/dab/l100 0 2024-09-16T09:45:34.329 INFO:tasks.workunit.client.1.smithi114.stdout:0/567: mknod d1f/d22/d2e/d46/d7f/cd0 0 2024-09-16T09:45:34.329 INFO:tasks.workunit.client.1.smithi114.stdout:0/568: read d1f/d20/d48/f73 [807407,18645] 0 2024-09-16T09:45:34.329 INFO:tasks.workunit.client.1.smithi114.stdout:0/569: write d1f/d22/d2e/f37 [1696226,15458] 0 2024-09-16T09:45:34.330 INFO:tasks.workunit.client.1.smithi114.stdout:9/546: creat d3/da/d10/d23/d43/d1e/d78/db2/fb8 x:0 0 0 2024-09-16T09:45:34.331 INFO:tasks.workunit.client.1.smithi114.stdout:9/547: read d3/f5 [1154397,57931] 0 2024-09-16T09:45:34.332 INFO:tasks.workunit.client.1.smithi114.stdout:1/568: mkdir d4/d2b/d16/d71/d72/d75/db4/dbb 0 2024-09-16T09:45:34.332 INFO:tasks.workunit.client.1.smithi114.stdout:1/569: write d4/d2b/d2f/d3a/d9d/d41/d42/f5a [276460,6204] 0 2024-09-16T09:45:34.334 INFO:tasks.workunit.client.1.smithi114.stdout:4/562: rename d0/d26/d40/d75/c9d to d0/d13/d56/cbd 0 2024-09-16T09:45:34.335 INFO:tasks.workunit.client.1.smithi114.stdout:5/542: mkdir d3/d24/d84/d7a/d43/d4c/db2/db5 0 2024-09-16T09:45:34.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/570: mknod d1f/cd1 0 2024-09-16T09:45:34.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/571: chown f1e 1679719 1 2024-09-16T09:45:34.339 INFO:tasks.workunit.client.1.smithi114.stdout:1/570: creat d4/d2b/d29/da0/db1/fbc x:0 0 0 2024-09-16T09:45:34.341 INFO:tasks.workunit.client.1.smithi114.stdout:4/563: mkdir d0/d26/d29/dbe 0 2024-09-16T09:45:34.344 INFO:tasks.workunit.client.1.smithi114.stdout:2/619: rename d1/caa to d1/d9e/daf/ce7 0 2024-09-16T09:45:34.344 INFO:tasks.workunit.client.1.smithi114.stdout:9/548: dwrite d3/da/d10/d23/d43/d82/f75 [0,4194304] 0 2024-09-16T09:45:34.344 INFO:tasks.workunit.client.1.smithi114.stdout:9/549: fsync d3/da/d10/fb3 0 2024-09-16T09:45:34.347 INFO:tasks.workunit.client.1.smithi114.stdout:5/543: unlink d3/d24/d84/d7a/d43/d4c/d92/l69 0 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:4/564: creat d0/d26/d3c/d3e/d5a/d5d/d70/fbf x:0 0 0 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:3/721: rename dc/de/d37/d3d/lef to dc/de/d37/d57/l101 0 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:8/498: sync 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:7/633: sync 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:3/722: chown dc/de/d37/l82 0 1 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:2/620: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/le8 0 2024-09-16T09:45:34.354 INFO:tasks.workunit.client.1.smithi114.stdout:2/621: read - d1/d8/f8b zero size 2024-09-16T09:45:34.355 INFO:tasks.workunit.client.1.smithi114.stdout:3/723: write dc/de/d18/d78/d8d/ff6 [793347,122626] 0 2024-09-16T09:45:34.355 INFO:tasks.workunit.client.1.smithi114.stdout:3/724: dread - dc/de/d17/fee zero size 2024-09-16T09:45:34.358 INFO:tasks.workunit.client.1.smithi114.stdout:8/499: creat d4/db/dd/fa8 x:0 0 0 2024-09-16T09:45:34.359 INFO:tasks.workunit.client.1.smithi114.stdout:4/565: mkdir d0/d26/d2e/dc0 0 2024-09-16T09:45:34.360 INFO:tasks.workunit.client.1.smithi114.stdout:4/566: write d0/d13/d56/d7e/fbc [325236,14507] 0 2024-09-16T09:45:34.361 INFO:tasks.workunit.client.1.smithi114.stdout:2/622: creat d1/d8/d10/d16/d1d/d92/fe9 x:0 0 0 2024-09-16T09:45:34.362 INFO:tasks.workunit.client.1.smithi114.stdout:7/634: dread - d2/d9/d2b/d2e/d22/d66/db0/fcf zero size 2024-09-16T09:45:34.364 INFO:tasks.workunit.client.1.smithi114.stdout:3/725: creat dc/de/d18/dfe/d7f/f102 x:0 0 0 2024-09-16T09:45:34.365 INFO:tasks.workunit.client.1.smithi114.stdout:2/623: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/c4c 2 1 2024-09-16T09:45:34.367 INFO:tasks.workunit.client.1.smithi114.stdout:7/635: mknod d2/d9/d2b/d2e/d3e/d89/cd9 0 2024-09-16T09:45:34.369 INFO:tasks.workunit.client.1.smithi114.stdout:3/726: symlink dc/de/d37/da7/l103 0 2024-09-16T09:45:34.369 INFO:tasks.workunit.client.1.smithi114.stdout:3/727: truncate dc/de/d1f/f80 1426355 0 2024-09-16T09:45:34.369 INFO:tasks.workunit.client.1.smithi114.stdout:3/728: fdatasync dc/de/d17/f1a 0 2024-09-16T09:45:34.371 INFO:tasks.workunit.client.1.smithi114.stdout:2/624: link d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/cb9 d1/d8/d10/cea 0 2024-09-16T09:45:34.372 INFO:tasks.workunit.client.1.smithi114.stdout:4/567: write d0/d26/f48 [1474088,84861] 0 2024-09-16T09:45:34.372 INFO:tasks.workunit.client.1.smithi114.stdout:7/636: unlink d2/d9/d2b/f95 0 2024-09-16T09:45:34.373 INFO:tasks.workunit.client.1.smithi114.stdout:3/729: creat dc/de/d17/d2d/f104 x:0 0 0 2024-09-16T09:45:34.375 INFO:tasks.workunit.client.1.smithi114.stdout:7/637: mkdir d2/d9/d51/d84/dda 0 2024-09-16T09:45:34.375 INFO:tasks.workunit.client.1.smithi114.stdout:7/638: chown d2/d9/d2b/d2e/d22/d27/d4d/d72/ca3 0 1 2024-09-16T09:45:34.375 INFO:tasks.workunit.client.1.smithi114.stdout:3/730: symlink dc/de/d37/da7/l105 0 2024-09-16T09:45:34.381 INFO:tasks.workunit.client.1.smithi114.stdout:0/572: dwrite d1f/f74 [0,4194304] 0 2024-09-16T09:45:34.386 INFO:tasks.workunit.client.1.smithi114.stdout:9/550: dwrite d3/fc [4194304,4194304] 0 2024-09-16T09:45:34.386 INFO:tasks.workunit.client.1.smithi114.stdout:4/568: dread d0/d26/d40/d75/d7f/d87/fab [0,4194304] 0 2024-09-16T09:45:34.390 INFO:tasks.workunit.client.1.smithi114.stdout:9/551: dread d3/da/d10/d23/d43/fa6 [0,4194304] 0 2024-09-16T09:45:34.390 INFO:tasks.workunit.client.1.smithi114.stdout:9/552: write d3/da/d10/d23/d29/d2c/d45/d93/fab [811276,51179] 0 2024-09-16T09:45:34.397 INFO:tasks.workunit.client.1.smithi114.stdout:4/569: write d0/f3a [2389169,45210] 0 2024-09-16T09:45:34.408 INFO:tasks.workunit.client.1.smithi114.stdout:1/571: dwrite d4/d2b/d2f/d3a/f4f [0,4194304] 0 2024-09-16T09:45:34.408 INFO:tasks.workunit.client.1.smithi114.stdout:5/544: dwrite d3/d24/d84/d7a/d43/d4c/d92/f97 [0,4194304] 0 2024-09-16T09:45:34.411 INFO:tasks.workunit.client.1.smithi114.stdout:5/545: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/fb6 x:0 0 0 2024-09-16T09:45:34.412 INFO:tasks.workunit.client.1.smithi114.stdout:5/546: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72 0 2024-09-16T09:45:34.413 INFO:tasks.workunit.client.1.smithi114.stdout:5/547: mkdir d3/d24/d84/d7a/d43/d4c/db2/db7 0 2024-09-16T09:45:34.415 INFO:tasks.workunit.client.1.smithi114.stdout:5/548: symlink d3/d24/d84/d7a/d43/d4c/d6d/d9e/lb8 0 2024-09-16T09:45:34.415 INFO:tasks.workunit.client.1.smithi114.stdout:5/549: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/c4b 0 1 2024-09-16T09:45:34.416 INFO:tasks.workunit.client.1.smithi114.stdout:5/550: mkdir d3/d24/d84/db9 0 2024-09-16T09:45:34.419 INFO:tasks.workunit.client.1.smithi114.stdout:8/500: dwrite d4/db/dd/f6f [0,4194304] 0 2024-09-16T09:45:34.419 INFO:tasks.workunit.client.1.smithi114.stdout:2/625: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f6f [0,4194304] 0 2024-09-16T09:45:34.419 INFO:tasks.workunit.client.1.smithi114.stdout:2/626: truncate d1/d9e/db0/fdf 321413 0 2024-09-16T09:45:34.419 INFO:tasks.workunit.client.1.smithi114.stdout:3/731: dwrite dc/de/d37/d98/fdc [0,4194304] 0 2024-09-16T09:45:34.419 INFO:tasks.workunit.client.1.smithi114.stdout:3/732: truncate dc/d38/fcf 1350722 0 2024-09-16T09:45:34.425 INFO:tasks.workunit.client.1.smithi114.stdout:7/639: dwrite d2/f1c [0,4194304] 0 2024-09-16T09:45:34.425 INFO:tasks.workunit.client.1.smithi114.stdout:7/640: fdatasync d2/d9/d2b/d2e/d3e/f65 0 2024-09-16T09:45:34.426 INFO:tasks.workunit.client.1.smithi114.stdout:8/501: stat d4/db/d39/d3c/d4e/l5b 0 2024-09-16T09:45:34.426 INFO:tasks.workunit.client.1.smithi114.stdout:2/627: mkdir d1/d8/d10/d16/d60/db7/deb 0 2024-09-16T09:45:34.426 INFO:tasks.workunit.client.1.smithi114.stdout:2/628: truncate d1/d8/d10/d16/f8c 786724 0 2024-09-16T09:45:34.426 INFO:tasks.workunit.client.1.smithi114.stdout:3/733: unlink dc/de/d1f/lbf 0 2024-09-16T09:45:34.428 INFO:tasks.workunit.client.1.smithi114.stdout:8/502: mkdir d4/db/d3e/d71/d78/d8d/da9 0 2024-09-16T09:45:34.429 INFO:tasks.workunit.client.1.smithi114.stdout:8/503: read d4/db/f4d [672454,117942] 0 2024-09-16T09:45:34.430 INFO:tasks.workunit.client.1.smithi114.stdout:2/629: mkdir d1/dec 0 2024-09-16T09:45:34.430 INFO:tasks.workunit.client.1.smithi114.stdout:2/630: chown d1/f2c 136 1 2024-09-16T09:45:34.430 INFO:tasks.workunit.client.1.smithi114.stdout:2/631: truncate d1/d8/d10/d16/f8c 1437906 0 2024-09-16T09:45:34.430 INFO:tasks.workunit.client.1.smithi114.stdout:2/632: dread - d1/d8/d10/d16/d1d/d92/da7/fe0 zero size 2024-09-16T09:45:34.430 INFO:tasks.workunit.client.1.smithi114.stdout:2/633: dread - d1/d8/d10/d5a/fce zero size 2024-09-16T09:45:34.431 INFO:tasks.workunit.client.1.smithi114.stdout:3/734: creat dc/de/d18/d78/d5c/d5d/d50/dea/f106 x:0 0 0 2024-09-16T09:45:34.432 INFO:tasks.workunit.client.1.smithi114.stdout:5/551: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f10 [0,4194304] 0 2024-09-16T09:45:34.432 INFO:tasks.workunit.client.1.smithi114.stdout:2/634: mknod d1/d8/d10/d16/d60/db7/ced 0 2024-09-16T09:45:34.432 INFO:tasks.workunit.client.1.smithi114.stdout:2/635: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/ccc 335 1 2024-09-16T09:45:34.432 INFO:tasks.workunit.client.1.smithi114.stdout:2/636: chown d1/d8/d82/lac 0 1 2024-09-16T09:45:34.433 INFO:tasks.workunit.client.1.smithi114.stdout:3/735: symlink dc/de/d37/l107 0 2024-09-16T09:45:34.433 INFO:tasks.workunit.client.1.smithi114.stdout:3/736: write dc/de/d17/f1a [1821476,42942] 0 2024-09-16T09:45:34.433 INFO:tasks.workunit.client.1.smithi114.stdout:3/737: fdatasync dc/de/d18/f28 0 2024-09-16T09:45:34.433 INFO:tasks.workunit.client.1.smithi114.stdout:3/738: fdatasync dc/de/d17/fee 0 2024-09-16T09:45:34.433 INFO:tasks.workunit.client.1.smithi114.stdout:3/739: chown dc/de/d37/d3d/fbb 11 1 2024-09-16T09:45:34.433 INFO:tasks.workunit.client.1.smithi114.stdout:5/552: symlink d3/d24/d84/d7a/d43/d4c/d6d/d9e/lba 0 2024-09-16T09:45:34.434 INFO:tasks.workunit.client.1.smithi114.stdout:8/504: dread d4/db/d3e/d71/d78/d7a/f9f [0,4194304] 0 2024-09-16T09:45:34.434 INFO:tasks.workunit.client.1.smithi114.stdout:2/637: rename d1/d8/d10/f25 to d1/d8/d10/d16/d1d/d92/da3/fee 0 2024-09-16T09:45:34.436 INFO:tasks.workunit.client.1.smithi114.stdout:5/553: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb 0 2024-09-16T09:45:34.437 INFO:tasks.workunit.client.1.smithi114.stdout:8/505: symlink d4/db/d3e/laa 0 2024-09-16T09:45:34.437 INFO:tasks.workunit.client.1.smithi114.stdout:8/506: fsync d4/db/d3e/f97 0 2024-09-16T09:45:34.437 INFO:tasks.workunit.client.1.smithi114.stdout:8/507: getdents d4/db/d3e/d71/d78/d8d/da9 0 2024-09-16T09:45:34.438 INFO:tasks.workunit.client.1.smithi114.stdout:8/508: rename d4/f15 to d4/db/d91/fab 0 2024-09-16T09:45:34.439 INFO:tasks.workunit.client.1.smithi114.stdout:2/638: link d1/l37 d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/lef 0 2024-09-16T09:45:34.439 INFO:tasks.workunit.client.1.smithi114.stdout:7/641: dread d2/d9/d2b/d2e/d22/fb2 [0,4194304] 0 2024-09-16T09:45:34.439 INFO:tasks.workunit.client.1.smithi114.stdout:2/639: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/fdb 0 2024-09-16T09:45:34.439 INFO:tasks.workunit.client.1.smithi114.stdout:7/642: chown d2/d9/d2b/d59/d7f/fbb 16561487 1 2024-09-16T09:45:34.440 INFO:tasks.workunit.client.1.smithi114.stdout:5/554: mkdir d3/d24/d84/dbc 0 2024-09-16T09:45:34.440 INFO:tasks.workunit.client.1.smithi114.stdout:5/555: chown d3/d24/d84/d7a/d43/d4c/d92/c6e 7 1 2024-09-16T09:45:34.441 INFO:tasks.workunit.client.1.smithi114.stdout:8/509: mkdir d4/db/d68/d28/dac 0 2024-09-16T09:45:34.441 INFO:tasks.workunit.client.1.smithi114.stdout:8/510: symlink d4/db/d68/d28/lad 0 2024-09-16T09:45:34.443 INFO:tasks.workunit.client.1.smithi114.stdout:7/643: rename d2/d9/d2b/d2e/d22/fd2 to d2/d9/d2b/d2e/d22/d27/fdb 0 2024-09-16T09:45:34.443 INFO:tasks.workunit.client.1.smithi114.stdout:7/644: write d2/d9/d2b/d2e/d22/d27/d4d/f9d [190010,125661] 0 2024-09-16T09:45:34.444 INFO:tasks.workunit.client.1.smithi114.stdout:2/640: dread d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f40 [0,4194304] 0 2024-09-16T09:45:34.444 INFO:tasks.workunit.client.1.smithi114.stdout:1/572: dwrite d4/d2b/d2f/d3a/d56/f88 [0,4194304] 0 2024-09-16T09:45:34.444 INFO:tasks.workunit.client.1.smithi114.stdout:2/641: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f8e [500104,96231] 0 2024-09-16T09:45:34.444 INFO:tasks.workunit.client.1.smithi114.stdout:4/570: dwrite d0/d26/d40/d75/d7f/d87/fab [0,4194304] 0 2024-09-16T09:45:34.445 INFO:tasks.workunit.client.1.smithi114.stdout:3/740: dread dc/de/d37/d3d/fbb [0,4194304] 0 2024-09-16T09:45:34.445 INFO:tasks.workunit.client.1.smithi114.stdout:0/573: dwrite d1f/d22/d2e/f37 [0,4194304] 0 2024-09-16T09:45:34.445 INFO:tasks.workunit.client.1.smithi114.stdout:7/645: creat d2/d9/d2b/d59/dca/fdc x:0 0 0 2024-09-16T09:45:34.445 INFO:tasks.workunit.client.1.smithi114.stdout:0/574: stat d1f/d20/c6b 0 2024-09-16T09:45:34.447 INFO:tasks.workunit.client.1.smithi114.stdout:1/573: mknod d4/d2b/cbd 0 2024-09-16T09:45:34.449 INFO:tasks.workunit.client.1.smithi114.stdout:2/642: symlink d1/d8/d10/d16/d1d/lf0 0 2024-09-16T09:45:34.449 INFO:tasks.workunit.client.1.smithi114.stdout:4/571: dread d0/d26/d40/d75/d7f/d87/f8d [0,4194304] 0 2024-09-16T09:45:34.450 INFO:tasks.workunit.client.1.smithi114.stdout:3/741: link dc/de/d18/d78/d5c/cf4 dc/de/c108 0 2024-09-16T09:45:34.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/575: rename f9 to d1f/d22/d2e/d46/d7f/daf/fd2 0 2024-09-16T09:45:34.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/576: write d1f/d9e/fbc [276511,91143] 0 2024-09-16T09:45:34.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/577: readlink d1f/d20/d48/d75/la5 0 2024-09-16T09:45:34.452 INFO:tasks.workunit.client.1.smithi114.stdout:0/578: chown d1f/d27/d55/f71 119800448 1 2024-09-16T09:45:34.453 INFO:tasks.workunit.client.1.smithi114.stdout:0/579: fsync d1f/f8b 0 2024-09-16T09:45:34.453 INFO:tasks.workunit.client.1.smithi114.stdout:0/580: fdatasync d1f/d20/fad 0 2024-09-16T09:45:34.453 INFO:tasks.workunit.client.1.smithi114.stdout:7/646: mkdir d2/d9/d2b/d78/d99/ddd 0 2024-09-16T09:45:34.454 INFO:tasks.workunit.client.1.smithi114.stdout:1/574: mknod d4/d2b/d2f/d3a/d9d/d41/d42/cbe 0 2024-09-16T09:45:34.454 INFO:tasks.workunit.client.1.smithi114.stdout:1/575: write d4/d2b/d16/f65 [3844160,9447] 0 2024-09-16T09:45:34.454 INFO:tasks.workunit.client.1.smithi114.stdout:8/511: dread d4/db/f22 [4194304,4194304] 0 2024-09-16T09:45:34.454 INFO:tasks.workunit.client.1.smithi114.stdout:8/512: dread - d4/db/d68/d28/f89 zero size 2024-09-16T09:45:34.455 INFO:tasks.workunit.client.1.smithi114.stdout:8/513: fdatasync d4/f40 0 2024-09-16T09:45:34.455 INFO:tasks.workunit.client.1.smithi114.stdout:3/742: symlink dc/de/l109 0 2024-09-16T09:45:34.457 INFO:tasks.workunit.client.1.smithi114.stdout:0/581: creat d1f/d27/d55/fd3 x:0 0 0 2024-09-16T09:45:34.458 INFO:tasks.workunit.client.1.smithi114.stdout:7/647: rmdir d2/d9/d2b/d2e/d77/dd7 0 2024-09-16T09:45:34.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/576: mknod d4/d2b/d16/d47/da7/cbf 0 2024-09-16T09:45:34.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/577: write d4/d2b/f91 [518906,122817] 0 2024-09-16T09:45:34.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/578: fdatasync d4/d2b/d16/f22 0 2024-09-16T09:45:34.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/579: readlink d4/d2b/d2f/d3a/d56/l6c 0 2024-09-16T09:45:34.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/580: read - d4/fb3 zero size 2024-09-16T09:45:34.462 INFO:tasks.workunit.client.1.smithi114.stdout:0/582: unlink d1f/d27/d47/d56/fcb 0 2024-09-16T09:45:34.462 INFO:tasks.workunit.client.1.smithi114.stdout:4/572: read d0/d26/d29/f14 [2908146,53779] 0 2024-09-16T09:45:34.463 INFO:tasks.workunit.client.1.smithi114.stdout:7/648: link d2/d9/d2b/d78/c8f d2/d9/d2b/dcc/cde 0 2024-09-16T09:45:34.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/514: rename d4/db/d68/d52 to d4/dae 0 2024-09-16T09:45:34.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/515: chown d4/dae/d54/l5c 5 1 2024-09-16T09:45:34.465 INFO:tasks.workunit.client.1.smithi114.stdout:8/516: read d4/db/d68/d28/f7e [530546,80899] 0 2024-09-16T09:45:34.465 INFO:tasks.workunit.client.1.smithi114.stdout:4/573: creat d0/d26/d3c/d45/fc1 x:0 0 0 2024-09-16T09:45:34.466 INFO:tasks.workunit.client.1.smithi114.stdout:5/556: dwrite d3/d24/d84/d7a/d43/f48 [8388608,4194304] 0 2024-09-16T09:45:34.467 INFO:tasks.workunit.client.1.smithi114.stdout:7/649: rename d2/d9/d2b/d2e/d93/lc8 to d2/d9/d2b/dcc/ldf 0 2024-09-16T09:45:34.468 INFO:tasks.workunit.client.1.smithi114.stdout:8/517: mknod d4/db/d39/d3c/d4e/d82/d72/caf 0 2024-09-16T09:45:34.469 INFO:tasks.workunit.client.1.smithi114.stdout:5/557: stat d3/le 0 2024-09-16T09:45:34.469 INFO:tasks.workunit.client.1.smithi114.stdout:7/650: symlink d2/d9/d2b/d2e/d22/d27/d64/le0 0 2024-09-16T09:45:34.470 INFO:tasks.workunit.client.1.smithi114.stdout:8/518: mknod d4/db/d3e/d71/d78/cb0 0 2024-09-16T09:45:34.470 INFO:tasks.workunit.client.1.smithi114.stdout:8/519: stat d4/db/d3e/d47/f5e 0 2024-09-16T09:45:34.471 INFO:tasks.workunit.client.1.smithi114.stdout:5/558: mknod d3/d24/d84/dbc/cbd 0 2024-09-16T09:45:34.472 INFO:tasks.workunit.client.1.smithi114.stdout:5/559: read d3/d24/d84/d7a/d43/d4c/d6d/d79/f8d [189191,22464] 0 2024-09-16T09:45:34.472 INFO:tasks.workunit.client.1.smithi114.stdout:5/560: fdatasync d3/d24/d84/d7a/d43/f51 0 2024-09-16T09:45:34.472 INFO:tasks.workunit.client.1.smithi114.stdout:7/651: rename d2/d9/d2b/d78/c8f to d2/d9/d2b/d2e/d22/d27/d4d/d72/ce1 0 2024-09-16T09:45:34.473 INFO:tasks.workunit.client.1.smithi114.stdout:1/581: read d4/d2b/d2f/d3a/d9d/d41/fa2 [1111608,3914] 0 2024-09-16T09:45:34.474 INFO:tasks.workunit.client.1.smithi114.stdout:5/561: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/fbe x:0 0 0 2024-09-16T09:45:34.475 INFO:tasks.workunit.client.1.smithi114.stdout:6/628: sync 2024-09-16T09:45:34.475 INFO:tasks.workunit.client.1.smithi114.stdout:1/582: symlink d4/d2b/d29/da0/lc0 0 2024-09-16T09:45:34.475 INFO:tasks.workunit.client.1.smithi114.stdout:1/583: write d4/d2b/d29/da0/db1/fbc [287391,105164] 0 2024-09-16T09:45:34.476 INFO:tasks.workunit.client.1.smithi114.stdout:5/562: mknod d3/d24/d7d/d96/cbf 0 2024-09-16T09:45:34.477 INFO:tasks.workunit.client.1.smithi114.stdout:6/629: creat d6/d64/fc6 x:0 0 0 2024-09-16T09:45:34.480 INFO:tasks.workunit.client.1.smithi114.stdout:6/630: rename d6/da/d10/f1d to d6/d2d/d46/d9c/fc7 0 2024-09-16T09:45:34.481 INFO:tasks.workunit.client.1.smithi114.stdout:8/520: read d4/d6d/f8e [1339047,26445] 0 2024-09-16T09:45:34.482 INFO:tasks.workunit.client.1.smithi114.stdout:6/631: mkdir d6/da/db3/dc8 0 2024-09-16T09:45:34.482 INFO:tasks.workunit.client.1.smithi114.stdout:6/632: chown d6/f88 32058610 1 2024-09-16T09:45:34.482 INFO:tasks.workunit.client.1.smithi114.stdout:6/633: write d6/da/d76/fc1 [631583,89639] 0 2024-09-16T09:45:34.482 INFO:tasks.workunit.client.1.smithi114.stdout:3/743: dwrite dc/de/d18/d78/d5c/d5d/d50/fd0 [4194304,4194304] 0 2024-09-16T09:45:34.483 INFO:tasks.workunit.client.1.smithi114.stdout:8/521: getdents d4/db/d39/d3c/d86 0 2024-09-16T09:45:34.485 INFO:tasks.workunit.client.1.smithi114.stdout:3/744: truncate dc/de/d17/d2d/f63 4609904 0 2024-09-16T09:45:34.487 INFO:tasks.workunit.client.1.smithi114.stdout:7/652: dread d2/d9/d2b/d78/d99/f9b [0,4194304] 0 2024-09-16T09:45:34.487 INFO:tasks.workunit.client.1.smithi114.stdout:8/522: link d4/db/d39/d3c/d4e/d82/d72/d59/f69 d4/d6d/fb1 0 2024-09-16T09:45:34.489 INFO:tasks.workunit.client.1.smithi114.stdout:7/653: getdents d2/d9/d2b 0 2024-09-16T09:45:34.490 INFO:tasks.workunit.client.1.smithi114.stdout:8/523: creat d4/db/dd/fb2 x:0 0 0 2024-09-16T09:45:34.491 INFO:tasks.workunit.client.1.smithi114.stdout:4/574: dwrite d0/d13/d25/fb7 [0,4194304] 0 2024-09-16T09:45:34.491 INFO:tasks.workunit.client.1.smithi114.stdout:2/643: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/f59 [0,4194304] 0 2024-09-16T09:45:34.491 INFO:tasks.workunit.client.1.smithi114.stdout:2/644: dread - d1/d8/d82/f8d zero size 2024-09-16T09:45:34.492 INFO:tasks.workunit.client.1.smithi114.stdout:7/654: link d2/d9/d2b/d2e/d22/d27/f1f d2/d9/d2b/d2e/fe2 0 2024-09-16T09:45:34.493 INFO:tasks.workunit.client.1.smithi114.stdout:0/583: dwrite d1f/d22/d2e/d46/d7f/d8d/fc5 [0,4194304] 0 2024-09-16T09:45:34.496 INFO:tasks.workunit.client.1.smithi114.stdout:2/645: symlink d1/d8/d10/d16/d1d/d92/da7/lf1 0 2024-09-16T09:45:34.496 INFO:tasks.workunit.client.1.smithi114.stdout:2/646: fsync d1/d8/d10/d16/d1d/f1e 0 2024-09-16T09:45:34.503 INFO:tasks.workunit.client.1.smithi114.stdout:2/647: dread d1/d8/d10/d16/d1d/f5c [0,4194304] 0 2024-09-16T09:45:34.507 INFO:tasks.workunit.client.1.smithi114.stdout:0/584: write d1f/d22/f49 [2238842,79161] 0 2024-09-16T09:45:34.507 INFO:tasks.workunit.client.1.smithi114.stdout:0/585: stat d1f/d27/d47/d56/cc6 0 2024-09-16T09:45:34.512 INFO:tasks.workunit.client.1.smithi114.stdout:2/648: mknod d1/d8/d10/d5a/cf2 0 2024-09-16T09:45:34.514 INFO:tasks.workunit.client.1.smithi114.stdout:0/586: mknod d1f/d22/d2e/cd4 0 2024-09-16T09:45:34.515 INFO:tasks.workunit.client.1.smithi114.stdout:2/649: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/ff3 x:0 0 0 2024-09-16T09:45:34.517 INFO:tasks.workunit.client.1.smithi114.stdout:0/587: symlink d1f/d2d/ld5 0 2024-09-16T09:45:34.517 INFO:tasks.workunit.client.1.smithi114.stdout:0/588: fdatasync d1f/d22/fa0 0 2024-09-16T09:45:34.517 INFO:tasks.workunit.client.1.smithi114.stdout:0/589: chown d1f/d2d/l72 7207 1 2024-09-16T09:45:34.517 INFO:tasks.workunit.client.1.smithi114.stdout:2/650: creat d1/d9e/daf/ff4 x:0 0 0 2024-09-16T09:45:34.517 INFO:tasks.workunit.client.1.smithi114.stdout:2/651: fdatasync d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f36 0 2024-09-16T09:45:34.519 INFO:tasks.workunit.client.1.smithi114.stdout:2/652: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/df5 0 2024-09-16T09:45:34.519 INFO:tasks.workunit.client.1.smithi114.stdout:2/653: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/fdc zero size 2024-09-16T09:45:34.531 INFO:tasks.workunit.client.1.smithi114.stdout:6/634: dwrite f5 [0,4194304] 0 2024-09-16T09:45:34.533 INFO:tasks.workunit.client.1.smithi114.stdout:6/635: creat d6/da/d10/d92/fc9 x:0 0 0 2024-09-16T09:45:34.533 INFO:tasks.workunit.client.1.smithi114.stdout:6/636: chown d6/da/d10/f25 3216390 1 2024-09-16T09:45:34.534 INFO:tasks.workunit.client.1.smithi114.stdout:5/563: dwrite d3/d24/f2e [4194304,4194304] 0 2024-09-16T09:45:34.534 INFO:tasks.workunit.client.1.smithi114.stdout:5/564: chown d3/d24/d84/d7a/d43/d4c/f54 3 1 2024-09-16T09:45:34.535 INFO:tasks.workunit.client.1.smithi114.stdout:2/654: dread d1/d8/f7a [0,4194304] 0 2024-09-16T09:45:34.535 INFO:tasks.workunit.client.1.smithi114.stdout:5/565: symlink d3/d24/d84/db9/lc0 0 2024-09-16T09:45:34.536 INFO:tasks.workunit.client.1.smithi114.stdout:2/655: mkdir d1/d8/d10/d16/d60/db7/deb/df6 0 2024-09-16T09:45:34.536 INFO:tasks.workunit.client.1.smithi114.stdout:2/656: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/f59 4844955 0 2024-09-16T09:45:34.536 INFO:tasks.workunit.client.1.smithi114.stdout:5/566: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/fc1 x:0 0 0 2024-09-16T09:45:34.537 INFO:tasks.workunit.client.1.smithi114.stdout:2/657: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/ff7 x:0 0 0 2024-09-16T09:45:34.537 INFO:tasks.workunit.client.1.smithi114.stdout:2/658: fdatasync d1/d9e/daf/ff4 0 2024-09-16T09:45:34.539 INFO:tasks.workunit.client.1.smithi114.stdout:5/567: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f5d to d3/d24/d84/d7a/d43/d4c/d6d/d9e/fc2 0 2024-09-16T09:45:34.539 INFO:tasks.workunit.client.1.smithi114.stdout:2/659: symlink d1/d8/d10/d16/d60/lf8 0 2024-09-16T09:45:34.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/660: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9 0 2024-09-16T09:45:34.541 INFO:tasks.workunit.client.1.smithi114.stdout:2/661: write d1/d9e/fd3 [5971,82175] 0 2024-09-16T09:45:34.541 INFO:tasks.workunit.client.1.smithi114.stdout:2/662: mknod d1/d8/d10/d16/d1d/cfa 0 2024-09-16T09:45:34.542 INFO:tasks.workunit.client.1.smithi114.stdout:6/637: write d6/d2d/f54 [4807753,30133] 0 2024-09-16T09:45:34.542 INFO:tasks.workunit.client.1.smithi114.stdout:2/663: symlink d1/d8/d10/d16/d60/db7/deb/lfb 0 2024-09-16T09:45:34.542 INFO:tasks.workunit.client.1.smithi114.stdout:2/664: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f7e 743804 1 2024-09-16T09:45:34.543 INFO:tasks.workunit.client.1.smithi114.stdout:6/638: creat d6/da/d10/d40/d82/fca x:0 0 0 2024-09-16T09:45:34.544 INFO:tasks.workunit.client.1.smithi114.stdout:2/665: symlink d1/d8/d10/d16/d1d/d92/da7/lfc 0 2024-09-16T09:45:34.544 INFO:tasks.workunit.client.1.smithi114.stdout:2/666: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68 39 2024-09-16T09:45:34.548 INFO:tasks.workunit.client.1.smithi114.stdout:5/568: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/f60 [0,4194304] 0 2024-09-16T09:45:34.551 INFO:tasks.workunit.client.1.smithi114.stdout:3/745: dwrite dc/d38/f66 [0,4194304] 0 2024-09-16T09:45:34.551 INFO:tasks.workunit.client.1.smithi114.stdout:1/584: dwrite d4/d2b/f91 [0,4194304] 0 2024-09-16T09:45:34.552 INFO:tasks.workunit.client.1.smithi114.stdout:8/524: dwrite d4/dae/f7b [0,4194304] 0 2024-09-16T09:45:34.552 INFO:tasks.workunit.client.1.smithi114.stdout:8/525: fdatasync d4/db/d68/d30/f33 0 2024-09-16T09:45:34.552 INFO:tasks.workunit.client.1.smithi114.stdout:7/655: dwrite d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:34.553 INFO:tasks.workunit.client.1.smithi114.stdout:7/656: readlink d2/d9/d2b/d2e/l1d 0 2024-09-16T09:45:34.553 INFO:tasks.workunit.client.1.smithi114.stdout:9/553: sync 2024-09-16T09:45:34.553 INFO:tasks.workunit.client.1.smithi114.stdout:3/746: creat dc/de/d17/d79/f10a x:0 0 0 2024-09-16T09:45:34.554 INFO:tasks.workunit.client.1.smithi114.stdout:9/554: stat d3/da/d10/d23/d29/d2c/d45/c5d 0 2024-09-16T09:45:34.554 INFO:tasks.workunit.client.1.smithi114.stdout:6/639: dread d6/da/d36/d51/f6b [0,4194304] 0 2024-09-16T09:45:34.554 INFO:tasks.workunit.client.1.smithi114.stdout:6/640: chown d6/da/f15 1 1 2024-09-16T09:45:34.554 INFO:tasks.workunit.client.1.smithi114.stdout:0/590: dwrite d1f/f3f [0,4194304] 0 2024-09-16T09:45:34.555 INFO:tasks.workunit.client.1.smithi114.stdout:1/585: rmdir d4/d2b/d29/d92/db9 0 2024-09-16T09:45:34.555 INFO:tasks.workunit.client.1.smithi114.stdout:1/586: write d4/f25 [678037,17902] 0 2024-09-16T09:45:34.560 INFO:tasks.workunit.client.1.smithi114.stdout:2/667: write d1/d8/d10/f50 [3676624,34539] 0 2024-09-16T09:45:34.560 INFO:tasks.workunit.client.1.smithi114.stdout:2/668: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f8e 1381690 0 2024-09-16T09:45:34.562 INFO:tasks.workunit.client.1.smithi114.stdout:6/641: rename d6/da/d10/d40/fa2 to d6/fcb 0 2024-09-16T09:45:34.562 INFO:tasks.workunit.client.1.smithi114.stdout:6/642: write d6/da/d10/d40/f72 [1314561,28259] 0 2024-09-16T09:45:34.562 INFO:tasks.workunit.client.1.smithi114.stdout:6/643: write d6/da/d36/d51/f6f [999050,17752] 0 2024-09-16T09:45:34.562 INFO:tasks.workunit.client.1.smithi114.stdout:6/644: write d6/da/d36/fa9 [772082,94715] 0 2024-09-16T09:45:34.565 INFO:tasks.workunit.client.1.smithi114.stdout:0/591: creat d1f/d22/d2e/d46/d7f/d8d/dbb/fd6 x:0 0 0 2024-09-16T09:45:34.565 INFO:tasks.workunit.client.1.smithi114.stdout:7/657: write d2/d9/f5c [1611765,102045] 0 2024-09-16T09:45:34.567 INFO:tasks.workunit.client.1.smithi114.stdout:2/669: creat d1/ffd x:0 0 0 2024-09-16T09:45:34.569 INFO:tasks.workunit.client.1.smithi114.stdout:6/645: rmdir d6/da/d36/d51 39 2024-09-16T09:45:34.569 INFO:tasks.workunit.client.1.smithi114.stdout:6/646: chown d6/d64 1 1 2024-09-16T09:45:34.569 INFO:tasks.workunit.client.1.smithi114.stdout:0/592: mknod d1f/d9e/cd7 0 2024-09-16T09:45:34.571 INFO:tasks.workunit.client.1.smithi114.stdout:7/658: creat d2/d9/d51/d84/fe3 x:0 0 0 2024-09-16T09:45:34.571 INFO:tasks.workunit.client.1.smithi114.stdout:7/659: truncate d2/d9/d2b/d2e/d22/d66/db0/fc1 866143 0 2024-09-16T09:45:34.572 INFO:tasks.workunit.client.1.smithi114.stdout:9/555: dread d3/f5 [0,4194304] 0 2024-09-16T09:45:34.572 INFO:tasks.workunit.client.1.smithi114.stdout:9/556: stat d3/da/d10/d23/f7e 0 2024-09-16T09:45:34.574 INFO:tasks.workunit.client.1.smithi114.stdout:2/670: getdents d1/d8/d10/d16/d1d/d92/da3 0 2024-09-16T09:45:34.574 INFO:tasks.workunit.client.1.smithi114.stdout:2/671: dread - d1/d8/d10/d16/d1d/d92/fe9 zero size 2024-09-16T09:45:34.574 INFO:tasks.workunit.client.1.smithi114.stdout:2/672: dread - d1/f8a zero size 2024-09-16T09:45:34.575 INFO:tasks.workunit.client.1.smithi114.stdout:2/673: dread d1/d8/d10/d16/d1d/d92/da3/fc6 [0,4194304] 0 2024-09-16T09:45:34.575 INFO:tasks.workunit.client.1.smithi114.stdout:2/674: write d1/d8/d10/d16/d1d/d92/da7/d3e/fb4 [4922404,24333] 0 2024-09-16T09:45:34.575 INFO:tasks.workunit.client.1.smithi114.stdout:0/593: creat d1f/d22/d2e/d46/d7f/fd8 x:0 0 0 2024-09-16T09:45:34.576 INFO:tasks.workunit.client.1.smithi114.stdout:9/557: mkdir d3/da/d10/d23/d29/d2c/d6b/db9 0 2024-09-16T09:45:34.578 INFO:tasks.workunit.client.1.smithi114.stdout:9/558: write d3/da/d10/d23/d29/d2c/d70/f7c [1046265,18642] 0 2024-09-16T09:45:34.579 INFO:tasks.workunit.client.1.smithi114.stdout:8/526: dwrite d4/db/d68/d28/f67 [0,4194304] 0 2024-09-16T09:45:34.580 INFO:tasks.workunit.client.1.smithi114.stdout:3/747: dwrite dc/de/d17/d2d/db4/d6a/fd1 [0,4194304] 0 2024-09-16T09:45:34.581 INFO:tasks.workunit.client.1.smithi114.stdout:2/675: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b 39 2024-09-16T09:45:34.581 INFO:tasks.workunit.client.1.smithi114.stdout:5/569: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f35 [0,4194304] 0 2024-09-16T09:45:34.583 INFO:tasks.workunit.client.1.smithi114.stdout:0/594: creat d1f/d22/fd9 x:0 0 0 2024-09-16T09:45:34.583 INFO:tasks.workunit.client.1.smithi114.stdout:0/595: chown d1f/d27/d47/f60 14 1 2024-09-16T09:45:34.583 INFO:tasks.workunit.client.1.smithi114.stdout:0/596: dread - d1f/d27/d55/fb4 zero size 2024-09-16T09:45:34.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/748: dread dc/de/d1f/f80 [0,4194304] 0 2024-09-16T09:45:34.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/749: chown dc/de/d17/d79/dab/l100 334766969 1 2024-09-16T09:45:34.584 INFO:tasks.workunit.client.1.smithi114.stdout:9/559: symlink d3/da/d10/d23/d29/d2c/d70/lba 0 2024-09-16T09:45:34.588 INFO:tasks.workunit.client.1.smithi114.stdout:8/527: mkdir d4/dae/d54/db3 0 2024-09-16T09:45:34.588 INFO:tasks.workunit.client.1.smithi114.stdout:8/528: write d4/db/d39/d3c/f6b [4507419,98573] 0 2024-09-16T09:45:34.589 INFO:tasks.workunit.client.1.smithi114.stdout:7/660: dwrite d2/f5 [0,4194304] 0 2024-09-16T09:45:34.592 INFO:tasks.workunit.client.1.smithi114.stdout:2/676: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/df5/cfe 0 2024-09-16T09:45:34.596 INFO:tasks.workunit.client.1.smithi114.stdout:5/570: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f5c to d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/fc3 0 2024-09-16T09:45:34.596 INFO:tasks.workunit.client.1.smithi114.stdout:0/597: truncate d1f/d27/d55/f71 2438429 0 2024-09-16T09:45:34.598 INFO:tasks.workunit.client.1.smithi114.stdout:9/560: symlink d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d/lbb 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:9/561: stat d3/fc 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/529: dread d4/dae/f9b [0,4194304] 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/530: chown d4/dae 1 1 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/531: chown d4/db/d68/d28/f89 23884 1 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/532: truncate d4/db/d68/d28/f89 522838 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/533: chown d4/db/d68/l25 0 1 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/534: dread - d4/db/d68/d28/f51 zero size 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/535: fsync d4/db/d68/d28/f89 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/536: write d4/db/d39/d3c/d4e/d62/f73 [124811,127820] 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:8/537: fdatasync d4/db/d3e/d71/f3d 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:7/661: truncate d2/d9/d2b/d2e/d22/d27/f1f 178628 0 2024-09-16T09:45:34.599 INFO:tasks.workunit.client.1.smithi114.stdout:7/662: read d2/d9/d2b/d2e/d22/d4c/f9e [783373,114460] 0 2024-09-16T09:45:34.600 INFO:tasks.workunit.client.1.smithi114.stdout:7/663: chown d2/d9/d2b/d78 3586 1 2024-09-16T09:45:34.600 INFO:tasks.workunit.client.1.smithi114.stdout:7/664: write d2/d9/d2b/d2e/d22/d27/d4d/fa4 [9668,10148] 0 2024-09-16T09:45:34.600 INFO:tasks.workunit.client.1.smithi114.stdout:5/571: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/lc4 0 2024-09-16T09:45:34.601 INFO:tasks.workunit.client.1.smithi114.stdout:3/750: dwrite dc/de/d18/d78/d5c/d5d/d50/dea/f106 [0,4194304] 0 2024-09-16T09:45:34.601 INFO:tasks.workunit.client.1.smithi114.stdout:3/751: write dc/d38/d3f/f5f [283794,66581] 0 2024-09-16T09:45:34.601 INFO:tasks.workunit.client.1.smithi114.stdout:3/752: truncate dc/de/d17/f1d 1043976 0 2024-09-16T09:45:34.601 INFO:tasks.workunit.client.1.smithi114.stdout:3/753: fsync dc/de/d18/dfe/ffb 0 2024-09-16T09:45:34.601 INFO:tasks.workunit.client.1.smithi114.stdout:0/598: creat d1f/d22/d2e/d46/d7f/d8d/dbb/fda x:0 0 0 2024-09-16T09:45:34.604 INFO:tasks.workunit.client.1.smithi114.stdout:9/562: unlink d3/da/d10/f51 0 2024-09-16T09:45:34.605 INFO:tasks.workunit.client.1.smithi114.stdout:9/563: chown d3/da/d10/d23/d43/d1e/l31 192706806 1 2024-09-16T09:45:34.606 INFO:tasks.workunit.client.1.smithi114.stdout:2/677: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 [133776,103849] 0 2024-09-16T09:45:34.606 INFO:tasks.workunit.client.1.smithi114.stdout:2/678: fdatasync d1/d8/f32 0 2024-09-16T09:45:34.606 INFO:tasks.workunit.client.1.smithi114.stdout:5/572: mknod d3/d24/d84/d7a/d43/d4c/d6d/cc5 0 2024-09-16T09:45:34.606 INFO:tasks.workunit.client.1.smithi114.stdout:5/573: chown d3/le 2781 1 2024-09-16T09:45:34.608 INFO:tasks.workunit.client.1.smithi114.stdout:1/587: truncate d4/f25 706900 0 2024-09-16T09:45:34.611 INFO:tasks.workunit.client.1.smithi114.stdout:3/754: creat dc/de/d17/d2d/db4/d26/f10b x:0 0 0 2024-09-16T09:45:34.613 INFO:tasks.workunit.client.1.smithi114.stdout:0/599: stat d1f/d22/c9c 0 2024-09-16T09:45:34.616 INFO:tasks.workunit.client.1.smithi114.stdout:5/574: truncate d3/d24/d84/f4f 2642759 0 2024-09-16T09:45:34.616 INFO:tasks.workunit.client.1.smithi114.stdout:5/575: truncate d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f35 4653855 0 2024-09-16T09:45:34.616 INFO:tasks.workunit.client.1.smithi114.stdout:5/576: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f81 2 1 2024-09-16T09:45:34.617 INFO:tasks.workunit.client.1.smithi114.stdout:1/588: creat d4/d2b/d16/d71/d72/d75/db4/dbb/fc1 x:0 0 0 2024-09-16T09:45:34.618 INFO:tasks.workunit.client.1.smithi114.stdout:0/600: mkdir d1f/d22/d2e/d46/d7f/d8d/dbb/ddb 0 2024-09-16T09:45:34.619 INFO:tasks.workunit.client.1.smithi114.stdout:2/679: write d1/d8/d10/f35 [9476535,57216] 0 2024-09-16T09:45:34.619 INFO:tasks.workunit.client.1.smithi114.stdout:2/680: dread - d1/d8/d10/d5a/fce zero size 2024-09-16T09:45:34.620 INFO:tasks.workunit.client.1.smithi114.stdout:5/577: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6 0 2024-09-16T09:45:34.621 INFO:tasks.workunit.client.1.smithi114.stdout:0/601: mkdir d1f/d2d/d7a/ddc 0 2024-09-16T09:45:34.621 INFO:tasks.workunit.client.1.smithi114.stdout:0/602: readlink d1f/d22/d2e/l35 0 2024-09-16T09:45:34.623 INFO:tasks.workunit.client.1.smithi114.stdout:5/578: creat d3/d1f/d8c/fc7 x:0 0 0 2024-09-16T09:45:34.624 INFO:tasks.workunit.client.1.smithi114.stdout:0/603: mkdir d1f/d2d/d7a/ddd 0 2024-09-16T09:45:34.625 INFO:tasks.workunit.client.1.smithi114.stdout:7/665: dwrite d2/f1c [0,4194304] 0 2024-09-16T09:45:34.625 INFO:tasks.workunit.client.1.smithi114.stdout:3/755: dread dc/de/d18/dfe/d7f/fc0 [0,4194304] 0 2024-09-16T09:45:34.625 INFO:tasks.workunit.client.1.smithi114.stdout:3/756: fsync dc/de/d18/dfe/d7f/fc0 0 2024-09-16T09:45:34.628 INFO:tasks.workunit.client.1.smithi114.stdout:7/666: creat d2/d9/d2b/d78/d99/ddd/fe4 x:0 0 0 2024-09-16T09:45:34.629 INFO:tasks.workunit.client.1.smithi114.stdout:7/667: rename d2/d9/db1/lc6 to d2/d9/le5 0 2024-09-16T09:45:34.630 INFO:tasks.workunit.client.1.smithi114.stdout:7/668: stat d2/f5 0 2024-09-16T09:45:34.630 INFO:tasks.workunit.client.1.smithi114.stdout:7/669: chown d2/d9/d51/d84 1958 1 2024-09-16T09:45:34.631 INFO:tasks.workunit.client.1.smithi114.stdout:7/670: mknod d2/d9/d2b/d2e/d3e/ce6 0 2024-09-16T09:45:34.632 INFO:tasks.workunit.client.1.smithi114.stdout:7/671: mknod d2/d9/d51/d84/dda/ce7 0 2024-09-16T09:45:34.637 INFO:tasks.workunit.client.1.smithi114.stdout:0/604: read d1f/f74 [3836750,9291] 0 2024-09-16T09:45:34.637 INFO:tasks.workunit.client.1.smithi114.stdout:0/605: write d1f/d27/d55/fb4 [813195,91965] 0 2024-09-16T09:45:34.637 INFO:tasks.workunit.client.1.smithi114.stdout:0/606: dread - d1f/d27/fa1 zero size 2024-09-16T09:45:34.638 INFO:tasks.workunit.client.1.smithi114.stdout:5/579: dread d3/d24/f2e [0,4194304] 0 2024-09-16T09:45:34.638 INFO:tasks.workunit.client.1.smithi114.stdout:5/580: fsync d3/d24/d84/d7a/d43/d4c/f54 0 2024-09-16T09:45:34.639 INFO:tasks.workunit.client.1.smithi114.stdout:0/607: rename f14 to d1f/d22/d2e/d46/d7f/d8d/dbb/fde 0 2024-09-16T09:45:34.641 INFO:tasks.workunit.client.1.smithi114.stdout:5/581: unlink d3/d1f/f16 0 2024-09-16T09:45:34.642 INFO:tasks.workunit.client.1.smithi114.stdout:3/757: dread dc/fb7 [0,4194304] 0 2024-09-16T09:45:34.642 INFO:tasks.workunit.client.1.smithi114.stdout:3/758: dread - dc/de/d37/fd9 zero size 2024-09-16T09:45:34.642 INFO:tasks.workunit.client.1.smithi114.stdout:9/564: dwrite d3/da/d10/f21 [0,4194304] 0 2024-09-16T09:45:34.643 INFO:tasks.workunit.client.1.smithi114.stdout:0/608: mkdir d1f/ddf 0 2024-09-16T09:45:34.644 INFO:tasks.workunit.client.1.smithi114.stdout:5/582: rename d3/d1f/c3e to d3/d24/d84/dbc/cc8 0 2024-09-16T09:45:34.644 INFO:tasks.workunit.client.1.smithi114.stdout:9/565: creat d3/da/d10/d23/d43/d1e/d7b/fbc x:0 0 0 2024-09-16T09:45:34.645 INFO:tasks.workunit.client.1.smithi114.stdout:0/609: creat d1f/d27/d47/d56/fe0 x:0 0 0 2024-09-16T09:45:34.645 INFO:tasks.workunit.client.1.smithi114.stdout:5/583: rmdir d3/d24/d84/d7a 39 2024-09-16T09:45:34.647 INFO:tasks.workunit.client.1.smithi114.stdout:5/584: creat d3/d24/d7d/fc9 x:0 0 0 2024-09-16T09:45:34.647 INFO:tasks.workunit.client.1.smithi114.stdout:5/585: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/l76 172646162 1 2024-09-16T09:45:34.655 INFO:tasks.workunit.client.1.smithi114.stdout:3/759: write dc/d38/f45 [2393471,126266] 0 2024-09-16T09:45:34.657 INFO:tasks.workunit.client.1.smithi114.stdout:7/672: dwrite d2/d9/d2b/d2e/d22/d4c/f9e [0,4194304] 0 2024-09-16T09:45:34.657 INFO:tasks.workunit.client.1.smithi114.stdout:7/673: readlink d2/d9/d2b/d2e/d3e/la9 0 2024-09-16T09:45:34.659 INFO:tasks.workunit.client.1.smithi114.stdout:9/566: write d3/da/d10/d23/d29/d2c/d6b/d68/f9a [368112,42776] 0 2024-09-16T09:45:34.664 INFO:tasks.workunit.client.1.smithi114.stdout:2/681: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 [0,4194304] 0 2024-09-16T09:45:34.665 INFO:tasks.workunit.client.1.smithi114.stdout:1/589: dwrite d4/d2b/d16/d47/f6e [0,4194304] 0 2024-09-16T09:45:34.665 INFO:tasks.workunit.client.1.smithi114.stdout:1/590: fdatasync d4/d2b/f3c 0 2024-09-16T09:45:34.667 INFO:tasks.workunit.client.1.smithi114.stdout:2/682: link d1/d8/l19 d1/d8/d10/d16/d1d/d92/da7/lff 0 2024-09-16T09:45:34.669 INFO:tasks.workunit.client.1.smithi114.stdout:3/760: write dc/de/d18/d78/d5c/d5d/d50/fd0 [4946696,20108] 0 2024-09-16T09:45:34.670 INFO:tasks.workunit.client.1.smithi114.stdout:2/683: creat d1/d8/d10/d16/d1d/d92/da7/f100 x:0 0 0 2024-09-16T09:45:34.672 INFO:tasks.workunit.client.1.smithi114.stdout:3/761: mknod dc/de/d17/d72/c10c 0 2024-09-16T09:45:34.676 INFO:tasks.workunit.client.1.smithi114.stdout:5/586: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f10 [0,4194304] 0 2024-09-16T09:45:34.677 INFO:tasks.workunit.client.1.smithi114.stdout:5/587: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/f60 0 2024-09-16T09:45:34.677 INFO:tasks.workunit.client.1.smithi114.stdout:5/588: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/f9d [236758,49020] 0 2024-09-16T09:45:34.677 INFO:tasks.workunit.client.1.smithi114.stdout:5/589: write d3/f25 [23698,286] 0 2024-09-16T09:45:34.677 INFO:tasks.workunit.client.1.smithi114.stdout:5/590: fdatasync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f81 0 2024-09-16T09:45:34.679 INFO:tasks.workunit.client.1.smithi114.stdout:2/684: creat d1/d8/f101 x:0 0 0 2024-09-16T09:45:34.680 INFO:tasks.workunit.client.1.smithi114.stdout:3/762: rename dc/de/d17/d2d/d41/c97 to dc/de/d18/dfe/db2/c10d 0 2024-09-16T09:45:34.680 INFO:tasks.workunit.client.1.smithi114.stdout:5/591: chown d3/l32 5955 1 2024-09-16T09:45:34.681 INFO:tasks.workunit.client.1.smithi114.stdout:2/685: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/df5/f102 x:0 0 0 2024-09-16T09:45:34.681 INFO:tasks.workunit.client.1.smithi114.stdout:3/763: truncate dc/de/d37/d3d/fbb 1945665 0 2024-09-16T09:45:34.682 INFO:tasks.workunit.client.1.smithi114.stdout:5/592: link d3/d24/d84/d7a/la5 d3/d24/lca 0 2024-09-16T09:45:34.683 INFO:tasks.workunit.client.1.smithi114.stdout:2/686: truncate d1/d8/f7a 111066 0 2024-09-16T09:45:34.683 INFO:tasks.workunit.client.1.smithi114.stdout:7/674: dwrite d2/df/f10 [0,4194304] 0 2024-09-16T09:45:34.683 INFO:tasks.workunit.client.1.smithi114.stdout:7/675: chown d2/d9/d2b/d2e/d3e/c38 8055 1 2024-09-16T09:45:34.684 INFO:tasks.workunit.client.1.smithi114.stdout:9/567: dwrite d3/da/d10/d23/d29/d2c/d70/f7c [0,4194304] 0 2024-09-16T09:45:34.685 INFO:tasks.workunit.client.1.smithi114.stdout:3/764: rmdir dc/de/d18/ddb 0 2024-09-16T09:45:34.685 INFO:tasks.workunit.client.1.smithi114.stdout:5/593: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/lcb 0 2024-09-16T09:45:34.685 INFO:tasks.workunit.client.1.smithi114.stdout:5/594: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f4a 0 2024-09-16T09:45:34.686 INFO:tasks.workunit.client.1.smithi114.stdout:7/676: creat d2/d9/db1/fe8 x:0 0 0 2024-09-16T09:45:34.686 INFO:tasks.workunit.client.1.smithi114.stdout:7/677: read d2/d9/d2b/d2e/d22/d27/f1f [156976,80428] 0 2024-09-16T09:45:34.688 INFO:tasks.workunit.client.1.smithi114.stdout:9/568: link d3/da/d10/d23/d29/d2c/d45/f61 d3/da/d10/d23/d29/d3f/d85/fbd 0 2024-09-16T09:45:34.688 INFO:tasks.workunit.client.1.smithi114.stdout:9/569: dread - d3/da/d10/d23/d43/d1e/d7b/fa3 zero size 2024-09-16T09:45:34.689 INFO:tasks.workunit.client.1.smithi114.stdout:5/595: write d3/d24/f2e [760069,68008] 0 2024-09-16T09:45:34.689 INFO:tasks.workunit.client.1.smithi114.stdout:3/765: creat dc/de/d17/d2d/f10e x:0 0 0 2024-09-16T09:45:34.690 INFO:tasks.workunit.client.1.smithi114.stdout:7/678: creat d2/d9/d2b/d2e/d22/d27/d4d/fe9 x:0 0 0 2024-09-16T09:45:34.692 INFO:tasks.workunit.client.1.smithi114.stdout:9/570: creat d3/da/d10/d23/d43/d1e/d78/fbe x:0 0 0 2024-09-16T09:45:34.692 INFO:tasks.workunit.client.1.smithi114.stdout:9/571: dread - d3/da/d10/d23/d29/d3f/f76 zero size 2024-09-16T09:45:34.696 INFO:tasks.workunit.client.1.smithi114.stdout:7/679: mkdir d2/d9/d2b/d78/d99/ddd/dea 0 2024-09-16T09:45:34.696 INFO:tasks.workunit.client.1.smithi114.stdout:7/680: read d2/d9/d2b/f57 [797255,46984] 0 2024-09-16T09:45:34.703 INFO:tasks.workunit.client.1.smithi114.stdout:9/572: dread d3/da/d10/d23/d43/f16 [0,4194304] 0 2024-09-16T09:45:34.706 INFO:tasks.workunit.client.1.smithi114.stdout:9/573: mkdir d3/da/d10/dbf 0 2024-09-16T09:45:34.706 INFO:tasks.workunit.client.1.smithi114.stdout:9/574: write d3/da/d10/d23/d43/d1e/d78/fbe [423036,25601] 0 2024-09-16T09:45:34.708 INFO:tasks.workunit.client.1.smithi114.stdout:9/575: mkdir d3/da/d10/d23/d43/d1e/d25/dc0 0 2024-09-16T09:45:34.710 INFO:tasks.workunit.client.1.smithi114.stdout:9/576: creat d3/da/d10/d23/d29/d2c/d6b/fc1 x:0 0 0 2024-09-16T09:45:34.712 INFO:tasks.workunit.client.1.smithi114.stdout:5/596: truncate d3/d24/f2e 3181682 0 2024-09-16T09:45:34.713 INFO:tasks.workunit.client.1.smithi114.stdout:5/597: fsync d3/d24/d84/d7a/d43/d4c/d92/f97 0 2024-09-16T09:45:34.715 INFO:tasks.workunit.client.1.smithi114.stdout:2/687: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 [0,4194304] 0 2024-09-16T09:45:34.716 INFO:tasks.workunit.client.1.smithi114.stdout:3/766: dwrite dc/de/d17/f1d [0,4194304] 0 2024-09-16T09:45:34.723 INFO:tasks.workunit.client.1.smithi114.stdout:3/767: rename dc/de/d18/d78/d5c/d6e/dc4 to dc/de/d18/d78/d5c/d5d/d50/dd6/d10f 0 2024-09-16T09:45:34.743 INFO:tasks.workunit.client.1.smithi114.stdout:2/688: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/f6f [0,4194304] 0 2024-09-16T09:45:34.743 INFO:tasks.workunit.client.1.smithi114.stdout:9/577: dwrite d3/da/f11 [0,4194304] 0 2024-09-16T09:45:34.743 INFO:tasks.workunit.client.1.smithi114.stdout:5/598: dwrite d3/f5 [0,4194304] 0 2024-09-16T09:45:34.745 INFO:tasks.workunit.client.1.smithi114.stdout:3/768: dwrite dc/d38/f9c [0,4194304] 0 2024-09-16T09:45:34.745 INFO:tasks.workunit.client.1.smithi114.stdout:9/578: rename d3/da/d10/d23/d43/d1e/d78/fbe to d3/da/d10/d23/d43/d1e/d25/fc2 0 2024-09-16T09:45:34.746 INFO:tasks.workunit.client.1.smithi114.stdout:2/689: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/f103 x:0 0 0 2024-09-16T09:45:34.747 INFO:tasks.workunit.client.1.smithi114.stdout:3/769: creat dc/de/d18/dfe/db2/dd8/f110 x:0 0 0 2024-09-16T09:45:34.747 INFO:tasks.workunit.client.1.smithi114.stdout:3/770: chown dc/de/d37/d3d/cb9 2194 1 2024-09-16T09:45:34.747 INFO:tasks.workunit.client.1.smithi114.stdout:3/771: write dc/de/d17/d2d/db4/d26/f54 [4188204,32701] 0 2024-09-16T09:45:34.749 INFO:tasks.workunit.client.1.smithi114.stdout:9/579: mknod d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/cc3 0 2024-09-16T09:45:34.749 INFO:tasks.workunit.client.1.smithi114.stdout:9/580: fsync d3/da/d10/d23/d29/d2c/d45/d93/fab 0 2024-09-16T09:45:34.750 INFO:tasks.workunit.client.1.smithi114.stdout:2/690: unlink d1/d8/d10/c57 0 2024-09-16T09:45:34.752 INFO:tasks.workunit.client.1.smithi114.stdout:3/772: symlink dc/de/d37/d4e/df8/l111 0 2024-09-16T09:45:34.752 INFO:tasks.workunit.client.1.smithi114.stdout:5/599: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f10 [455746,120004] 0 2024-09-16T09:45:34.754 INFO:tasks.workunit.client.1.smithi114.stdout:2/691: unlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/l4d 0 2024-09-16T09:45:34.754 INFO:tasks.workunit.client.1.smithi114.stdout:2/692: readlink d1/l5 0 2024-09-16T09:45:34.756 INFO:tasks.workunit.client.1.smithi114.stdout:3/773: link dc/de/d37/d4e/l59 dc/de/d18/d78/d5c/l112 0 2024-09-16T09:45:34.758 INFO:tasks.workunit.client.1.smithi114.stdout:5/600: rename d3/d24/d84/d7a/d43/d4c/d6d/caf to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/ccc 0 2024-09-16T09:45:34.759 INFO:tasks.workunit.client.1.smithi114.stdout:5/601: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/db4 0 2024-09-16T09:45:34.761 INFO:tasks.workunit.client.1.smithi114.stdout:5/602: link d3/d24/d84/d7a/d43/d4c/d6d/l7f d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/lcd 0 2024-09-16T09:45:34.771 INFO:tasks.workunit.client.1.smithi114.stdout:5/603: read d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f55 [3480742,126071] 0 2024-09-16T09:45:34.771 INFO:tasks.workunit.client.1.smithi114.stdout:5/604: fsync d3/d1f/d8c/fc7 0 2024-09-16T09:45:34.772 INFO:tasks.workunit.client.1.smithi114.stdout:5/605: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/dce 0 2024-09-16T09:45:34.774 INFO:tasks.workunit.client.1.smithi114.stdout:3/774: dwrite dc/de/d18/fd7 [0,4194304] 0 2024-09-16T09:45:34.775 INFO:tasks.workunit.client.1.smithi114.stdout:2/693: dwrite d1/d8/d10/d5a/fe5 [4194304,4194304] 0 2024-09-16T09:45:34.775 INFO:tasks.workunit.client.1.smithi114.stdout:2/694: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/f88 zero size 2024-09-16T09:45:34.776 INFO:tasks.workunit.client.1.smithi114.stdout:3/775: symlink dc/de/l113 0 2024-09-16T09:45:34.777 INFO:tasks.workunit.client.1.smithi114.stdout:2/695: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/f104 x:0 0 0 2024-09-16T09:45:34.779 INFO:tasks.workunit.client.1.smithi114.stdout:3/776: creat dc/de/f114 x:0 0 0 2024-09-16T09:45:34.787 INFO:tasks.workunit.client.1.smithi114.stdout:2/696: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9/d105 0 2024-09-16T09:45:34.787 INFO:tasks.workunit.client.1.smithi114.stdout:2/697: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f61 7179 1 2024-09-16T09:45:34.797 INFO:tasks.workunit.client.1.smithi114.stdout:4/575: sync 2024-09-16T09:45:34.798 INFO:tasks.workunit.client.1.smithi114.stdout:3/777: dwrite dc/de/d18/d78/d5c/d5d/fa6 [0,4194304] 0 2024-09-16T09:45:34.798 INFO:tasks.workunit.client.1.smithi114.stdout:4/576: symlink d0/d26/d40/d75/d7f/lc2 0 2024-09-16T09:45:34.798 INFO:tasks.workunit.client.1.smithi114.stdout:4/577: chown d0/d26/d40/d75/d7f/d87/f8d 389 1 2024-09-16T09:45:34.800 INFO:tasks.workunit.client.1.smithi114.stdout:4/578: dread d0/d13/d56/d7e/fbc [0,4194304] 0 2024-09-16T09:45:34.800 INFO:tasks.workunit.client.1.smithi114.stdout:4/579: chown d0/d26/d3c/d3e/d4b/fba 11718 1 2024-09-16T09:45:34.800 INFO:tasks.workunit.client.1.smithi114.stdout:4/580: readlink d0/d26/d40/d75/d7f/l96 0 2024-09-16T09:45:34.803 INFO:tasks.workunit.client.1.smithi114.stdout:2/698: dwrite d1/d8/d10/d16/d1d/d92/da3/fc5 [0,4194304] 0 2024-09-16T09:45:34.807 INFO:tasks.workunit.client.1.smithi114.stdout:2/699: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/f106 x:0 0 0 2024-09-16T09:45:34.824 INFO:tasks.workunit.client.1.smithi114.stdout:4/581: dwrite d0/d26/d40/d75/d7f/d87/fab [0,4194304] 0 2024-09-16T09:45:34.824 INFO:tasks.workunit.client.1.smithi114.stdout:4/582: chown d0/d26/d3c/d3e/d4b/f92 988799 1 2024-09-16T09:45:34.825 INFO:tasks.workunit.client.1.smithi114.stdout:4/583: symlink d0/d26/d40/da6/lc3 0 2024-09-16T09:45:34.825 INFO:tasks.workunit.client.1.smithi114.stdout:4/584: dread - d0/d26/d29/d2b/d58/f8a zero size 2024-09-16T09:45:34.840 INFO:tasks.workunit.client.1.smithi114.stdout:4/585: dwrite d0/d26/d29/f39 [0,4194304] 0 2024-09-16T09:45:34.840 INFO:tasks.workunit.client.1.smithi114.stdout:4/586: write d0/d26/d3c/d3e/d4b/fba [156574,47456] 0 2024-09-16T09:45:34.857 INFO:tasks.workunit.client.1.smithi114.stdout:4/587: dwrite d0/d26/d3c/d3e/d4b/d46/f80 [0,4194304] 0 2024-09-16T09:45:34.858 INFO:tasks.workunit.client.1.smithi114.stdout:4/588: mknod d0/d26/d3c/d74/d9c/cc4 0 2024-09-16T09:45:34.859 INFO:tasks.workunit.client.1.smithi114.stdout:4/589: creat d0/d26/d3c/d3e/d4b/d46/db3/fc5 x:0 0 0 2024-09-16T09:45:34.864 INFO:tasks.workunit.client.1.smithi114.stdout:6/647: sync 2024-09-16T09:45:34.865 INFO:tasks.workunit.client.1.smithi114.stdout:8/538: sync 2024-09-16T09:45:34.865 INFO:tasks.workunit.client.1.smithi114.stdout:8/539: readlink d4/dae/d54/l5c 0 2024-09-16T09:45:34.867 INFO:tasks.workunit.client.1.smithi114.stdout:6/648: rename d6/da/d36/d51 to d6/d2d/d46/dcc 0 2024-09-16T09:45:34.895 INFO:tasks.workunit.client.1.smithi114.stdout:4/590: dwrite d0/d13/d25/f9b [0,4194304] 0 2024-09-16T09:45:34.896 INFO:tasks.workunit.client.1.smithi114.stdout:8/540: dwrite d4/db/d68/d28/f31 [0,4194304] 0 2024-09-16T09:45:34.896 INFO:tasks.workunit.client.1.smithi114.stdout:4/591: write d0/d26/f48 [1263200,99385] 0 2024-09-16T09:45:34.896 INFO:tasks.workunit.client.1.smithi114.stdout:6/649: dwrite d6/da/fb4 [0,4194304] 0 2024-09-16T09:45:34.900 INFO:tasks.workunit.client.1.smithi114.stdout:4/592: symlink d0/d26/d29/d9f/da0/lc6 0 2024-09-16T09:45:34.901 INFO:tasks.workunit.client.1.smithi114.stdout:6/650: unlink d6/da/d10/f59 0 2024-09-16T09:45:34.902 INFO:tasks.workunit.client.1.smithi114.stdout:6/651: chown d6/da/f4a 3142 1 2024-09-16T09:45:34.903 INFO:tasks.workunit.client.1.smithi114.stdout:4/593: mkdir d0/d26/d29/d2b/dc7 0 2024-09-16T09:45:34.903 INFO:tasks.workunit.client.1.smithi114.stdout:4/594: fdatasync d0/d26/d3c/d45/f50 0 2024-09-16T09:45:34.904 INFO:tasks.workunit.client.1.smithi114.stdout:4/595: mkdir d0/d26/d29/d2b/dc7/dc8 0 2024-09-16T09:45:34.906 INFO:tasks.workunit.client.1.smithi114.stdout:4/596: creat d0/d26/d29/d2b/d58/fc9 x:0 0 0 2024-09-16T09:45:34.909 INFO:tasks.workunit.client.1.smithi114.stdout:0/610: sync 2024-09-16T09:45:34.909 INFO:tasks.workunit.client.1.smithi114.stdout:0/611: write d1f/fc4 [755639,61636] 0 2024-09-16T09:45:34.910 INFO:tasks.workunit.client.1.smithi114.stdout:8/541: dwrite d4/d1f/f35 [0,4194304] 0 2024-09-16T09:45:34.911 INFO:tasks.workunit.client.1.smithi114.stdout:8/542: symlink d4/dae/d54/db3/lb4 0 2024-09-16T09:45:34.918 INFO:tasks.workunit.client.1.smithi114.stdout:4/597: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:34.919 INFO:tasks.workunit.client.1.smithi114.stdout:0/612: write d1f/d22/d2e/f6c [639020,57506] 0 2024-09-16T09:45:34.919 INFO:tasks.workunit.client.1.smithi114.stdout:4/598: creat d0/d26/d3c/d3e/d4b/d46/db3/fca x:0 0 0 2024-09-16T09:45:34.921 INFO:tasks.workunit.client.1.smithi114.stdout:0/613: link d1f/fca d1f/d27/d47/d56/d7e/fe1 0 2024-09-16T09:45:34.921 INFO:tasks.workunit.client.1.smithi114.stdout:0/614: readlink d1f/d27/d47/d56/l63 0 2024-09-16T09:45:34.921 INFO:tasks.workunit.client.1.smithi114.stdout:0/615: chown d1f/d22/d2e/d46/d7f/d8d/dbb/fda 7 1 2024-09-16T09:45:34.921 INFO:tasks.workunit.client.1.smithi114.stdout:0/616: stat f3 0 2024-09-16T09:45:34.923 INFO:tasks.workunit.client.1.smithi114.stdout:4/599: rename d0/d26/d40/d75/d7f/lc2 to d0/d26/d3c/d3e/d5a/d5d/lcb 0 2024-09-16T09:45:34.923 INFO:tasks.workunit.client.1.smithi114.stdout:4/600: chown d0/d26/d40/da6/lc3 24 1 2024-09-16T09:45:34.923 INFO:tasks.workunit.client.1.smithi114.stdout:6/652: dwrite d6/d64/f65 [0,4194304] 0 2024-09-16T09:45:34.923 INFO:tasks.workunit.client.1.smithi114.stdout:6/653: chown d6/l2e 2457 1 2024-09-16T09:45:34.924 INFO:tasks.workunit.client.1.smithi114.stdout:0/617: creat d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/fe2 x:0 0 0 2024-09-16T09:45:34.924 INFO:tasks.workunit.client.1.smithi114.stdout:0/618: write d1f/d27/d47/d56/fe0 [176409,123357] 0 2024-09-16T09:45:34.926 INFO:tasks.workunit.client.1.smithi114.stdout:4/601: link d0/d26/d29/d2b/d58/l63 d0/d26/d3c/d3e/d5a/lcc 0 2024-09-16T09:45:34.926 INFO:tasks.workunit.client.1.smithi114.stdout:4/602: write d0/d26/d3c/d3e/d4b/d46/db3/fca [541490,22632] 0 2024-09-16T09:45:34.926 INFO:tasks.workunit.client.1.smithi114.stdout:4/603: readlink d0/l24 0 2024-09-16T09:45:34.930 INFO:tasks.workunit.client.1.smithi114.stdout:0/619: creat d1f/d27/db9/fe3 x:0 0 0 2024-09-16T09:45:34.930 INFO:tasks.workunit.client.1.smithi114.stdout:4/604: mknod d0/d26/d29/d2b/dc7/dc8/ccd 0 2024-09-16T09:45:34.931 INFO:tasks.workunit.client.1.smithi114.stdout:4/605: dread - d0/d26/d29/d2b/d58/fc9 zero size 2024-09-16T09:45:34.931 INFO:tasks.workunit.client.1.smithi114.stdout:4/606: write d0/d26/d3c/d3e/d4b/f8f [144400,121262] 0 2024-09-16T09:45:34.931 INFO:tasks.workunit.client.1.smithi114.stdout:4/607: truncate d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 885813 0 2024-09-16T09:45:34.931 INFO:tasks.workunit.client.1.smithi114.stdout:8/543: dwrite d4/db/d68/d28/f67 [0,4194304] 0 2024-09-16T09:45:34.932 INFO:tasks.workunit.client.1.smithi114.stdout:4/608: rename d0/d26/d3c/d45/f6e to d0/d26/d29/dbe/fce 0 2024-09-16T09:45:34.937 INFO:tasks.workunit.client.1.smithi114.stdout:4/609: rmdir d0/d26/d2e 39 2024-09-16T09:45:34.937 INFO:tasks.workunit.client.1.smithi114.stdout:4/610: fdatasync d0/d26/d29/d2b/f61 0 2024-09-16T09:45:34.939 INFO:tasks.workunit.client.1.smithi114.stdout:6/654: dwrite d6/da/d10/d40/f43 [0,4194304] 0 2024-09-16T09:45:34.939 INFO:tasks.workunit.client.1.smithi114.stdout:8/544: link d4/l49 d4/db/d3e/d71/d78/d7a/lb5 0 2024-09-16T09:45:34.941 INFO:tasks.workunit.client.1.smithi114.stdout:4/611: mknod d0/d26/d3c/d3e/d5a/d5d/ccf 0 2024-09-16T09:45:34.941 INFO:tasks.workunit.client.1.smithi114.stdout:8/545: mknod d4/db/d3e/cb6 0 2024-09-16T09:45:34.946 INFO:tasks.workunit.client.1.smithi114.stdout:8/546: dread d4/db/d3e/f4f [0,4194304] 0 2024-09-16T09:45:34.946 INFO:tasks.workunit.client.1.smithi114.stdout:8/547: write d4/db/dd/fa8 [1025073,33743] 0 2024-09-16T09:45:34.946 INFO:tasks.workunit.client.1.smithi114.stdout:8/548: fdatasync d4/db/dd/f13 0 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:4/612: dread d0/d26/d3c/d45/f50 [0,4194304] 0 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:3/778: sync 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:5/606: sync 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:2/700: sync 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:7/681: sync 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:9/581: sync 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:1/591: sync 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:3/779: write dc/de/f34 [1264082,112041] 0 2024-09-16T09:45:34.947 INFO:tasks.workunit.client.1.smithi114.stdout:3/780: fdatasync dc/de/d17/d2d/db4/d26/f10b 0 2024-09-16T09:45:34.948 INFO:tasks.workunit.client.1.smithi114.stdout:8/549: rename d4/db/dd/f44 to d4/db/d3e/d71/d78/d8d/da9/fb7 0 2024-09-16T09:45:34.948 INFO:tasks.workunit.client.1.smithi114.stdout:8/550: truncate d4/db/d39/d3c/fa7 286027 0 2024-09-16T09:45:34.949 INFO:tasks.workunit.client.1.smithi114.stdout:5/607: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/ccf 0 2024-09-16T09:45:34.949 INFO:tasks.workunit.client.1.smithi114.stdout:9/582: creat d3/d7d/fc4 x:0 0 0 2024-09-16T09:45:34.952 INFO:tasks.workunit.client.1.smithi114.stdout:0/620: dwrite d1f/d22/d2e/d46/d7f/fd8 [0,4194304] 0 2024-09-16T09:45:34.957 INFO:tasks.workunit.client.1.smithi114.stdout:6/655: dread d6/da/d36/f3b [0,4194304] 0 2024-09-16T09:45:34.961 INFO:tasks.workunit.client.1.smithi114.stdout:5/608: dread d3/d24/d84/d7a/d43/d4c/d92/f97 [0,4194304] 0 2024-09-16T09:45:34.963 INFO:tasks.workunit.client.1.smithi114.stdout:0/621: read d1f/d20/d48/f4e [2610850,607] 0 2024-09-16T09:45:34.972 INFO:tasks.workunit.client.1.smithi114.stdout:7/682: dwrite d2/d9/d2b/d2e/f45 [0,4194304] 0 2024-09-16T09:45:34.973 INFO:tasks.workunit.client.1.smithi114.stdout:9/583: dwrite d3/da/d10/d23/d43/f16 [0,4194304] 0 2024-09-16T09:45:34.973 INFO:tasks.workunit.client.1.smithi114.stdout:9/584: chown d3/da/d10/dbf 361 1 2024-09-16T09:45:34.992 INFO:tasks.workunit.client.1.smithi114.stdout:9/585: dwrite d3/da/d10/d23/d29/d3f/f76 [0,4194304] 0 2024-09-16T09:45:34.992 INFO:tasks.workunit.client.1.smithi114.stdout:1/592: getdents d4/d2b/d2f/d3a/d9d/d41/d42/d58 0 2024-09-16T09:45:34.995 INFO:tasks.workunit.client.1.smithi114.stdout:4/613: rename d0/d13/d56/d7e/l9a to d0/d26/d29/d2b/dc7/ld0 0 2024-09-16T09:45:34.996 INFO:tasks.workunit.client.1.smithi114.stdout:8/551: creat d4/db/d68/d28/dac/fb8 x:0 0 0 2024-09-16T09:45:35.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/609: rmdir d3/d1f/d8c 39 2024-09-16T09:45:35.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/610: write d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 [1221225,79544] 0 2024-09-16T09:45:35.015 INFO:tasks.workunit.client.1.smithi114.stdout:1/593: dwrite d4/d2b/d16/d47/da7/f63 [0,4194304] 0 2024-09-16T09:45:35.015 INFO:tasks.workunit.client.1.smithi114.stdout:1/594: write d4/d2b/d2f/d3a/d9d/d41/f8e [1849158,112409] 0 2024-09-16T09:45:35.015 INFO:tasks.workunit.client.1.smithi114.stdout:0/622: symlink d1f/d22/d2e/d46/d7f/le4 0 2024-09-16T09:45:35.015 INFO:tasks.workunit.client.1.smithi114.stdout:4/614: dwrite d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:35.020 INFO:tasks.workunit.client.1.smithi114.stdout:9/586: mkdir d3/da/d10/d23/d43/d82/dc5 0 2024-09-16T09:45:35.020 INFO:tasks.workunit.client.1.smithi114.stdout:9/587: readlink d3/da/d10/d23/d29/d87/l89 0 2024-09-16T09:45:35.022 INFO:tasks.workunit.client.1.smithi114.stdout:2/701: rename d1/d8/d10/d16/d1d/d92/da3/fc6 to d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9/d105/f107 0 2024-09-16T09:45:35.026 INFO:tasks.workunit.client.1.smithi114.stdout:5/611: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/ld0 0 2024-09-16T09:45:35.026 INFO:tasks.workunit.client.1.smithi114.stdout:5/612: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/f9d [575082,28125] 0 2024-09-16T09:45:35.027 INFO:tasks.workunit.client.1.smithi114.stdout:5/613: dread - d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/fc1 zero size 2024-09-16T09:45:35.027 INFO:tasks.workunit.client.1.smithi114.stdout:5/614: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87 113 1 2024-09-16T09:45:35.030 INFO:tasks.workunit.client.1.smithi114.stdout:1/595: mkdir d4/d2b/d16/d47/dc2 0 2024-09-16T09:45:35.030 INFO:tasks.workunit.client.1.smithi114.stdout:1/596: fdatasync d4/d2b/d2f/d3a/d9d/d41/d42/d58/f6d 0 2024-09-16T09:45:35.032 INFO:tasks.workunit.client.1.smithi114.stdout:4/615: symlink d0/d26/d29/d2b/ld1 0 2024-09-16T09:45:35.032 INFO:tasks.workunit.client.1.smithi114.stdout:4/616: stat d0/d26/d3c/d74/d9c/fad 0 2024-09-16T09:45:35.036 INFO:tasks.workunit.client.1.smithi114.stdout:6/656: rename d6/da/d10/d40/f5e to d6/d2d/d46/fcd 0 2024-09-16T09:45:35.037 INFO:tasks.workunit.client.1.smithi114.stdout:2/702: mknod d1/d8/d10/d5a/c108 0 2024-09-16T09:45:35.037 INFO:tasks.workunit.client.1.smithi114.stdout:2/703: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/l5d 122301 1 2024-09-16T09:45:35.037 INFO:tasks.workunit.client.1.smithi114.stdout:2/704: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/f106 162564 1 2024-09-16T09:45:35.039 INFO:tasks.workunit.client.1.smithi114.stdout:5/615: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/ld1 0 2024-09-16T09:45:35.039 INFO:tasks.workunit.client.1.smithi114.stdout:5/616: chown d3/d1f/c62 4 1 2024-09-16T09:45:35.041 INFO:tasks.workunit.client.1.smithi114.stdout:5/617: dread d3/d1f/f27 [0,4194304] 0 2024-09-16T09:45:35.043 INFO:tasks.workunit.client.1.smithi114.stdout:8/552: rename d4/db/d39/d94/d9a to d4/d1f/db9 0 2024-09-16T09:45:35.043 INFO:tasks.workunit.client.1.smithi114.stdout:8/553: write d4/db/d39/d3c/d4e/d62/f73 [525218,64879] 0 2024-09-16T09:45:35.043 INFO:tasks.workunit.client.1.smithi114.stdout:6/657: mkdir d6/d2d/d46/dce 0 2024-09-16T09:45:35.043 INFO:tasks.workunit.client.1.smithi114.stdout:6/658: chown d6/d2d/d46/dcc 846250 1 2024-09-16T09:45:35.045 INFO:tasks.workunit.client.1.smithi114.stdout:2/705: creat d1/d8/d10/d16/d60/f109 x:0 0 0 2024-09-16T09:45:35.048 INFO:tasks.workunit.client.1.smithi114.stdout:5/618: rmdir d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/dce 0 2024-09-16T09:45:35.048 INFO:tasks.workunit.client.1.smithi114.stdout:5/619: fdatasync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f55 0 2024-09-16T09:45:35.050 INFO:tasks.workunit.client.1.smithi114.stdout:8/554: truncate d4/db/d3e/f7c 89150 0 2024-09-16T09:45:35.050 INFO:tasks.workunit.client.1.smithi114.stdout:6/659: getdents d6/d2d/d46/dcc/d62/d77 0 2024-09-16T09:45:35.051 INFO:tasks.workunit.client.1.smithi114.stdout:6/660: stat d6/fcb 0 2024-09-16T09:45:35.051 INFO:tasks.workunit.client.1.smithi114.stdout:2/706: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9/d105 39 2024-09-16T09:45:35.052 INFO:tasks.workunit.client.1.smithi114.stdout:2/707: stat d1/d9e/daf 0 2024-09-16T09:45:35.052 INFO:tasks.workunit.client.1.smithi114.stdout:5/620: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f10 [0,4194304] 0 2024-09-16T09:45:35.054 INFO:tasks.workunit.client.1.smithi114.stdout:6/661: truncate d6/d2d/d46/dcc/f6b 554123 0 2024-09-16T09:45:35.054 INFO:tasks.workunit.client.1.smithi114.stdout:2/708: getdents d1/d8/d10/d16/d1d/d92/da7/d3e 0 2024-09-16T09:45:35.060 INFO:tasks.workunit.client.1.smithi114.stdout:6/662: creat d6/da/d76/fcf x:0 0 0 2024-09-16T09:45:35.060 INFO:tasks.workunit.client.1.smithi114.stdout:6/663: truncate d6/da/d10/f25 4638051 0 2024-09-16T09:45:35.062 INFO:tasks.workunit.client.1.smithi114.stdout:2/709: unlink d1/d8/d10/d16/d1d/d92/lc9 0 2024-09-16T09:45:35.062 INFO:tasks.workunit.client.1.smithi114.stdout:2/710: read d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f95 [58145,21536] 0 2024-09-16T09:45:35.064 INFO:tasks.workunit.client.1.smithi114.stdout:2/711: creat d1/d8/d10/d16/d60/db7/deb/f10a x:0 0 0 2024-09-16T09:45:35.078 INFO:tasks.workunit.client.1.smithi114.stdout:5/621: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 [0,4194304] 0 2024-09-16T09:45:35.122 INFO:tasks.workunit.client.1.smithi114.stdout:4/617: creat d0/fd2 x:0 0 0 2024-09-16T09:45:35.126 INFO:tasks.workunit.client.1.smithi114.stdout:1/597: rename d4/d2b/cbd to d4/cc3 0 2024-09-16T09:45:35.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/598: fdatasync d4/d2b/d16/d47/f4b 0 2024-09-16T09:45:35.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/599: chown d4/d2b/d2f/d3a/d56/f88 709579040 1 2024-09-16T09:45:35.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/600: chown d4/d2b/f27 0 1 2024-09-16T09:45:35.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/601: dread - d4/d2b/d16/d47/d83/fae zero size 2024-09-16T09:45:35.128 INFO:tasks.workunit.client.1.smithi114.stdout:1/602: dread d4/d2b/d29/f5e [0,4194304] 0 2024-09-16T09:45:35.128 INFO:tasks.workunit.client.1.smithi114.stdout:1/603: chown d4/d2b/d29/c30 25 1 2024-09-16T09:45:35.130 INFO:tasks.workunit.client.1.smithi114.stdout:2/712: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63 39 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:2/713: mknod d1/d8/d10/d5a/c10b 0 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:2/714: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f61 17358 1 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:2/715: fdatasync d1/f7b 0 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:1/604: dread d4/d2b/d2f/d3a/d9d/d41/fa2 [0,4194304] 0 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:1/605: truncate d4/d2b/d16/d47/d83/fae 227585 0 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:1/606: fdatasync d4/d2b/d2f/d3a/d9d/d41/d42/fb6 0 2024-09-16T09:45:35.132 INFO:tasks.workunit.client.1.smithi114.stdout:2/716: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/l10c 0 2024-09-16T09:45:35.133 INFO:tasks.workunit.client.1.smithi114.stdout:1/607: mknod d4/d2b/d16/d71/d72/d75/cc4 0 2024-09-16T09:45:35.134 INFO:tasks.workunit.client.1.smithi114.stdout:2/717: symlink d1/d8/d82/l10d 0 2024-09-16T09:45:35.136 INFO:tasks.workunit.client.1.smithi114.stdout:4/618: rmdir d0/d26/d29/d9f 39 2024-09-16T09:45:35.138 INFO:tasks.workunit.client.1.smithi114.stdout:8/555: creat d4/db/dd/fba x:0 0 0 2024-09-16T09:45:35.150 INFO:tasks.workunit.client.1.smithi114.stdout:2/718: dread d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 [0,4194304] 0 2024-09-16T09:45:35.150 INFO:tasks.workunit.client.1.smithi114.stdout:2/719: write d1/d8/d10/d16/d1d/fc7 [1001372,62067] 0 2024-09-16T09:45:35.154 INFO:tasks.workunit.client.1.smithi114.stdout:2/720: dread d1/f84 [0,4194304] 0 2024-09-16T09:45:35.154 INFO:tasks.workunit.client.1.smithi114.stdout:2/721: fsync d1/f84 0 2024-09-16T09:45:35.157 INFO:tasks.workunit.client.1.smithi114.stdout:8/556: write d4/dae/f9b [6225742,62533] 0 2024-09-16T09:45:35.157 INFO:tasks.workunit.client.1.smithi114.stdout:8/557: fdatasync d4/db/f6e 0 2024-09-16T09:45:35.158 INFO:tasks.workunit.client.1.smithi114.stdout:8/558: mknod d4/db/d39/d3c/d86/cbb 0 2024-09-16T09:45:35.159 INFO:tasks.workunit.client.1.smithi114.stdout:4/619: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:45:35.160 INFO:tasks.workunit.client.1.smithi114.stdout:8/559: mknod d4/db/d39/d3c/d4e/d82/cbc 0 2024-09-16T09:45:35.160 INFO:tasks.workunit.client.1.smithi114.stdout:8/560: readlink d4/db/d68/l23 0 2024-09-16T09:45:35.160 INFO:tasks.workunit.client.1.smithi114.stdout:1/608: dwrite d4/d2b/f14 [0,4194304] 0 2024-09-16T09:45:35.161 INFO:tasks.workunit.client.1.smithi114.stdout:4/620: link d0/d13/d56/d7e/c98 d0/d26/d29/d2b/cd3 0 2024-09-16T09:45:35.161 INFO:tasks.workunit.client.1.smithi114.stdout:4/621: chown d0/d13/fac 74407121 1 2024-09-16T09:45:35.162 INFO:tasks.workunit.client.1.smithi114.stdout:8/561: creat d4/db/d68/d30/fbd x:0 0 0 2024-09-16T09:45:35.163 INFO:tasks.workunit.client.1.smithi114.stdout:8/562: symlink d4/db/d3e/d71/d78/d7a/lbe 0 2024-09-16T09:45:35.164 INFO:tasks.workunit.client.1.smithi114.stdout:8/563: mkdir d4/db/d39/d3c/dbf 0 2024-09-16T09:45:35.165 INFO:tasks.workunit.client.1.smithi114.stdout:1/609: dread d4/d2b/d29/da0/db1/fbc [0,4194304] 0 2024-09-16T09:45:35.165 INFO:tasks.workunit.client.1.smithi114.stdout:1/610: readlink d4/d2b/d16/l31 0 2024-09-16T09:45:35.165 INFO:tasks.workunit.client.1.smithi114.stdout:8/564: mknod d4/dae/cc0 0 2024-09-16T09:45:35.165 INFO:tasks.workunit.client.1.smithi114.stdout:8/565: mkdir d4/db/d68/d28/dc1 0 2024-09-16T09:45:35.176 INFO:tasks.workunit.client.1.smithi114.stdout:8/566: write d4/db/d68/d28/f67 [236236,4904] 0 2024-09-16T09:45:35.178 INFO:tasks.workunit.client.1.smithi114.stdout:8/567: creat d4/db/d3e/d71/d78/d8d/fc2 x:0 0 0 2024-09-16T09:45:35.178 INFO:tasks.workunit.client.1.smithi114.stdout:8/568: readlink d4/l37 0 2024-09-16T09:45:35.178 INFO:tasks.workunit.client.1.smithi114.stdout:1/611: dread d4/d2b/f37 [0,4194304] 0 2024-09-16T09:45:35.178 INFO:tasks.workunit.client.1.smithi114.stdout:1/612: fdatasync d4/d2b/d16/d47/f95 0 2024-09-16T09:45:35.178 INFO:tasks.workunit.client.1.smithi114.stdout:1/613: chown d4/c3f 0 1 2024-09-16T09:45:35.180 INFO:tasks.workunit.client.1.smithi114.stdout:2/722: dwrite d1/d8/f101 [0,4194304] 0 2024-09-16T09:45:35.180 INFO:tasks.workunit.client.1.smithi114.stdout:4/622: dwrite d0/d26/f88 [0,4194304] 0 2024-09-16T09:45:35.180 INFO:tasks.workunit.client.1.smithi114.stdout:1/614: rename d4/d2b/d29/d92 to d4/d2b/d2f/d3a/dc5 0 2024-09-16T09:45:35.180 INFO:tasks.workunit.client.1.smithi114.stdout:1/615: fsync d4/f4e 0 2024-09-16T09:45:35.180 INFO:tasks.workunit.client.1.smithi114.stdout:2/723: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/f106 zero size 2024-09-16T09:45:35.180 INFO:tasks.workunit.client.1.smithi114.stdout:2/724: chown d1/d8/d10/f49 220902506 1 2024-09-16T09:45:35.183 INFO:tasks.workunit.client.1.smithi114.stdout:1/616: creat d4/d2b/d2f/fc6 x:0 0 0 2024-09-16T09:45:35.184 INFO:tasks.workunit.client.1.smithi114.stdout:2/725: dread d1/d8/d10/d5a/fa9 [0,4194304] 0 2024-09-16T09:45:35.184 INFO:tasks.workunit.client.1.smithi114.stdout:1/617: creat d4/d2b/d16/d71/d81/fc7 x:0 0 0 2024-09-16T09:45:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:34 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:35.187 INFO:tasks.workunit.client.1.smithi114.stdout:2/726: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/c10e 0 2024-09-16T09:45:35.189 INFO:tasks.workunit.client.1.smithi114.stdout:8/569: dread d4/db/d3e/d71/d78/d8d/da9/fb7 [0,4194304] 0 2024-09-16T09:45:35.190 INFO:tasks.workunit.client.1.smithi114.stdout:4/623: dread d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:35.190 INFO:tasks.workunit.client.1.smithi114.stdout:4/624: fdatasync d0/d13/f22 0 2024-09-16T09:45:35.192 INFO:tasks.workunit.client.1.smithi114.stdout:1/618: write d4/d2b/d16/d47/f6e [1822942,105764] 0 2024-09-16T09:45:35.193 INFO:tasks.workunit.client.1.smithi114.stdout:4/625: link d0/d26/l91 d0/d26/d40/d75/d7f/ld4 0 2024-09-16T09:45:35.194 INFO:tasks.workunit.client.1.smithi114.stdout:3/781: sync 2024-09-16T09:45:35.194 INFO:tasks.workunit.client.1.smithi114.stdout:7/683: sync 2024-09-16T09:45:35.194 INFO:tasks.workunit.client.1.smithi114.stdout:3/782: chown dc/de/d1f/l99 2 1 2024-09-16T09:45:35.195 INFO:tasks.workunit.client.1.smithi114.stdout:1/619: mkdir d4/d2b/d16/d47/dc8 0 2024-09-16T09:45:35.195 INFO:tasks.workunit.client.1.smithi114.stdout:1/620: chown d4/d2b/f27 4346 1 2024-09-16T09:45:35.195 INFO:tasks.workunit.client.1.smithi114.stdout:1/621: read - d4/d2b/d2f/fad zero size 2024-09-16T09:45:35.195 INFO:tasks.workunit.client.1.smithi114.stdout:1/622: chown d4/f25 5039404 1 2024-09-16T09:45:35.196 INFO:tasks.workunit.client.1.smithi114.stdout:2/727: dread d1/d8/d10/d5a/fe5 [0,4194304] 0 2024-09-16T09:45:35.197 INFO:tasks.workunit.client.1.smithi114.stdout:9/588: sync 2024-09-16T09:45:35.197 INFO:tasks.workunit.client.1.smithi114.stdout:0/623: sync 2024-09-16T09:45:35.197 INFO:tasks.workunit.client.1.smithi114.stdout:4/626: mknod d0/d26/d3c/d3e/d5a/cd5 0 2024-09-16T09:45:35.197 INFO:tasks.workunit.client.1.smithi114.stdout:8/570: dread d4/db/dd/f6f [0,4194304] 0 2024-09-16T09:45:35.197 INFO:tasks.workunit.client.1.smithi114.stdout:8/571: readlink d4/db/d3e/d47/l4a 0 2024-09-16T09:45:35.198 INFO:tasks.workunit.client.1.smithi114.stdout:7/684: creat d2/d9/d2b/d2e/d22/feb x:0 0 0 2024-09-16T09:45:35.199 INFO:tasks.workunit.client.1.smithi114.stdout:3/783: creat dc/de/d18/d78/d5c/da5/f115 x:0 0 0 2024-09-16T09:45:35.202 INFO:tasks.workunit.client.1.smithi114.stdout:2/728: symlink d1/d8/d10/d5a/l10f 0 2024-09-16T09:45:35.203 INFO:tasks.workunit.client.1.smithi114.stdout:4/627: creat d0/d26/d3c/d3e/d4b/fd6 x:0 0 0 2024-09-16T09:45:35.203 INFO:tasks.workunit.client.1.smithi114.stdout:7/685: getdents d2/d9/d2b/d78/d99/ddd 0 2024-09-16T09:45:35.203 INFO:tasks.workunit.client.1.smithi114.stdout:7/686: fdatasync d2/d9/d2b/d78/d99/f9a 0 2024-09-16T09:45:35.204 INFO:tasks.workunit.client.1.smithi114.stdout:3/784: symlink dc/de/d17/d72/l116 0 2024-09-16T09:45:35.205 INFO:tasks.workunit.client.1.smithi114.stdout:1/623: rename d4/d2b/d16/d71/d81/fc7 to d4/d2b/d2f/d3a/d9d/fc9 0 2024-09-16T09:45:35.206 INFO:tasks.workunit.client.1.smithi114.stdout:0/624: write d1f/d22/fba [3397414,5112] 0 2024-09-16T09:45:35.207 INFO:tasks.workunit.client.1.smithi114.stdout:2/729: link d1/d9e/db0/fca d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/f110 0 2024-09-16T09:45:35.207 INFO:tasks.workunit.client.1.smithi114.stdout:2/730: read d1/d9e/fd3 [42760,44300] 0 2024-09-16T09:45:35.208 INFO:tasks.workunit.client.1.smithi114.stdout:4/628: symlink d0/d26/d3c/d74/ld7 0 2024-09-16T09:45:35.208 INFO:tasks.workunit.client.1.smithi114.stdout:7/687: dread d2/d9/d2b/d2e/d3e/f65 [0,4194304] 0 2024-09-16T09:45:35.209 INFO:tasks.workunit.client.1.smithi114.stdout:1/624: rename d4/c18 to d4/d2b/d16/d47/cca 0 2024-09-16T09:45:35.210 INFO:tasks.workunit.client.1.smithi114.stdout:0/625: mknod d1f/d22/d2e/d46/d7f/d8d/ce5 0 2024-09-16T09:45:35.212 INFO:tasks.workunit.client.1.smithi114.stdout:2/731: mkdir d1/d8/d10/d5a/d111 0 2024-09-16T09:45:35.212 INFO:tasks.workunit.client.1.smithi114.stdout:2/732: readlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/lc1 0 2024-09-16T09:45:35.212 INFO:tasks.workunit.client.1.smithi114.stdout:2/733: chown d1/d8/d10/f50 1899065087 1 2024-09-16T09:45:35.212 INFO:tasks.workunit.client.1.smithi114.stdout:4/629: link d0/d26/d3c/d3e/d4b/f92 d0/d26/d2e/dc0/fd8 0 2024-09-16T09:45:35.212 INFO:tasks.workunit.client.1.smithi114.stdout:7/688: rmdir d2/d9/d2b/d2e/d22/d27 39 2024-09-16T09:45:35.212 INFO:tasks.workunit.client.1.smithi114.stdout:7/689: getdents d2/d9/d2b/d2e/d22/d4c/dbd 0 2024-09-16T09:45:35.213 INFO:tasks.workunit.client.1.smithi114.stdout:0/626: mkdir d1f/d27/de6 0 2024-09-16T09:45:35.213 INFO:tasks.workunit.client.1.smithi114.stdout:0/627: fsync d1f/d22/d2e/fa2 0 2024-09-16T09:45:35.215 INFO:tasks.workunit.client.1.smithi114.stdout:4/630: creat d0/d26/d3c/d3e/d4b/fd9 x:0 0 0 2024-09-16T09:45:35.215 INFO:tasks.workunit.client.1.smithi114.stdout:7/690: creat d2/d9/d51/d84/dda/fec x:0 0 0 2024-09-16T09:45:35.225 INFO:tasks.workunit.client.1.smithi114.stdout:9/589: dwrite d3/f49 [0,4194304] 0 2024-09-16T09:45:35.226 INFO:tasks.workunit.client.1.smithi114.stdout:9/590: creat d3/da/d10/d23/d29/d2c/d6b/fc6 x:0 0 0 2024-09-16T09:45:35.227 INFO:tasks.workunit.client.1.smithi114.stdout:9/591: write d3/da/d10/d23/d43/d1e/f83 [8826,27152] 0 2024-09-16T09:45:35.227 INFO:tasks.workunit.client.1.smithi114.stdout:9/592: fsync d3/da/d10/d23/d29/d2c/d45/f61 0 2024-09-16T09:45:35.228 INFO:tasks.workunit.client.1.smithi114.stdout:4/631: dread d0/f3a [0,4194304] 0 2024-09-16T09:45:35.228 INFO:tasks.workunit.client.1.smithi114.stdout:9/593: creat d3/da/d10/d23/d43/d1e/d4c/d8c/fc7 x:0 0 0 2024-09-16T09:45:35.228 INFO:tasks.workunit.client.1.smithi114.stdout:4/632: creat d0/d26/d29/fda x:0 0 0 2024-09-16T09:45:35.229 INFO:tasks.workunit.client.1.smithi114.stdout:9/594: link d3/da/f55 d3/da/d10/d23/d29/d2c/d6b/db9/fc8 0 2024-09-16T09:45:35.229 INFO:tasks.workunit.client.1.smithi114.stdout:9/595: chown d3/da/d10/d23/d43/d1e/f5e 101776788 1 2024-09-16T09:45:35.230 INFO:tasks.workunit.client.1.smithi114.stdout:0/628: dread d1f/d22/d2e/d46/f54 [0,4194304] 0 2024-09-16T09:45:35.232 INFO:tasks.workunit.client.1.smithi114.stdout:4/633: dread d0/f7 [0,4194304] 0 2024-09-16T09:45:35.234 INFO:tasks.workunit.client.1.smithi114.stdout:4/634: symlink d0/d26/d29/d2b/dc7/ldb 0 2024-09-16T09:45:35.234 INFO:tasks.workunit.client.1.smithi114.stdout:4/635: chown d0/d13/d56/d7e/c98 13657 1 2024-09-16T09:45:35.246 INFO:tasks.workunit.client.1.smithi114.stdout:4/636: dread d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:35.246 INFO:tasks.workunit.client.1.smithi114.stdout:4/637: fdatasync d0/d26/d3c/d3e/d4b/d46/db3/fca 0 2024-09-16T09:45:35.247 INFO:tasks.workunit.client.1.smithi114.stdout:8/572: dwrite d4/db/d39/d3c/fa7 [0,4194304] 0 2024-09-16T09:45:35.247 INFO:tasks.workunit.client.1.smithi114.stdout:8/573: fsync d4/db/d3e/f7f 0 2024-09-16T09:45:35.248 INFO:tasks.workunit.client.1.smithi114.stdout:4/638: creat d0/d26/d29/d2b/dc7/dc8/fdc x:0 0 0 2024-09-16T09:45:35.248 INFO:tasks.workunit.client.1.smithi114.stdout:1/625: dwrite d4/f6f [0,4194304] 0 2024-09-16T09:45:35.249 INFO:tasks.workunit.client.1.smithi114.stdout:3/785: dwrite dc/de/d18/dfe/d7f/f86 [0,4194304] 0 2024-09-16T09:45:35.249 INFO:tasks.workunit.client.1.smithi114.stdout:4/639: link d0/d26/d29/l52 d0/d26/d3c/d3e/d4b/ldd 0 2024-09-16T09:45:35.250 INFO:tasks.workunit.client.1.smithi114.stdout:1/626: rmdir d4/d2b/d29/da0 39 2024-09-16T09:45:35.250 INFO:tasks.workunit.client.1.smithi114.stdout:1/627: truncate d4/d2b/d2f/d3a/d9d/d41/d42/fb6 959903 0 2024-09-16T09:45:35.251 INFO:tasks.workunit.client.1.smithi114.stdout:2/734: dwrite d1/d9e/fd3 [0,4194304] 0 2024-09-16T09:45:35.251 INFO:tasks.workunit.client.1.smithi114.stdout:2/735: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 4780629 0 2024-09-16T09:45:35.251 INFO:tasks.workunit.client.1.smithi114.stdout:2/736: truncate d1/d9e/daf/ff4 243770 0 2024-09-16T09:45:35.251 INFO:tasks.workunit.client.1.smithi114.stdout:4/640: symlink d0/d26/d40/d75/lde 0 2024-09-16T09:45:35.251 INFO:tasks.workunit.client.1.smithi114.stdout:2/737: write d1/d8/d10/d16/fcf [894821,94775] 0 2024-09-16T09:45:35.253 INFO:tasks.workunit.client.1.smithi114.stdout:2/738: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/f112 x:0 0 0 2024-09-16T09:45:35.255 INFO:tasks.workunit.client.1.smithi114.stdout:4/641: dread d0/d26/d3c/d3e/d4b/d46/db3/fca [0,4194304] 0 2024-09-16T09:45:35.256 INFO:tasks.workunit.client.1.smithi114.stdout:2/739: link d1/d8/d10/d16/d1d/d92/da7/d3e/f59 d1/d8/d10/d16/d60/db7/f113 0 2024-09-16T09:45:35.257 INFO:tasks.workunit.client.1.smithi114.stdout:2/740: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b 39 2024-09-16T09:45:35.257 INFO:tasks.workunit.client.1.smithi114.stdout:2/741: fsync d1/fe6 0 2024-09-16T09:45:35.257 INFO:tasks.workunit.client.1.smithi114.stdout:2/742: read d1/d9e/db0/fdf [304123,20667] 0 2024-09-16T09:45:35.265 INFO:tasks.workunit.client.1.smithi114.stdout:7/691: dwrite d2/f1c [0,4194304] 0 2024-09-16T09:45:35.268 INFO:tasks.workunit.client.1.smithi114.stdout:7/692: mknod d2/d9/d2b/d2e/d77/ced 0 2024-09-16T09:45:35.268 INFO:tasks.workunit.client.1.smithi114.stdout:7/693: stat d2/cd5 0 2024-09-16T09:45:35.268 INFO:tasks.workunit.client.1.smithi114.stdout:0/629: dwrite d1f/f45 [0,4194304] 0 2024-09-16T09:45:35.269 INFO:tasks.workunit.client.1.smithi114.stdout:9/596: dwrite d3/da/d10/d23/d43/d1e/d7b/fbc [0,4194304] 0 2024-09-16T09:45:35.269 INFO:tasks.workunit.client.1.smithi114.stdout:9/597: truncate d3/da/d10/d23/d29/d2c/d45/f64 5131522 0 2024-09-16T09:45:35.272 INFO:tasks.workunit.client.1.smithi114.stdout:0/630: rename d1f/d2d/d7a/l9d to d1f/d27/d55/dce/le7 0 2024-09-16T09:45:35.273 INFO:tasks.workunit.client.1.smithi114.stdout:4/642: dread d0/d13/d25/f9b [0,4194304] 0 2024-09-16T09:45:35.282 INFO:tasks.workunit.client.1.smithi114.stdout:7/694: dread d2/d9/d2b/f61 [0,4194304] 0 2024-09-16T09:45:35.282 INFO:tasks.workunit.client.1.smithi114.stdout:7/695: fsync d2/d9/d2b/d59/d7f/fa8 0 2024-09-16T09:45:35.283 INFO:tasks.workunit.client.1.smithi114.stdout:0/631: unlink d1f/d22/l6e 0 2024-09-16T09:45:35.283 INFO:tasks.workunit.client.1.smithi114.stdout:0/632: chown d1f/d22/l8c 2795300 1 2024-09-16T09:45:35.284 INFO:tasks.workunit.client.1.smithi114.stdout:4/643: mkdir d0/d26/d3c/d3e/d5a/d5d/ddf 0 2024-09-16T09:45:35.285 INFO:tasks.workunit.client.1.smithi114.stdout:7/696: creat d2/d9/d2b/d2e/d22/d4c/dbd/fee x:0 0 0 2024-09-16T09:45:35.285 INFO:tasks.workunit.client.1.smithi114.stdout:9/598: read d3/da/d10/d23/d43/d82/f75 [2481733,96460] 0 2024-09-16T09:45:35.286 INFO:tasks.workunit.client.1.smithi114.stdout:0/633: truncate f15 2390707 0 2024-09-16T09:45:35.287 INFO:tasks.workunit.client.1.smithi114.stdout:4/644: mknod d0/d26/d3c/d74/d9c/ce0 0 2024-09-16T09:45:35.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/697: mkdir d2/d9/d2b/d78/d99/ddd/def 0 2024-09-16T09:45:35.289 INFO:tasks.workunit.client.1.smithi114.stdout:9/599: rename d3/da/d10/d23/d43/d1e/d25/c34 to d3/da/d10/d23/d29/d87/cc9 0 2024-09-16T09:45:35.290 INFO:tasks.workunit.client.1.smithi114.stdout:9/600: truncate d3/da/d10/fb3 991550 0 2024-09-16T09:45:35.290 INFO:tasks.workunit.client.1.smithi114.stdout:0/634: mknod d1f/d27/d47/d56/d7e/ce8 0 2024-09-16T09:45:35.290 INFO:tasks.workunit.client.1.smithi114.stdout:0/635: dread - d1f/d22/d2e/f90 zero size 2024-09-16T09:45:35.290 INFO:tasks.workunit.client.1.smithi114.stdout:0/636: truncate d1f/f3f 4837995 0 2024-09-16T09:45:35.290 INFO:tasks.workunit.client.1.smithi114.stdout:7/698: getdents d2/d9/d2b/d2e/d22 0 2024-09-16T09:45:35.291 INFO:tasks.workunit.client.1.smithi114.stdout:9/601: creat d3/da/d10/d23/d29/d2c/d45/fca x:0 0 0 2024-09-16T09:45:35.291 INFO:tasks.workunit.client.1.smithi114.stdout:0/637: link d1f/d22/f49 d1f/d20/d48/fe9 0 2024-09-16T09:45:35.293 INFO:tasks.workunit.client.1.smithi114.stdout:4/645: mkdir d0/d26/d40/d75/d7f/de1 0 2024-09-16T09:45:35.293 INFO:tasks.workunit.client.1.smithi114.stdout:4/646: chown d0/d26/d3c/d3e/d4b/d46/fa3 47940 1 2024-09-16T09:45:35.293 INFO:tasks.workunit.client.1.smithi114.stdout:7/699: creat d2/d9/d2b/d59/ff0 x:0 0 0 2024-09-16T09:45:35.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/602: creat d3/da/d10/d23/d43/d1e/d78/fcb x:0 0 0 2024-09-16T09:45:35.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/603: fsync d3/da/d10/d23/d43/d1e/d25/f27 0 2024-09-16T09:45:35.294 INFO:tasks.workunit.client.1.smithi114.stdout:9/604: fsync d3/da/d10/d23/d43/d1e/d25/fc2 0 2024-09-16T09:45:35.295 INFO:tasks.workunit.client.1.smithi114.stdout:0/638: mkdir d1f/d20/dea 0 2024-09-16T09:45:35.296 INFO:tasks.workunit.client.1.smithi114.stdout:3/786: dwrite dc/de/d17/d79/fe9 [0,4194304] 0 2024-09-16T09:45:35.296 INFO:tasks.workunit.client.1.smithi114.stdout:7/700: unlink d2/d9/d2b/d2e/d22/d27/f2a 0 2024-09-16T09:45:35.297 INFO:tasks.workunit.client.1.smithi114.stdout:7/701: chown d2/d9/d2b/d2e/d3e/c38 42097474 1 2024-09-16T09:45:35.297 INFO:tasks.workunit.client.1.smithi114.stdout:7/702: chown d2/d9/d2b/f57 83909988 1 2024-09-16T09:45:35.298 INFO:tasks.workunit.client.1.smithi114.stdout:1/628: dwrite d4/d2b/d2f/f5d [0,4194304] 0 2024-09-16T09:45:35.299 INFO:tasks.workunit.client.1.smithi114.stdout:1/629: write d4/d2b/f53 [263526,117894] 0 2024-09-16T09:45:35.299 INFO:tasks.workunit.client.1.smithi114.stdout:8/574: dwrite d4/db/d68/d28/f51 [0,4194304] 0 2024-09-16T09:45:35.299 INFO:tasks.workunit.client.1.smithi114.stdout:3/787: rmdir dc/de/d17/d2d/d41/d9e/dad 0 2024-09-16T09:45:35.303 INFO:tasks.workunit.client.1.smithi114.stdout:3/788: mkdir dc/de/d18/d117 0 2024-09-16T09:45:35.303 INFO:tasks.workunit.client.1.smithi114.stdout:3/789: truncate dc/de/d37/d3d/fbb 2127965 0 2024-09-16T09:45:35.304 INFO:tasks.workunit.client.1.smithi114.stdout:8/575: mkdir d4/dc3 0 2024-09-16T09:45:35.306 INFO:tasks.workunit.client.1.smithi114.stdout:8/576: creat d4/db/d68/fc4 x:0 0 0 2024-09-16T09:45:35.306 INFO:tasks.workunit.client.1.smithi114.stdout:2/743: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f71 [0,4194304] 0 2024-09-16T09:45:35.306 INFO:tasks.workunit.client.1.smithi114.stdout:2/744: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/ff3 zero size 2024-09-16T09:45:35.307 INFO:tasks.workunit.client.1.smithi114.stdout:2/745: fsync d1/d8/f12 0 2024-09-16T09:45:35.307 INFO:tasks.workunit.client.1.smithi114.stdout:2/746: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/ff3 zero size 2024-09-16T09:45:35.307 INFO:tasks.workunit.client.1.smithi114.stdout:8/577: dread d4/db/d3e/f97 [0,4194304] 0 2024-09-16T09:45:35.308 INFO:tasks.workunit.client.1.smithi114.stdout:9/605: dread d3/da/f55 [0,4194304] 0 2024-09-16T09:45:35.308 INFO:tasks.workunit.client.1.smithi114.stdout:9/606: chown d3/da/d10/d23/d43/d1e/da0 2069 1 2024-09-16T09:45:35.309 INFO:tasks.workunit.client.1.smithi114.stdout:7/703: dread d2/d9/d2b/d2e/d22/d27/d4d/f97 [0,4194304] 0 2024-09-16T09:45:35.311 INFO:tasks.workunit.client.1.smithi114.stdout:2/747: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/f114 x:0 0 0 2024-09-16T09:45:35.311 INFO:tasks.workunit.client.1.smithi114.stdout:2/748: write d1/d8/d10/d16/d1d/fd0 [563241,104224] 0 2024-09-16T09:45:35.314 INFO:tasks.workunit.client.1.smithi114.stdout:8/578: symlink d4/db/d39/d3c/d4e/lc5 0 2024-09-16T09:45:35.314 INFO:tasks.workunit.client.1.smithi114.stdout:8/579: write d4/db/d3e/d71/d78/d8d/da9/fb7 [2199910,86017] 0 2024-09-16T09:45:35.314 INFO:tasks.workunit.client.1.smithi114.stdout:2/749: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/c115 0 2024-09-16T09:45:35.316 INFO:tasks.workunit.client.1.smithi114.stdout:0/639: read d1f/d27/f3b [1446913,77619] 0 2024-09-16T09:45:35.317 INFO:tasks.workunit.client.1.smithi114.stdout:2/750: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/c93 0 1 2024-09-16T09:45:35.318 INFO:tasks.workunit.client.1.smithi114.stdout:0/640: symlink d1f/d22/d2e/d46/d7f/leb 0 2024-09-16T09:45:35.319 INFO:tasks.workunit.client.1.smithi114.stdout:2/751: mkdir d1/d8/d10/d16/dd9/d116 0 2024-09-16T09:45:35.320 INFO:tasks.workunit.client.1.smithi114.stdout:7/704: dread d2/df/f30 [0,4194304] 0 2024-09-16T09:45:35.322 INFO:tasks.workunit.client.1.smithi114.stdout:0/641: rename d1f/d22/d2e/l35 to d1f/d27/lec 0 2024-09-16T09:45:35.323 INFO:tasks.workunit.client.1.smithi114.stdout:5/622: sync 2024-09-16T09:45:35.323 INFO:tasks.workunit.client.1.smithi114.stdout:6/664: sync 2024-09-16T09:45:35.325 INFO:tasks.workunit.client.1.smithi114.stdout:6/665: getdents d6 0 2024-09-16T09:45:35.327 INFO:tasks.workunit.client.1.smithi114.stdout:5/623: creat d3/d24/d84/d7a/d43/d4c/db2/db7/fd2 x:0 0 0 2024-09-16T09:45:35.327 INFO:tasks.workunit.client.1.smithi114.stdout:5/624: write d3/d1f/d8c/fc7 [115340,21081] 0 2024-09-16T09:45:35.327 INFO:tasks.workunit.client.1.smithi114.stdout:6/666: creat d6/da/d10/d40/d82/fd0 x:0 0 0 2024-09-16T09:45:35.327 INFO:tasks.workunit.client.1.smithi114.stdout:6/667: readlink d6/da/d10/l12 0 2024-09-16T09:45:35.328 INFO:tasks.workunit.client.1.smithi114.stdout:6/668: write d6/da/d10/f71 [5205672,115829] 0 2024-09-16T09:45:35.329 INFO:tasks.workunit.client.1.smithi114.stdout:5/625: rmdir d3/d24/d84/d7a/d43/d58 39 2024-09-16T09:45:35.329 INFO:tasks.workunit.client.1.smithi114.stdout:5/626: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f94 [493872,15540] 0 2024-09-16T09:45:35.329 INFO:tasks.workunit.client.1.smithi114.stdout:5/627: chown d3/d24/d84/d7a/d43/d4c/d6d 436672474 1 2024-09-16T09:45:35.334 INFO:tasks.workunit.client.1.smithi114.stdout:5/628: creat d3/d1f/d8c/fd3 x:0 0 0 2024-09-16T09:45:35.334 INFO:tasks.workunit.client.1.smithi114.stdout:5/629: read - d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f9c zero size 2024-09-16T09:45:35.334 INFO:tasks.workunit.client.1.smithi114.stdout:2/752: write d1/d8/d10/d16/f51 [2718651,125911] 0 2024-09-16T09:45:35.334 INFO:tasks.workunit.client.1.smithi114.stdout:2/753: fsync d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/f103 0 2024-09-16T09:45:35.334 INFO:tasks.workunit.client.1.smithi114.stdout:2/754: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f95 246930 0 2024-09-16T09:45:35.334 INFO:tasks.workunit.client.1.smithi114.stdout:2/755: mkdir d1/d8/d10/d16/d60/db7/deb/d117 0 2024-09-16T09:45:35.336 INFO:tasks.workunit.client.1.smithi114.stdout:2/756: rename d1/l37 to d1/d8/d10/d16/d60/db7/deb/d117/l118 0 2024-09-16T09:45:35.337 INFO:tasks.workunit.client.1.smithi114.stdout:0/642: dread f1e [0,4194304] 0 2024-09-16T09:45:35.341 INFO:tasks.workunit.client.1.smithi114.stdout:4/647: dwrite d0/d26/d3c/d3e/d4b/d46/f80 [4194304,4194304] 0 2024-09-16T09:45:35.341 INFO:tasks.workunit.client.1.smithi114.stdout:1/630: dwrite d4/d2b/d16/d71/d72/d75/f7f [0,4194304] 0 2024-09-16T09:45:35.341 INFO:tasks.workunit.client.1.smithi114.stdout:1/631: write d4/d2b/d16/d71/d72/fb5 [720210,86378] 0 2024-09-16T09:45:35.351 INFO:tasks.workunit.client.1.smithi114.stdout:0/643: read d1f/d22/d2e/d46/d7f/d8d/fc5 [1876300,120403] 0 2024-09-16T09:45:35.353 INFO:tasks.workunit.client.1.smithi114.stdout:0/644: rename d1f/d22/d2e/d46/f7b to d1f/d27/d55/dce/fed 0 2024-09-16T09:45:35.353 INFO:tasks.workunit.client.1.smithi114.stdout:0/645: readlink d1f/d27/lec 0 2024-09-16T09:45:35.367 INFO:tasks.workunit.client.1.smithi114.stdout:8/580: dwrite d4/db/d3e/f7c [0,4194304] 0 2024-09-16T09:45:35.367 INFO:tasks.workunit.client.1.smithi114.stdout:4/648: dwrite d0/d13/f6f [0,4194304] 0 2024-09-16T09:45:35.368 INFO:tasks.workunit.client.1.smithi114.stdout:4/649: dread d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 [0,4194304] 0 2024-09-16T09:45:35.369 INFO:tasks.workunit.client.1.smithi114.stdout:8/581: creat d4/db/d3e/d71/d78/d7a/fc6 x:0 0 0 2024-09-16T09:45:35.369 INFO:tasks.workunit.client.1.smithi114.stdout:4/650: link d0/d26/d2e/c3f d0/d26/d3c/d45/ce2 0 2024-09-16T09:45:35.370 INFO:tasks.workunit.client.1.smithi114.stdout:4/651: mkdir d0/d26/d40/de3 0 2024-09-16T09:45:35.371 INFO:tasks.workunit.client.1.smithi114.stdout:8/582: link d4/db/dd/fa8 d4/fc7 0 2024-09-16T09:45:35.376 INFO:tasks.workunit.client.1.smithi114.stdout:7/705: dwrite d2/d9/fa7 [0,4194304] 0 2024-09-16T09:45:35.376 INFO:tasks.workunit.client.1.smithi114.stdout:3/790: dwrite dc/de/d18/dfe/db2/dd8/f110 [0,4194304] 0 2024-09-16T09:45:35.377 INFO:tasks.workunit.client.1.smithi114.stdout:7/706: link d2/d9/d2b/d78/cad d2/d9/d2b/d78/d99/cf1 0 2024-09-16T09:45:35.378 INFO:tasks.workunit.client.1.smithi114.stdout:7/707: getdents d2/d9/db1 0 2024-09-16T09:45:35.379 INFO:tasks.workunit.client.1.smithi114.stdout:7/708: rmdir d2/d9/d2b/d2e/d22/d27/d4d/d72 39 2024-09-16T09:45:35.380 INFO:tasks.workunit.client.1.smithi114.stdout:7/709: creat d2/d9/d2b/d2e/d77/ff2 x:0 0 0 2024-09-16T09:45:35.380 INFO:tasks.workunit.client.1.smithi114.stdout:7/710: creat d2/d9/d2b/d2e/d3e/d79/ff3 x:0 0 0 2024-09-16T09:45:35.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:34 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:35.382 INFO:tasks.workunit.client.1.smithi114.stdout:7/711: rename d2/d9/f5c to d2/d9/d2b/d2e/d22/d4c/dbd/ff4 0 2024-09-16T09:45:35.384 INFO:tasks.workunit.client.1.smithi114.stdout:7/712: symlink d2/d9/d2b/d78/d99/ddd/dea/lf5 0 2024-09-16T09:45:35.386 INFO:tasks.workunit.client.1.smithi114.stdout:6/669: dwrite d6/da/d10/d40/f94 [0,4194304] 0 2024-09-16T09:45:35.387 INFO:tasks.workunit.client.1.smithi114.stdout:5/630: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/f9d [0,4194304] 0 2024-09-16T09:45:35.387 INFO:tasks.workunit.client.1.smithi114.stdout:0/646: dwrite f19 [0,4194304] 0 2024-09-16T09:45:35.388 INFO:tasks.workunit.client.1.smithi114.stdout:1/632: dwrite d4/d2b/d2f/d3a/d9d/d41/d42/d58/f5c [4194304,4194304] 0 2024-09-16T09:45:35.388 INFO:tasks.workunit.client.1.smithi114.stdout:1/633: fdatasync d4/d2b/f9 0 2024-09-16T09:45:35.397 INFO:tasks.workunit.client.1.smithi114.stdout:3/791: dwrite dc/d38/f45 [4194304,4194304] 0 2024-09-16T09:45:35.398 INFO:tasks.workunit.client.1.smithi114.stdout:0/647: write d1f/d22/d2e/d46/d7f/fd8 [3699297,29917] 0 2024-09-16T09:45:35.405 INFO:tasks.workunit.client.1.smithi114.stdout:6/670: write d6/da/d10/d40/fa6 [1808115,41245] 0 2024-09-16T09:45:35.406 INFO:tasks.workunit.client.1.smithi114.stdout:1/634: rename d4/d2b/d2f/d3a/l69 to d4/d2b/d16/d71/lcb 0 2024-09-16T09:45:35.408 INFO:tasks.workunit.client.1.smithi114.stdout:7/713: dwrite d2/d9/d2b/d78/d99/fc5 [0,4194304] 0 2024-09-16T09:45:35.409 INFO:tasks.workunit.client.1.smithi114.stdout:0/648: mknod d1f/d22/cee 0 2024-09-16T09:45:35.409 INFO:tasks.workunit.client.1.smithi114.stdout:0/649: fsync d1f/d22/fd9 0 2024-09-16T09:45:35.410 INFO:tasks.workunit.client.1.smithi114.stdout:8/583: truncate d4/db/d3e/f7c 515998 0 2024-09-16T09:45:35.411 INFO:tasks.workunit.client.1.smithi114.stdout:1/635: symlink d4/d2b/lcc 0 2024-09-16T09:45:35.416 INFO:tasks.workunit.client.1.smithi114.stdout:7/714: creat d2/d9/d2b/d78/d99/ddd/dea/ff6 x:0 0 0 2024-09-16T09:45:35.416 INFO:tasks.workunit.client.1.smithi114.stdout:7/715: dread - d2/df/fce zero size 2024-09-16T09:45:35.418 INFO:tasks.workunit.client.1.smithi114.stdout:0/650: creat d1f/d27/d47/d56/fef x:0 0 0 2024-09-16T09:45:35.419 INFO:tasks.workunit.client.1.smithi114.stdout:5/631: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/f60 [0,4194304] 0 2024-09-16T09:45:35.420 INFO:tasks.workunit.client.1.smithi114.stdout:1/636: creat d4/d2b/d2f/d3a/d9d/fcd x:0 0 0 2024-09-16T09:45:35.420 INFO:tasks.workunit.client.1.smithi114.stdout:1/637: write d4/d2b/d16/f9a [224327,29227] 0 2024-09-16T09:45:35.421 INFO:tasks.workunit.client.1.smithi114.stdout:8/584: read d4/db/d3e/d47/f5e [3730555,44743] 0 2024-09-16T09:45:35.421 INFO:tasks.workunit.client.1.smithi114.stdout:8/585: dread - d4/db/d3e/d71/d78/d8d/fc2 zero size 2024-09-16T09:45:35.421 INFO:tasks.workunit.client.1.smithi114.stdout:8/586: chown d4/db/d39/d3c/d4e/d62/l76 244846937 1 2024-09-16T09:45:35.422 INFO:tasks.workunit.client.1.smithi114.stdout:0/651: creat d1f/d27/de6/ff0 x:0 0 0 2024-09-16T09:45:35.423 INFO:tasks.workunit.client.1.smithi114.stdout:1/638: creat d4/d2b/d16/d71/d72/fce x:0 0 0 2024-09-16T09:45:35.423 INFO:tasks.workunit.client.1.smithi114.stdout:1/639: dread - d4/d2b/d16/d47/f95 zero size 2024-09-16T09:45:35.425 INFO:tasks.workunit.client.1.smithi114.stdout:8/587: creat d4/db/d3e/fc8 x:0 0 0 2024-09-16T09:45:35.426 INFO:tasks.workunit.client.1.smithi114.stdout:3/792: dwrite dc/d38/d3f/f9f [0,4194304] 0 2024-09-16T09:45:35.426 INFO:tasks.workunit.client.1.smithi114.stdout:3/793: fdatasync dc/de/d18/d78/d5c/d5d/fcb 0 2024-09-16T09:45:35.426 INFO:tasks.workunit.client.1.smithi114.stdout:3/794: chown dc/de/d17/d2d/l32 0 1 2024-09-16T09:45:35.426 INFO:tasks.workunit.client.1.smithi114.stdout:0/652: link f3 d1f/d2d/d7a/ddd/ff1 0 2024-09-16T09:45:35.427 INFO:tasks.workunit.client.1.smithi114.stdout:6/671: dwrite d6/da/d10/d40/f72 [0,4194304] 0 2024-09-16T09:45:35.427 INFO:tasks.workunit.client.1.smithi114.stdout:1/640: mknod d4/d2b/d16/d71/d72/d75/db4/ccf 0 2024-09-16T09:45:35.428 INFO:tasks.workunit.client.1.smithi114.stdout:8/588: creat d4/d1f/db9/fc9 x:0 0 0 2024-09-16T09:45:35.428 INFO:tasks.workunit.client.1.smithi114.stdout:8/589: chown d4/db/d3e/cb6 12 1 2024-09-16T09:45:35.431 INFO:tasks.workunit.client.1.smithi114.stdout:3/795: rename dc/de/d18/d78/d5c/d5d/d8a/lb8 to dc/de/d18/dfe/d7f/l118 0 2024-09-16T09:45:35.435 INFO:tasks.workunit.client.1.smithi114.stdout:0/653: symlink d1f/d2d/d7a/lf2 0 2024-09-16T09:45:35.435 INFO:tasks.workunit.client.1.smithi114.stdout:0/654: stat d1f/d22/d2e/d46/f54 0 2024-09-16T09:45:35.436 INFO:tasks.workunit.client.1.smithi114.stdout:6/672: getdents d6/d2d/d46/dcc 0 2024-09-16T09:45:35.436 INFO:tasks.workunit.client.1.smithi114.stdout:6/673: readlink d6/da/l8f 0 2024-09-16T09:45:35.443 INFO:tasks.workunit.client.1.smithi114.stdout:3/796: write dc/de/d18/d78/d5c/d5d/d50/dea/f106 [543093,30158] 0 2024-09-16T09:45:35.443 INFO:tasks.workunit.client.1.smithi114.stdout:3/797: write dc/de/d17/d2d/db4/f25 [5013369,36898] 0 2024-09-16T09:45:35.443 INFO:tasks.workunit.client.1.smithi114.stdout:3/798: write dc/de/d17/fee [748361,3259] 0 2024-09-16T09:45:35.444 INFO:tasks.workunit.client.1.smithi114.stdout:3/799: getdents dc/de/d17/d2d/db4/d6a 0 2024-09-16T09:45:35.446 INFO:tasks.workunit.client.1.smithi114.stdout:6/674: dread d6/da/d48/f58 [0,4194304] 0 2024-09-16T09:45:35.455 INFO:tasks.workunit.client.1.smithi114.stdout:5/632: dwrite d3/d24/d84/d7a/d43/d4c/f54 [0,4194304] 0 2024-09-16T09:45:35.457 INFO:tasks.workunit.client.1.smithi114.stdout:5/633: creat d3/d24/d84/dbc/fd4 x:0 0 0 2024-09-16T09:45:35.457 INFO:tasks.workunit.client.1.smithi114.stdout:5/634: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/l17 0 2024-09-16T09:45:35.457 INFO:tasks.workunit.client.1.smithi114.stdout:5/635: readlink d3/l6c 0 2024-09-16T09:45:35.457 INFO:tasks.workunit.client.1.smithi114.stdout:5/636: stat d3/d24/d84/d7a/d43/d4c/db2/db5 0 2024-09-16T09:45:35.457 INFO:tasks.workunit.client.1.smithi114.stdout:5/637: readlink d3/d24/d84/l21 0 2024-09-16T09:45:35.458 INFO:tasks.workunit.client.1.smithi114.stdout:5/638: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/ld5 0 2024-09-16T09:45:35.459 INFO:tasks.workunit.client.1.smithi114.stdout:5/639: truncate d3/d24/d84/d7a/d43/d4c/d92/f6f 2921331 0 2024-09-16T09:45:35.471 INFO:tasks.workunit.client.1.smithi114.stdout:7/716: dwrite d2/d9/d2b/d78/d99/f9a [0,4194304] 0 2024-09-16T09:45:35.471 INFO:tasks.workunit.client.1.smithi114.stdout:7/717: chown d2/d9/d2b/lb5 1 1 2024-09-16T09:45:35.474 INFO:tasks.workunit.client.1.smithi114.stdout:5/640: dread d3/f8 [0,4194304] 0 2024-09-16T09:45:35.474 INFO:tasks.workunit.client.1.smithi114.stdout:8/590: dwrite d4/db/d3e/d71/f3d [0,4194304] 0 2024-09-16T09:45:35.476 INFO:tasks.workunit.client.1.smithi114.stdout:8/591: rmdir d4 39 2024-09-16T09:45:35.476 INFO:tasks.workunit.client.1.smithi114.stdout:8/592: creat d4/dae/d9c/fca x:0 0 0 2024-09-16T09:45:35.477 INFO:tasks.workunit.client.1.smithi114.stdout:8/593: getdents d4/d1f 0 2024-09-16T09:45:35.477 INFO:tasks.workunit.client.1.smithi114.stdout:8/594: truncate d4/db/d3e/d47/fa2 183089 0 2024-09-16T09:45:35.478 INFO:tasks.workunit.client.1.smithi114.stdout:8/595: rename d4/db/d39/d3c/d4e/d62/c9e to d4/db/d39/d3c/d84/ccb 0 2024-09-16T09:45:35.479 INFO:tasks.workunit.client.1.smithi114.stdout:8/596: getdents d4/db/d3e/d71/d78 0 2024-09-16T09:45:35.479 INFO:tasks.workunit.client.1.smithi114.stdout:8/597: chown d4/db/d39/d3c/d4e/f93 4 1 2024-09-16T09:45:35.481 INFO:tasks.workunit.client.1.smithi114.stdout:6/675: dwrite d6/da/d10/d40/fb7 [0,4194304] 0 2024-09-16T09:45:35.481 INFO:tasks.workunit.client.1.smithi114.stdout:3/800: dwrite dc/de/d17/d2d/db4/f3c [0,4194304] 0 2024-09-16T09:45:35.481 INFO:tasks.workunit.client.1.smithi114.stdout:6/676: write d6/da/d48/fbd [300018,32550] 0 2024-09-16T09:45:35.481 INFO:tasks.workunit.client.1.smithi114.stdout:3/801: fsync dc/de/d18/d78/f73 0 2024-09-16T09:45:35.481 INFO:tasks.workunit.client.1.smithi114.stdout:8/598: symlink d4/db/d39/d3c/d4e/d62/lcc 0 2024-09-16T09:45:35.481 INFO:tasks.workunit.client.1.smithi114.stdout:1/641: dwrite d4/d2b/d2f/d3a/d9d/d41/d42/f5a [0,4194304] 0 2024-09-16T09:45:35.482 INFO:tasks.workunit.client.1.smithi114.stdout:6/677: mkdir d6/da/db3/dd1 0 2024-09-16T09:45:35.483 INFO:tasks.workunit.client.1.smithi114.stdout:6/678: chown d6/da/d76/l9e 11 1 2024-09-16T09:45:35.483 INFO:tasks.workunit.client.1.smithi114.stdout:8/599: symlink d4/dae/d54/db3/lcd 0 2024-09-16T09:45:35.483 INFO:tasks.workunit.client.1.smithi114.stdout:0/655: dwrite d1f/d27/d55/fd3 [0,4194304] 0 2024-09-16T09:45:35.487 INFO:tasks.workunit.client.1.smithi114.stdout:6/679: rename d6/cd to d6/d2d/d46/dcc/d62/d77/d7b/cd2 0 2024-09-16T09:45:35.487 INFO:tasks.workunit.client.1.smithi114.stdout:6/680: chown d6/d2d/d46/dcc/d62/d77/l80 15470407 1 2024-09-16T09:45:35.493 INFO:tasks.workunit.client.1.smithi114.stdout:5/641: write d3/d24/d84/d7a/d43/d4c/d6d/d9e/fc2 [9854103,37701] 0 2024-09-16T09:45:35.503 INFO:tasks.workunit.client.1.smithi114.stdout:8/600: rename d4/db/d39/d3c/l63 to d4/d1f/db9/lce 0 2024-09-16T09:45:35.503 INFO:tasks.workunit.client.1.smithi114.stdout:8/601: write d4/fc7 [1566756,64745] 0 2024-09-16T09:45:35.503 INFO:tasks.workunit.client.1.smithi114.stdout:7/718: dwrite d2/d9/fc [4194304,4194304] 0 2024-09-16T09:45:35.505 INFO:tasks.workunit.client.1.smithi114.stdout:6/681: mkdir d6/da/dbb/dd3 0 2024-09-16T09:45:35.507 INFO:tasks.workunit.client.1.smithi114.stdout:5/642: mknod d3/d24/d84/d7a/cd6 0 2024-09-16T09:45:35.507 INFO:tasks.workunit.client.1.smithi114.stdout:5/643: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/fb6 [185257,48597] 0 2024-09-16T09:45:35.508 INFO:tasks.workunit.client.1.smithi114.stdout:8/602: symlink d4/db/d68/d28/lcf 0 2024-09-16T09:45:35.508 INFO:tasks.workunit.client.1.smithi114.stdout:8/603: readlink d4/db/d39/d3c/d4e/l8b 0 2024-09-16T09:45:35.508 INFO:tasks.workunit.client.1.smithi114.stdout:5/644: fsync d3/f20 0 2024-09-16T09:45:35.508 INFO:tasks.workunit.client.1.smithi114.stdout:8/604: mknod d4/db/d39/d3c/d4e/cd0 0 2024-09-16T09:45:35.509 INFO:tasks.workunit.client.1.smithi114.stdout:5/645: symlink d3/d24/d84/d7a/d43/d58/da0/ld7 0 2024-09-16T09:45:35.510 INFO:tasks.workunit.client.1.smithi114.stdout:8/605: creat d4/db/fd1 x:0 0 0 2024-09-16T09:45:35.511 INFO:tasks.workunit.client.1.smithi114.stdout:5/646: creat d3/d24/d84/dbc/fd8 x:0 0 0 2024-09-16T09:45:35.517 INFO:tasks.workunit.client.1.smithi114.stdout:3/802: dwrite dc/de/d18/d78/d5c/d5d/f76 [0,4194304] 0 2024-09-16T09:45:35.518 INFO:tasks.workunit.client.1.smithi114.stdout:0/656: dwrite d1f/d20/d48/d75/fcd [0,4194304] 0 2024-09-16T09:45:35.522 INFO:tasks.workunit.client.1.smithi114.stdout:6/682: fsync d6/da/d10/d40/fa6 0 2024-09-16T09:45:35.523 INFO:tasks.workunit.client.1.smithi114.stdout:1/642: dwrite d4/d2b/d16/f84 [0,4194304] 0 2024-09-16T09:45:35.523 INFO:tasks.workunit.client.1.smithi114.stdout:1/643: write d4/d2b/d16/d47/f6e [2001777,8303] 0 2024-09-16T09:45:35.524 INFO:tasks.workunit.client.1.smithi114.stdout:6/683: link d6/d2d/d46/dcc/dad/fae d6/d2d/d46/fd4 0 2024-09-16T09:45:35.526 INFO:tasks.workunit.client.1.smithi114.stdout:1/644: mknod d4/d2b/d2f/cd0 0 2024-09-16T09:45:35.527 INFO:tasks.workunit.client.1.smithi114.stdout:1/645: mknod d4/d2b/d2f/cd1 0 2024-09-16T09:45:35.529 INFO:tasks.workunit.client.1.smithi114.stdout:1/646: creat d4/d2b/d29/da0/db1/fd2 x:0 0 0 2024-09-16T09:45:35.532 INFO:tasks.workunit.client.1.smithi114.stdout:0/657: write d1f/d22/d2e/f5a [8193844,65893] 0 2024-09-16T09:45:35.532 INFO:tasks.workunit.client.1.smithi114.stdout:0/658: write d1f/d27/d47/d56/d7e/fe1 [938697,45836] 0 2024-09-16T09:45:35.537 INFO:tasks.workunit.client.1.smithi114.stdout:7/719: dwrite d2/d9/d2b/d2e/d22/d4c/dbd/ff4 [0,4194304] 0 2024-09-16T09:45:35.538 INFO:tasks.workunit.client.1.smithi114.stdout:9/607: sync 2024-09-16T09:45:35.538 INFO:tasks.workunit.client.1.smithi114.stdout:2/757: sync 2024-09-16T09:45:35.539 INFO:tasks.workunit.client.1.smithi114.stdout:4/652: sync 2024-09-16T09:45:35.540 INFO:tasks.workunit.client.1.smithi114.stdout:7/720: rename d2/d9/d2b/d78/d9f/fd4 to d2/d9/d2b/d78/d99/ddd/dea/ff7 0 2024-09-16T09:45:35.540 INFO:tasks.workunit.client.1.smithi114.stdout:7/721: write d2/d9/d2b/d2e/d22/d27/d4d/fa4 [855114,104082] 0 2024-09-16T09:45:35.542 INFO:tasks.workunit.client.1.smithi114.stdout:8/606: dwrite d4/db/d3e/d71/f87 [0,4194304] 0 2024-09-16T09:45:35.542 INFO:tasks.workunit.client.1.smithi114.stdout:8/607: readlink d4/db/d3e/d71/d78/d8d/l98 0 2024-09-16T09:45:35.542 INFO:tasks.workunit.client.1.smithi114.stdout:8/608: getdents d4/db/d39/d3c/d4e/d82/d72/d59/da0 0 2024-09-16T09:45:35.542 INFO:tasks.workunit.client.1.smithi114.stdout:7/722: symlink d2/lf8 0 2024-09-16T09:45:35.544 INFO:tasks.workunit.client.1.smithi114.stdout:8/609: mknod d4/dae/d9c/cd2 0 2024-09-16T09:45:35.547 INFO:tasks.workunit.client.1.smithi114.stdout:7/723: rename d2/d9/d2b/d2e/d22/d4c to d2/df/df9 0 2024-09-16T09:45:35.547 INFO:tasks.workunit.client.1.smithi114.stdout:7/724: dread - d2/d9/d2b/d59/d7f/fa8 zero size 2024-09-16T09:45:35.547 INFO:tasks.workunit.client.1.smithi114.stdout:7/725: stat d2/d9/d2b/d2e/d22/d66/fc3 0 2024-09-16T09:45:35.549 INFO:tasks.workunit.client.1.smithi114.stdout:8/610: unlink d4/db/d39/d3c/d4e/d82/d72/d59/f69 0 2024-09-16T09:45:35.552 INFO:tasks.workunit.client.1.smithi114.stdout:8/611: rename d4/c1d to d4/db/d39/d3c/cd3 0 2024-09-16T09:45:35.554 INFO:tasks.workunit.client.1.smithi114.stdout:2/758: write d1/d8/d10/f22 [1753924,12834] 0 2024-09-16T09:45:35.554 INFO:tasks.workunit.client.1.smithi114.stdout:8/612: creat d4/db/d3e/d71/d78/d8d/da9/fd4 x:0 0 0 2024-09-16T09:45:35.555 INFO:tasks.workunit.client.1.smithi114.stdout:9/608: write d3/da/f11 [3488293,118611] 0 2024-09-16T09:45:35.557 INFO:tasks.workunit.client.1.smithi114.stdout:2/759: creat d1/d8/d10/d16/d1d/d92/da7/d3e/f119 x:0 0 0 2024-09-16T09:45:35.557 INFO:tasks.workunit.client.1.smithi114.stdout:5/647: dwrite d3/d24/d84/d7a/d43/d4c/d92/f97 [4194304,4194304] 0 2024-09-16T09:45:35.561 INFO:tasks.workunit.client.1.smithi114.stdout:2/760: truncate d1/d8/d10/d16/f27 168884 0 2024-09-16T09:45:35.561 INFO:tasks.workunit.client.1.smithi114.stdout:2/761: fsync d1/d8/d10/f50 0 2024-09-16T09:45:35.562 INFO:tasks.workunit.client.1.smithi114.stdout:1/647: dwrite d4/d2b/d16/d71/f96 [0,4194304] 0 2024-09-16T09:45:35.563 INFO:tasks.workunit.client.1.smithi114.stdout:2/762: symlink d1/d8/d10/d16/d60/db7/deb/d117/l11a 0 2024-09-16T09:45:35.564 INFO:tasks.workunit.client.1.smithi114.stdout:6/684: dwrite d6/da/d36/f4f [0,4194304] 0 2024-09-16T09:45:35.565 INFO:tasks.workunit.client.1.smithi114.stdout:4/653: dwrite d0/d26/d3c/d74/d9c/fbb [0,4194304] 0 2024-09-16T09:45:35.566 INFO:tasks.workunit.client.1.smithi114.stdout:1/648: unlink d4/d2b/d16/d71/d72/d75/c8d 0 2024-09-16T09:45:35.566 INFO:tasks.workunit.client.1.smithi114.stdout:1/649: fdatasync d4/d2b/d29/f5e 0 2024-09-16T09:45:35.567 INFO:tasks.workunit.client.1.smithi114.stdout:6/685: mkdir d6/d2d/d46/dcc/d62/dd5 0 2024-09-16T09:45:35.572 INFO:tasks.workunit.client.1.smithi114.stdout:2/763: unlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/c6a 0 2024-09-16T09:45:35.572 INFO:tasks.workunit.client.1.smithi114.stdout:2/764: write d1/d8/d10/d16/d1d/f1e [314802,83659] 0 2024-09-16T09:45:35.576 INFO:tasks.workunit.client.1.smithi114.stdout:4/654: write d0/d26/f90 [2371309,49825] 0 2024-09-16T09:45:35.576 INFO:tasks.workunit.client.1.smithi114.stdout:4/655: stat d0/d26/d3c/d3e/d4b/d46/db3/fca 0 2024-09-16T09:45:35.579 INFO:tasks.workunit.client.1.smithi114.stdout:7/726: dwrite d2/d9/d2b/d59/d7f/fa8 [0,4194304] 0 2024-09-16T09:45:35.580 INFO:tasks.workunit.client.1.smithi114.stdout:7/727: stat d2/d9/d2b/l3c 0 2024-09-16T09:45:35.580 INFO:tasks.workunit.client.1.smithi114.stdout:7/728: dread - d2/d9/d2b/d59/dca/fdc zero size 2024-09-16T09:45:35.581 INFO:tasks.workunit.client.1.smithi114.stdout:7/729: creat d2/d9/db1/ffa x:0 0 0 2024-09-16T09:45:35.581 INFO:tasks.workunit.client.1.smithi114.stdout:7/730: creat d2/d9/d2b/d2e/d93/ffb x:0 0 0 2024-09-16T09:45:35.582 INFO:tasks.workunit.client.1.smithi114.stdout:7/731: mkdir d2/d9/db1/dfc 0 2024-09-16T09:45:35.584 INFO:tasks.workunit.client.1.smithi114.stdout:1/650: dread d4/d2b/f91 [0,4194304] 0 2024-09-16T09:45:35.589 INFO:tasks.workunit.client.1.smithi114.stdout:2/765: dread d1/fe [0,4194304] 0 2024-09-16T09:45:35.596 INFO:tasks.workunit.client.1.smithi114.stdout:5/648: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f94 [0,4194304] 0 2024-09-16T09:45:35.596 INFO:tasks.workunit.client.1.smithi114.stdout:8/613: dwrite d4/db/d3e/f4f [0,4194304] 0 2024-09-16T09:45:35.596 INFO:tasks.workunit.client.1.smithi114.stdout:9/609: dwrite d3/da/d10/d23/d43/d1e/d4c/d8c/fc7 [0,4194304] 0 2024-09-16T09:45:35.596 INFO:tasks.workunit.client.1.smithi114.stdout:6/686: dwrite d6/da/f2c [0,4194304] 0 2024-09-16T09:45:35.597 INFO:tasks.workunit.client.1.smithi114.stdout:5/649: write d3/f25 [386842,75879] 0 2024-09-16T09:45:35.599 INFO:tasks.workunit.client.1.smithi114.stdout:1/651: dread d4/d2b/d16/f65 [0,4194304] 0 2024-09-16T09:45:35.601 INFO:tasks.workunit.client.1.smithi114.stdout:8/614: mkdir d4/db/d3e/dd5 0 2024-09-16T09:45:35.603 INFO:tasks.workunit.client.1.smithi114.stdout:9/610: mknod d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/db5/ccc 0 2024-09-16T09:45:35.605 INFO:tasks.workunit.client.1.smithi114.stdout:6/687: mkdir d6/da/d48/dd6 0 2024-09-16T09:45:35.606 INFO:tasks.workunit.client.1.smithi114.stdout:7/732: dwrite d2/d9/d2b/d2e/d3e/d79/ff3 [0,4194304] 0 2024-09-16T09:45:35.606 INFO:tasks.workunit.client.1.smithi114.stdout:5/650: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/cd9 0 2024-09-16T09:45:35.608 INFO:tasks.workunit.client.1.smithi114.stdout:9/611: mknod d3/da/d10/d23/d29/d2c/d6b/d68/ccd 0 2024-09-16T09:45:35.610 INFO:tasks.workunit.client.1.smithi114.stdout:6/688: rename d6/c2b to d6/da/d48/db0/cd7 0 2024-09-16T09:45:35.614 INFO:tasks.workunit.client.1.smithi114.stdout:7/733: symlink d2/d9/d2b/d2e/lfd 0 2024-09-16T09:45:35.615 INFO:tasks.workunit.client.1.smithi114.stdout:5/651: mknod d3/d24/d7d/da6/cda 0 2024-09-16T09:45:35.617 INFO:tasks.workunit.client.1.smithi114.stdout:5/652: creat d3/d1f/fdb x:0 0 0 2024-09-16T09:45:35.617 INFO:tasks.workunit.client.1.smithi114.stdout:5/653: fdatasync d3/d24/d84/d7a/d43/d4c/d6d/d9e/fc2 0 2024-09-16T09:45:35.619 INFO:tasks.workunit.client.1.smithi114.stdout:5/654: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc 0 2024-09-16T09:45:35.621 INFO:tasks.workunit.client.1.smithi114.stdout:5/655: unlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f4a 0 2024-09-16T09:45:35.621 INFO:tasks.workunit.client.1.smithi114.stdout:9/612: write d3/da/d10/d23/d29/d2c/d6b/db9/fc8 [706921,79038] 0 2024-09-16T09:45:35.624 INFO:tasks.workunit.client.1.smithi114.stdout:5/656: rename d3/d24/d84/d7a/d43/d58/da0/ld7 to d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/ldd 0 2024-09-16T09:45:35.627 INFO:tasks.workunit.client.1.smithi114.stdout:9/613: rename d3/da/d10/d23/d43/d1e/d4c/d8c/l99 to d3/da/d10/d23/d43/d1e/da0/lce 0 2024-09-16T09:45:35.629 INFO:tasks.workunit.client.1.smithi114.stdout:9/614: unlink d3/da/d10/d23/l48 0 2024-09-16T09:45:35.630 INFO:tasks.workunit.client.1.smithi114.stdout:1/652: dwrite d4/d2b/d16/d47/da7/f63 [0,4194304] 0 2024-09-16T09:45:35.630 INFO:tasks.workunit.client.1.smithi114.stdout:1/653: readlink d4/l11 0 2024-09-16T09:45:35.633 INFO:tasks.workunit.client.1.smithi114.stdout:1/654: mknod d4/d2b/d2f/d3a/db0/cd3 0 2024-09-16T09:45:35.635 INFO:tasks.workunit.client.1.smithi114.stdout:1/655: creat d4/d2b/d16/d71/d72/d75/fd4 x:0 0 0 2024-09-16T09:45:35.636 INFO:tasks.workunit.client.1.smithi114.stdout:1/656: creat d4/d2b/d2f/d3a/fd5 x:0 0 0 2024-09-16T09:45:35.637 INFO:tasks.workunit.client.1.smithi114.stdout:1/657: mknod d4/d2b/d16/d71/d72/d75/db4/dbb/cd6 0 2024-09-16T09:45:35.651 INFO:tasks.workunit.client.1.smithi114.stdout:7/734: dwrite d2/d9/d2b/d2e/f45 [0,4194304] 0 2024-09-16T09:45:35.651 INFO:tasks.workunit.client.1.smithi114.stdout:7/735: write d2/d9/d2b/d2e/d93/ffb [236667,121241] 0 2024-09-16T09:45:35.651 INFO:tasks.workunit.client.1.smithi114.stdout:6/689: dwrite d6/d64/f84 [0,4194304] 0 2024-09-16T09:45:35.651 INFO:tasks.workunit.client.1.smithi114.stdout:6/690: truncate d6/d2d/f9b 26522 0 2024-09-16T09:45:35.652 INFO:tasks.workunit.client.1.smithi114.stdout:7/736: creat d2/d9/d2b/d2e/d3e/ffe x:0 0 0 2024-09-16T09:45:35.653 INFO:tasks.workunit.client.1.smithi114.stdout:8/615: dwrite d4/db/d3e/fc8 [0,4194304] 0 2024-09-16T09:45:35.653 INFO:tasks.workunit.client.1.smithi114.stdout:9/615: dwrite d3/da/d10/d23/d43/f2f [0,4194304] 0 2024-09-16T09:45:35.655 INFO:tasks.workunit.client.1.smithi114.stdout:7/737: rename d2/d9/d2b/d2e/d22/d66/fc3 to d2/d9/d2b/d2e/d22/d27/d64/dc0/fff 0 2024-09-16T09:45:35.655 INFO:tasks.workunit.client.1.smithi114.stdout:7/738: read d2/d9/d2b/d2e/d77/f56 [346932,43878] 0 2024-09-16T09:45:35.655 INFO:tasks.workunit.client.1.smithi114.stdout:1/658: dwrite d4/d2b/d16/d71/d72/fb5 [0,4194304] 0 2024-09-16T09:45:35.655 INFO:tasks.workunit.client.1.smithi114.stdout:7/739: dread d2/d9/d2b/d2e/d22/d66/db0/fc1 [0,4194304] 0 2024-09-16T09:45:35.657 INFO:tasks.workunit.client.1.smithi114.stdout:8/616: creat d4/db/d39/d3c/d86/fd6 x:0 0 0 2024-09-16T09:45:35.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/657: dwrite d3/f5 [0,4194304] 0 2024-09-16T09:45:35.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/658: truncate d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fa9 705283 0 2024-09-16T09:45:35.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/659: write d3/d24/d84/d7a/d43/f47 [4782627,60953] 0 2024-09-16T09:45:35.657 INFO:tasks.workunit.client.1.smithi114.stdout:8/617: write d4/db/d3e/f97 [476663,16790] 0 2024-09-16T09:45:35.658 INFO:tasks.workunit.client.1.smithi114.stdout:1/659: rename d4/d2b/d16/d47/dc8 to d4/d2b/d16/d47/da7/dd7 0 2024-09-16T09:45:35.659 INFO:tasks.workunit.client.1.smithi114.stdout:8/618: unlink d4/db/d3e/d71/d78/d7a/f9f 0 2024-09-16T09:45:35.661 INFO:tasks.workunit.client.1.smithi114.stdout:7/740: dread d2/d9/d2b/d2e/d22/f49 [0,4194304] 0 2024-09-16T09:45:35.662 INFO:tasks.workunit.client.1.smithi114.stdout:1/660: truncate d4/d2b/f91 1916120 0 2024-09-16T09:45:35.664 INFO:tasks.workunit.client.1.smithi114.stdout:8/619: rename d4/dae/d54/db3/lcd to d4/dc3/ld7 0 2024-09-16T09:45:35.667 INFO:tasks.workunit.client.1.smithi114.stdout:6/691: write d6/d64/f91 [3126247,2720] 0 2024-09-16T09:45:35.671 INFO:tasks.workunit.client.1.smithi114.stdout:9/616: write d3/da/d10/f21 [1673497,84027] 0 2024-09-16T09:45:35.675 INFO:tasks.workunit.client.1.smithi114.stdout:7/741: mknod d2/d9/d2b/d2e/d22/d66/db0/c100 0 2024-09-16T09:45:35.675 INFO:tasks.workunit.client.1.smithi114.stdout:1/661: unlink d4/d2b/d2f/d3a/d9d/d41/d42/f4a 0 2024-09-16T09:45:35.675 INFO:tasks.workunit.client.1.smithi114.stdout:5/660: dread d3/d24/d84/d7a/d43/f47 [0,4194304] 0 2024-09-16T09:45:35.675 INFO:tasks.workunit.client.1.smithi114.stdout:8/620: mknod d4/db/d39/d3c/d4e/d82/d72/cd8 0 2024-09-16T09:45:35.675 INFO:tasks.workunit.client.1.smithi114.stdout:5/661: truncate d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f9c 688943 0 2024-09-16T09:45:35.677 INFO:tasks.workunit.client.1.smithi114.stdout:9/617: creat d3/da/d10/d23/d43/d1e/d25/d88/fcf x:0 0 0 2024-09-16T09:45:35.680 INFO:tasks.workunit.client.1.smithi114.stdout:1/662: mknod d4/d2b/d2f/d3a/dc5/cd8 0 2024-09-16T09:45:35.680 INFO:tasks.workunit.client.1.smithi114.stdout:1/663: readlink d4/d2b/d16/d71/lcb 0 2024-09-16T09:45:35.680 INFO:tasks.workunit.client.1.smithi114.stdout:7/742: creat d2/d9/d2b/f101 x:0 0 0 2024-09-16T09:45:35.681 INFO:tasks.workunit.client.1.smithi114.stdout:7/743: fdatasync d2/d9/d2b/d78/d99/ddd/fe4 0 2024-09-16T09:45:35.681 INFO:tasks.workunit.client.1.smithi114.stdout:5/662: write d3/d24/d84/f2a [5263459,83251] 0 2024-09-16T09:45:35.681 INFO:tasks.workunit.client.1.smithi114.stdout:5/663: stat d3/d24/d84/d7a/d43/d4c/d6d/d9e/fc2 0 2024-09-16T09:45:35.681 INFO:tasks.workunit.client.1.smithi114.stdout:6/692: dwrite d6/da/d76/f8a [0,4194304] 0 2024-09-16T09:45:35.682 INFO:tasks.workunit.client.1.smithi114.stdout:8/621: link d4/db/d68/d28/f89 d4/db/d68/d28/fd9 0 2024-09-16T09:45:35.683 INFO:tasks.workunit.client.1.smithi114.stdout:9/618: rename d3/da/d10/d23/d29/c69 to d3/da/d10/d23/d29/d2c/d6b/d9d/cd0 0 2024-09-16T09:45:35.685 INFO:tasks.workunit.client.1.smithi114.stdout:1/664: creat d4/d2b/fd9 x:0 0 0 2024-09-16T09:45:35.685 INFO:tasks.workunit.client.1.smithi114.stdout:1/665: stat d4/d2b/d16/c2a 0 2024-09-16T09:45:35.686 INFO:tasks.workunit.client.1.smithi114.stdout:7/744: mkdir d2/d9/d2b/d2e/d3e/d79/d102 0 2024-09-16T09:45:35.686 INFO:tasks.workunit.client.1.smithi114.stdout:7/745: chown d2/d9/d2b/d78/d99/ddd 2213 1 2024-09-16T09:45:35.691 INFO:tasks.workunit.client.1.smithi114.stdout:6/693: creat d6/da/dbb/fd8 x:0 0 0 2024-09-16T09:45:35.691 INFO:tasks.workunit.client.1.smithi114.stdout:5/664: dread d3/d24/d84/d7a/d43/d4c/f54 [0,4194304] 0 2024-09-16T09:45:35.691 INFO:tasks.workunit.client.1.smithi114.stdout:5/665: truncate d3/d24/d7d/f99 351727 0 2024-09-16T09:45:35.695 INFO:tasks.workunit.client.1.smithi114.stdout:1/666: link d4/d2b/d29/f5e d4/d2b/d2f/d3a/dc5/fda 0 2024-09-16T09:45:35.697 INFO:tasks.workunit.client.1.smithi114.stdout:6/694: rmdir d6/d2d/d46/dce 0 2024-09-16T09:45:35.697 INFO:tasks.workunit.client.1.smithi114.stdout:6/695: chown d6/f7 4094348 1 2024-09-16T09:45:35.697 INFO:tasks.workunit.client.1.smithi114.stdout:6/696: chown d6/da/d10/d92/fc0 796809 1 2024-09-16T09:45:35.698 INFO:tasks.workunit.client.1.smithi114.stdout:7/746: dread d2/df/df9/f9e [0,4194304] 0 2024-09-16T09:45:35.698 INFO:tasks.workunit.client.1.smithi114.stdout:7/747: readlink d2/d9/d2b/l7d 0 2024-09-16T09:45:35.699 INFO:tasks.workunit.client.1.smithi114.stdout:5/666: creat d3/d24/d84/d7a/d43/d4c/d92/fde x:0 0 0 2024-09-16T09:45:35.699 INFO:tasks.workunit.client.1.smithi114.stdout:5/667: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/ldd 0 2024-09-16T09:45:35.699 INFO:tasks.workunit.client.1.smithi114.stdout:5/668: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/l65 0 2024-09-16T09:45:35.701 INFO:tasks.workunit.client.1.smithi114.stdout:5/669: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/ldf 0 2024-09-16T09:45:35.702 INFO:tasks.workunit.client.1.smithi114.stdout:9/619: dwrite d3/da/d10/d23/d29/d2c/d6b/d68/d81/fae [0,4194304] 0 2024-09-16T09:45:35.702 INFO:tasks.workunit.client.1.smithi114.stdout:9/620: read - d3/da/d10/d23/d29/d2c/d45/fca zero size 2024-09-16T09:45:35.703 INFO:tasks.workunit.client.1.smithi114.stdout:3/803: sync 2024-09-16T09:45:35.705 INFO:tasks.workunit.client.1.smithi114.stdout:5/670: rename d3/le to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/le0 0 2024-09-16T09:45:35.713 INFO:tasks.workunit.client.1.smithi114.stdout:9/621: truncate d3/da/d10/d23/d43/d1e/d78/fcb 381118 0 2024-09-16T09:45:35.713 INFO:tasks.workunit.client.1.smithi114.stdout:9/622: readlink d3/da/d10/d23/d29/d2c/d70/lba 0 2024-09-16T09:45:35.714 INFO:tasks.workunit.client.1.smithi114.stdout:3/804: truncate dc/de/d17/f1d 139447 0 2024-09-16T09:45:35.715 INFO:tasks.workunit.client.1.smithi114.stdout:5/671: rename d3/d24/d84/d7a/d43/d58/da0/faa to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fe1 0 2024-09-16T09:45:35.722 INFO:tasks.workunit.client.1.smithi114.stdout:8/622: dwrite d4/dae/f9b [0,4194304] 0 2024-09-16T09:45:35.726 INFO:tasks.workunit.client.1.smithi114.stdout:1/667: dwrite d4/d2b/f3c [0,4194304] 0 2024-09-16T09:45:35.729 INFO:tasks.workunit.client.1.smithi114.stdout:0/659: sync 2024-09-16T09:45:35.729 INFO:tasks.workunit.client.1.smithi114.stdout:0/660: fdatasync d1f/d27/db9/fe3 0 2024-09-16T09:45:35.730 INFO:tasks.workunit.client.1.smithi114.stdout:6/697: dwrite d6/d64/fc6 [0,4194304] 0 2024-09-16T09:45:35.730 INFO:tasks.workunit.client.1.smithi114.stdout:6/698: dread - d6/da/d36/fa4 zero size 2024-09-16T09:45:35.733 INFO:tasks.workunit.client.1.smithi114.stdout:0/661: rename d1f/d27/de6/ff0 to d1f/d22/d2e/d46/d7f/d8d/ff3 0 2024-09-16T09:45:35.736 INFO:tasks.workunit.client.1.smithi114.stdout:6/699: symlink d6/da/d10/d40/ld9 0 2024-09-16T09:45:35.736 INFO:tasks.workunit.client.1.smithi114.stdout:6/700: chown d6/d64 264 1 2024-09-16T09:45:35.736 INFO:tasks.workunit.client.1.smithi114.stdout:6/701: truncate d6/da/d10/d40/d82/fca 682246 0 2024-09-16T09:45:35.736 INFO:tasks.workunit.client.1.smithi114.stdout:6/702: chown d6/da/c5b 520559 1 2024-09-16T09:45:35.737 INFO:tasks.workunit.client.1.smithi114.stdout:0/662: rename d1f/d20/dea to d1f/d22/d2e/d46/d7f/df4 0 2024-09-16T09:45:35.737 INFO:tasks.workunit.client.1.smithi114.stdout:0/663: chown d1f 11 1 2024-09-16T09:45:35.738 INFO:tasks.workunit.client.1.smithi114.stdout:0/664: write d1f/d20/d48/f78 [747214,69223] 0 2024-09-16T09:45:35.738 INFO:tasks.workunit.client.1.smithi114.stdout:6/703: creat d6/da/d10/d40/d82/fda x:0 0 0 2024-09-16T09:45:35.739 INFO:tasks.workunit.client.1.smithi114.stdout:0/665: mkdir d1f/ddf/df5 0 2024-09-16T09:45:35.740 INFO:tasks.workunit.client.1.smithi114.stdout:0/666: symlink d1f/d27/d47/d56/lf6 0 2024-09-16T09:45:35.754 INFO:tasks.workunit.client.1.smithi114.stdout:0/667: dread d1f/d27/f3b [0,4194304] 0 2024-09-16T09:45:35.754 INFO:tasks.workunit.client.1.smithi114.stdout:9/623: dwrite d3/da/d10/f21 [4194304,4194304] 0 2024-09-16T09:45:35.755 INFO:tasks.workunit.client.1.smithi114.stdout:0/668: mknod d1f/ddf/cf7 0 2024-09-16T09:45:35.755 INFO:tasks.workunit.client.1.smithi114.stdout:0/669: read d1f/d22/d2e/d46/d7f/d8d/fc5 [3243634,63427] 0 2024-09-16T09:45:35.755 INFO:tasks.workunit.client.1.smithi114.stdout:0/670: truncate d1f/d20/f51 109344 0 2024-09-16T09:45:35.755 INFO:tasks.workunit.client.1.smithi114.stdout:9/624: mkdir d3/da/d10/d23/d29/dd1 0 2024-09-16T09:45:35.756 INFO:tasks.workunit.client.1.smithi114.stdout:0/671: mknod d1f/d22/cf8 0 2024-09-16T09:45:35.756 INFO:tasks.workunit.client.1.smithi114.stdout:0/672: dread - d1f/d22/faa zero size 2024-09-16T09:45:35.756 INFO:tasks.workunit.client.1.smithi114.stdout:0/673: fsync d1f/d20/d48/fb8 0 2024-09-16T09:45:35.756 INFO:tasks.workunit.client.1.smithi114.stdout:0/674: write f16 [2237955,18114] 0 2024-09-16T09:45:35.756 INFO:tasks.workunit.client.1.smithi114.stdout:0/675: chown c13 11 1 2024-09-16T09:45:35.757 INFO:tasks.workunit.client.1.smithi114.stdout:9/625: unlink d3/da/d10/d23/d29/d2c/l58 0 2024-09-16T09:45:35.758 INFO:tasks.workunit.client.1.smithi114.stdout:9/626: truncate d3/da/d10/d23/d29/d2c/d45/f65 1177869 0 2024-09-16T09:45:35.764 INFO:tasks.workunit.client.1.smithi114.stdout:5/672: dwrite d3/d24/d84/d7a/d43/d4c/f54 [0,4194304] 0 2024-09-16T09:45:35.764 INFO:tasks.workunit.client.1.smithi114.stdout:8/623: dwrite d4/db/d68/d28/f67 [0,4194304] 0 2024-09-16T09:45:35.765 INFO:tasks.workunit.client.1.smithi114.stdout:8/624: read - d4/db/d68/d28/dac/fb8 zero size 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:6/704: dwrite d6/da/d10/d40/d82/fca [0,4194304] 0 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:1/668: dwrite d4/d2b/d2f/d3a/f40 [0,4194304] 0 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:1/669: write d4/d2b/d2f/d3a/d9d/f6b [133174,42636] 0 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:5/673: rmdir d3/d24/d7d/d96 39 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:3/805: dwrite dc/de/d18/d78/d5c/d6e/dc1/fc3 [4194304,4194304] 0 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:5/674: dread - d3/f18 zero size 2024-09-16T09:45:35.766 INFO:tasks.workunit.client.1.smithi114.stdout:3/806: read - dc/de/d18/d78/d5c/fe3 zero size 2024-09-16T09:45:35.767 INFO:tasks.workunit.client.1.smithi114.stdout:0/676: dread d1f/f74 [0,4194304] 0 2024-09-16T09:45:35.767 INFO:tasks.workunit.client.1.smithi114.stdout:0/677: dread - d1f/d22/d2e/d46/d7f/d8d/dbb/fda zero size 2024-09-16T09:45:35.771 INFO:tasks.workunit.client.1.smithi114.stdout:1/670: symlink d4/d2b/d29/da0/ldb 0 2024-09-16T09:45:35.778 INFO:tasks.workunit.client.1.smithi114.stdout:9/627: dwrite d3/da/d10/d23/d43/f16 [0,4194304] 0 2024-09-16T09:45:35.780 INFO:tasks.workunit.client.1.smithi114.stdout:6/705: dread d6/da/d10/d40/f43 [0,4194304] 0 2024-09-16T09:45:35.781 INFO:tasks.workunit.client.1.smithi114.stdout:5/675: link d3/d24/d84/d7a/d43/d58/ca7 d3/d1f/d8c/ce2 0 2024-09-16T09:45:35.781 INFO:tasks.workunit.client.1.smithi114.stdout:5/676: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1 36 1 2024-09-16T09:45:35.782 INFO:tasks.workunit.client.1.smithi114.stdout:5/677: stat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/l3c 0 2024-09-16T09:45:35.782 INFO:tasks.workunit.client.1.smithi114.stdout:5/678: chown d3/d24/d84/d7a/d43/d4c/d92/d78/c89 16324503 1 2024-09-16T09:45:35.782 INFO:tasks.workunit.client.1.smithi114.stdout:5/679: stat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fe1 0 2024-09-16T09:45:35.782 INFO:tasks.workunit.client.1.smithi114.stdout:5/680: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/lcb 16 1 2024-09-16T09:45:35.782 INFO:tasks.workunit.client.1.smithi114.stdout:5/681: chown d3/d1f/c62 100949747 1 2024-09-16T09:45:35.783 INFO:tasks.workunit.client.1.smithi114.stdout:3/807: unlink dc/de/d18/f28 0 2024-09-16T09:45:35.785 INFO:tasks.workunit.client.1.smithi114.stdout:9/628: creat d3/da/d10/d23/d29/d2c/d6b/fd2 x:0 0 0 2024-09-16T09:45:35.785 INFO:tasks.workunit.client.1.smithi114.stdout:9/629: rename d3/da/d10/d23/d43/d1e to d3/da/d10/d23/d43/d1e/d78/db2/dd3 22 2024-09-16T09:45:35.785 INFO:tasks.workunit.client.1.smithi114.stdout:9/630: write d3/da/d10/f26 [902960,19715] 0 2024-09-16T09:45:35.786 INFO:tasks.workunit.client.1.smithi114.stdout:6/706: creat d6/fdb x:0 0 0 2024-09-16T09:45:35.786 INFO:tasks.workunit.client.1.smithi114.stdout:6/707: fdatasync d6/da/d10/d40/d82/f8d 0 2024-09-16T09:45:35.786 INFO:tasks.workunit.client.1.smithi114.stdout:3/808: creat dc/de/d18/d78/f119 x:0 0 0 2024-09-16T09:45:35.788 INFO:tasks.workunit.client.1.smithi114.stdout:6/708: symlink d6/da/d48/ldc 0 2024-09-16T09:45:35.790 INFO:tasks.workunit.client.1.smithi114.stdout:9/631: rename d3/da/d10/d23/d29/d2c/fa2 to d3/da/d10/d23/d43/d1e/d4c/d8c/fd4 0 2024-09-16T09:45:35.791 INFO:tasks.workunit.client.1.smithi114.stdout:9/632: chown d3/da/d10/d23/d29/d2c/d6b/fc1 101 1 2024-09-16T09:45:35.791 INFO:tasks.workunit.client.1.smithi114.stdout:9/633: fdatasync d3/da/d10/d23/d29/d2c/d70/f7c 0 2024-09-16T09:45:35.791 INFO:tasks.workunit.client.1.smithi114.stdout:9/634: stat d3/da/d10/d23 0 2024-09-16T09:45:35.791 INFO:tasks.workunit.client.1.smithi114.stdout:6/709: mknod d6/da/d10/d92/cdd 0 2024-09-16T09:45:35.792 INFO:tasks.workunit.client.1.smithi114.stdout:6/710: symlink d6/da/d10/d40/lde 0 2024-09-16T09:45:35.793 INFO:tasks.workunit.client.1.smithi114.stdout:0/678: dwrite d1f/d2d/d7a/ddd/ff1 [8388608,4194304] 0 2024-09-16T09:45:35.793 INFO:tasks.workunit.client.1.smithi114.stdout:6/711: rename d6/da/f15 to d6/da/dbb/fdf 0 2024-09-16T09:45:35.794 INFO:tasks.workunit.client.1.smithi114.stdout:0/679: rmdir d1f 39 2024-09-16T09:45:35.796 INFO:tasks.workunit.client.1.smithi114.stdout:1/671: dwrite d4/f6f [0,4194304] 0 2024-09-16T09:45:35.797 INFO:tasks.workunit.client.1.smithi114.stdout:5/682: dwrite d3/f20 [4194304,4194304] 0 2024-09-16T09:45:35.798 INFO:tasks.workunit.client.1.smithi114.stdout:1/672: mkdir d4/d2b/d16/d71/d81/ddc 0 2024-09-16T09:45:35.799 INFO:tasks.workunit.client.1.smithi114.stdout:1/673: write d4/d2b/d2f/d3a/d56/fa6 [612019,122282] 0 2024-09-16T09:45:35.799 INFO:tasks.workunit.client.1.smithi114.stdout:1/674: fsync d4/d2b/d2f/d3a/fab 0 2024-09-16T09:45:35.799 INFO:tasks.workunit.client.1.smithi114.stdout:1/675: readlink d4/l80 0 2024-09-16T09:45:35.799 INFO:tasks.workunit.client.1.smithi114.stdout:1/676: write d4/d2b/d2f/d3a/d56/fa6 [158019,35804] 0 2024-09-16T09:45:35.799 INFO:tasks.workunit.client.1.smithi114.stdout:1/677: fsync d4/d2b/d2f/fad 0 2024-09-16T09:45:35.800 INFO:tasks.workunit.client.1.smithi114.stdout:3/809: write dc/d38/d3f/f9f [1841330,113016] 0 2024-09-16T09:45:35.800 INFO:tasks.workunit.client.1.smithi114.stdout:3/810: chown dc/de/d18/d78/d8d/fff 3333 1 2024-09-16T09:45:35.800 INFO:tasks.workunit.client.1.smithi114.stdout:1/678: rmdir d4/d2b/d16/d47/da7 39 2024-09-16T09:45:35.800 INFO:tasks.workunit.client.1.smithi114.stdout:1/679: creat d4/d2b/d2f/d3a/fdd x:0 0 0 2024-09-16T09:45:35.801 INFO:tasks.workunit.client.1.smithi114.stdout:1/680: symlink d4/d2b/d16/d47/da7/dd7/lde 0 2024-09-16T09:45:35.802 INFO:tasks.workunit.client.1.smithi114.stdout:1/681: chown d4/d2b/d16/f9a 6 1 2024-09-16T09:45:35.802 INFO:tasks.workunit.client.1.smithi114.stdout:1/682: rmdir d4/d2b/d16/d71/d72/d75 39 2024-09-16T09:45:35.802 INFO:tasks.workunit.client.1.smithi114.stdout:1/683: chown d4/d2b/d2f/d3a/dc5/cd8 29838 1 2024-09-16T09:45:35.804 INFO:tasks.workunit.client.1.smithi114.stdout:2/766: sync 2024-09-16T09:45:35.805 INFO:tasks.workunit.client.1.smithi114.stdout:4/656: sync 2024-09-16T09:45:35.805 INFO:tasks.workunit.client.1.smithi114.stdout:2/767: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f 39 2024-09-16T09:45:35.807 INFO:tasks.workunit.client.1.smithi114.stdout:4/657: creat d0/d26/d3c/d3e/d4b/fe4 x:0 0 0 2024-09-16T09:45:35.809 INFO:tasks.workunit.client.1.smithi114.stdout:4/658: mknod d0/d26/d2e/ce5 0 2024-09-16T09:45:35.809 INFO:tasks.workunit.client.1.smithi114.stdout:6/712: fsync d6/fdb 0 2024-09-16T09:45:35.810 INFO:tasks.workunit.client.1.smithi114.stdout:4/659: rename d0/d13/d56/d7e/cb5 to d0/d26/d2e/dc0/ce6 0 2024-09-16T09:45:35.811 INFO:tasks.workunit.client.1.smithi114.stdout:4/660: symlink d0/d13/d56/d7e/le7 0 2024-09-16T09:45:35.811 INFO:tasks.workunit.client.1.smithi114.stdout:4/661: write d0/d26/f48 [1659970,131002] 0 2024-09-16T09:45:35.813 INFO:tasks.workunit.client.1.smithi114.stdout:4/662: creat d0/d26/d40/d75/fe8 x:0 0 0 2024-09-16T09:45:35.814 INFO:tasks.workunit.client.1.smithi114.stdout:4/663: mkdir d0/d26/d29/de9 0 2024-09-16T09:45:35.815 INFO:tasks.workunit.client.1.smithi114.stdout:4/664: creat d0/d26/d3c/d74/fea x:0 0 0 2024-09-16T09:45:35.816 INFO:tasks.workunit.client.1.smithi114.stdout:4/665: mknod d0/d26/d3c/d74/ceb 0 2024-09-16T09:45:35.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/713: read d6/d64/f65 [1207992,98259] 0 2024-09-16T09:45:35.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/714: fdatasync d6/da/d10/d92/fc0 0 2024-09-16T09:45:35.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/715: dread - d6/da/d10/d40/d82/fd0 zero size 2024-09-16T09:45:35.824 INFO:tasks.workunit.client.1.smithi114.stdout:1/684: dwrite d4/d2b/d16/d47/f95 [0,4194304] 0 2024-09-16T09:45:35.826 INFO:tasks.workunit.client.1.smithi114.stdout:6/716: link d6/f7 d6/da/d10/fe0 0 2024-09-16T09:45:35.826 INFO:tasks.workunit.client.1.smithi114.stdout:6/717: read - d6/d2d/d46/dcc/d62/d77/fac zero size 2024-09-16T09:45:35.826 INFO:tasks.workunit.client.1.smithi114.stdout:6/718: dread - d6/da/d10/f56 zero size 2024-09-16T09:45:35.827 INFO:tasks.workunit.client.1.smithi114.stdout:1/685: dread d4/d2b/d29/f5e [0,4194304] 0 2024-09-16T09:45:35.827 INFO:tasks.workunit.client.1.smithi114.stdout:1/686: fdatasync d4/d2b/d16/d47/f95 0 2024-09-16T09:45:35.827 INFO:tasks.workunit.client.1.smithi114.stdout:6/719: dread d6/da/f45 [0,4194304] 0 2024-09-16T09:45:35.828 INFO:tasks.workunit.client.1.smithi114.stdout:1/687: rename d4/d2b/d2f/d3a/dc5/fda to d4/d2b/d2f/d3a/fdf 0 2024-09-16T09:45:35.828 INFO:tasks.workunit.client.1.smithi114.stdout:1/688: write d4/d2b/d2f/d3a/d9d/f67 [129240,114110] 0 2024-09-16T09:45:35.828 INFO:tasks.workunit.client.1.smithi114.stdout:1/689: write d4/d2b/d2f/fad [531887,42974] 0 2024-09-16T09:45:35.829 INFO:tasks.workunit.client.1.smithi114.stdout:1/690: mknod d4/d2b/d16/d47/da7/dd7/ce0 0 2024-09-16T09:45:35.830 INFO:tasks.workunit.client.1.smithi114.stdout:1/691: creat d4/d2b/d2f/d3a/dc5/fe1 x:0 0 0 2024-09-16T09:45:35.831 INFO:tasks.workunit.client.1.smithi114.stdout:1/692: creat d4/d2b/d2f/d3a/fe2 x:0 0 0 2024-09-16T09:45:35.831 INFO:tasks.workunit.client.1.smithi114.stdout:1/693: fdatasync d4/d2b/f90 0 2024-09-16T09:45:35.833 INFO:tasks.workunit.client.1.smithi114.stdout:1/694: rename d4/f4e to d4/d2b/d16/d71/d81/fe3 0 2024-09-16T09:45:35.833 INFO:tasks.workunit.client.1.smithi114.stdout:1/695: write d4/d2b/d16/f1b [851008,41603] 0 2024-09-16T09:45:35.833 INFO:tasks.workunit.client.1.smithi114.stdout:1/696: chown d4/d2b/d29/da0/db1/fbc 0 1 2024-09-16T09:45:35.834 INFO:tasks.workunit.client.1.smithi114.stdout:4/666: dwrite d0/d26/d3c/d3e/d4b/d46/db3/fca [0,4194304] 0 2024-09-16T09:45:35.838 INFO:tasks.workunit.client.1.smithi114.stdout:4/667: mkdir d0/d13/d56/d7e/dec 0 2024-09-16T09:45:35.839 INFO:tasks.workunit.client.1.smithi114.stdout:4/668: rename d0/d26/d3c/d45/f50 to d0/d13/fed 0 2024-09-16T09:45:35.843 INFO:tasks.workunit.client.1.smithi114.stdout:1/697: dread d4/d2b/d16/d47/f95 [0,4194304] 0 2024-09-16T09:45:35.844 INFO:tasks.workunit.client.1.smithi114.stdout:1/698: getdents d4/d2b 0 2024-09-16T09:45:35.844 INFO:tasks.workunit.client.1.smithi114.stdout:1/699: write d4/d2b/d16/d47/f93 [54525,124020] 0 2024-09-16T09:45:35.845 INFO:tasks.workunit.client.1.smithi114.stdout:1/700: rename d4/d2b/d16/lac to d4/le4 0 2024-09-16T09:45:35.846 INFO:tasks.workunit.client.1.smithi114.stdout:1/701: mkdir d4/d2b/d16/d71/de5 0 2024-09-16T09:45:35.848 INFO:tasks.workunit.client.1.smithi114.stdout:1/702: mkdir d4/d2b/d16/d71/de5/de6 0 2024-09-16T09:45:35.848 INFO:tasks.workunit.client.1.smithi114.stdout:4/669: dread d0/d13/d25/f9b [0,4194304] 0 2024-09-16T09:45:35.848 INFO:tasks.workunit.client.1.smithi114.stdout:6/720: dwrite d6/da/d76/fcf [0,4194304] 0 2024-09-16T09:45:35.848 INFO:tasks.workunit.client.1.smithi114.stdout:1/703: mknod d4/d2b/d2f/d3a/ce7 0 2024-09-16T09:45:35.851 INFO:tasks.workunit.client.1.smithi114.stdout:4/670: mknod d0/d26/d29/d9f/da0/cee 0 2024-09-16T09:45:35.852 INFO:tasks.workunit.client.1.smithi114.stdout:4/671: rename d0/d26/d29/d2b/ld1 to d0/d26/d29/dbe/lef 0 2024-09-16T09:45:35.852 INFO:tasks.workunit.client.1.smithi114.stdout:4/672: dread - d0/d26/d3c/d3e/d4b/d46/db3/fa8 zero size 2024-09-16T09:45:35.853 INFO:tasks.workunit.client.1.smithi114.stdout:4/673: write d0/d26/d40/d75/fe8 [229047,116318] 0 2024-09-16T09:45:35.856 INFO:tasks.workunit.client.1.smithi114.stdout:6/721: dread d6/da/d10/d40/d82/f8d [0,4194304] 0 2024-09-16T09:45:35.856 INFO:tasks.workunit.client.1.smithi114.stdout:6/722: chown d6/da/d10/f25 1029733 1 2024-09-16T09:45:35.860 INFO:tasks.workunit.client.1.smithi114.stdout:1/704: dread d4/d2b/d29/f49 [0,4194304] 0 2024-09-16T09:45:35.861 INFO:tasks.workunit.client.1.smithi114.stdout:4/674: creat d0/d13/d25/ff0 x:0 0 0 2024-09-16T09:45:35.862 INFO:tasks.workunit.client.1.smithi114.stdout:6/723: rename d6/da/d76/l9e to d6/da/d48/dd6/le1 0 2024-09-16T09:45:35.862 INFO:tasks.workunit.client.1.smithi114.stdout:1/705: creat d4/d2b/d16/d71/d72/d75/fe8 x:0 0 0 2024-09-16T09:45:35.864 INFO:tasks.workunit.client.1.smithi114.stdout:4/675: mkdir d0/d26/df1 0 2024-09-16T09:45:35.865 INFO:tasks.workunit.client.1.smithi114.stdout:6/724: truncate d6/d2d/d46/f83 394801 0 2024-09-16T09:45:35.866 INFO:tasks.workunit.client.1.smithi114.stdout:1/706: creat d4/d2b/d2f/d3a/dc5/fe9 x:0 0 0 2024-09-16T09:45:35.867 INFO:tasks.workunit.client.1.smithi114.stdout:4/676: mknod d0/d26/d3c/d3e/d4b/d46/db3/db8/cf2 0 2024-09-16T09:45:35.867 INFO:tasks.workunit.client.1.smithi114.stdout:4/677: write d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 [56347,51515] 0 2024-09-16T09:45:35.868 INFO:tasks.workunit.client.1.smithi114.stdout:4/678: mkdir d0/d26/d3c/d3e/d4b/d46/df3 0 2024-09-16T09:45:35.869 INFO:tasks.workunit.client.1.smithi114.stdout:4/679: read d0/d26/d2e/f62 [995794,66131] 0 2024-09-16T09:45:35.869 INFO:tasks.workunit.client.1.smithi114.stdout:4/680: read - d0/d26/d3c/d3e/d4b/fe4 zero size 2024-09-16T09:45:35.869 INFO:tasks.workunit.client.1.smithi114.stdout:4/681: fdatasync d0/d26/d29/dbe/fce 0 2024-09-16T09:45:35.872 INFO:tasks.workunit.client.1.smithi114.stdout:7/748: sync 2024-09-16T09:45:35.874 INFO:tasks.workunit.client.1.smithi114.stdout:7/749: mknod d2/d9/d2b/d78/d99/ddd/def/c103 0 2024-09-16T09:45:35.877 INFO:tasks.workunit.client.1.smithi114.stdout:1/707: write d4/d2b/d16/f84 [315262,121130] 0 2024-09-16T09:45:35.877 INFO:tasks.workunit.client.1.smithi114.stdout:1/708: chown d4/d2b/d29/l3b 0 1 2024-09-16T09:45:35.877 INFO:tasks.workunit.client.1.smithi114.stdout:6/725: write d6/da/d10/f16 [332679,44136] 0 2024-09-16T09:45:35.878 INFO:tasks.workunit.client.1.smithi114.stdout:1/709: getdents d4 0 2024-09-16T09:45:35.878 INFO:tasks.workunit.client.1.smithi114.stdout:4/682: dread d0/d26/d3c/f2d [0,4194304] 0 2024-09-16T09:45:35.879 INFO:tasks.workunit.client.1.smithi114.stdout:4/683: dread - d0/d26/d29/d2b/d58/f8a zero size 2024-09-16T09:45:35.879 INFO:tasks.workunit.client.1.smithi114.stdout:4/684: write d0/f64 [263645,122349] 0 2024-09-16T09:45:35.889 INFO:tasks.workunit.client.1.smithi114.stdout:6/726: dread d6/d2d/d46/f52 [0,4194304] 0 2024-09-16T09:45:35.890 INFO:tasks.workunit.client.1.smithi114.stdout:7/750: dwrite d2/df/df9/f69 [0,4194304] 0 2024-09-16T09:45:35.890 INFO:tasks.workunit.client.1.smithi114.stdout:6/727: link d6/c66 d6/da/ce2 0 2024-09-16T09:45:35.900 INFO:tasks.workunit.client.1.smithi114.stdout:7/751: dread d2/d9/d2b/d2e/d22/d27/f40 [4194304,4194304] 0 2024-09-16T09:45:35.907 INFO:tasks.workunit.client.1.smithi114.stdout:6/728: dwrite d6/f23 [0,4194304] 0 2024-09-16T09:45:35.909 INFO:tasks.workunit.client.1.smithi114.stdout:6/729: mknod d6/d2d/d46/d9c/ce3 0 2024-09-16T09:45:35.910 INFO:tasks.workunit.client.1.smithi114.stdout:8/625: sync 2024-09-16T09:45:35.910 INFO:tasks.workunit.client.1.smithi114.stdout:8/626: write d4/db/d39/f8f [284750,67527] 0 2024-09-16T09:45:35.911 INFO:tasks.workunit.client.1.smithi114.stdout:8/627: mknod d4/d1f/cda 0 2024-09-16T09:45:35.911 INFO:tasks.workunit.client.1.smithi114.stdout:8/628: read d4/db/d68/d28/f77 [2282450,129125] 0 2024-09-16T09:45:35.911 INFO:tasks.workunit.client.1.smithi114.stdout:8/629: unlink d4/dae/c61 0 2024-09-16T09:45:35.912 INFO:tasks.workunit.client.1.smithi114.stdout:8/630: dread - d4/db/dd/fba zero size 2024-09-16T09:45:35.912 INFO:tasks.workunit.client.1.smithi114.stdout:8/631: readlink d4/l37 0 2024-09-16T09:45:35.912 INFO:tasks.workunit.client.1.smithi114.stdout:7/752: dread d2/df/df9/f69 [0,4194304] 0 2024-09-16T09:45:35.912 INFO:tasks.workunit.client.1.smithi114.stdout:8/632: mkdir d4/db/d3e/d71/d78/d8d/ddb 0 2024-09-16T09:45:35.913 INFO:tasks.workunit.client.1.smithi114.stdout:8/633: link d4/db/d3e/d71/d78/d8d/l98 d4/db/d39/d3c/d4e/d62/ldc 0 2024-09-16T09:45:35.914 INFO:tasks.workunit.client.1.smithi114.stdout:8/634: symlink d4/db/d39/d3c/d4e/d82/d72/d59/ldd 0 2024-09-16T09:45:35.915 INFO:tasks.workunit.client.1.smithi114.stdout:8/635: creat d4/dae/d9c/fde x:0 0 0 2024-09-16T09:45:35.920 INFO:tasks.workunit.client.1.smithi114.stdout:6/730: write d6/da/d76/fcf [739153,48735] 0 2024-09-16T09:45:35.926 INFO:tasks.workunit.client.1.smithi114.stdout:6/731: read d6/da/d76/fc1 [283487,18624] 0 2024-09-16T09:45:35.926 INFO:tasks.workunit.client.1.smithi114.stdout:6/732: read d6/d2d/f3c [486637,63922] 0 2024-09-16T09:45:35.926 INFO:tasks.workunit.client.1.smithi114.stdout:6/733: dread - d6/d2d/d46/fd4 zero size 2024-09-16T09:45:35.927 INFO:tasks.workunit.client.1.smithi114.stdout:6/734: rmdir d6/d2d/d46/dcc/d62/dd5 0 2024-09-16T09:45:35.935 INFO:tasks.workunit.client.1.smithi114.stdout:7/753: dwrite d2/d9/d2b/d78/fb6 [0,4194304] 0 2024-09-16T09:45:35.936 INFO:tasks.workunit.client.1.smithi114.stdout:8/636: dwrite d4/db/d39/d3c/fa7 [0,4194304] 0 2024-09-16T09:45:35.936 INFO:tasks.workunit.client.1.smithi114.stdout:8/637: read - d4/db/fa4 zero size 2024-09-16T09:45:35.936 INFO:tasks.workunit.client.1.smithi114.stdout:8/638: read - d4/dae/d9c/fca zero size 2024-09-16T09:45:35.936 INFO:tasks.workunit.client.1.smithi114.stdout:7/754: mknod d2/d9/d2b/d2e/d93/c104 0 2024-09-16T09:45:35.937 INFO:tasks.workunit.client.1.smithi114.stdout:7/755: fsync d2/d9/d2b/d59/dca/fdc 0 2024-09-16T09:45:35.940 INFO:tasks.workunit.client.1.smithi114.stdout:6/735: dread d6/da/d36/f38 [0,4194304] 0 2024-09-16T09:45:35.941 INFO:tasks.workunit.client.1.smithi114.stdout:6/736: truncate d6/da/d10/d40/d82/f8d 585183 0 2024-09-16T09:45:35.942 INFO:tasks.workunit.client.1.smithi114.stdout:6/737: truncate d6/da/d10/f4b 148845 0 2024-09-16T09:45:35.943 INFO:tasks.workunit.client.1.smithi114.stdout:6/738: mknod d6/d2d/ce4 0 2024-09-16T09:45:35.945 INFO:tasks.workunit.client.1.smithi114.stdout:6/739: rename d6/da/d76/fc1 to d6/da/fe5 0 2024-09-16T09:45:35.956 INFO:tasks.workunit.client.1.smithi114.stdout:8/639: dwrite d4/db/dd/f20 [0,4194304] 0 2024-09-16T09:45:35.958 INFO:tasks.workunit.client.1.smithi114.stdout:7/756: dwrite d2/d9/d2b/d59/dca/fdc [0,4194304] 0 2024-09-16T09:45:35.958 INFO:tasks.workunit.client.1.smithi114.stdout:7/757: readlink d2/d9/d2b/d2e/d77/l9c 0 2024-09-16T09:45:35.959 INFO:tasks.workunit.client.1.smithi114.stdout:7/758: write d2/d9/f19 [916478,60026] 0 2024-09-16T09:45:35.959 INFO:tasks.workunit.client.1.smithi114.stdout:7/759: chown d2/d9/d2b/d59/d7f/fbb 1011297709 1 2024-09-16T09:45:35.959 INFO:tasks.workunit.client.1.smithi114.stdout:8/640: creat d4/db/d39/d3c/d4e/d82/d72/fdf x:0 0 0 2024-09-16T09:45:35.962 INFO:tasks.workunit.client.1.smithi114.stdout:7/760: unlink d2/d9/d2b/d2e/d22/f49 0 2024-09-16T09:45:35.963 INFO:tasks.workunit.client.1.smithi114.stdout:8/641: mknod d4/db/ce0 0 2024-09-16T09:45:35.964 INFO:tasks.workunit.client.1.smithi114.stdout:8/642: read - d4/db/d3e/d71/d78/d8d/da9/fd4 zero size 2024-09-16T09:45:35.965 INFO:tasks.workunit.client.1.smithi114.stdout:8/643: dread d4/db/d39/d3c/f81 [0,4194304] 0 2024-09-16T09:45:35.966 INFO:tasks.workunit.client.1.smithi114.stdout:8/644: stat d4/db/d3e/d71/d78/d8d 0 2024-09-16T09:45:35.966 INFO:tasks.workunit.client.1.smithi114.stdout:8/645: truncate d4/db/d68/d28/f89 1088711 0 2024-09-16T09:45:35.971 INFO:tasks.workunit.client.1.smithi114.stdout:7/761: dread d2/d9/d2b/d2e/d3e/d79/ff3 [0,4194304] 0 2024-09-16T09:45:35.972 INFO:tasks.workunit.client.1.smithi114.stdout:7/762: rmdir d2/d9/d51/d84 39 2024-09-16T09:45:35.974 INFO:tasks.workunit.client.1.smithi114.stdout:8/646: dread d4/db/d68/d28/f31 [0,4194304] 0 2024-09-16T09:45:35.976 INFO:tasks.workunit.client.1.smithi114.stdout:8/647: creat d4/db/dd/da1/fe1 x:0 0 0 2024-09-16T09:45:35.978 INFO:tasks.workunit.client.1.smithi114.stdout:8/648: unlink d4/db/d39/d3c/f6b 0 2024-09-16T09:45:35.980 INFO:tasks.workunit.client.1.smithi114.stdout:8/649: symlink d4/db/d3e/d71/d78/d8d/da9/le2 0 2024-09-16T09:45:35.980 INFO:tasks.workunit.client.1.smithi114.stdout:8/650: fdatasync d4/db/dd/f6f 0 2024-09-16T09:45:35.980 INFO:tasks.workunit.client.1.smithi114.stdout:8/651: write d4/db/fa4 [35883,49989] 0 2024-09-16T09:45:35.982 INFO:tasks.workunit.client.1.smithi114.stdout:8/652: rmdir d4/db/d39/d3c/dbf 0 2024-09-16T09:45:35.982 INFO:tasks.workunit.client.1.smithi114.stdout:8/653: chown d4/db/d39/d3c/d86 13924789 1 2024-09-16T09:45:35.982 INFO:tasks.workunit.client.1.smithi114.stdout:8/654: fsync d4/db/d3e/f7f 0 2024-09-16T09:45:35.991 INFO:tasks.workunit.client.1.smithi114.stdout:7/763: dwrite d2/d9/d2b/d78/d99/ddd/dea/ff6 [0,4194304] 0 2024-09-16T09:45:35.991 INFO:tasks.workunit.client.1.smithi114.stdout:7/764: stat d2/d9/d2b/d2e/d22/d27/f1f 0 2024-09-16T09:45:36.001 INFO:tasks.workunit.client.1.smithi114.stdout:8/655: dwrite d4/dae/f9b [0,4194304] 0 2024-09-16T09:45:36.001 INFO:tasks.workunit.client.1.smithi114.stdout:8/656: dread - d4/db/dd/da1/fe1 zero size 2024-09-16T09:45:36.013 INFO:tasks.workunit.client.1.smithi114.stdout:7/765: dwrite d2/d9/d2b/d78/d99/f9b [0,4194304] 0 2024-09-16T09:45:36.015 INFO:tasks.workunit.client.1.smithi114.stdout:8/657: mknod d4/db/d39/d3c/d86/ce3 0 2024-09-16T09:45:36.018 INFO:tasks.workunit.client.1.smithi114.stdout:8/658: unlink d4/db/d68/l29 0 2024-09-16T09:45:36.018 INFO:tasks.workunit.client.1.smithi114.stdout:8/659: fdatasync d4/db/f22 0 2024-09-16T09:45:36.018 INFO:tasks.workunit.client.1.smithi114.stdout:8/660: mkdir d4/db/dd/de4 0 2024-09-16T09:45:36.021 INFO:tasks.workunit.client.1.smithi114.stdout:8/661: rename d4/c75 to d4/db/d3e/d71/d78/d7a/ce5 0 2024-09-16T09:45:36.022 INFO:tasks.workunit.client.1.smithi114.stdout:8/662: dread d4/db/d3e/d47/fa2 [0,4194304] 0 2024-09-16T09:45:36.032 INFO:tasks.workunit.client.1.smithi114.stdout:7/766: dwrite d2/f2c [0,4194304] 0 2024-09-16T09:45:36.033 INFO:tasks.workunit.client.1.smithi114.stdout:7/767: rmdir d2/d9/d2b/d78 39 2024-09-16T09:45:36.042 INFO:tasks.workunit.client.1.smithi114.stdout:7/768: dread d2/d9/d2b/d2e/d22/fb2 [0,4194304] 0 2024-09-16T09:45:36.044 INFO:tasks.workunit.client.1.smithi114.stdout:8/663: dwrite d4/db/d39/d3c/d86/f8c [0,4194304] 0 2024-09-16T09:45:36.053 INFO:tasks.workunit.client.1.smithi114.stdout:7/769: dread d2/d9/d2b/d78/fb6 [0,4194304] 0 2024-09-16T09:45:36.053 INFO:tasks.workunit.client.1.smithi114.stdout:7/770: chown d2/d9/d2b/d59/dca/fdc 14 1 2024-09-16T09:45:36.057 INFO:tasks.workunit.client.1.smithi114.stdout:2/768: sync 2024-09-16T09:45:36.057 INFO:tasks.workunit.client.1.smithi114.stdout:9/635: sync 2024-09-16T09:45:36.057 INFO:tasks.workunit.client.1.smithi114.stdout:5/683: sync 2024-09-16T09:45:36.057 INFO:tasks.workunit.client.1.smithi114.stdout:3/811: sync 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:4/685: sync 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:4/686: fdatasync d0/d26/d40/f44 0 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:5/684: read d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f55 [11283620,12032] 0 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:6/740: sync 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:0/680: sync 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:1/710: sync 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:0/681: read - d1f/d27/fa1 zero size 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:0/682: write d1f/d27/d47/d56/fb7 [5341465,43977] 0 2024-09-16T09:45:36.058 INFO:tasks.workunit.client.1.smithi114.stdout:9/636: mkdir d3/da/d10/d23/d43/d82/dc5/dd5 0 2024-09-16T09:45:36.059 INFO:tasks.workunit.client.1.smithi114.stdout:9/637: fsync d3/d7d/fc4 0 2024-09-16T09:45:36.059 INFO:tasks.workunit.client.1.smithi114.stdout:3/812: mknod dc/de/d37/c11a 0 2024-09-16T09:45:36.059 INFO:tasks.workunit.client.1.smithi114.stdout:8/664: dwrite d4/db/d39/d3c/d4e/f92 [0,4194304] 0 2024-09-16T09:45:36.059 INFO:tasks.workunit.client.1.smithi114.stdout:3/813: fdatasync dc/de/d18/f30 0 2024-09-16T09:45:36.061 INFO:tasks.workunit.client.1.smithi114.stdout:1/711: truncate d4/d2b/f9 830819 0 2024-09-16T09:45:36.061 INFO:tasks.workunit.client.1.smithi114.stdout:6/741: creat d6/da/dbb/fe6 x:0 0 0 2024-09-16T09:45:36.061 INFO:tasks.workunit.client.1.smithi114.stdout:6/742: stat d6/da/d10/d40/fa0 0 2024-09-16T09:45:36.064 INFO:tasks.workunit.client.1.smithi114.stdout:9/638: creat d3/da/d10/d23/d43/d82/dc5/fd6 x:0 0 0 2024-09-16T09:45:36.064 INFO:tasks.workunit.client.1.smithi114.stdout:9/639: write d3/da/d10/d23/d29/d2c/d6b/db9/fc8 [1978003,13749] 0 2024-09-16T09:45:36.066 INFO:tasks.workunit.client.1.smithi114.stdout:8/665: link d4/db/dd/fba d4/db/d68/d28/dac/fe6 0 2024-09-16T09:45:36.068 INFO:tasks.workunit.client.1.smithi114.stdout:1/712: mknod d4/d2b/d2f/d3a/dc5/cea 0 2024-09-16T09:45:36.068 INFO:tasks.workunit.client.1.smithi114.stdout:1/713: write d4/d2b/d2f/d3a/fe2 [745675,19823] 0 2024-09-16T09:45:36.068 INFO:tasks.workunit.client.1.smithi114.stdout:1/714: truncate d4/d2b/d2f/d3a/fdf 1294082 0 2024-09-16T09:45:36.068 INFO:tasks.workunit.client.1.smithi114.stdout:6/743: mkdir d6/d2d/d46/dcc/d62/d77/d7b/de7 0 2024-09-16T09:45:36.069 INFO:tasks.workunit.client.1.smithi114.stdout:0/683: dread d1f/d22/d2e/f5a [4194304,4194304] 0 2024-09-16T09:45:36.071 INFO:tasks.workunit.client.1.smithi114.stdout:9/640: rename d3/da/d10/d23/d29/d2c/d6b/d68/d81/f8f to d3/da/d10/d23/d29/d2c/d45/da5/fd7 0 2024-09-16T09:45:36.071 INFO:tasks.workunit.client.1.smithi114.stdout:8/666: rmdir d4/dae/d54/db3 39 2024-09-16T09:45:36.072 INFO:tasks.workunit.client.1.smithi114.stdout:8/667: read d4/db/d3e/d47/fa2 [112911,127645] 0 2024-09-16T09:45:36.072 INFO:tasks.workunit.client.1.smithi114.stdout:1/715: mkdir d4/d2b/d16/d71/d72/deb 0 2024-09-16T09:45:36.074 INFO:tasks.workunit.client.1.smithi114.stdout:6/744: unlink d6/d2d/d46/dcc/d62/d77/l80 0 2024-09-16T09:45:36.075 INFO:tasks.workunit.client.1.smithi114.stdout:0/684: getdents d1f/d27/d47/d56 0 2024-09-16T09:45:36.075 INFO:tasks.workunit.client.1.smithi114.stdout:0/685: readlink d1f/d2d/d7a/lf2 0 2024-09-16T09:45:36.077 INFO:tasks.workunit.client.1.smithi114.stdout:8/668: creat d4/d1f/db9/fe7 x:0 0 0 2024-09-16T09:45:36.077 INFO:tasks.workunit.client.1.smithi114.stdout:8/669: write d4/db/d91/fab [1657215,126738] 0 2024-09-16T09:45:36.077 INFO:tasks.workunit.client.1.smithi114.stdout:1/716: symlink d4/lec 0 2024-09-16T09:45:36.078 INFO:tasks.workunit.client.1.smithi114.stdout:0/686: creat d1f/d27/d47/d56/d7e/ff9 x:0 0 0 2024-09-16T09:45:36.079 INFO:tasks.workunit.client.1.smithi114.stdout:6/745: read d6/da/d10/d40/f43 [3029123,73506] 0 2024-09-16T09:45:36.079 INFO:tasks.workunit.client.1.smithi114.stdout:6/746: write d6/da/d10/d40/d82/fca [4905078,62800] 0 2024-09-16T09:45:36.079 INFO:tasks.workunit.client.1.smithi114.stdout:8/670: rename d4/db/dd/da1/fe1 to d4/dae/d54/db3/fe8 0 2024-09-16T09:45:36.082 INFO:tasks.workunit.client.1.smithi114.stdout:9/641: write d3/f49 [3340936,34657] 0 2024-09-16T09:45:36.084 INFO:tasks.workunit.client.1.smithi114.stdout:8/671: symlink d4/db/d39/d3c/d4e/d82/d72/d59/le9 0 2024-09-16T09:45:36.084 INFO:tasks.workunit.client.1.smithi114.stdout:8/672: write d4/db/d3e/d71/d78/d8d/da9/fd4 [381646,12691] 0 2024-09-16T09:45:36.086 INFO:tasks.workunit.client.1.smithi114.stdout:9/642: rmdir d3/da/d10/d23/d29/d2c/d45/d93 39 2024-09-16T09:45:36.086 INFO:tasks.workunit.client.1.smithi114.stdout:9/643: fsync d3/da/d10/d23/d29/d2c/d6b/f56 0 2024-09-16T09:45:36.088 INFO:tasks.workunit.client.1.smithi114.stdout:0/687: write d1f/f84 [2063461,3211] 0 2024-09-16T09:45:36.088 INFO:tasks.workunit.client.1.smithi114.stdout:5/685: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/fbe [0,4194304] 0 2024-09-16T09:45:36.088 INFO:tasks.workunit.client.1.smithi114.stdout:5/686: fdatasync d3/f25 0 2024-09-16T09:45:36.088 INFO:tasks.workunit.client.1.smithi114.stdout:9/644: chown d3/da/d10/d23/d29/d87/fa4 396998 1 2024-09-16T09:45:36.090 INFO:tasks.workunit.client.1.smithi114.stdout:5/687: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fe3 x:0 0 0 2024-09-16T09:45:36.091 INFO:tasks.workunit.client.1.smithi114.stdout:5/688: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/le4 0 2024-09-16T09:45:36.092 INFO:tasks.workunit.client.1.smithi114.stdout:5/689: truncate d3/d24/d84/d7a/d43/d4c/f54 4531460 0 2024-09-16T09:45:36.094 INFO:tasks.workunit.client.1.smithi114.stdout:5/690: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/le5 0 2024-09-16T09:45:36.094 INFO:tasks.workunit.client.1.smithi114.stdout:6/747: dread d6/da/d10/f33 [0,4194304] 0 2024-09-16T09:45:36.094 INFO:tasks.workunit.client.1.smithi114.stdout:6/748: chown d6/da/d10/d40/d82/lb9 230933 1 2024-09-16T09:45:36.095 INFO:tasks.workunit.client.1.smithi114.stdout:7/771: dwrite d2/d9/d2b/f61 [4194304,4194304] 0 2024-09-16T09:45:36.095 INFO:tasks.workunit.client.1.smithi114.stdout:7/772: fsync d2/df/f10 0 2024-09-16T09:45:36.096 INFO:tasks.workunit.client.1.smithi114.stdout:5/691: creat d3/d24/d84/dbc/fe6 x:0 0 0 2024-09-16T09:45:36.096 INFO:tasks.workunit.client.1.smithi114.stdout:5/692: truncate d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f9a 338735 0 2024-09-16T09:45:36.096 INFO:tasks.workunit.client.1.smithi114.stdout:6/749: rmdir d6/d2d/d46/dcc/d62/d77 39 2024-09-16T09:45:36.098 INFO:tasks.workunit.client.1.smithi114.stdout:7/773: creat d2/d9/d2b/d2e/d3e/d79/f105 x:0 0 0 2024-09-16T09:45:36.100 INFO:tasks.workunit.client.1.smithi114.stdout:5/693: creat d3/d24/d84/d7a/d43/d4c/d6d/fe7 x:0 0 0 2024-09-16T09:45:36.100 INFO:tasks.workunit.client.1.smithi114.stdout:5/694: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/ldd 0 2024-09-16T09:45:36.100 INFO:tasks.workunit.client.1.smithi114.stdout:5/695: write d3/d24/d7d/f99 [1176024,71197] 0 2024-09-16T09:45:36.100 INFO:tasks.workunit.client.1.smithi114.stdout:5/696: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75 5 1 2024-09-16T09:45:36.101 INFO:tasks.workunit.client.1.smithi114.stdout:6/750: creat d6/da/db3/fe8 x:0 0 0 2024-09-16T09:45:36.103 INFO:tasks.workunit.client.1.smithi114.stdout:3/814: dwrite dc/de/d17/d2d/d41/f42 [0,4194304] 0 2024-09-16T09:45:36.103 INFO:tasks.workunit.client.1.smithi114.stdout:7/774: creat d2/d9/d2b/d78/d99/f106 x:0 0 0 2024-09-16T09:45:36.104 INFO:tasks.workunit.client.1.smithi114.stdout:4/687: dwrite d0/d26/d3c/d74/d9c/fbb [0,4194304] 0 2024-09-16T09:45:36.104 INFO:tasks.workunit.client.1.smithi114.stdout:5/697: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/de8 0 2024-09-16T09:45:36.105 INFO:tasks.workunit.client.1.smithi114.stdout:6/751: getdents d6/da/d48 0 2024-09-16T09:45:36.108 INFO:tasks.workunit.client.1.smithi114.stdout:7/775: creat d2/d9/d51/d84/dda/f107 x:0 0 0 2024-09-16T09:45:36.109 INFO:tasks.workunit.client.1.smithi114.stdout:7/776: chown d2/df/df9/f91 7847 1 2024-09-16T09:45:36.109 INFO:tasks.workunit.client.1.smithi114.stdout:7/777: chown d2/d9/d2b/d2e/d22/d27/f40 0 1 2024-09-16T09:45:36.110 INFO:tasks.workunit.client.1.smithi114.stdout:7/778: write d2/d9/d2b/d2e/d22/d66/fd0 [878911,20347] 0 2024-09-16T09:45:36.111 INFO:tasks.workunit.client.1.smithi114.stdout:6/752: dread d6/d2d/d46/f83 [0,4194304] 0 2024-09-16T09:45:36.111 INFO:tasks.workunit.client.1.smithi114.stdout:6/753: dread - d6/d2d/d46/fd4 zero size 2024-09-16T09:45:36.111 INFO:tasks.workunit.client.1.smithi114.stdout:4/688: unlink d0/d26/d3c/d74/ceb 0 2024-09-16T09:45:36.111 INFO:tasks.workunit.client.1.smithi114.stdout:4/689: write d0/fd2 [135322,64620] 0 2024-09-16T09:45:36.111 INFO:tasks.workunit.client.1.smithi114.stdout:5/698: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/ce9 0 2024-09-16T09:45:36.113 INFO:tasks.workunit.client.1.smithi114.stdout:7/779: rename d2/d9/d2b/d59/c8e to d2/d9/d2b/d78/d99/ddd/def/c108 0 2024-09-16T09:45:36.114 INFO:tasks.workunit.client.1.smithi114.stdout:4/690: getdents d0/d26/d3c/d74/d9c 0 2024-09-16T09:45:36.115 INFO:tasks.workunit.client.1.smithi114.stdout:7/780: creat d2/d9/d51/f109 x:0 0 0 2024-09-16T09:45:36.115 INFO:tasks.workunit.client.1.smithi114.stdout:7/781: write d2/d9/d2b/d2e/d22/d27/fdb [41848,96530] 0 2024-09-16T09:45:36.115 INFO:tasks.workunit.client.1.smithi114.stdout:7/782: write d2/df/fce [810968,110814] 0 2024-09-16T09:45:36.116 INFO:tasks.workunit.client.1.smithi114.stdout:4/691: creat d0/d26/d3c/d3e/d5a/d5d/ff4 x:0 0 0 2024-09-16T09:45:36.116 INFO:tasks.workunit.client.1.smithi114.stdout:4/692: creat d0/d26/d3c/d3e/d4b/d46/ff5 x:0 0 0 2024-09-16T09:45:36.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/717: dwrite d4/d2b/d2f/d3a/d9d/d41/d42/d58/f5c [0,4194304] 0 2024-09-16T09:45:36.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/718: truncate d4/d2b/f53 980367 0 2024-09-16T09:45:36.127 INFO:tasks.workunit.client.1.smithi114.stdout:1/719: stat d4/d2b/d2f/d3a/d9d 0 2024-09-16T09:45:36.129 INFO:tasks.workunit.client.1.smithi114.stdout:1/720: mknod d4/d2b/d2f/d3a/d9d/ced 0 2024-09-16T09:45:36.129 INFO:tasks.workunit.client.1.smithi114.stdout:1/721: chown d4/d2b/d16/d47/l54 52851 1 2024-09-16T09:45:36.129 INFO:tasks.workunit.client.1.smithi114.stdout:1/722: mknod d4/d2b/d16/d71/d81/cee 0 2024-09-16T09:45:36.130 INFO:tasks.workunit.client.1.smithi114.stdout:1/723: chown d4/d2b/d16/d71/d81/ddc 3789 1 2024-09-16T09:45:36.130 INFO:tasks.workunit.client.1.smithi114.stdout:1/724: chown d4/d2b/d16/d47/fb2 3 1 2024-09-16T09:45:36.131 INFO:tasks.workunit.client.1.smithi114.stdout:1/725: rename d4/d2b/d2f/d3a/d56/f66 to d4/d2b/d16/d71/d72/fef 0 2024-09-16T09:45:36.133 INFO:tasks.workunit.client.1.smithi114.stdout:1/726: rename d4/f25 to d4/d2b/d2f/d3a/ff0 0 2024-09-16T09:45:36.135 INFO:tasks.workunit.client.1.smithi114.stdout:1/727: mkdir d4/d2b/d16/d71/de5/df1 0 2024-09-16T09:45:36.136 INFO:tasks.workunit.client.1.smithi114.stdout:1/728: creat d4/d2b/d16/d47/da7/dd7/ff2 x:0 0 0 2024-09-16T09:45:36.138 INFO:tasks.workunit.client.1.smithi114.stdout:1/729: creat d4/d2b/d29/da0/db1/ff3 x:0 0 0 2024-09-16T09:45:36.139 INFO:tasks.workunit.client.1.smithi114.stdout:1/730: creat d4/ff4 x:0 0 0 2024-09-16T09:45:36.139 INFO:tasks.workunit.client.1.smithi114.stdout:1/731: read d4/f26 [4253108,96475] 0 2024-09-16T09:45:36.142 INFO:tasks.workunit.client.1.smithi114.stdout:1/732: creat d4/d2b/d16/d71/d72/ff5 x:0 0 0 2024-09-16T09:45:36.142 INFO:tasks.workunit.client.1.smithi114.stdout:1/733: mknod d4/d2b/d29/cf6 0 2024-09-16T09:45:36.144 INFO:tasks.workunit.client.1.smithi114.stdout:1/734: mkdir d4/d2b/d16/d71/d72/deb/df7 0 2024-09-16T09:45:36.149 INFO:tasks.workunit.client.1.smithi114.stdout:0/688: dwrite d1f/d22/d2e/d46/f5f [0,4194304] 0 2024-09-16T09:45:36.149 INFO:tasks.workunit.client.1.smithi114.stdout:0/689: stat d1f/d9e/l9f 0 2024-09-16T09:45:36.149 INFO:tasks.workunit.client.1.smithi114.stdout:9/645: dwrite d3/da/d10/d23/d29/f4b [0,4194304] 0 2024-09-16T09:45:36.149 INFO:tasks.workunit.client.1.smithi114.stdout:3/815: dwrite dc/de/d37/d3d/f6c [0,4194304] 0 2024-09-16T09:45:36.150 INFO:tasks.workunit.client.1.smithi114.stdout:4/693: dwrite d0/d13/d56/d7e/fbc [0,4194304] 0 2024-09-16T09:45:36.150 INFO:tasks.workunit.client.1.smithi114.stdout:4/694: truncate d0/d26/d3c/d3e/d4b/d46/db3/fc5 892371 0 2024-09-16T09:45:36.150 INFO:tasks.workunit.client.1.smithi114.stdout:5/699: dwrite d3/f8 [0,4194304] 0 2024-09-16T09:45:36.152 INFO:tasks.workunit.client.1.smithi114.stdout:0/690: unlink d1f/f3f 0 2024-09-16T09:45:36.152 INFO:tasks.workunit.client.1.smithi114.stdout:0/691: write d1f/d27/db9/fe3 [137470,44703] 0 2024-09-16T09:45:36.153 INFO:tasks.workunit.client.1.smithi114.stdout:1/735: dread d4/d2b/d2f/f4c [0,4194304] 0 2024-09-16T09:45:36.153 INFO:tasks.workunit.client.1.smithi114.stdout:1/736: read d4/d2b/f3c [3719252,22540] 0 2024-09-16T09:45:36.156 INFO:tasks.workunit.client.1.smithi114.stdout:9/646: symlink d3/da/d10/d23/d29/d2c/d45/da5/ld8 0 2024-09-16T09:45:36.160 INFO:tasks.workunit.client.1.smithi114.stdout:3/816: write dc/d38/f45 [4950745,21440] 0 2024-09-16T09:45:36.161 INFO:tasks.workunit.client.1.smithi114.stdout:4/695: rename d0/d26/d2e/dc0/fd8 to d0/d26/d29/d2b/ff6 0 2024-09-16T09:45:36.162 INFO:tasks.workunit.client.1.smithi114.stdout:5/700: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/fbe [496267,50858] 0 2024-09-16T09:45:36.162 INFO:tasks.workunit.client.1.smithi114.stdout:5/701: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/c4b 6 1 2024-09-16T09:45:36.163 INFO:tasks.workunit.client.1.smithi114.stdout:0/692: link d1f/d22/l67 d1f/d22/d2e/lfa 0 2024-09-16T09:45:36.164 INFO:tasks.workunit.client.1.smithi114.stdout:1/737: creat d4/d2b/d16/d71/d72/d75/ff8 x:0 0 0 2024-09-16T09:45:36.165 INFO:tasks.workunit.client.1.smithi114.stdout:9/647: write d3/da/f4d [413819,80093] 0 2024-09-16T09:45:36.166 INFO:tasks.workunit.client.1.smithi114.stdout:3/817: creat dc/de/d18/d78/d5c/d5d/d50/f11b x:0 0 0 2024-09-16T09:45:36.167 INFO:tasks.workunit.client.1.smithi114.stdout:4/696: creat d0/d26/d3c/d45/ff7 x:0 0 0 2024-09-16T09:45:36.168 INFO:tasks.workunit.client.1.smithi114.stdout:4/697: dread - d0/d26/d3c/d3e/d5a/d5d/d70/fbf zero size 2024-09-16T09:45:36.168 INFO:tasks.workunit.client.1.smithi114.stdout:4/698: truncate d0/d13/f86 146448 0 2024-09-16T09:45:36.168 INFO:tasks.workunit.client.1.smithi114.stdout:4/699: fdatasync d0/d26/d3c/d3e/d4b/d46/db3/fca 0 2024-09-16T09:45:36.168 INFO:tasks.workunit.client.1.smithi114.stdout:4/700: fdatasync d0/f85 0 2024-09-16T09:45:36.169 INFO:tasks.workunit.client.1.smithi114.stdout:5/702: chown d3/l7 509503 1 2024-09-16T09:45:36.171 INFO:tasks.workunit.client.1.smithi114.stdout:0/693: rename d1f/d27/d47/d56/f99 to d1f/d22/d2e/d46/d7f/daf/ffb 0 2024-09-16T09:45:36.173 INFO:tasks.workunit.client.1.smithi114.stdout:1/738: getdents d4/d2b/d2f 0 2024-09-16T09:45:36.177 INFO:tasks.workunit.client.1.smithi114.stdout:9/648: dread d3/da/fb [0,4194304] 0 2024-09-16T09:45:36.177 INFO:tasks.workunit.client.1.smithi114.stdout:3/818: symlink dc/de/d17/d2d/db4/l11c 0 2024-09-16T09:45:36.179 INFO:tasks.workunit.client.1.smithi114.stdout:5/703: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6/fea x:0 0 0 2024-09-16T09:45:36.183 INFO:tasks.workunit.client.1.smithi114.stdout:3/819: mkdir dc/de/d18/dfe/db2/dd8/d11d 0 2024-09-16T09:45:36.184 INFO:tasks.workunit.client.1.smithi114.stdout:5/704: symlink d3/d24/d84/db9/leb 0 2024-09-16T09:45:36.186 INFO:tasks.workunit.client.1.smithi114.stdout:9/649: symlink d3/da/d10/d23/d43/d1e/d25/dc0/ld9 0 2024-09-16T09:45:36.186 INFO:tasks.workunit.client.1.smithi114.stdout:9/650: stat d3/da/d10/d23/d43/d82/dc5/dd5 0 2024-09-16T09:45:36.187 INFO:tasks.workunit.client.1.smithi114.stdout:3/820: getdents dc/de/d18/d78/d5c/d5d/d50/dea 0 2024-09-16T09:45:36.190 INFO:tasks.workunit.client.1.smithi114.stdout:5/705: symlink d3/d24/d7d/d96/lec 0 2024-09-16T09:45:36.194 INFO:tasks.workunit.client.1.smithi114.stdout:5/706: mknod d3/d24/d84/d7a/d43/d4c/d92/d78/ced 0 2024-09-16T09:45:36.195 INFO:tasks.workunit.client.1.smithi114.stdout:4/701: dwrite d0/d26/d29/f39 [0,4194304] 0 2024-09-16T09:45:36.196 INFO:tasks.workunit.client.1.smithi114.stdout:9/651: link d3/da/f2a d3/da/d10/d23/d43/d1e/da0/fda 0 2024-09-16T09:45:36.198 INFO:tasks.workunit.client.1.smithi114.stdout:5/707: creat d3/d24/d84/db9/fee x:0 0 0 2024-09-16T09:45:36.198 INFO:tasks.workunit.client.1.smithi114.stdout:5/708: truncate d3/d1f/d8c/fc7 1018950 0 2024-09-16T09:45:36.198 INFO:tasks.workunit.client.1.smithi114.stdout:1/739: dwrite d4/d2b/d2f/d3a/fe2 [0,4194304] 0 2024-09-16T09:45:36.199 INFO:tasks.workunit.client.1.smithi114.stdout:9/652: rename d3/da/d10/d23/d43/d1e/d4c/d8c/l91 to d3/da/d10/d23/d29/d2c/d6b/d68/d81/ldb 0 2024-09-16T09:45:36.203 INFO:tasks.workunit.client.1.smithi114.stdout:5/709: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/def 0 2024-09-16T09:45:36.203 INFO:tasks.workunit.client.1.smithi114.stdout:5/710: write d3/d24/d84/d7a/d43/d4c/d6d/fe7 [9186,95919] 0 2024-09-16T09:45:36.204 INFO:tasks.workunit.client.1.smithi114.stdout:1/740: creat d4/d2b/d16/d47/da7/ff9 x:0 0 0 2024-09-16T09:45:36.205 INFO:tasks.workunit.client.1.smithi114.stdout:5/711: unlink d3/d24/d84/c40 0 2024-09-16T09:45:36.205 INFO:tasks.workunit.client.1.smithi114.stdout:5/712: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f81 [947316,99311] 0 2024-09-16T09:45:36.206 INFO:tasks.workunit.client.1.smithi114.stdout:4/702: write d0/f21 [7538873,101129] 0 2024-09-16T09:45:36.207 INFO:tasks.workunit.client.1.smithi114.stdout:4/703: chown d0/d26/f90 2800 1 2024-09-16T09:45:36.207 INFO:tasks.workunit.client.1.smithi114.stdout:1/741: rename d4/d2b/d16/d71/d72/d75/f7f to d4/d2b/d16/d71/d72/ffa 0 2024-09-16T09:45:36.212 INFO:tasks.workunit.client.1.smithi114.stdout:4/704: unlink d0/d26/d3c/d3e/d4b/d46/db3/f54 0 2024-09-16T09:45:36.212 INFO:tasks.workunit.client.1.smithi114.stdout:4/705: write d0/d26/d40/d75/fe8 [765978,123834] 0 2024-09-16T09:45:36.212 INFO:tasks.workunit.client.1.smithi114.stdout:3/821: dwrite dc/de/d17/d2d/f10e [0,4194304] 0 2024-09-16T09:45:36.213 INFO:tasks.workunit.client.1.smithi114.stdout:1/742: rmdir d4/d2b/d16/d47/da7 39 2024-09-16T09:45:36.213 INFO:tasks.workunit.client.1.smithi114.stdout:1/743: read d4/d2b/d2f/d3a/d56/fa6 [344841,25581] 0 2024-09-16T09:45:36.214 INFO:tasks.workunit.client.1.smithi114.stdout:4/706: truncate d0/fe 2685376 0 2024-09-16T09:45:36.214 INFO:tasks.workunit.client.1.smithi114.stdout:9/653: write d3/da/d10/d23/d29/d2c/d6b/f56 [3001633,38919] 0 2024-09-16T09:45:36.214 INFO:tasks.workunit.client.1.smithi114.stdout:9/654: chown d3/f49 1301604527 1 2024-09-16T09:45:36.217 INFO:tasks.workunit.client.1.smithi114.stdout:5/713: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/f60 [3056393,17242] 0 2024-09-16T09:45:36.218 INFO:tasks.workunit.client.1.smithi114.stdout:5/714: dread - d3/d24/d84/d7a/d43/d4c/db2/db7/fd2 zero size 2024-09-16T09:45:36.226 INFO:tasks.workunit.client.1.smithi114.stdout:1/744: dwrite d4/d2b/d16/d47/f93 [0,4194304] 0 2024-09-16T09:45:36.226 INFO:tasks.workunit.client.1.smithi114.stdout:1/745: read - d4/d2b/d16/d71/d72/d75/db4/dbb/fc1 zero size 2024-09-16T09:45:36.226 INFO:tasks.workunit.client.1.smithi114.stdout:3/822: rmdir dc/de/d18/d78/d5c/d5d/d50/dd6/d10f 0 2024-09-16T09:45:36.227 INFO:tasks.workunit.client.1.smithi114.stdout:4/707: link d0/d26/d3c/d3e/d4b/fd6 d0/d26/d3c/d74/ff8 0 2024-09-16T09:45:36.229 INFO:tasks.workunit.client.1.smithi114.stdout:9/655: mkdir d3/da/d10/d23/d29/d2c/d6b/d9d/ddc 0 2024-09-16T09:45:36.230 INFO:tasks.workunit.client.1.smithi114.stdout:5/715: unlink d3/d24/d84/d7a/d43/d58/f7c 0 2024-09-16T09:45:36.233 INFO:tasks.workunit.client.1.smithi114.stdout:1/746: symlink d4/d2b/d2f/d3a/d9d/d41/lfb 0 2024-09-16T09:45:36.235 INFO:tasks.workunit.client.1.smithi114.stdout:3/823: rename dc/de/d37 to dc/de/d17/d2d/d41/d11e 0 2024-09-16T09:45:36.236 INFO:tasks.workunit.client.1.smithi114.stdout:4/708: stat d0/d26/d29/l52 0 2024-09-16T09:45:36.236 INFO:tasks.workunit.client.1.smithi114.stdout:4/709: write d0/d26/d2e/f62 [412048,97775] 0 2024-09-16T09:45:36.236 INFO:tasks.workunit.client.1.smithi114.stdout:4/710: fdatasync d0/d26/d29/d2b/f61 0 2024-09-16T09:45:36.236 INFO:tasks.workunit.client.1.smithi114.stdout:4/711: fdatasync d0/d26/d29/fda 0 2024-09-16T09:45:36.237 INFO:tasks.workunit.client.1.smithi114.stdout:9/656: unlink c1 0 2024-09-16T09:45:36.239 INFO:tasks.workunit.client.1.smithi114.stdout:1/747: rename d4/d2b/d2f/d3a/d9d/f67 to d4/d2b/d2f/d3a/d9d/ffc 0 2024-09-16T09:45:36.241 INFO:tasks.workunit.client.1.smithi114.stdout:4/712: symlink d0/d26/d29/d9f/da0/lf9 0 2024-09-16T09:45:36.243 INFO:tasks.workunit.client.1.smithi114.stdout:1/748: symlink d4/d2b/d16/d71/de5/de6/lfd 0 2024-09-16T09:45:36.243 INFO:tasks.workunit.client.1.smithi114.stdout:1/749: stat d4/d2b/d2f/d3a/dc5/fe9 0 2024-09-16T09:45:36.244 INFO:tasks.workunit.client.1.smithi114.stdout:3/824: write dc/de/d18/d78/f73 [1853730,7949] 0 2024-09-16T09:45:36.244 INFO:tasks.workunit.client.1.smithi114.stdout:9/657: symlink d3/da/d10/d23/d43/d1e/ldd 0 2024-09-16T09:45:36.244 INFO:tasks.workunit.client.1.smithi114.stdout:9/658: write d3/da/d10/d23/d43/d1e/d4c/fb7 [324798,63017] 0 2024-09-16T09:45:36.246 INFO:tasks.workunit.client.1.smithi114.stdout:1/750: truncate d4/f6f 2314526 0 2024-09-16T09:45:36.249 INFO:tasks.workunit.client.1.smithi114.stdout:3/825: creat dc/de/d18/d78/d5c/da5/f11f x:0 0 0 2024-09-16T09:45:36.250 INFO:tasks.workunit.client.1.smithi114.stdout:9/659: mknod d3/da/d10/d23/d43/d82/cde 0 2024-09-16T09:45:36.250 INFO:tasks.workunit.client.1.smithi114.stdout:9/660: chown d3/l12 897023 1 2024-09-16T09:45:36.250 INFO:tasks.workunit.client.1.smithi114.stdout:4/713: write d0/d13/fed [2994945,56639] 0 2024-09-16T09:45:36.252 INFO:tasks.workunit.client.1.smithi114.stdout:1/751: unlink d4/d2b/d2f/d3a/d9d/d41/f8e 0 2024-09-16T09:45:36.252 INFO:tasks.workunit.client.1.smithi114.stdout:1/752: write d4/d2b/d2f/f5d [4433426,34616] 0 2024-09-16T09:45:36.253 INFO:tasks.workunit.client.1.smithi114.stdout:3/826: rmdir dc/de/d18/d78/d5c/da5 39 2024-09-16T09:45:36.254 INFO:tasks.workunit.client.1.smithi114.stdout:9/661: mknod d3/da/d10/d23/d43/d82/cdf 0 2024-09-16T09:45:36.255 INFO:tasks.workunit.client.1.smithi114.stdout:4/714: symlink d0/d26/d3c/d3e/d4b/d46/df3/lfa 0 2024-09-16T09:45:36.255 INFO:tasks.workunit.client.1.smithi114.stdout:4/715: readlink d0/d26/d3c/d3e/d5a/lcc 0 2024-09-16T09:45:36.257 INFO:tasks.workunit.client.1.smithi114.stdout:1/753: rename d4/d2b/f3c to d4/ffe 0 2024-09-16T09:45:36.257 INFO:tasks.workunit.client.1.smithi114.stdout:9/662: mknod d3/da/d10/d23/ce0 0 2024-09-16T09:45:36.258 INFO:tasks.workunit.client.1.smithi114.stdout:4/716: link d0/d26/d3c/d3e/d4b/d46/db3/fca d0/d26/d3c/ffb 0 2024-09-16T09:45:36.261 INFO:tasks.workunit.client.1.smithi114.stdout:4/717: mkdir d0/d26/d40/da6/dfc 0 2024-09-16T09:45:36.261 INFO:tasks.workunit.client.1.smithi114.stdout:2/769: sync 2024-09-16T09:45:36.261 INFO:tasks.workunit.client.1.smithi114.stdout:4/718: chown d0/d26/d3c/d3e/d5a/lcc 47 1 2024-09-16T09:45:36.261 INFO:tasks.workunit.client.1.smithi114.stdout:4/719: truncate d0/f85 3953184 0 2024-09-16T09:45:36.261 INFO:tasks.workunit.client.1.smithi114.stdout:2/770: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/f119 zero size 2024-09-16T09:45:36.263 INFO:tasks.workunit.client.1.smithi114.stdout:4/720: unlink d0/d13/d56/d7e/c98 0 2024-09-16T09:45:36.265 INFO:tasks.workunit.client.1.smithi114.stdout:2/771: creat d1/d8/d10/d16/d1d/f11b x:0 0 0 2024-09-16T09:45:36.266 INFO:tasks.workunit.client.1.smithi114.stdout:4/721: mkdir d0/d26/d29/d2b/d58/dfd 0 2024-09-16T09:45:36.268 INFO:tasks.workunit.client.1.smithi114.stdout:4/722: rename d0/d26/d2e/dc0/ce6 to d0/d26/d3c/d3e/d5a/cfe 0 2024-09-16T09:45:36.268 INFO:tasks.workunit.client.1.smithi114.stdout:9/663: dread d3/da/fb [0,4194304] 0 2024-09-16T09:45:36.272 INFO:tasks.workunit.client.1.smithi114.stdout:4/723: mknod d0/d26/d40/da6/cff 0 2024-09-16T09:45:36.272 INFO:tasks.workunit.client.1.smithi114.stdout:4/724: rmdir d0/d13/d56/d7e 39 2024-09-16T09:45:36.273 INFO:tasks.workunit.client.1.smithi114.stdout:4/725: truncate d0/f1f 821978 0 2024-09-16T09:45:36.280 INFO:tasks.workunit.client.1.smithi114.stdout:1/754: dwrite d4/d2b/d16/d71/d72/ff5 [0,4194304] 0 2024-09-16T09:45:36.283 INFO:tasks.workunit.client.1.smithi114.stdout:3/827: dwrite dc/d38/f66 [0,4194304] 0 2024-09-16T09:45:36.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/828: creat dc/f120 x:0 0 0 2024-09-16T09:45:36.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/829: fdatasync dc/de/d18/d78/d5c/d5d/fa6 0 2024-09-16T09:45:36.285 INFO:tasks.workunit.client.1.smithi114.stdout:3/830: symlink dc/de/d18/d78/d5c/d5d/d50/dea/l121 0 2024-09-16T09:45:36.293 INFO:tasks.workunit.client.1.smithi114.stdout:1/755: dread d4/d2b/d16/d71/f7b [0,4194304] 0 2024-09-16T09:45:36.293 INFO:tasks.workunit.client.1.smithi114.stdout:1/756: fdatasync d4/d2b/f91 0 2024-09-16T09:45:36.294 INFO:tasks.workunit.client.1.smithi114.stdout:2/772: dwrite d1/d8/d82/f8d [0,4194304] 0 2024-09-16T09:45:36.298 INFO:tasks.workunit.client.1.smithi114.stdout:2/773: rename d1/d8/f32 to d1/d8/d10/f11c 0 2024-09-16T09:45:36.298 INFO:tasks.workunit.client.1.smithi114.stdout:9/664: dwrite d3/da/d10/d23/d43/d1e/d78/db2/fb8 [0,4194304] 0 2024-09-16T09:45:36.299 INFO:tasks.workunit.client.1.smithi114.stdout:2/774: getdents d1 0 2024-09-16T09:45:36.301 INFO:tasks.workunit.client.1.smithi114.stdout:9/665: creat d3/da/d10/d23/d29/d2c/d6b/d9d/fe1 x:0 0 0 2024-09-16T09:45:36.303 INFO:tasks.workunit.client.1.smithi114.stdout:9/666: creat d3/da/d10/d23/d43/d1e/d4c/d8c/fe2 x:0 0 0 2024-09-16T09:45:36.304 INFO:tasks.workunit.client.1.smithi114.stdout:9/667: fdatasync d3/da/d10/d23/d29/d2c/d6b/f63 0 2024-09-16T09:45:36.304 INFO:tasks.workunit.client.1.smithi114.stdout:9/668: mknod d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/ce3 0 2024-09-16T09:45:36.305 INFO:tasks.workunit.client.1.smithi114.stdout:9/669: mknod d3/da/d10/d23/d29/d3f/d85/ce4 0 2024-09-16T09:45:36.308 INFO:tasks.workunit.client.1.smithi114.stdout:1/757: dwrite d4/d2b/d29/da0/db1/ff3 [0,4194304] 0 2024-09-16T09:45:36.310 INFO:tasks.workunit.client.1.smithi114.stdout:2/775: write d1/f2c [39288,8363] 0 2024-09-16T09:45:36.311 INFO:tasks.workunit.client.1.smithi114.stdout:1/758: creat d4/d2b/d2f/d3a/dc5/fff x:0 0 0 2024-09-16T09:45:36.313 INFO:tasks.workunit.client.1.smithi114.stdout:1/759: creat d4/d2b/d2f/d3a/f100 x:0 0 0 2024-09-16T09:45:36.314 INFO:tasks.workunit.client.1.smithi114.stdout:1/760: mkdir d4/d101 0 2024-09-16T09:45:36.315 INFO:tasks.workunit.client.1.smithi114.stdout:9/670: dread d3/da/f46 [0,4194304] 0 2024-09-16T09:45:36.315 INFO:tasks.workunit.client.1.smithi114.stdout:6/754: sync 2024-09-16T09:45:36.315 INFO:tasks.workunit.client.1.smithi114.stdout:7/783: sync 2024-09-16T09:45:36.319 INFO:tasks.workunit.client.1.smithi114.stdout:6/755: link d6/d2d/f3a d6/da/d76/fe9 0 2024-09-16T09:45:36.320 INFO:tasks.workunit.client.1.smithi114.stdout:2/776: write d1/d8/d10/d16/d1d/d92/da3/fc5 [3962242,86848] 0 2024-09-16T09:45:36.320 INFO:tasks.workunit.client.1.smithi114.stdout:7/784: symlink d2/d9/d2b/d2e/d22/d27/d64/l10a 0 2024-09-16T09:45:36.323 INFO:tasks.workunit.client.1.smithi114.stdout:1/761: dread d4/d2b/d16/f1b [0,4194304] 0 2024-09-16T09:45:36.323 INFO:tasks.workunit.client.1.smithi114.stdout:1/762: dread - d4/d2b/d16/d47/d83/f97 zero size 2024-09-16T09:45:36.323 INFO:tasks.workunit.client.1.smithi114.stdout:6/756: mkdir d6/dea 0 2024-09-16T09:45:36.324 INFO:tasks.workunit.client.1.smithi114.stdout:7/785: rmdir d2/d9/d2b/d2e/d22/d27/d4d 39 2024-09-16T09:45:36.324 INFO:tasks.workunit.client.1.smithi114.stdout:7/786: write d2/d9/d2b/d2e/d22/d66/db0/fcf [427005,37609] 0 2024-09-16T09:45:36.325 INFO:tasks.workunit.client.1.smithi114.stdout:1/763: link d4/d2b/f53 d4/d2b/d29/da0/db1/f102 0 2024-09-16T09:45:36.326 INFO:tasks.workunit.client.1.smithi114.stdout:6/757: creat d6/da/dbb/dd3/feb x:0 0 0 2024-09-16T09:45:36.326 INFO:tasks.workunit.client.1.smithi114.stdout:1/764: getdents d4/d2b/d16/d71/d72/deb 0 2024-09-16T09:45:36.327 INFO:tasks.workunit.client.1.smithi114.stdout:6/758: unlink d6/da/l8f 0 2024-09-16T09:45:36.328 INFO:tasks.workunit.client.1.smithi114.stdout:6/759: mkdir d6/da/db3/dd1/dec 0 2024-09-16T09:45:36.328 INFO:tasks.workunit.client.1.smithi114.stdout:6/760: rmdir d6/da/d10/d40/d82 39 2024-09-16T09:45:36.329 INFO:tasks.workunit.client.1.smithi114.stdout:2/777: write d1/d9e/fd3 [838516,93486] 0 2024-09-16T09:45:36.329 INFO:tasks.workunit.client.1.smithi114.stdout:6/761: creat d6/d64/fed x:0 0 0 2024-09-16T09:45:36.332 INFO:tasks.workunit.client.1.smithi114.stdout:6/762: mknod d6/da/d48/db0/cee 0 2024-09-16T09:45:36.334 INFO:tasks.workunit.client.1.smithi114.stdout:7/787: write d2/d9/f12 [3686650,37091] 0 2024-09-16T09:45:36.334 INFO:tasks.workunit.client.1.smithi114.stdout:7/788: fsync d2/d9/d2b/fb3 0 2024-09-16T09:45:36.334 INFO:tasks.workunit.client.1.smithi114.stdout:7/789: truncate d2/d9/d2b/d2e/d22/d27/d4d/fa4 1002365 0 2024-09-16T09:45:36.334 INFO:tasks.workunit.client.1.smithi114.stdout:7/790: fdatasync d2/f5 0 2024-09-16T09:45:36.334 INFO:tasks.workunit.client.1.smithi114.stdout:7/791: read - d2/d9/d2b/d2e/d22/feb zero size 2024-09-16T09:45:36.335 INFO:tasks.workunit.client.1.smithi114.stdout:9/671: dwrite d3/da/d10/d23/d43/d82/fa9 [0,4194304] 0 2024-09-16T09:45:36.335 INFO:tasks.workunit.client.1.smithi114.stdout:9/672: fsync d3/da/d10/d23/d43/d1e/d4c/d8c/faf 0 2024-09-16T09:45:36.335 INFO:tasks.workunit.client.1.smithi114.stdout:9/673: chown d3/da/d10/f26 54076040 1 2024-09-16T09:45:36.336 INFO:tasks.workunit.client.1.smithi114.stdout:7/792: rename d2/df/df9/f91 to d2/d9/d2b/dcc/f10b 0 2024-09-16T09:45:36.339 INFO:tasks.workunit.client.1.smithi114.stdout:9/674: rmdir d3/da/d10/d23/d43/d1e/d25/d88 39 2024-09-16T09:45:36.340 INFO:tasks.workunit.client.1.smithi114.stdout:9/675: creat d3/da/d10/d23/fe5 x:0 0 0 2024-09-16T09:45:36.341 INFO:tasks.workunit.client.1.smithi114.stdout:9/676: creat d3/da/d10/d23/d29/dd1/fe6 x:0 0 0 2024-09-16T09:45:36.342 INFO:tasks.workunit.client.1.smithi114.stdout:9/677: mknod d3/da/d10/d23/d43/d82/dc5/ce7 0 2024-09-16T09:45:36.343 INFO:tasks.workunit.client.1.smithi114.stdout:9/678: symlink d3/da/d10/d23/d29/d2c/d70/le8 0 2024-09-16T09:45:36.343 INFO:tasks.workunit.client.1.smithi114.stdout:9/679: chown d3/da/d10/d23/d29/d2c/d6b/db9 9601 1 2024-09-16T09:45:36.343 INFO:tasks.workunit.client.1.smithi114.stdout:9/680: truncate d3/f5 5376889 0 2024-09-16T09:45:36.346 INFO:tasks.workunit.client.1.smithi114.stdout:7/793: dread d2/d9/d2b/d2e/d22/d27/d4d/f97 [0,4194304] 0 2024-09-16T09:45:36.354 INFO:tasks.workunit.client.1.smithi114.stdout:2/778: dwrite d1/d8/d10/d16/d1d/f34 [0,4194304] 0 2024-09-16T09:45:36.354 INFO:tasks.workunit.client.1.smithi114.stdout:2/779: dread - d1/d8/d10/d16/d1d/d92/da7/f100 zero size 2024-09-16T09:45:36.361 INFO:tasks.workunit.client.1.smithi114.stdout:6/763: dwrite d6/d2d/d46/d9c/fba [0,4194304] 0 2024-09-16T09:45:36.362 INFO:tasks.workunit.client.1.smithi114.stdout:9/681: dread d3/da/d10/d23/d43/d1e/f5e [0,4194304] 0 2024-09-16T09:45:36.362 INFO:tasks.workunit.client.1.smithi114.stdout:9/682: fsync d3/da/d10/d23/d43/f18 0 2024-09-16T09:45:36.364 INFO:tasks.workunit.client.1.smithi114.stdout:6/764: rename d6/da/c5b to d6/da/d36/cef 0 2024-09-16T09:45:36.365 INFO:tasks.workunit.client.1.smithi114.stdout:9/683: mkdir d3/da/d10/d23/de9 0 2024-09-16T09:45:36.366 INFO:tasks.workunit.client.1.smithi114.stdout:6/765: rename d6/da/f2c to d6/da/d10/d92/ff0 0 2024-09-16T09:45:36.367 INFO:tasks.workunit.client.1.smithi114.stdout:2/780: read d1/d8/d10/d16/d1d/f34 [281719,26264] 0 2024-09-16T09:45:36.372 INFO:tasks.workunit.client.1.smithi114.stdout:7/794: dwrite d2/d9/d2b/d78/d99/f9a [0,4194304] 0 2024-09-16T09:45:36.372 INFO:tasks.workunit.client.1.smithi114.stdout:7/795: write d2/df/df9/dbd/ff4 [4637803,130980] 0 2024-09-16T09:45:36.373 INFO:tasks.workunit.client.1.smithi114.stdout:7/796: fdatasync d2/df/df9/f69 0 2024-09-16T09:45:36.374 INFO:tasks.workunit.client.1.smithi114.stdout:7/797: creat d2/d9/d2b/d2e/d22/d27/d64/dc0/f10c x:0 0 0 2024-09-16T09:45:36.374 INFO:tasks.workunit.client.1.smithi114.stdout:7/798: write d2/d9/d2b/d2e/d22/d27/fae [41859,61301] 0 2024-09-16T09:45:36.376 INFO:tasks.workunit.client.1.smithi114.stdout:2/781: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f71 [2721281,62735] 0 2024-09-16T09:45:36.380 INFO:tasks.workunit.client.1.smithi114.stdout:7/799: mkdir d2/d9/d2b/d78/d9f/d10d 0 2024-09-16T09:45:36.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:35 smithi111 ceph-mon[27997]: pgmap v241: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 106 MiB/s rd, 143 MiB/s wr, 524 op/s 2024-09-16T09:45:36.382 INFO:tasks.workunit.client.1.smithi114.stdout:2/782: creat d1/d8/d10/d16/dd9/f11d x:0 0 0 2024-09-16T09:45:36.383 INFO:tasks.workunit.client.1.smithi114.stdout:7/800: mkdir d2/d9/d51/d10e 0 2024-09-16T09:45:36.383 INFO:tasks.workunit.client.1.smithi114.stdout:2/783: mknod d1/d8/d10/d16/c11e 0 2024-09-16T09:45:36.384 INFO:tasks.workunit.client.1.smithi114.stdout:2/784: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d90/l11f 0 2024-09-16T09:45:36.385 INFO:tasks.workunit.client.1.smithi114.stdout:2/785: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/df5/f102 977 1 2024-09-16T09:45:36.385 INFO:tasks.workunit.client.1.smithi114.stdout:2/786: truncate d1/d8/d10/d16/d1d/d92/da3/fc5 4968739 0 2024-09-16T09:45:36.385 INFO:tasks.workunit.client.1.smithi114.stdout:2/787: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120 0 2024-09-16T09:45:36.386 INFO:tasks.workunit.client.1.smithi114.stdout:2/788: creat d1/d8/d10/d16/dd9/f121 x:0 0 0 2024-09-16T09:45:36.387 INFO:tasks.workunit.client.1.smithi114.stdout:2/789: link d1/d8/d10/l24 d1/d9e/l122 0 2024-09-16T09:45:36.387 INFO:tasks.workunit.client.1.smithi114.stdout:2/790: write d1/d8/d10/d16/d1d/fc7 [1074149,24194] 0 2024-09-16T09:45:36.387 INFO:tasks.workunit.client.1.smithi114.stdout:2/791: truncate d1/d8/d10/f11c 4842555 0 2024-09-16T09:45:36.388 INFO:tasks.workunit.client.1.smithi114.stdout:2/792: rename d1/d8/d10/d16/d1d/d92/da3/cb5 to d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/c123 0 2024-09-16T09:45:36.395 INFO:tasks.workunit.client.1.smithi114.stdout:2/793: dread d1/d8/d10/f50 [0,4194304] 0 2024-09-16T09:45:36.396 INFO:tasks.workunit.client.1.smithi114.stdout:2/794: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/l124 0 2024-09-16T09:45:36.397 INFO:tasks.workunit.client.1.smithi114.stdout:7/801: dread d2/d9/d2b/d78/d99/f9b [0,4194304] 0 2024-09-16T09:45:36.398 INFO:tasks.workunit.client.1.smithi114.stdout:6/766: dwrite d6/da/d76/fe9 [0,4194304] 0 2024-09-16T09:45:36.398 INFO:tasks.workunit.client.1.smithi114.stdout:6/767: fdatasync d6/da/d10/d40/f72 0 2024-09-16T09:45:36.398 INFO:tasks.workunit.client.1.smithi114.stdout:6/768: write d6/da/dbb/fe6 [126587,100928] 0 2024-09-16T09:45:36.399 INFO:tasks.workunit.client.1.smithi114.stdout:6/769: stat d6/d2d/d46/c81 0 2024-09-16T09:45:36.399 INFO:tasks.workunit.client.1.smithi114.stdout:7/802: link d2/d9/d2b/d2e/d22/d27/c17 d2/df/df9/dbd/c10f 0 2024-09-16T09:45:36.399 INFO:tasks.workunit.client.1.smithi114.stdout:9/684: dwrite d3/da/f55 [0,4194304] 0 2024-09-16T09:45:36.402 INFO:tasks.workunit.client.1.smithi114.stdout:6/770: mkdir d6/d2d/d46/dcc/d62/d77/df1 0 2024-09-16T09:45:36.402 INFO:tasks.workunit.client.1.smithi114.stdout:6/771: write d6/da/d10/d40/f95 [244053,38917] 0 2024-09-16T09:45:36.402 INFO:tasks.workunit.client.1.smithi114.stdout:6/772: fdatasync d6/d64/fed 0 2024-09-16T09:45:36.411 INFO:tasks.workunit.client.1.smithi114.stdout:6/773: unlink d6/d2d/d46/dcc/f60 0 2024-09-16T09:45:36.411 INFO:tasks.workunit.client.1.smithi114.stdout:6/774: dread - d6/da/d10/d40/fa0 zero size 2024-09-16T09:45:36.411 INFO:tasks.workunit.client.1.smithi114.stdout:6/775: mknod d6/d2d/d46/dcc/dad/cf2 0 2024-09-16T09:45:36.413 INFO:tasks.workunit.client.1.smithi114.stdout:6/776: unlink d6/da/d10/d40/f72 0 2024-09-16T09:45:36.417 INFO:tasks.workunit.client.1.smithi114.stdout:2/795: dwrite d1/d8/d10/d16/d1d/d92/da3/fc2 [0,4194304] 0 2024-09-16T09:45:36.417 INFO:tasks.workunit.client.1.smithi114.stdout:9/685: dwrite d3/da/d10/d23/d29/d2c/f8e [0,4194304] 0 2024-09-16T09:45:36.418 INFO:tasks.workunit.client.1.smithi114.stdout:6/777: dread d6/da/d48/f58 [0,4194304] 0 2024-09-16T09:45:36.422 INFO:tasks.workunit.client.1.smithi114.stdout:2/796: dread d1/d8/f12 [0,4194304] 0 2024-09-16T09:45:36.422 INFO:tasks.workunit.client.1.smithi114.stdout:9/686: mknod d3/da/cea 0 2024-09-16T09:45:36.423 INFO:tasks.workunit.client.1.smithi114.stdout:6/778: creat d6/ff3 x:0 0 0 2024-09-16T09:45:36.424 INFO:tasks.workunit.client.1.smithi114.stdout:2/797: rmdir d1/d8/d10/d16/d1d/d92 39 2024-09-16T09:45:36.426 INFO:tasks.workunit.client.1.smithi114.stdout:6/779: creat d6/da/d48/db0/ff4 x:0 0 0 2024-09-16T09:45:36.426 INFO:tasks.workunit.client.1.smithi114.stdout:6/780: write d6/d2d/f70 [486811,7490] 0 2024-09-16T09:45:36.427 INFO:tasks.workunit.client.1.smithi114.stdout:2/798: symlink d1/d8/d10/l125 0 2024-09-16T09:45:36.429 INFO:tasks.workunit.client.1.smithi114.stdout:9/687: symlink d3/da/d10/d23/d43/d1e/d7b/leb 0 2024-09-16T09:45:36.429 INFO:tasks.workunit.client.1.smithi114.stdout:2/799: dread d1/d8/d10/f67 [0,4194304] 0 2024-09-16T09:45:36.431 INFO:tasks.workunit.client.1.smithi114.stdout:2/800: link d1/f2c d1/d9e/daf/f126 0 2024-09-16T09:45:36.431 INFO:tasks.workunit.client.1.smithi114.stdout:2/801: getdents d1/dec 0 2024-09-16T09:45:36.432 INFO:tasks.workunit.client.1.smithi114.stdout:2/802: mknod d1/d8/d10/d16/d60/db7/deb/d117/c127 0 2024-09-16T09:45:36.433 INFO:tasks.workunit.client.1.smithi114.stdout:2/803: creat d1/d8/d10/d16/d1d/d92/da3/f128 x:0 0 0 2024-09-16T09:45:36.435 INFO:tasks.workunit.client.1.smithi114.stdout:2/804: link d1/d8/d10/d16/lb2 d1/d8/d10/d16/d1d/d92/da3/l129 0 2024-09-16T09:45:36.436 INFO:tasks.workunit.client.1.smithi114.stdout:2/805: rmdir d1/d8 39 2024-09-16T09:45:36.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:35 smithi114 ceph-mon[35635]: pgmap v241: 65 pgs: 65 active+clean; 1.1 GiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 106 MiB/s rd, 143 MiB/s wr, 524 op/s 2024-09-16T09:45:36.453 INFO:tasks.workunit.client.1.smithi114.stdout:6/781: dwrite d6/da/d76/f8a [0,4194304] 0 2024-09-16T09:45:36.454 INFO:tasks.workunit.client.1.smithi114.stdout:6/782: symlink d6/dea/lf5 0 2024-09-16T09:45:36.455 INFO:tasks.workunit.client.1.smithi114.stdout:9/688: dwrite d3/da/d10/d23/d29/d3f/d85/fbd [4194304,4194304] 0 2024-09-16T09:45:36.455 INFO:tasks.workunit.client.1.smithi114.stdout:0/694: sync 2024-09-16T09:45:36.455 INFO:tasks.workunit.client.1.smithi114.stdout:5/716: sync 2024-09-16T09:45:36.455 INFO:tasks.workunit.client.1.smithi114.stdout:4/726: sync 2024-09-16T09:45:36.455 INFO:tasks.workunit.client.1.smithi114.stdout:8/673: sync 2024-09-16T09:45:36.455 INFO:tasks.workunit.client.1.smithi114.stdout:2/806: dwrite d1/d8/d10/d16/d1d/d92/da3/fc5 [0,4194304] 0 2024-09-16T09:45:36.456 INFO:tasks.workunit.client.1.smithi114.stdout:9/689: creat d3/da/fec x:0 0 0 2024-09-16T09:45:36.458 INFO:tasks.workunit.client.1.smithi114.stdout:0/695: write d1f/d27/d47/d56/d7e/f85 [71952,95168] 0 2024-09-16T09:45:36.458 INFO:tasks.workunit.client.1.smithi114.stdout:4/727: rename d0/f3a to d0/d26/d3c/d3e/f100 0 2024-09-16T09:45:36.459 INFO:tasks.workunit.client.1.smithi114.stdout:5/717: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/f9d to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/ff0 0 2024-09-16T09:45:36.459 INFO:tasks.workunit.client.1.smithi114.stdout:5/718: truncate d3/d24/d84/d7a/d43/d4c/db2/db7/fd2 905472 0 2024-09-16T09:45:36.460 INFO:tasks.workunit.client.1.smithi114.stdout:8/674: mkdir d4/db/dd/de4/dea 0 2024-09-16T09:45:36.460 INFO:tasks.workunit.client.1.smithi114.stdout:8/675: write d4/f40 [4884784,112765] 0 2024-09-16T09:45:36.464 INFO:tasks.workunit.client.1.smithi114.stdout:2/807: creat d1/d8/d10/d16/d60/db7/deb/f12a x:0 0 0 2024-09-16T09:45:36.464 INFO:tasks.workunit.client.1.smithi114.stdout:2/808: fsync d1/d8/d10/f18 0 2024-09-16T09:45:36.467 INFO:tasks.workunit.client.1.smithi114.stdout:0/696: write f15 [1211050,94654] 0 2024-09-16T09:45:36.467 INFO:tasks.workunit.client.1.smithi114.stdout:0/697: readlink d1f/d22/d2e/lfa 0 2024-09-16T09:45:36.468 INFO:tasks.workunit.client.1.smithi114.stdout:4/728: truncate d0/d13/fac 2002444 0 2024-09-16T09:45:36.470 INFO:tasks.workunit.client.1.smithi114.stdout:2/809: rename d1/d9e/db0 to d1/d8/d10/d16/d60/db7/deb/d12b 0 2024-09-16T09:45:36.470 INFO:tasks.workunit.client.1.smithi114.stdout:2/810: readlink d1/d8/d10/d16/d1d/d92/da7/lfc 0 2024-09-16T09:45:36.470 INFO:tasks.workunit.client.1.smithi114.stdout:2/811: write d1/d8/fa4 [517371,117050] 0 2024-09-16T09:45:36.470 INFO:tasks.workunit.client.1.smithi114.stdout:2/812: fsync d1/d8/d10/d16/d60/f109 0 2024-09-16T09:45:36.470 INFO:tasks.workunit.client.1.smithi114.stdout:0/698: creat d1f/ddf/df5/ffc x:0 0 0 2024-09-16T09:45:36.471 INFO:tasks.workunit.client.1.smithi114.stdout:0/699: fsync d1f/f45 0 2024-09-16T09:45:36.471 INFO:tasks.workunit.client.1.smithi114.stdout:9/690: dread d3/da/f55 [0,4194304] 0 2024-09-16T09:45:36.471 INFO:tasks.workunit.client.1.smithi114.stdout:4/729: rename d0/d13/c34 to d0/d26/d29/d2b/d58/dfd/c101 0 2024-09-16T09:45:36.472 INFO:tasks.workunit.client.1.smithi114.stdout:0/700: link d1f/d27/d47/d56/d7e/ce8 d1f/d22/d2e/cfd 0 2024-09-16T09:45:36.473 INFO:tasks.workunit.client.1.smithi114.stdout:5/719: dread d3/d24/d84/d7a/d43/d4c/d92/f97 [0,4194304] 0 2024-09-16T09:45:36.474 INFO:tasks.workunit.client.1.smithi114.stdout:9/691: rename d3/da/d10/d23/d29/d2c/d45/da5 to d3/da/d10/d23/d29/ded 0 2024-09-16T09:45:36.477 INFO:tasks.workunit.client.1.smithi114.stdout:0/701: rename d1f/d22/d2e/f5a to d1f/d20/d48/ffe 0 2024-09-16T09:45:36.477 INFO:tasks.workunit.client.1.smithi114.stdout:9/692: mknod d3/da/d10/d23/d43/d1e/d25/cee 0 2024-09-16T09:45:36.477 INFO:tasks.workunit.client.1.smithi114.stdout:9/693: chown d3/f5 114980292 1 2024-09-16T09:45:36.481 INFO:tasks.workunit.client.1.smithi114.stdout:6/783: dwrite d6/da/d10/fc4 [0,4194304] 0 2024-09-16T09:45:36.481 INFO:tasks.workunit.client.1.smithi114.stdout:8/676: dwrite d4/db/dd/f20 [0,4194304] 0 2024-09-16T09:45:36.481 INFO:tasks.workunit.client.1.smithi114.stdout:8/677: chown d4/db/d3e/d71/d78/cb0 746875 1 2024-09-16T09:45:36.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/813: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/fb3 [2715640,78916] 0 2024-09-16T09:45:36.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/814: readlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/la2 0 2024-09-16T09:45:36.482 INFO:tasks.workunit.client.1.smithi114.stdout:2/815: truncate d1/d8/d10/d16/fcf 1789807 0 2024-09-16T09:45:36.484 INFO:tasks.workunit.client.1.smithi114.stdout:4/730: dread d0/d26/d29/dbe/fce [0,4194304] 0 2024-09-16T09:45:36.484 INFO:tasks.workunit.client.1.smithi114.stdout:8/678: truncate d4/db/d68/d28/f77 399091 0 2024-09-16T09:45:36.484 INFO:tasks.workunit.client.1.smithi114.stdout:6/784: rmdir d6/da/d10/d92 39 2024-09-16T09:45:36.485 INFO:tasks.workunit.client.1.smithi114.stdout:6/785: dread - d6/d2d/d46/dcc/d62/d77/fac zero size 2024-09-16T09:45:36.485 INFO:tasks.workunit.client.1.smithi114.stdout:9/694: dread d3/da/d10/d23/d29/d87/fa4 [0,4194304] 0 2024-09-16T09:45:36.487 INFO:tasks.workunit.client.1.smithi114.stdout:2/816: symlink d1/d8/d82/l12c 0 2024-09-16T09:45:36.489 INFO:tasks.workunit.client.1.smithi114.stdout:4/731: link d0/d26/f48 d0/d26/df1/f102 0 2024-09-16T09:45:36.489 INFO:tasks.workunit.client.1.smithi114.stdout:4/732: truncate d0/d26/d3c/d3e/d4b/d46/db3/fa8 1048139 0 2024-09-16T09:45:36.489 INFO:tasks.workunit.client.1.smithi114.stdout:0/702: write d1f/d22/f3c [445377,37830] 0 2024-09-16T09:45:36.489 INFO:tasks.workunit.client.1.smithi114.stdout:0/703: readlink d1f/d22/l43 0 2024-09-16T09:45:36.489 INFO:tasks.workunit.client.1.smithi114.stdout:6/786: mkdir d6/d64/df6 0 2024-09-16T09:45:36.491 INFO:tasks.workunit.client.1.smithi114.stdout:9/695: mkdir d3/daa/def 0 2024-09-16T09:45:36.492 INFO:tasks.workunit.client.1.smithi114.stdout:2/817: mkdir d1/dec/d12d 0 2024-09-16T09:45:36.492 INFO:tasks.workunit.client.1.smithi114.stdout:2/818: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/f119 zero size 2024-09-16T09:45:36.495 INFO:tasks.workunit.client.1.smithi114.stdout:2/819: dread d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f95 [0,4194304] 0 2024-09-16T09:45:36.496 INFO:tasks.workunit.client.1.smithi114.stdout:0/704: unlink d1f/d20/d48/fa7 0 2024-09-16T09:45:36.497 INFO:tasks.workunit.client.1.smithi114.stdout:0/705: write d1f/d20/d48/fb8 [240448,75578] 0 2024-09-16T09:45:36.499 INFO:tasks.workunit.client.1.smithi114.stdout:4/733: write d0/d26/f88 [3493821,46715] 0 2024-09-16T09:45:36.500 INFO:tasks.workunit.client.1.smithi114.stdout:9/696: symlink d3/da/d10/d23/d29/lf0 0 2024-09-16T09:45:36.501 INFO:tasks.workunit.client.1.smithi114.stdout:2/820: creat d1/d8/d10/d16/d60/db7/deb/f12e x:0 0 0 2024-09-16T09:45:36.502 INFO:tasks.workunit.client.1.smithi114.stdout:0/706: truncate d1f/d22/d2e/d46/d7f/d8d/dbb/fde 3726481 0 2024-09-16T09:45:36.503 INFO:tasks.workunit.client.1.smithi114.stdout:9/697: creat d3/da/d10/d23/d43/d1e/d78/db2/ff1 x:0 0 0 2024-09-16T09:45:36.503 INFO:tasks.workunit.client.1.smithi114.stdout:9/698: write d3/da/d10/d23/d43/d1e/d7b/fa3 [283805,2178] 0 2024-09-16T09:45:36.503 INFO:tasks.workunit.client.1.smithi114.stdout:2/821: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b 39 2024-09-16T09:45:36.503 INFO:tasks.workunit.client.1.smithi114.stdout:2/822: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68 7496 1 2024-09-16T09:45:36.503 INFO:tasks.workunit.client.1.smithi114.stdout:2/823: write d1/d8/d10/d16/d1d/d92/fe9 [1026810,68783] 0 2024-09-16T09:45:36.504 INFO:tasks.workunit.client.1.smithi114.stdout:0/707: mknod d1f/cff 0 2024-09-16T09:45:36.504 INFO:tasks.workunit.client.1.smithi114.stdout:9/699: rename d3/da/d10/d23/d29/d2c/d6b/f92 to d3/daa/def/ff2 0 2024-09-16T09:45:36.505 INFO:tasks.workunit.client.1.smithi114.stdout:0/708: mknod d1f/ddf/c100 0 2024-09-16T09:45:36.505 INFO:tasks.workunit.client.1.smithi114.stdout:0/709: readlink d1f/d22/d2e/lfa 0 2024-09-16T09:45:36.511 INFO:tasks.workunit.client.1.smithi114.stdout:8/679: dwrite d4/db/d39/d3c/d4e/f92 [0,4194304] 0 2024-09-16T09:45:36.512 INFO:tasks.workunit.client.1.smithi114.stdout:6/787: dwrite d6/da/d36/f38 [0,4194304] 0 2024-09-16T09:45:36.512 INFO:tasks.workunit.client.1.smithi114.stdout:6/788: chown d6/d2d/f9b 150333044 1 2024-09-16T09:45:36.512 INFO:tasks.workunit.client.1.smithi114.stdout:6/789: truncate d6/d2d/d46/dcc/d62/d77/fac 43759 0 2024-09-16T09:45:36.512 INFO:tasks.workunit.client.1.smithi114.stdout:6/790: fsync d6/da/f1e 0 2024-09-16T09:45:36.512 INFO:tasks.workunit.client.1.smithi114.stdout:6/791: fsync d6/d2d/d46/f83 0 2024-09-16T09:45:36.512 INFO:tasks.workunit.client.1.smithi114.stdout:6/792: fdatasync d6/da/d10/d92/fc0 0 2024-09-16T09:45:36.513 INFO:tasks.workunit.client.1.smithi114.stdout:8/680: link d4/db/d39/d3c/d4e/f93 d4/db/d39/feb 0 2024-09-16T09:45:36.513 INFO:tasks.workunit.client.1.smithi114.stdout:4/734: dread d0/d13/f6f [4194304,4194304] 0 2024-09-16T09:45:36.513 INFO:tasks.workunit.client.1.smithi114.stdout:8/681: stat d4/db/d39/d94 0 2024-09-16T09:45:36.513 INFO:tasks.workunit.client.1.smithi114.stdout:8/682: readlink d4/d1f/db9/lce 0 2024-09-16T09:45:36.514 INFO:tasks.workunit.client.1.smithi114.stdout:6/793: getdents d6/da/db3 0 2024-09-16T09:45:36.514 INFO:tasks.workunit.client.1.smithi114.stdout:6/794: readlink d6/da/d36/l41 0 2024-09-16T09:45:36.516 INFO:tasks.workunit.client.1.smithi114.stdout:4/735: creat d0/f103 x:0 0 0 2024-09-16T09:45:36.516 INFO:tasks.workunit.client.1.smithi114.stdout:4/736: chown d0/d13/fed 46576 1 2024-09-16T09:45:36.516 INFO:tasks.workunit.client.1.smithi114.stdout:4/737: dread - d0/d26/d40/d75/fa2 zero size 2024-09-16T09:45:36.518 INFO:tasks.workunit.client.1.smithi114.stdout:8/683: mkdir d4/db/d39/d3c/dec 0 2024-09-16T09:45:36.520 INFO:tasks.workunit.client.1.smithi114.stdout:4/738: rename d0/d26/d3c/d3e/l4f to d0/d26/d3c/d3e/d5a/d5d/d70/d83/l104 0 2024-09-16T09:45:36.530 INFO:tasks.workunit.client.1.smithi114.stdout:1/765: sync 2024-09-16T09:45:36.530 INFO:tasks.workunit.client.1.smithi114.stdout:3/831: sync 2024-09-16T09:45:36.530 INFO:tasks.workunit.client.1.smithi114.stdout:1/766: dread - d4/d2b/d2f/d3a/d9d/fc9 zero size 2024-09-16T09:45:36.532 INFO:tasks.workunit.client.1.smithi114.stdout:3/832: symlink dc/de/d18/d78/d5c/d6e/l122 0 2024-09-16T09:45:36.534 INFO:tasks.workunit.client.1.smithi114.stdout:8/684: dread d4/dae/f7b [0,4194304] 0 2024-09-16T09:45:36.535 INFO:tasks.workunit.client.1.smithi114.stdout:8/685: rmdir d4/d1f 39 2024-09-16T09:45:36.535 INFO:tasks.workunit.client.1.smithi114.stdout:8/686: chown d4/db/d3e/d71/d78/d8d/da9/le2 2439193 1 2024-09-16T09:45:36.541 INFO:tasks.workunit.client.1.smithi114.stdout:2/824: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f97 [0,4194304] 0 2024-09-16T09:45:36.543 INFO:tasks.workunit.client.1.smithi114.stdout:9/700: dwrite d3/da/d10/d23/d43/f33 [0,4194304] 0 2024-09-16T09:45:36.543 INFO:tasks.workunit.client.1.smithi114.stdout:9/701: fsync d3/da/d10/d23/d43/d1e/d4c/d8c/fc7 0 2024-09-16T09:45:36.543 INFO:tasks.workunit.client.1.smithi114.stdout:9/702: fdatasync d3/da/d10/d23/fe5 0 2024-09-16T09:45:36.544 INFO:tasks.workunit.client.1.smithi114.stdout:0/710: dwrite d1f/d22/d2e/f37 [4194304,4194304] 0 2024-09-16T09:45:36.547 INFO:tasks.workunit.client.1.smithi114.stdout:0/711: rmdir d1f/d20/d48/d75 39 2024-09-16T09:45:36.548 INFO:tasks.workunit.client.1.smithi114.stdout:3/833: dread dc/de/d18/d78/d5c/d5d/d50/fd0 [4194304,4194304] 0 2024-09-16T09:45:36.549 INFO:tasks.workunit.client.1.smithi114.stdout:0/712: creat d1f/d22/d2e/d46/d7f/d8d/f101 x:0 0 0 2024-09-16T09:45:36.550 INFO:tasks.workunit.client.1.smithi114.stdout:6/795: dwrite d6/d2d/d46/dcc/d62/faa [0,4194304] 0 2024-09-16T09:45:36.551 INFO:tasks.workunit.client.1.smithi114.stdout:3/834: creat dc/de/d17/d2d/db4/f123 x:0 0 0 2024-09-16T09:45:36.551 INFO:tasks.workunit.client.1.smithi114.stdout:3/835: chown dc 667586 1 2024-09-16T09:45:36.551 INFO:tasks.workunit.client.1.smithi114.stdout:3/836: write dc/de/d18/d78/f119 [768306,41326] 0 2024-09-16T09:45:36.551 INFO:tasks.workunit.client.1.smithi114.stdout:3/837: readlink dc/de/d17/d72/l116 0 2024-09-16T09:45:36.553 INFO:tasks.workunit.client.1.smithi114.stdout:0/713: unlink d1f/fca 0 2024-09-16T09:45:36.553 INFO:tasks.workunit.client.1.smithi114.stdout:0/714: dread - d1f/d9e/fc1 zero size 2024-09-16T09:45:36.553 INFO:tasks.workunit.client.1.smithi114.stdout:9/703: dread d3/da/f55 [0,4194304] 0 2024-09-16T09:45:36.553 INFO:tasks.workunit.client.1.smithi114.stdout:9/704: readlink d3/lad 0 2024-09-16T09:45:36.554 INFO:tasks.workunit.client.1.smithi114.stdout:6/796: write d6/da/d36/f3f [2436325,16121] 0 2024-09-16T09:45:36.554 INFO:tasks.workunit.client.1.smithi114.stdout:4/739: truncate d0/d26/f88 1883579 0 2024-09-16T09:45:36.559 INFO:tasks.workunit.client.1.smithi114.stdout:3/838: mkdir dc/de/d17/d124 0 2024-09-16T09:45:36.559 INFO:tasks.workunit.client.1.smithi114.stdout:3/839: fdatasync dc/de/d17/d2d/db4/f123 0 2024-09-16T09:45:36.559 INFO:tasks.workunit.client.1.smithi114.stdout:6/797: getdents d6/da/d76 0 2024-09-16T09:45:36.560 INFO:tasks.workunit.client.1.smithi114.stdout:8/687: dwrite d4/dae/f7b [4194304,4194304] 0 2024-09-16T09:45:36.560 INFO:tasks.workunit.client.1.smithi114.stdout:2/825: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/fdb [0,4194304] 0 2024-09-16T09:45:36.560 INFO:tasks.workunit.client.1.smithi114.stdout:0/715: mknod d1f/d27/d47/c102 0 2024-09-16T09:45:36.561 INFO:tasks.workunit.client.1.smithi114.stdout:0/716: chown d1f/d22/d2e/d46/d7f/cd0 649 1 2024-09-16T09:45:36.561 INFO:tasks.workunit.client.1.smithi114.stdout:3/840: creat dc/de/d17/d2d/d41/d11e/da7/f125 x:0 0 0 2024-09-16T09:45:36.564 INFO:tasks.workunit.client.1.smithi114.stdout:6/798: getdents d6/da/d48/db0 0 2024-09-16T09:45:36.565 INFO:tasks.workunit.client.1.smithi114.stdout:2/826: mknod d1/d8/d10/d5a/c12f 0 2024-09-16T09:45:36.567 INFO:tasks.workunit.client.1.smithi114.stdout:8/688: mknod d4/dae/d54/db3/ced 0 2024-09-16T09:45:36.570 INFO:tasks.workunit.client.1.smithi114.stdout:0/717: creat d1f/d2d/d7a/ddc/f103 x:0 0 0 2024-09-16T09:45:36.571 INFO:tasks.workunit.client.1.smithi114.stdout:3/841: dread dc/de/d18/f35 [0,4194304] 0 2024-09-16T09:45:36.573 INFO:tasks.workunit.client.1.smithi114.stdout:6/799: unlink d6/da/d36/f38 0 2024-09-16T09:45:36.576 INFO:tasks.workunit.client.1.smithi114.stdout:0/718: link d1f/d22/d2e/c86 d1f/d22/d2e/c104 0 2024-09-16T09:45:36.576 INFO:tasks.workunit.client.1.smithi114.stdout:0/719: chown d1f/cd1 381566 1 2024-09-16T09:45:36.579 INFO:tasks.workunit.client.1.smithi114.stdout:6/800: symlink d6/da/db3/dd1/dec/lf7 0 2024-09-16T09:45:36.579 INFO:tasks.workunit.client.1.smithi114.stdout:6/801: fsync d6/d64/fc6 0 2024-09-16T09:45:36.579 INFO:tasks.workunit.client.1.smithi114.stdout:7/803: sync 2024-09-16T09:45:36.580 INFO:tasks.workunit.client.1.smithi114.stdout:8/689: rename d4/db/d68/fc4 to d4/d1f/fee 0 2024-09-16T09:45:36.580 INFO:tasks.workunit.client.1.smithi114.stdout:4/740: dwrite d0/d26/f90 [0,4194304] 0 2024-09-16T09:45:36.581 INFO:tasks.workunit.client.1.smithi114.stdout:7/804: mknod d2/d9/d2b/d2e/d22/d27/d4d/dba/c110 0 2024-09-16T09:45:36.583 INFO:tasks.workunit.client.1.smithi114.stdout:4/741: mknod d0/d26/d3c/d3e/d5a/d5d/ddf/c105 0 2024-09-16T09:45:36.583 INFO:tasks.workunit.client.1.smithi114.stdout:4/742: readlink d0/d13/db0/lb9 0 2024-09-16T09:45:36.586 INFO:tasks.workunit.client.1.smithi114.stdout:4/743: mkdir d0/d26/d40/da6/d106 0 2024-09-16T09:45:36.586 INFO:tasks.workunit.client.1.smithi114.stdout:4/744: write d0/d26/d3c/d3e/f100 [643492,21433] 0 2024-09-16T09:45:36.588 INFO:tasks.workunit.client.1.smithi114.stdout:4/745: creat d0/d26/d40/da6/f107 x:0 0 0 2024-09-16T09:45:36.591 INFO:tasks.workunit.client.1.smithi114.stdout:4/746: dread d0/f64 [0,4194304] 0 2024-09-16T09:45:36.593 INFO:tasks.workunit.client.1.smithi114.stdout:4/747: mknod d0/d26/d29/de9/c108 0 2024-09-16T09:45:36.593 INFO:tasks.workunit.client.1.smithi114.stdout:4/748: chown d0/d26/d40/da6/f107 129836112 1 2024-09-16T09:45:36.593 INFO:tasks.workunit.client.1.smithi114.stdout:7/805: write d2/d9/d2b/d78/fb6 [735649,11699] 0 2024-09-16T09:45:36.593 INFO:tasks.workunit.client.1.smithi114.stdout:7/806: readlink d2/l1b 0 2024-09-16T09:45:36.593 INFO:tasks.workunit.client.1.smithi114.stdout:4/749: creat d0/d26/d3c/d3e/d5a/d5d/d70/d83/f109 x:0 0 0 2024-09-16T09:45:36.595 INFO:tasks.workunit.client.1.smithi114.stdout:7/807: creat d2/d9/d51/f111 x:0 0 0 2024-09-16T09:45:36.595 INFO:tasks.workunit.client.1.smithi114.stdout:7/808: truncate d2/d9/d2b/d2e/d22/d66/fd0 1286265 0 2024-09-16T09:45:36.595 INFO:tasks.workunit.client.1.smithi114.stdout:7/809: chown d2/df/df9/ca0 181737 1 2024-09-16T09:45:36.595 INFO:tasks.workunit.client.1.smithi114.stdout:4/750: rmdir d0/d26/d3c/d3e/d5a 39 2024-09-16T09:45:36.595 INFO:tasks.workunit.client.1.smithi114.stdout:8/690: write d4/db/d39/d3c/f95 [4150492,20292] 0 2024-09-16T09:45:36.606 INFO:tasks.workunit.client.1.smithi114.stdout:3/842: dwrite dc/de/d17/d2d/db4/f123 [0,4194304] 0 2024-09-16T09:45:36.606 INFO:tasks.workunit.client.1.smithi114.stdout:7/810: write d2/d9/d2b/d2e/d22/d27/f40 [736199,56091] 0 2024-09-16T09:45:36.607 INFO:tasks.workunit.client.1.smithi114.stdout:7/811: read d2/d9/d2b/d2e/d3e/f65 [1310489,122364] 0 2024-09-16T09:45:36.609 INFO:tasks.workunit.client.1.smithi114.stdout:7/812: link d2/c37 d2/d9/d2b/d2e/d93/c112 0 2024-09-16T09:45:36.609 INFO:tasks.workunit.client.1.smithi114.stdout:7/813: write d2/d9/d2b/d2e/d77/ff2 [699626,111331] 0 2024-09-16T09:45:36.609 INFO:tasks.workunit.client.1.smithi114.stdout:7/814: write d2/d9/d2b/d2e/d3e/d79/f105 [474726,40540] 0 2024-09-16T09:45:36.609 INFO:tasks.workunit.client.1.smithi114.stdout:7/815: stat d2/lf8 0 2024-09-16T09:45:36.610 INFO:tasks.workunit.client.1.smithi114.stdout:7/816: dread - d2/d9/d2b/d59/ff0 zero size 2024-09-16T09:45:36.610 INFO:tasks.workunit.client.1.smithi114.stdout:7/817: rename d2/d9/d2b/d2e/d3e/d79/lb4 to d2/df/l113 0 2024-09-16T09:45:36.616 INFO:tasks.workunit.client.1.smithi114.stdout:2/827: dwrite d1/f2c [0,4194304] 0 2024-09-16T09:45:36.617 INFO:tasks.workunit.client.1.smithi114.stdout:2/828: mkdir d1/d8/d10/d16/d1d/d130 0 2024-09-16T09:45:36.618 INFO:tasks.workunit.client.1.smithi114.stdout:2/829: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/c131 0 2024-09-16T09:45:36.620 INFO:tasks.workunit.client.1.smithi114.stdout:3/843: dread dc/fb7 [0,4194304] 0 2024-09-16T09:45:36.620 INFO:tasks.workunit.client.1.smithi114.stdout:2/830: dread d1/d8/d10/d16/d1d/f66 [0,4194304] 0 2024-09-16T09:45:36.620 INFO:tasks.workunit.client.1.smithi114.stdout:2/831: readlink d1/l5 0 2024-09-16T09:45:36.621 INFO:tasks.workunit.client.1.smithi114.stdout:3/844: symlink dc/de/d17/d2d/d41/d9e/l126 0 2024-09-16T09:45:36.621 INFO:tasks.workunit.client.1.smithi114.stdout:3/845: stat dc/de/d17/d2d/d41/d11e/d98/fdc 0 2024-09-16T09:45:36.621 INFO:tasks.workunit.client.1.smithi114.stdout:3/846: write dc/fb7 [5015821,122456] 0 2024-09-16T09:45:36.622 INFO:tasks.workunit.client.1.smithi114.stdout:2/832: rename d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/ccc to d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/c132 0 2024-09-16T09:45:36.622 INFO:tasks.workunit.client.1.smithi114.stdout:7/818: dread d2/df/f3a [0,4194304] 0 2024-09-16T09:45:36.622 INFO:tasks.workunit.client.1.smithi114.stdout:7/819: dread - d2/d9/d51/d84/dda/fec zero size 2024-09-16T09:45:36.623 INFO:tasks.workunit.client.1.smithi114.stdout:3/847: link dc/de/d18/d78/d5c/d5d/d50/dea/f106 dc/de/d18/dfe/db2/dd8/f127 0 2024-09-16T09:45:36.624 INFO:tasks.workunit.client.1.smithi114.stdout:2/833: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9/l133 0 2024-09-16T09:45:36.624 INFO:tasks.workunit.client.1.smithi114.stdout:0/720: dwrite d1f/d22/d2e/f37 [4194304,4194304] 0 2024-09-16T09:45:36.625 INFO:tasks.workunit.client.1.smithi114.stdout:7/820: link d2/df/df9/ca0 d2/d9/d51/d84/dda/c114 0 2024-09-16T09:45:36.625 INFO:tasks.workunit.client.1.smithi114.stdout:4/751: dwrite d0/d26/d3c/d3e/d4b/d46/ff5 [0,4194304] 0 2024-09-16T09:45:36.625 INFO:tasks.workunit.client.1.smithi114.stdout:4/752: chown d0/d26/d2e/c3f 58936095 1 2024-09-16T09:45:36.625 INFO:tasks.workunit.client.1.smithi114.stdout:8/691: dwrite d4/db/dd/f6f [0,4194304] 0 2024-09-16T09:45:36.626 INFO:tasks.workunit.client.1.smithi114.stdout:3/848: creat dc/de/d17/d2d/db4/f128 x:0 0 0 2024-09-16T09:45:36.626 INFO:tasks.workunit.client.1.smithi114.stdout:3/849: chown dc/de/d1f 3794 1 2024-09-16T09:45:36.626 INFO:tasks.workunit.client.1.smithi114.stdout:2/834: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9/d105/f134 x:0 0 0 2024-09-16T09:45:36.628 INFO:tasks.workunit.client.1.smithi114.stdout:0/721: symlink d1f/d22/d2e/l105 0 2024-09-16T09:45:36.629 INFO:tasks.workunit.client.1.smithi114.stdout:7/821: symlink d2/d9/d2b/d78/d99/ddd/def/l115 0 2024-09-16T09:45:36.631 INFO:tasks.workunit.client.1.smithi114.stdout:5/720: sync 2024-09-16T09:45:36.632 INFO:tasks.workunit.client.1.smithi114.stdout:4/753: mknod d0/d26/d3c/d3e/d5a/d5d/d70/c10a 0 2024-09-16T09:45:36.634 INFO:tasks.workunit.client.1.smithi114.stdout:3/850: rename dc/de/d17/d2d/db4/d26/fcc to dc/d38/d3f/f129 0 2024-09-16T09:45:36.634 INFO:tasks.workunit.client.1.smithi114.stdout:3/851: write dc/de/d17/d2d/db4/fae [5095875,109939] 0 2024-09-16T09:45:36.635 INFO:tasks.workunit.client.1.smithi114.stdout:2/835: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/f135 x:0 0 0 2024-09-16T09:45:36.636 INFO:tasks.workunit.client.1.smithi114.stdout:0/722: creat d1f/d22/d2e/d46/d7f/daf/f106 x:0 0 0 2024-09-16T09:45:36.637 INFO:tasks.workunit.client.1.smithi114.stdout:5/721: unlink d3/d24/d84/db9/fee 0 2024-09-16T09:45:36.639 INFO:tasks.workunit.client.1.smithi114.stdout:4/754: rmdir d0/d26/d40/da6/dfc 0 2024-09-16T09:45:36.641 INFO:tasks.workunit.client.1.smithi114.stdout:3/852: rename dc/de/d17/d2d/db4/d26/f54 to dc/de/d18/dfe/db2/dd8/d11d/f12a 0 2024-09-16T09:45:36.641 INFO:tasks.workunit.client.1.smithi114.stdout:2/836: mkdir d1/d8/d10/d16/d60/db7/deb/d136 0 2024-09-16T09:45:36.642 INFO:tasks.workunit.client.1.smithi114.stdout:0/723: rmdir d1f/d22/d2e/d46/d7f/d8d/dbb/ddb 39 2024-09-16T09:45:36.643 INFO:tasks.workunit.client.1.smithi114.stdout:4/755: dread d0/d13/f6f [4194304,4194304] 0 2024-09-16T09:45:36.643 INFO:tasks.workunit.client.1.smithi114.stdout:5/722: unlink d3/d24/d84/d7a/d43/d4c/d6d/l7f 0 2024-09-16T09:45:36.646 INFO:tasks.workunit.client.1.smithi114.stdout:3/853: creat dc/de/d17/d2d/d41/d11e/d98/f12b x:0 0 0 2024-09-16T09:45:36.648 INFO:tasks.workunit.client.1.smithi114.stdout:2/837: link d1/d8/d10/f67 d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d90/f137 0 2024-09-16T09:45:36.649 INFO:tasks.workunit.client.1.smithi114.stdout:0/724: truncate d1f/d9e/fbc 260615 0 2024-09-16T09:45:36.651 INFO:tasks.workunit.client.1.smithi114.stdout:4/756: mknod d0/d26/d40/c10b 0 2024-09-16T09:45:36.652 INFO:tasks.workunit.client.1.smithi114.stdout:7/822: dwrite d2/df/df9/dbd/ff4 [0,4194304] 0 2024-09-16T09:45:36.652 INFO:tasks.workunit.client.1.smithi114.stdout:7/823: write d2/d9/fd3 [942525,49876] 0 2024-09-16T09:45:36.652 INFO:tasks.workunit.client.1.smithi114.stdout:7/824: write d2/d9/d51/d84/fe3 [514743,118378] 0 2024-09-16T09:45:36.653 INFO:tasks.workunit.client.1.smithi114.stdout:8/692: dwrite d4/dae/f7b [0,4194304] 0 2024-09-16T09:45:36.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/723: mknod d3/d24/d7d/cf1 0 2024-09-16T09:45:36.655 INFO:tasks.workunit.client.1.smithi114.stdout:2/838: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138 0 2024-09-16T09:45:36.656 INFO:tasks.workunit.client.1.smithi114.stdout:0/725: mkdir d1f/d2d/d7a/d107 0 2024-09-16T09:45:36.660 INFO:tasks.workunit.client.1.smithi114.stdout:7/825: creat d2/d55/f116 x:0 0 0 2024-09-16T09:45:36.661 INFO:tasks.workunit.client.1.smithi114.stdout:7/826: dread d2/d9/d2b/d2e/d22/d27/f1f [0,4194304] 0 2024-09-16T09:45:36.661 INFO:tasks.workunit.client.1.smithi114.stdout:7/827: fsync d2/d55/fa6 0 2024-09-16T09:45:36.663 INFO:tasks.workunit.client.1.smithi114.stdout:3/854: dwrite dc/de/d18/d78/d5c/d5d/fa6 [0,4194304] 0 2024-09-16T09:45:36.669 INFO:tasks.workunit.client.1.smithi114.stdout:8/693: creat d4/db/d91/fef x:0 0 0 2024-09-16T09:45:36.671 INFO:tasks.workunit.client.1.smithi114.stdout:5/724: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/c73 to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/cf2 0 2024-09-16T09:45:36.672 INFO:tasks.workunit.client.1.smithi114.stdout:2/839: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d90 39 2024-09-16T09:45:36.674 INFO:tasks.workunit.client.1.smithi114.stdout:0/726: truncate d1f/d22/d2e/d46/d7f/daf/fd2 6040675 0 2024-09-16T09:45:36.675 INFO:tasks.workunit.client.1.smithi114.stdout:4/757: truncate d0/d26/d3c/d3e/d4b/d46/ff5 3620702 0 2024-09-16T09:45:36.678 INFO:tasks.workunit.client.1.smithi114.stdout:7/828: mkdir d2/d9/d2b/d2e/d93/d117 0 2024-09-16T09:45:36.684 INFO:tasks.workunit.client.1.smithi114.stdout:8/694: mkdir d4/db/d3e/d71/d78/df0 0 2024-09-16T09:45:36.684 INFO:tasks.workunit.client.1.smithi114.stdout:3/855: rename dc/de/d17/f1d to dc/de/f12c 0 2024-09-16T09:45:36.685 INFO:tasks.workunit.client.1.smithi114.stdout:5/725: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/de8/ff3 x:0 0 0 2024-09-16T09:45:36.685 INFO:tasks.workunit.client.1.smithi114.stdout:5/726: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/ff0 0 2024-09-16T09:45:36.686 INFO:tasks.workunit.client.1.smithi114.stdout:0/727: truncate d1f/d27/d55/fd3 240157 0 2024-09-16T09:45:36.687 INFO:tasks.workunit.client.1.smithi114.stdout:4/758: unlink d0/d26/d29/d9f/da0/lc6 0 2024-09-16T09:45:36.687 INFO:tasks.workunit.client.1.smithi114.stdout:4/759: write d0/d26/d3c/d3e/d4b/fd6 [543395,9715] 0 2024-09-16T09:45:36.689 INFO:tasks.workunit.client.1.smithi114.stdout:8/695: rmdir d4/dae/d54/db3 39 2024-09-16T09:45:36.690 INFO:tasks.workunit.client.1.smithi114.stdout:3/856: getdents dc/de/d17/d2d/d41/d11e/d57 0 2024-09-16T09:45:36.690 INFO:tasks.workunit.client.1.smithi114.stdout:3/857: write dc/de/d17/d2d/d41/f42 [4313909,71010] 0 2024-09-16T09:45:36.691 INFO:tasks.workunit.client.1.smithi114.stdout:2/840: link d1/d8/d10/d16/d60/ld5 d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b/l139 0 2024-09-16T09:45:36.692 INFO:tasks.workunit.client.1.smithi114.stdout:0/728: creat d1f/d22/d2e/d46/f108 x:0 0 0 2024-09-16T09:45:36.694 INFO:tasks.workunit.client.1.smithi114.stdout:8/696: rename d4/db/d39/d3c/f81 to d4/db/d3e/ff1 0 2024-09-16T09:45:36.694 INFO:tasks.workunit.client.1.smithi114.stdout:8/697: readlink d4/db/d39/d3c/d4e/d82/d72/d59/ldd 0 2024-09-16T09:45:36.694 INFO:tasks.workunit.client.1.smithi114.stdout:8/698: fsync d4/d6d/f8e 0 2024-09-16T09:45:36.695 INFO:tasks.workunit.client.1.smithi114.stdout:3/858: mkdir dc/de/d17/d2d/db4/d6a/d12d 0 2024-09-16T09:45:36.696 INFO:tasks.workunit.client.1.smithi114.stdout:2/841: symlink d1/d8/d10/d16/dd9/l13a 0 2024-09-16T09:45:36.698 INFO:tasks.workunit.client.1.smithi114.stdout:8/699: rmdir d4/d1f 39 2024-09-16T09:45:36.698 INFO:tasks.workunit.client.1.smithi114.stdout:4/760: write d0/d26/d3c/d3e/d4b/d46/f80 [7763293,56668] 0 2024-09-16T09:45:36.701 INFO:tasks.workunit.client.1.smithi114.stdout:2/842: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f13b x:0 0 0 2024-09-16T09:45:36.701 INFO:tasks.workunit.client.1.smithi114.stdout:9/705: sync 2024-09-16T09:45:36.702 INFO:tasks.workunit.client.1.smithi114.stdout:1/767: sync 2024-09-16T09:45:36.703 INFO:tasks.workunit.client.1.smithi114.stdout:5/727: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/de8/ff3 [0,4194304] 0 2024-09-16T09:45:36.703 INFO:tasks.workunit.client.1.smithi114.stdout:5/728: dread - d3/d24/d84/d7a/d43/f91 zero size 2024-09-16T09:45:36.703 INFO:tasks.workunit.client.1.smithi114.stdout:8/700: rename d4/db/d68/c4c to d4/db/d3e/dd5/cf2 0 2024-09-16T09:45:36.705 INFO:tasks.workunit.client.1.smithi114.stdout:2/843: creat d1/d8/d10/d16/dd9/f13c x:0 0 0 2024-09-16T09:45:36.705 INFO:tasks.workunit.client.1.smithi114.stdout:6/802: sync 2024-09-16T09:45:36.706 INFO:tasks.workunit.client.1.smithi114.stdout:9/706: chown d3/da/d10/d23/d29/d87/cc9 9638 1 2024-09-16T09:45:36.708 INFO:tasks.workunit.client.1.smithi114.stdout:1/768: creat d4/d2b/d16/d71/d72/d75/db4/dbb/f103 x:0 0 0 2024-09-16T09:45:36.709 INFO:tasks.workunit.client.1.smithi114.stdout:4/761: write d0/d26/d3c/ffb [3614267,119741] 0 2024-09-16T09:45:36.710 INFO:tasks.workunit.client.1.smithi114.stdout:5/729: creat d3/d24/d84/d7a/d43/d4c/d6d/ff4 x:0 0 0 2024-09-16T09:45:36.710 INFO:tasks.workunit.client.1.smithi114.stdout:5/730: readlink d3/d24/d84/d7a/l5b 0 2024-09-16T09:45:36.711 INFO:tasks.workunit.client.1.smithi114.stdout:5/731: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/c6b 6717 1 2024-09-16T09:45:36.711 INFO:tasks.workunit.client.1.smithi114.stdout:5/732: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/l82 325 1 2024-09-16T09:45:36.711 INFO:tasks.workunit.client.1.smithi114.stdout:5/733: chown d3/d24/d84/d7a/d43/f51 119499 1 2024-09-16T09:45:36.712 INFO:tasks.workunit.client.1.smithi114.stdout:8/701: getdents d4/db/d68/d28/dac 0 2024-09-16T09:45:36.713 INFO:tasks.workunit.client.1.smithi114.stdout:8/702: fsync d4/dae/f9b 0 2024-09-16T09:45:36.713 INFO:tasks.workunit.client.1.smithi114.stdout:8/703: chown d4/l37 7184381 1 2024-09-16T09:45:36.713 INFO:tasks.workunit.client.1.smithi114.stdout:8/704: fdatasync d4/dae/d9c/fca 0 2024-09-16T09:45:36.713 INFO:tasks.workunit.client.1.smithi114.stdout:0/729: dwrite d1f/d20/d48/ffe [0,4194304] 0 2024-09-16T09:45:36.713 INFO:tasks.workunit.client.1.smithi114.stdout:1/769: dread d4/d2b/f53 [0,4194304] 0 2024-09-16T09:45:36.714 INFO:tasks.workunit.client.1.smithi114.stdout:2/844: creat d1/d8/d10/d16/d1d/d130/f13d x:0 0 0 2024-09-16T09:45:36.716 INFO:tasks.workunit.client.1.smithi114.stdout:6/803: rmdir d6/d2d/d46/dcc/d62/d77/df1 0 2024-09-16T09:45:36.718 INFO:tasks.workunit.client.1.smithi114.stdout:9/707: creat d3/da/d10/d23/d43/d82/dc5/ff3 x:0 0 0 2024-09-16T09:45:36.720 INFO:tasks.workunit.client.1.smithi114.stdout:4/762: mknod d0/d26/d3c/d3e/d5a/d5d/c10c 0 2024-09-16T09:45:36.720 INFO:tasks.workunit.client.1.smithi114.stdout:4/763: fdatasync d0/d26/d29/d2b/d58/fc9 0 2024-09-16T09:45:36.720 INFO:tasks.workunit.client.1.smithi114.stdout:4/764: truncate d0/d26/d3c/d3e/d5a/d5d/ff4 208052 0 2024-09-16T09:45:36.720 INFO:tasks.workunit.client.1.smithi114.stdout:4/765: chown d0/d26/d29/d2b/d58/fc9 24 1 2024-09-16T09:45:36.720 INFO:tasks.workunit.client.1.smithi114.stdout:5/734: creat d3/d24/d84/d7a/d43/ff5 x:0 0 0 2024-09-16T09:45:36.721 INFO:tasks.workunit.client.1.smithi114.stdout:8/705: creat d4/db/d3e/d71/d78/d8d/da9/ff3 x:0 0 0 2024-09-16T09:45:36.724 INFO:tasks.workunit.client.1.smithi114.stdout:2/845: rmdir d1/d9e 39 2024-09-16T09:45:36.725 INFO:tasks.workunit.client.1.smithi114.stdout:2/846: read - d1/d8/d10/d5a/fce zero size 2024-09-16T09:45:36.725 INFO:tasks.workunit.client.1.smithi114.stdout:9/708: write d3/da/d10/d23/d43/f18 [3022779,98512] 0 2024-09-16T09:45:36.725 INFO:tasks.workunit.client.1.smithi114.stdout:9/709: stat d3/da/d10/d23/d29/d2c/d6b/fc6 0 2024-09-16T09:45:36.726 INFO:tasks.workunit.client.1.smithi114.stdout:6/804: creat d6/d2d/d46/dcc/d62/ff8 x:0 0 0 2024-09-16T09:45:36.726 INFO:tasks.workunit.client.1.smithi114.stdout:6/805: chown d6/d2d/d46/dcc/d62/faa 3856 1 2024-09-16T09:45:36.727 INFO:tasks.workunit.client.1.smithi114.stdout:6/806: write d6/d2d/f54 [5971310,67673] 0 2024-09-16T09:45:36.728 INFO:tasks.workunit.client.1.smithi114.stdout:4/766: mknod d0/d13/d56/d7e/dec/c10d 0 2024-09-16T09:45:36.728 INFO:tasks.workunit.client.1.smithi114.stdout:5/735: truncate d3/d24/d84/f4f 108995 0 2024-09-16T09:45:36.730 INFO:tasks.workunit.client.1.smithi114.stdout:2/847: rename d1/d8/d10/d5a/fa9 to d1/d9e/daf/f13e 0 2024-09-16T09:45:36.731 INFO:tasks.workunit.client.1.smithi114.stdout:8/706: dread d4/d1f/f35 [0,4194304] 0 2024-09-16T09:45:36.731 INFO:tasks.workunit.client.1.smithi114.stdout:9/710: getdents d3/da/d10/d23/d43/d1e/d4c/d8c 0 2024-09-16T09:45:36.732 INFO:tasks.workunit.client.1.smithi114.stdout:6/807: mknod d6/da/d10/d92/cf9 0 2024-09-16T09:45:36.733 INFO:tasks.workunit.client.1.smithi114.stdout:4/767: symlink d0/d26/d29/d9f/da0/l10e 0 2024-09-16T09:45:36.734 INFO:tasks.workunit.client.1.smithi114.stdout:5/736: link d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/ccc d3/d24/cf6 0 2024-09-16T09:45:36.735 INFO:tasks.workunit.client.1.smithi114.stdout:8/707: rename d4/db/d39/feb to d4/db/d39/d3c/dec/ff4 0 2024-09-16T09:45:36.736 INFO:tasks.workunit.client.1.smithi114.stdout:8/708: dread d4/db/d3e/d47/fa2 [0,4194304] 0 2024-09-16T09:45:36.736 INFO:tasks.workunit.client.1.smithi114.stdout:8/709: fsync d4/db/dd/f80 0 2024-09-16T09:45:36.737 INFO:tasks.workunit.client.1.smithi114.stdout:9/711: readlink d3/da/d10/d23/d29/d87/l96 0 2024-09-16T09:45:36.738 INFO:tasks.workunit.client.1.smithi114.stdout:6/808: fdatasync d6/da/d10/d40/d82/fda 0 2024-09-16T09:45:36.740 INFO:tasks.workunit.client.1.smithi114.stdout:4/768: link d0/l24 d0/d26/d3c/d3e/d5a/d5d/ddf/l10f 0 2024-09-16T09:45:36.740 INFO:tasks.workunit.client.1.smithi114.stdout:0/730: dwrite d1f/d27/fac [0,4194304] 0 2024-09-16T09:45:36.740 INFO:tasks.workunit.client.1.smithi114.stdout:9/712: dread d3/da/d10/d23/d43/d1e/d4c/fb7 [0,4194304] 0 2024-09-16T09:45:36.740 INFO:tasks.workunit.client.1.smithi114.stdout:5/737: creat d3/d1f/ff7 x:0 0 0 2024-09-16T09:45:36.742 INFO:tasks.workunit.client.1.smithi114.stdout:8/710: creat d4/db/dd/de4/dea/ff5 x:0 0 0 2024-09-16T09:45:36.742 INFO:tasks.workunit.client.1.smithi114.stdout:1/770: dwrite d4/d2b/d2f/d3a/dc5/fe9 [0,4194304] 0 2024-09-16T09:45:36.743 INFO:tasks.workunit.client.1.smithi114.stdout:6/809: unlink d6/dea/lf5 0 2024-09-16T09:45:36.743 INFO:tasks.workunit.client.1.smithi114.stdout:6/810: stat d6/da/db3/fe8 0 2024-09-16T09:45:36.744 INFO:tasks.workunit.client.1.smithi114.stdout:0/731: symlink d1f/ddf/df5/l109 0 2024-09-16T09:45:36.745 INFO:tasks.workunit.client.1.smithi114.stdout:5/738: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/l44 to d3/d24/d84/d7a/d43/d4c/d6d/lf8 0 2024-09-16T09:45:36.746 INFO:tasks.workunit.client.1.smithi114.stdout:6/811: rmdir d6/da/db3/dc8 0 2024-09-16T09:45:36.748 INFO:tasks.workunit.client.1.smithi114.stdout:0/732: creat d1f/d27/de6/f10a x:0 0 0 2024-09-16T09:45:36.749 INFO:tasks.workunit.client.1.smithi114.stdout:1/771: rename d4/d2b/d29/l46 to d4/d2b/d16/d71/l104 0 2024-09-16T09:45:36.749 INFO:tasks.workunit.client.1.smithi114.stdout:1/772: write d4/d2b/d2f/d3a/ff0 [892663,53639] 0 2024-09-16T09:45:36.749 INFO:tasks.workunit.client.1.smithi114.stdout:1/773: truncate d4/d2b/f53 1804771 0 2024-09-16T09:45:36.750 INFO:tasks.workunit.client.1.smithi114.stdout:5/739: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/lf9 0 2024-09-16T09:45:36.751 INFO:tasks.workunit.client.1.smithi114.stdout:9/713: dread d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:36.753 INFO:tasks.workunit.client.1.smithi114.stdout:5/740: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/ffa x:0 0 0 2024-09-16T09:45:36.753 INFO:tasks.workunit.client.1.smithi114.stdout:5/741: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52 390 1 2024-09-16T09:45:36.754 INFO:tasks.workunit.client.1.smithi114.stdout:9/714: symlink d3/da/d10/d23/d43/d1e/da0/lf4 0 2024-09-16T09:45:36.754 INFO:tasks.workunit.client.1.smithi114.stdout:9/715: symlink d3/da/lf5 0 2024-09-16T09:45:36.755 INFO:tasks.workunit.client.1.smithi114.stdout:9/716: truncate d3/da/d10/d23/d29/d2c/d45/f65 1066024 0 2024-09-16T09:45:36.757 INFO:tasks.workunit.client.1.smithi114.stdout:9/717: mknod d3/da/d10/d23/d29/d87/cf6 0 2024-09-16T09:45:36.759 INFO:tasks.workunit.client.1.smithi114.stdout:2/848: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 [4194304,4194304] 0 2024-09-16T09:45:36.759 INFO:tasks.workunit.client.1.smithi114.stdout:2/849: read - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f13b zero size 2024-09-16T09:45:36.759 INFO:tasks.workunit.client.1.smithi114.stdout:8/711: dwrite d4/db/d3e/d71/d78/d8d/da9/ff3 [0,4194304] 0 2024-09-16T09:45:36.759 INFO:tasks.workunit.client.1.smithi114.stdout:8/712: rename d4 to d4/db/d39/d3c/d84/df6 22 2024-09-16T09:45:36.761 INFO:tasks.workunit.client.1.smithi114.stdout:6/812: dread d6/d2d/d46/d9c/fc7 [0,4194304] 0 2024-09-16T09:45:36.761 INFO:tasks.workunit.client.1.smithi114.stdout:2/850: creat d1/d8/d10/d16/d1d/d92/da7/d3e/f13f x:0 0 0 2024-09-16T09:45:36.761 INFO:tasks.workunit.client.1.smithi114.stdout:2/851: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f13b zero size 2024-09-16T09:45:36.768 INFO:tasks.workunit.client.1.smithi114.stdout:2/852: creat d1/d8/d10/d16/d1d/d130/f140 x:0 0 0 2024-09-16T09:45:36.770 INFO:tasks.workunit.client.1.smithi114.stdout:2/853: rename d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/df5 to d1/d9e/d141 0 2024-09-16T09:45:36.772 INFO:tasks.workunit.client.1.smithi114.stdout:2/854: mkdir d1/d8/d10/d16/d60/db7/deb/d136/d142 0 2024-09-16T09:45:36.772 INFO:tasks.workunit.client.1.smithi114.stdout:2/855: chown d1/d8/f101 1069 1 2024-09-16T09:45:36.772 INFO:tasks.workunit.client.1.smithi114.stdout:2/856: chown d1/d8/d10/d16/d1d/d92/da7/fe0 92372822 1 2024-09-16T09:45:36.772 INFO:tasks.workunit.client.1.smithi114.stdout:2/857: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/f13f zero size 2024-09-16T09:45:36.775 INFO:tasks.workunit.client.1.smithi114.stdout:2/858: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/f143 x:0 0 0 2024-09-16T09:45:36.779 INFO:tasks.workunit.client.1.smithi114.stdout:5/742: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fe1 [0,4194304] 0 2024-09-16T09:45:36.779 INFO:tasks.workunit.client.1.smithi114.stdout:5/743: write d3/d1f/ff7 [360151,110806] 0 2024-09-16T09:45:36.779 INFO:tasks.workunit.client.1.smithi114.stdout:5/744: fdatasync d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 0 2024-09-16T09:45:36.783 INFO:tasks.workunit.client.1.smithi114.stdout:5/745: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/d98/lfb 0 2024-09-16T09:45:36.783 INFO:tasks.workunit.client.1.smithi114.stdout:5/746: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/l3c 0 1 2024-09-16T09:45:36.784 INFO:tasks.workunit.client.1.smithi114.stdout:5/747: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/fc1 [118888,114538] 0 2024-09-16T09:45:36.785 INFO:tasks.workunit.client.1.smithi114.stdout:0/733: getdents d1f/ddf/df5 0 2024-09-16T09:45:36.785 INFO:tasks.workunit.client.1.smithi114.stdout:0/734: dread - d1f/d22/fa0 zero size 2024-09-16T09:45:36.786 INFO:tasks.workunit.client.1.smithi114.stdout:0/735: read d1f/d20/f51 [100939,31397] 0 2024-09-16T09:45:36.796 INFO:tasks.workunit.client.1.smithi114.stdout:0/736: dread f15 [0,4194304] 0 2024-09-16T09:45:36.796 INFO:tasks.workunit.client.1.smithi114.stdout:0/737: chown d1f/d2d/d7a/ddc 1752146 1 2024-09-16T09:45:36.796 INFO:tasks.workunit.client.1.smithi114.stdout:0/738: dread - d1f/ddf/df5/ffc zero size 2024-09-16T09:45:36.802 INFO:tasks.workunit.client.1.smithi114.stdout:6/813: dwrite d6/da/d36/fa9 [0,4194304] 0 2024-09-16T09:45:36.803 INFO:tasks.workunit.client.1.smithi114.stdout:9/718: dwrite d3/da/d10/d23/d43/d1e/d4c/d8c/fd4 [0,4194304] 0 2024-09-16T09:45:36.803 INFO:tasks.workunit.client.1.smithi114.stdout:2/859: dwrite d1/f96 [0,4194304] 0 2024-09-16T09:45:36.803 INFO:tasks.workunit.client.1.smithi114.stdout:8/713: dwrite d4/db/fa4 [0,4194304] 0 2024-09-16T09:45:36.805 INFO:tasks.workunit.client.1.smithi114.stdout:6/814: mknod d6/da/db3/cfa 0 2024-09-16T09:45:36.808 INFO:tasks.workunit.client.1.smithi114.stdout:0/739: write d1f/d27/d47/f64 [118226,57729] 0 2024-09-16T09:45:36.810 INFO:tasks.workunit.client.1.smithi114.stdout:2/860: creat d1/d8/d10/d16/d1d/d130/f144 x:0 0 0 2024-09-16T09:45:36.813 INFO:tasks.workunit.client.1.smithi114.stdout:8/714: rmdir d4/db/dd/de4 39 2024-09-16T09:45:36.813 INFO:tasks.workunit.client.1.smithi114.stdout:8/715: write d4/db/d91/fab [781967,80565] 0 2024-09-16T09:45:36.815 INFO:tasks.workunit.client.1.smithi114.stdout:6/815: creat d6/da/dbb/dd3/ffb x:0 0 0 2024-09-16T09:45:36.816 INFO:tasks.workunit.client.1.smithi114.stdout:8/716: mknod d4/db/d3e/d71/d78/df0/cf7 0 2024-09-16T09:45:36.817 INFO:tasks.workunit.client.1.smithi114.stdout:6/816: read d6/da/d10/f47 [638457,37217] 0 2024-09-16T09:45:36.818 INFO:tasks.workunit.client.1.smithi114.stdout:6/817: rename d6/da/d48/dd6 to d6/da/d48/db0/dfc 0 2024-09-16T09:45:36.820 INFO:tasks.workunit.client.1.smithi114.stdout:6/818: write d6/da/d36/fa8 [103111,43386] 0 2024-09-16T09:45:36.821 INFO:tasks.workunit.client.1.smithi114.stdout:6/819: rename d6/d2d/d46/f52 to d6/da/db3/dd1/dec/ffd 0 2024-09-16T09:45:36.821 INFO:tasks.workunit.client.1.smithi114.stdout:6/820: chown d6/d2d/f9b 98 1 2024-09-16T09:45:36.822 INFO:tasks.workunit.client.1.smithi114.stdout:6/821: write d6/da/d10/d40/d82/fda [799065,6337] 0 2024-09-16T09:45:36.822 INFO:tasks.workunit.client.1.smithi114.stdout:6/822: symlink d6/da/d10/d40/d82/lfe 0 2024-09-16T09:45:36.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/823: dread d6/d2d/d46/f83 [0,4194304] 0 2024-09-16T09:45:36.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/824: stat d6/d2d/d46/dcc/dad/fae 0 2024-09-16T09:45:36.824 INFO:tasks.workunit.client.1.smithi114.stdout:6/825: stat d6/da/c31 0 2024-09-16T09:45:36.825 INFO:tasks.workunit.client.1.smithi114.stdout:6/826: mknod d6/da/db3/dd1/dec/cff 0 2024-09-16T09:45:36.830 INFO:tasks.workunit.client.1.smithi114.stdout:8/717: dread d4/fa [0,4194304] 0 2024-09-16T09:45:36.831 INFO:tasks.workunit.client.1.smithi114.stdout:9/719: dwrite d3/da/d10/d23/d29/d2c/d6b/fc6 [0,4194304] 0 2024-09-16T09:45:36.831 INFO:tasks.workunit.client.1.smithi114.stdout:2/861: dwrite d1/d8/d10/d16/d60/f109 [0,4194304] 0 2024-09-16T09:45:36.832 INFO:tasks.workunit.client.1.smithi114.stdout:7/829: sync 2024-09-16T09:45:36.833 INFO:tasks.workunit.client.1.smithi114.stdout:9/720: symlink d3/da/d10/d23/d43/d1e/d25/dc0/lf7 0 2024-09-16T09:45:36.837 INFO:tasks.workunit.client.1.smithi114.stdout:9/721: symlink d3/da/d10/d23/d43/d1e/d78/lf8 0 2024-09-16T09:45:36.842 INFO:tasks.workunit.client.1.smithi114.stdout:8/718: dread d4/db/dd/f13 [0,4194304] 0 2024-09-16T09:45:36.844 INFO:tasks.workunit.client.1.smithi114.stdout:9/722: dread d3/da/f4d [0,4194304] 0 2024-09-16T09:45:36.844 INFO:tasks.workunit.client.1.smithi114.stdout:9/723: write d3/da/d10/d23/d43/d1e/d4c/d8c/faf [580016,25334] 0 2024-09-16T09:45:36.845 INFO:tasks.workunit.client.1.smithi114.stdout:9/724: symlink d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/db5/lf9 0 2024-09-16T09:45:36.847 INFO:tasks.workunit.client.1.smithi114.stdout:9/725: chown d3/da/d10/d23/d29/d87/l89 0 1 2024-09-16T09:45:36.848 INFO:tasks.workunit.client.1.smithi114.stdout:9/726: creat d3/da/d10/d23/d29/d2c/d45/ffa x:0 0 0 2024-09-16T09:45:36.849 INFO:tasks.workunit.client.1.smithi114.stdout:9/727: write d3/da/d10/fb3 [252764,80753] 0 2024-09-16T09:45:36.849 INFO:tasks.workunit.client.1.smithi114.stdout:9/728: write d3/da/d10/d23/d29/d2c/d6b/f5f [1552427,92232] 0 2024-09-16T09:45:36.850 INFO:tasks.workunit.client.1.smithi114.stdout:9/729: mkdir d3/da/d10/d23/d43/d1e/d25/dc0/dfb 0 2024-09-16T09:45:36.850 INFO:tasks.workunit.client.1.smithi114.stdout:9/730: getdents d3/da/d10/d23/d29/d2c/d6b/d9d/ddc 0 2024-09-16T09:45:36.852 INFO:tasks.workunit.client.1.smithi114.stdout:8/719: write d4/db/d39/d3c/d4e/f66 [3401121,103616] 0 2024-09-16T09:45:36.854 INFO:tasks.workunit.client.1.smithi114.stdout:8/720: unlink d4/db/d39/d3c/d4e/cd0 0 2024-09-16T09:45:36.854 INFO:tasks.workunit.client.1.smithi114.stdout:8/721: rmdir d4/db/d39/d3c/d4e/d82/d72/d59 39 2024-09-16T09:45:36.855 INFO:tasks.workunit.client.1.smithi114.stdout:8/722: creat d4/db/d3e/dd5/ff8 x:0 0 0 2024-09-16T09:45:36.855 INFO:tasks.workunit.client.1.smithi114.stdout:8/723: mknod d4/db/d68/d28/dc1/cf9 0 2024-09-16T09:45:36.858 INFO:tasks.workunit.client.1.smithi114.stdout:7/830: dwrite d2/df/df9/f69 [0,4194304] 0 2024-09-16T09:45:36.861 INFO:tasks.workunit.client.1.smithi114.stdout:7/831: truncate d2/d9/d2b/d78/fb6 1038777 0 2024-09-16T09:45:36.863 INFO:tasks.workunit.client.1.smithi114.stdout:7/832: rename d2/d9/d2b/d2e/d22/feb to d2/d9/d2b/d2e/d3e/d79/f118 0 2024-09-16T09:45:36.864 INFO:tasks.workunit.client.1.smithi114.stdout:9/731: dread d3/da/d10/d23/d43/d1e/d4c/d8c/fd4 [0,4194304] 0 2024-09-16T09:45:36.864 INFO:tasks.workunit.client.1.smithi114.stdout:7/833: mkdir d2/d9/d2b/d2e/d93/d117/d119 0 2024-09-16T09:45:36.865 INFO:tasks.workunit.client.1.smithi114.stdout:2/862: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/f119 [0,4194304] 0 2024-09-16T09:45:36.865 INFO:tasks.workunit.client.1.smithi114.stdout:2/863: chown d1/d8/d10/d16/d60/db7/deb/d136/d142 24915 1 2024-09-16T09:45:36.865 INFO:tasks.workunit.client.1.smithi114.stdout:9/732: creat d3/da/d10/d23/d43/d1e/d25/ffc x:0 0 0 2024-09-16T09:45:36.867 INFO:tasks.workunit.client.1.smithi114.stdout:7/834: mkdir d2/d9/d2b/d2e/d3e/d79/d11a 0 2024-09-16T09:45:36.867 INFO:tasks.workunit.client.1.smithi114.stdout:7/835: stat d2/d9/d2b/d78/d99/f9a 0 2024-09-16T09:45:36.867 INFO:tasks.workunit.client.1.smithi114.stdout:7/836: chown d2/d9/d2b/d59/c74 11420 1 2024-09-16T09:45:36.867 INFO:tasks.workunit.client.1.smithi114.stdout:7/837: truncate d2/d9/d2b/d78/d99/ddd/fe4 762277 0 2024-09-16T09:45:36.867 INFO:tasks.workunit.client.1.smithi114.stdout:7/838: chown d2/l1b 1 1 2024-09-16T09:45:36.870 INFO:tasks.workunit.client.1.smithi114.stdout:9/733: mknod d3/da/d10/d23/d43/d82/dc5/cfd 0 2024-09-16T09:45:36.882 INFO:tasks.workunit.client.1.smithi114.stdout:2/864: write d1/d8/d10/d16/d1d/d92/da3/fc2 [3011967,23830] 0 2024-09-16T09:45:36.882 INFO:tasks.workunit.client.1.smithi114.stdout:8/724: dwrite d4/dae/f9b [0,4194304] 0 2024-09-16T09:45:36.883 INFO:tasks.workunit.client.1.smithi114.stdout:2/865: getdents d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63 0 2024-09-16T09:45:36.884 INFO:tasks.workunit.client.1.smithi114.stdout:8/725: mkdir d4/db/d68/d28/dc1/dfa 0 2024-09-16T09:45:36.884 INFO:tasks.workunit.client.1.smithi114.stdout:8/726: write d4/db/dd/fba [736456,74871] 0 2024-09-16T09:45:36.885 INFO:tasks.workunit.client.1.smithi114.stdout:2/866: symlink d1/d8/d10/d16/d1d/l145 0 2024-09-16T09:45:36.888 INFO:tasks.workunit.client.1.smithi114.stdout:8/727: dread d4/db/d68/d28/fd9 [0,4194304] 0 2024-09-16T09:45:36.888 INFO:tasks.workunit.client.1.smithi114.stdout:2/867: symlink d1/d8/d10/d16/l146 0 2024-09-16T09:45:36.891 INFO:tasks.workunit.client.1.smithi114.stdout:9/734: dwrite d3/da/d10/d23/d43/d1e/d4c/fb7 [0,4194304] 0 2024-09-16T09:45:36.892 INFO:tasks.workunit.client.1.smithi114.stdout:9/735: write d3/d7d/fc4 [598596,104936] 0 2024-09-16T09:45:36.892 INFO:tasks.workunit.client.1.smithi114.stdout:7/839: dwrite d2/d9/d2b/f61 [0,4194304] 0 2024-09-16T09:45:36.892 INFO:tasks.workunit.client.1.smithi114.stdout:7/840: write d2/d9/d2b/d78/fb6 [1649273,48879] 0 2024-09-16T09:45:36.893 INFO:tasks.workunit.client.1.smithi114.stdout:8/728: unlink d4/db/d39/d3c/d4e/f93 0 2024-09-16T09:45:36.893 INFO:tasks.workunit.client.1.smithi114.stdout:8/729: stat d4/db/d39/d3c/d4e 0 2024-09-16T09:45:36.893 INFO:tasks.workunit.client.1.smithi114.stdout:9/736: dread d3/da/d10/d23/d43/d1e/d25/fc2 [0,4194304] 0 2024-09-16T09:45:36.894 INFO:tasks.workunit.client.1.smithi114.stdout:2/868: creat d1/d8/d10/d16/d60/db7/deb/df6/f147 x:0 0 0 2024-09-16T09:45:36.894 INFO:tasks.workunit.client.1.smithi114.stdout:2/869: dread - d1/d8/d10/d16/d1d/d130/f13d zero size 2024-09-16T09:45:36.896 INFO:tasks.workunit.client.1.smithi114.stdout:7/841: mknod d2/df/df9/dbd/c11b 0 2024-09-16T09:45:36.897 INFO:tasks.workunit.client.1.smithi114.stdout:8/730: symlink d4/db/dd/de4/dea/lfb 0 2024-09-16T09:45:36.898 INFO:tasks.workunit.client.1.smithi114.stdout:9/737: getdents d3/da/d10/d23/d43/d1e/d7b 0 2024-09-16T09:45:36.903 INFO:tasks.workunit.client.1.smithi114.stdout:2/870: rename d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d4b to d1/d8/d10/d16/d1d/d92/da7/d148 0 2024-09-16T09:45:36.904 INFO:tasks.workunit.client.1.smithi114.stdout:9/738: rename d3/da/d10/d23/d29/d2c/d6b/d68/d81/ldb to d3/da/d10/d23/d29/d87/lfe 0 2024-09-16T09:45:36.908 INFO:tasks.workunit.client.1.smithi114.stdout:2/871: rename d1/d8/d10/cea to d1/d8/d10/d16/d1d/d92/da3/c149 0 2024-09-16T09:45:36.909 INFO:tasks.workunit.client.1.smithi114.stdout:2/872: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/la2 123 1 2024-09-16T09:45:36.909 INFO:tasks.workunit.client.1.smithi114.stdout:2/873: write d1/d8/d10/d16/d60/db7/deb/f12a [265643,15689] 0 2024-09-16T09:45:36.909 INFO:tasks.workunit.client.1.smithi114.stdout:9/739: creat d3/da/d10/d23/d29/d2c/d6b/d9d/ddc/fff x:0 0 0 2024-09-16T09:45:36.909 INFO:tasks.workunit.client.1.smithi114.stdout:9/740: fsync d3/da/d10/d23/f7e 0 2024-09-16T09:45:36.910 INFO:tasks.workunit.client.1.smithi114.stdout:9/741: dread - d3/da/d10/d23/d29/d2c/d6b/d9d/ddc/fff zero size 2024-09-16T09:45:36.910 INFO:tasks.workunit.client.1.smithi114.stdout:2/874: creat d1/d8/d10/d16/d60/f14a x:0 0 0 2024-09-16T09:45:36.911 INFO:tasks.workunit.client.1.smithi114.stdout:9/742: mkdir d3/da/d10/d23/d29/ded/d100 0 2024-09-16T09:45:36.911 INFO:tasks.workunit.client.1.smithi114.stdout:2/875: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/c14b 0 2024-09-16T09:45:36.913 INFO:tasks.workunit.client.1.smithi114.stdout:2/876: mknod d1/d8/d10/d16/d60/db7/deb/d136/d142/c14c 0 2024-09-16T09:45:36.913 INFO:tasks.workunit.client.1.smithi114.stdout:2/877: fdatasync d1/d8/d10/d16/f1b 0 2024-09-16T09:45:36.915 INFO:tasks.workunit.client.1.smithi114.stdout:4/769: sync 2024-09-16T09:45:36.915 INFO:tasks.workunit.client.1.smithi114.stdout:3/859: sync 2024-09-16T09:45:36.915 INFO:tasks.workunit.client.1.smithi114.stdout:4/770: rename d0/d26/d3c/d3e to d0/d26/d3c/d3e/d5a/d110 22 2024-09-16T09:45:36.915 INFO:tasks.workunit.client.1.smithi114.stdout:4/771: dread - d0/d26/d29/d2b/d58/f8a zero size 2024-09-16T09:45:36.915 INFO:tasks.workunit.client.1.smithi114.stdout:4/772: truncate d0/d26/d3c/d3e/d5a/fa1 213092 0 2024-09-16T09:45:36.917 INFO:tasks.workunit.client.1.smithi114.stdout:4/773: symlink d0/d13/d25/l111 0 2024-09-16T09:45:36.917 INFO:tasks.workunit.client.1.smithi114.stdout:4/774: dread - d0/d26/d3c/d45/fc1 zero size 2024-09-16T09:45:36.919 INFO:tasks.workunit.client.1.smithi114.stdout:7/842: dwrite d2/df/f10 [4194304,4194304] 0 2024-09-16T09:45:36.920 INFO:tasks.workunit.client.1.smithi114.stdout:4/775: dread d0/d26/d3c/d3e/d5a/d5d/ff4 [0,4194304] 0 2024-09-16T09:45:36.920 INFO:tasks.workunit.client.1.smithi114.stdout:4/776: stat d0/d26/d29/d2b/l97 0 2024-09-16T09:45:36.920 INFO:tasks.workunit.client.1.smithi114.stdout:7/843: unlink d2/d9/d2b/d59/c74 0 2024-09-16T09:45:36.922 INFO:tasks.workunit.client.1.smithi114.stdout:7/844: creat d2/d9/d2b/d2e/d93/d117/d119/f11c x:0 0 0 2024-09-16T09:45:36.924 INFO:tasks.workunit.client.1.smithi114.stdout:7/845: unlink d2/d9/d2b/d78/d99/ddd/dea/lf5 0 2024-09-16T09:45:36.925 INFO:tasks.workunit.client.1.smithi114.stdout:9/743: dread d3/da/d10/d23/d29/d2c/d45/f61 [0,4194304] 0 2024-09-16T09:45:36.926 INFO:tasks.workunit.client.1.smithi114.stdout:9/744: readlink d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d/lbb 0 2024-09-16T09:45:36.926 INFO:tasks.workunit.client.1.smithi114.stdout:9/745: fsync d3/da/d10/d23/d43/d1e/d25/d88/fcf 0 2024-09-16T09:45:36.926 INFO:tasks.workunit.client.1.smithi114.stdout:9/746: dread - d3/da/d10/d23/d29/d2c/d6b/fd2 zero size 2024-09-16T09:45:36.926 INFO:tasks.workunit.client.1.smithi114.stdout:9/747: dread - d3/da/d10/d23/d43/d1e/d25/d88/fcf zero size 2024-09-16T09:45:36.926 INFO:tasks.workunit.client.1.smithi114.stdout:7/846: mknod d2/d9/d2b/d2e/d3e/d79/d102/c11d 0 2024-09-16T09:45:36.927 INFO:tasks.workunit.client.1.smithi114.stdout:7/847: symlink d2/d9/d2b/d78/d99/ddd/dea/l11e 0 2024-09-16T09:45:36.928 INFO:tasks.workunit.client.1.smithi114.stdout:7/848: truncate d2/d9/d2b/d2e/d77/ff2 700934 0 2024-09-16T09:45:36.933 INFO:tasks.workunit.client.1.smithi114.stdout:8/731: dwrite d4/db/d68/d28/f51 [0,4194304] 0 2024-09-16T09:45:36.934 INFO:tasks.workunit.client.1.smithi114.stdout:2/878: dwrite d1/f8a [0,4194304] 0 2024-09-16T09:45:36.936 INFO:tasks.workunit.client.1.smithi114.stdout:8/732: dread d4/db/d3e/f97 [0,4194304] 0 2024-09-16T09:45:36.937 INFO:tasks.workunit.client.1.smithi114.stdout:2/879: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/d14d 0 2024-09-16T09:45:36.938 INFO:tasks.workunit.client.1.smithi114.stdout:8/733: mknod d4/db/d39/d3c/d4e/d82/d72/cfc 0 2024-09-16T09:45:36.939 INFO:tasks.workunit.client.1.smithi114.stdout:2/880: rename d1/f84 to d1/d8/d10/d16/d60/db7/f14e 0 2024-09-16T09:45:36.941 INFO:tasks.workunit.client.1.smithi114.stdout:8/734: symlink d4/db/d3e/d71/d78/df0/lfd 0 2024-09-16T09:45:36.944 INFO:tasks.workunit.client.1.smithi114.stdout:2/881: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d14f 0 2024-09-16T09:45:36.944 INFO:tasks.workunit.client.1.smithi114.stdout:4/777: dwrite d0/f21 [0,4194304] 0 2024-09-16T09:45:36.944 INFO:tasks.workunit.client.1.smithi114.stdout:9/748: dread d3/da/d10/d23/d43/d1e/d78/db2/fb8 [0,4194304] 0 2024-09-16T09:45:36.944 INFO:tasks.workunit.client.1.smithi114.stdout:9/749: stat d3/da/d10/d23/d43/d1e/d25/d88 0 2024-09-16T09:45:36.944 INFO:tasks.workunit.client.1.smithi114.stdout:9/750: fsync d3/fc 0 2024-09-16T09:45:36.945 INFO:tasks.workunit.client.1.smithi114.stdout:2/882: rename d1/d9e/fd3 to d1/d8/d10/d5a/d111/f150 0 2024-09-16T09:45:36.946 INFO:tasks.workunit.client.1.smithi114.stdout:7/849: dwrite d2/d9/d2b/d2e/d77/f56 [0,4194304] 0 2024-09-16T09:45:36.950 INFO:tasks.workunit.client.1.smithi114.stdout:8/735: dread d4/d1f/f42 [0,4194304] 0 2024-09-16T09:45:36.950 INFO:tasks.workunit.client.1.smithi114.stdout:7/850: rmdir d2/d9/d2b/d2e/d22/d27/d4d/d72 39 2024-09-16T09:45:36.951 INFO:tasks.workunit.client.1.smithi114.stdout:2/883: mknod d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/c151 0 2024-09-16T09:45:36.952 INFO:tasks.workunit.client.1.smithi114.stdout:7/851: symlink d2/d9/d2b/d59/dca/l11f 0 2024-09-16T09:45:36.953 INFO:tasks.workunit.client.1.smithi114.stdout:1/774: sync 2024-09-16T09:45:36.953 INFO:tasks.workunit.client.1.smithi114.stdout:1/775: fdatasync d4/d2b/d16/d71/d72/d75/ff8 0 2024-09-16T09:45:36.954 INFO:tasks.workunit.client.1.smithi114.stdout:8/736: dread d4/db/d68/d28/dac/fe6 [0,4194304] 0 2024-09-16T09:45:36.957 INFO:tasks.workunit.client.1.smithi114.stdout:5/748: sync 2024-09-16T09:45:36.957 INFO:tasks.workunit.client.1.smithi114.stdout:5/749: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/l56 0 2024-09-16T09:45:36.957 INFO:tasks.workunit.client.1.smithi114.stdout:6/827: sync 2024-09-16T09:45:36.957 INFO:tasks.workunit.client.1.smithi114.stdout:0/740: sync 2024-09-16T09:45:36.958 INFO:tasks.workunit.client.1.smithi114.stdout:5/750: mkdir d3/d24/d7d/da6/dfc 0 2024-09-16T09:45:36.969 INFO:tasks.workunit.client.1.smithi114.stdout:9/751: dwrite d3/da/d10/d23/d43/d1e/da0/fda [0,4194304] 0 2024-09-16T09:45:36.971 INFO:tasks.workunit.client.1.smithi114.stdout:9/752: symlink d3/daa/l101 0 2024-09-16T09:45:36.971 INFO:tasks.workunit.client.1.smithi114.stdout:9/753: chown d3/da/d10/d23/d43/f33 46 1 2024-09-16T09:45:36.971 INFO:tasks.workunit.client.1.smithi114.stdout:8/737: dread d4/db/d68/d28/f67 [0,4194304] 0 2024-09-16T09:45:36.971 INFO:tasks.workunit.client.1.smithi114.stdout:7/852: dread d2/df/df9/f9e [0,4194304] 0 2024-09-16T09:45:36.971 INFO:tasks.workunit.client.1.smithi114.stdout:7/853: chown d2/d9/d2b/d2e/c53 7 1 2024-09-16T09:45:36.971 INFO:tasks.workunit.client.1.smithi114.stdout:9/754: write d3/da/d10/d23/d29/d2c/d6b/fc1 [498790,49004] 0 2024-09-16T09:45:36.972 INFO:tasks.workunit.client.1.smithi114.stdout:8/738: rmdir d4/db/d39/d3c/d4e/d82 39 2024-09-16T09:45:36.972 INFO:tasks.workunit.client.1.smithi114.stdout:8/739: chown d4/db/dd/fba 22 1 2024-09-16T09:45:36.973 INFO:tasks.workunit.client.1.smithi114.stdout:0/741: dread d1f/f45 [0,4194304] 0 2024-09-16T09:45:36.973 INFO:tasks.workunit.client.1.smithi114.stdout:0/742: readlink d1f/d2d/l8e 0 2024-09-16T09:45:36.973 INFO:tasks.workunit.client.1.smithi114.stdout:0/743: chown d1f/d27/fac 42331334 1 2024-09-16T09:45:36.975 INFO:tasks.workunit.client.1.smithi114.stdout:9/755: rename d3/da/c1f to d3/da/d10/d23/d43/d1e/d4c/d8c/c102 0 2024-09-16T09:45:36.975 INFO:tasks.workunit.client.1.smithi114.stdout:9/756: readlink d3/l12 0 2024-09-16T09:45:36.975 INFO:tasks.workunit.client.1.smithi114.stdout:8/740: mkdir d4/dae/d54/db3/dfe 0 2024-09-16T09:45:36.975 INFO:tasks.workunit.client.1.smithi114.stdout:0/744: mkdir d1f/d22/d2e/d46/d7f/d8d/dbb/d10b 0 2024-09-16T09:45:36.975 INFO:tasks.workunit.client.1.smithi114.stdout:0/745: chown d1f/d22/d2e/d46/d7f/d8d/dbb/ddb 55 1 2024-09-16T09:45:36.976 INFO:tasks.workunit.client.1.smithi114.stdout:9/757: rename d3/da/d10/d23/d29/d2c/c94 to d3/daa/c103 0 2024-09-16T09:45:36.977 INFO:tasks.workunit.client.1.smithi114.stdout:9/758: dread - d3/daa/def/ff2 zero size 2024-09-16T09:45:36.977 INFO:tasks.workunit.client.1.smithi114.stdout:9/759: chown d3/da/d10/d23/d29/ded/ld8 176 1 2024-09-16T09:45:36.977 INFO:tasks.workunit.client.1.smithi114.stdout:8/741: symlink d4/db/d3e/d71/d78/lff 0 2024-09-16T09:45:36.978 INFO:tasks.workunit.client.1.smithi114.stdout:9/760: getdents d3/da/d10/d23/d29/d2c/d6b/d9d 0 2024-09-16T09:45:36.978 INFO:tasks.workunit.client.1.smithi114.stdout:9/761: write d3/f49 [1889380,39339] 0 2024-09-16T09:45:36.979 INFO:tasks.workunit.client.1.smithi114.stdout:9/762: mknod d3/da/d10/d23/d29/d3f/d85/c104 0 2024-09-16T09:45:36.980 INFO:tasks.workunit.client.1.smithi114.stdout:2/884: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/f119 [0,4194304] 0 2024-09-16T09:45:36.980 INFO:tasks.workunit.client.1.smithi114.stdout:9/763: link d3/da/d10/d23/d43/d1e/d7b/fa3 d3/da/d10/d23/d43/d1e/d78/db2/f105 0 2024-09-16T09:45:36.981 INFO:tasks.workunit.client.1.smithi114.stdout:2/885: getdents d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120 0 2024-09-16T09:45:36.983 INFO:tasks.workunit.client.1.smithi114.stdout:9/764: creat d3/da/d10/d23/d29/d87/f106 x:0 0 0 2024-09-16T09:45:36.988 INFO:tasks.workunit.client.1.smithi114.stdout:7/854: write d2/d9/d2b/d2e/d22/d27/d64/dc0/fff [2939411,67248] 0 2024-09-16T09:45:36.989 INFO:tasks.workunit.client.1.smithi114.stdout:7/855: symlink d2/d9/d2b/d2e/d3e/d79/d11a/l120 0 2024-09-16T09:45:37.003 INFO:tasks.workunit.client.1.smithi114.stdout:2/886: write d1/d8/d10/d16/f30 [266177,109224] 0 2024-09-16T09:45:37.009 INFO:tasks.workunit.client.1.smithi114.stdout:2/887: dread d1/d8/d10/d16/d1d/d92/fe9 [0,4194304] 0 2024-09-16T09:45:37.009 INFO:tasks.workunit.client.1.smithi114.stdout:2/888: write d1/d8/d10/d16/d60/db7/deb/df6/f147 [1009592,5239] 0 2024-09-16T09:45:37.013 INFO:tasks.workunit.client.1.smithi114.stdout:2/889: dread d1/d8/f7a [0,4194304] 0 2024-09-16T09:45:37.022 INFO:tasks.workunit.client.1.smithi114.stdout:1/776: dwrite d4/d2b/d16/d47/fb2 [0,4194304] 0 2024-09-16T09:45:37.023 INFO:tasks.workunit.client.1.smithi114.stdout:5/751: dwrite d3/d24/d84/dbc/fd4 [0,4194304] 0 2024-09-16T09:45:37.023 INFO:tasks.workunit.client.1.smithi114.stdout:0/746: dwrite d1f/d20/f34 [0,4194304] 0 2024-09-16T09:45:37.024 INFO:tasks.workunit.client.1.smithi114.stdout:9/765: dwrite d3/da/d10/d23/d29/d2c/d6b/d9d/ddc/fff [0,4194304] 0 2024-09-16T09:45:37.024 INFO:tasks.workunit.client.1.smithi114.stdout:1/777: symlink d4/d2b/d16/d71/d81/ddc/l105 0 2024-09-16T09:45:37.027 INFO:tasks.workunit.client.1.smithi114.stdout:5/752: unlink d3/f8 0 2024-09-16T09:45:37.027 INFO:tasks.workunit.client.1.smithi114.stdout:8/742: dwrite d4/db/d68/d28/f7e [0,4194304] 0 2024-09-16T09:45:37.027 INFO:tasks.workunit.client.1.smithi114.stdout:8/743: write d4/dae/d9c/f9d [47886,29046] 0 2024-09-16T09:45:37.029 INFO:tasks.workunit.client.1.smithi114.stdout:7/856: dwrite d2/d9/d2b/d2e/d22/d27/f1e [0,4194304] 0 2024-09-16T09:45:37.029 INFO:tasks.workunit.client.1.smithi114.stdout:6/828: dwrite d6/da/d10/d40/d82/f8d [0,4194304] 0 2024-09-16T09:45:37.029 INFO:tasks.workunit.client.1.smithi114.stdout:0/747: symlink d1f/d22/d2e/d46/d7f/l10c 0 2024-09-16T09:45:37.029 INFO:tasks.workunit.client.1.smithi114.stdout:0/748: chown d1f/d22/d2e/f90 1094261820 1 2024-09-16T09:45:37.031 INFO:tasks.workunit.client.1.smithi114.stdout:1/778: creat d4/d2b/d2f/d3a/dc5/f106 x:0 0 0 2024-09-16T09:45:37.031 INFO:tasks.workunit.client.1.smithi114.stdout:1/779: write d4/d2b/d16/d71/d72/fa3 [2939451,50683] 0 2024-09-16T09:45:37.032 INFO:tasks.workunit.client.1.smithi114.stdout:1/780: chown d4/d2b/d2f/d3a/d9d/d41/d42/d58/f5c 2813931 1 2024-09-16T09:45:37.032 INFO:tasks.workunit.client.1.smithi114.stdout:1/781: read d4/d2b/d2f/d3a/d9d/ffc [80886,96518] 0 2024-09-16T09:45:37.032 INFO:tasks.workunit.client.1.smithi114.stdout:1/782: chown d4/d2b/f1e 24756440 1 2024-09-16T09:45:37.034 INFO:tasks.workunit.client.1.smithi114.stdout:8/744: creat d4/db/d68/d28/dc1/dfa/f100 x:0 0 0 2024-09-16T09:45:37.034 INFO:tasks.workunit.client.1.smithi114.stdout:8/745: dread - d4/db/d91/fef zero size 2024-09-16T09:45:37.034 INFO:tasks.workunit.client.1.smithi114.stdout:8/746: chown d4/dc3 9 1 2024-09-16T09:45:37.034 INFO:tasks.workunit.client.1.smithi114.stdout:8/747: truncate d4/db/d68/d30/fbd 907314 0 2024-09-16T09:45:37.034 INFO:tasks.workunit.client.1.smithi114.stdout:2/890: dwrite d1/fe6 [0,4194304] 0 2024-09-16T09:45:37.035 INFO:tasks.workunit.client.1.smithi114.stdout:8/748: dread d4/db/d68/d28/fd9 [0,4194304] 0 2024-09-16T09:45:37.036 INFO:tasks.workunit.client.1.smithi114.stdout:6/829: rmdir d6 39 2024-09-16T09:45:37.036 INFO:tasks.workunit.client.1.smithi114.stdout:6/830: chown d6/da/d36/cef 4937611 1 2024-09-16T09:45:37.036 INFO:tasks.workunit.client.1.smithi114.stdout:6/831: fdatasync d6/da/dbb/dd3/feb 0 2024-09-16T09:45:37.037 INFO:tasks.workunit.client.1.smithi114.stdout:7/857: mknod d2/d9/d2b/d2e/d22/d27/d4d/d72/c121 0 2024-09-16T09:45:37.037 INFO:tasks.workunit.client.1.smithi114.stdout:7/858: fsync d2/d9/d2b/d2e/d22/fb2 0 2024-09-16T09:45:37.037 INFO:tasks.workunit.client.1.smithi114.stdout:0/749: symlink d1f/d20/d48/l10d 0 2024-09-16T09:45:37.043 INFO:tasks.workunit.client.1.smithi114.stdout:1/783: mkdir d4/d2b/d29/d107 0 2024-09-16T09:45:37.045 INFO:tasks.workunit.client.1.smithi114.stdout:9/766: dwrite d3/da/d10/fb3 [0,4194304] 0 2024-09-16T09:45:37.046 INFO:tasks.workunit.client.1.smithi114.stdout:2/891: creat d1/d9e/daf/f152 x:0 0 0 2024-09-16T09:45:37.047 INFO:tasks.workunit.client.1.smithi114.stdout:6/832: creat d6/da/d48/db0/dfc/f100 x:0 0 0 2024-09-16T09:45:37.047 INFO:tasks.workunit.client.1.smithi114.stdout:6/833: chown d6/f22 265 1 2024-09-16T09:45:37.048 INFO:tasks.workunit.client.1.smithi114.stdout:6/834: chown d6/d64/c98 31155 1 2024-09-16T09:45:37.048 INFO:tasks.workunit.client.1.smithi114.stdout:7/859: creat d2/d9/d2b/d2e/f122 x:0 0 0 2024-09-16T09:45:37.048 INFO:tasks.workunit.client.1.smithi114.stdout:7/860: chown d2/d9/d2b/d2e/d22/d27/f1e 13159 1 2024-09-16T09:45:37.049 INFO:tasks.workunit.client.1.smithi114.stdout:8/749: dread d4/db/d91/fab [0,4194304] 0 2024-09-16T09:45:37.050 INFO:tasks.workunit.client.1.smithi114.stdout:0/750: creat d1f/d27/d47/d56/d7e/f10e x:0 0 0 2024-09-16T09:45:37.054 INFO:tasks.workunit.client.1.smithi114.stdout:9/767: rename d3/da/d10/dbf to d3/daa/d107 0 2024-09-16T09:45:37.055 INFO:tasks.workunit.client.1.smithi114.stdout:9/768: stat d3/da/d10/d23/d29/d87/cc9 0 2024-09-16T09:45:37.055 INFO:tasks.workunit.client.1.smithi114.stdout:9/769: stat d3/da/d10/d23/d29/d87/cf6 0 2024-09-16T09:45:37.056 INFO:tasks.workunit.client.1.smithi114.stdout:2/892: symlink d1/d9e/daf/l153 0 2024-09-16T09:45:37.056 INFO:tasks.workunit.client.1.smithi114.stdout:2/893: write d1/d9e/daf/f152 [668865,58367] 0 2024-09-16T09:45:37.056 INFO:tasks.workunit.client.1.smithi114.stdout:2/894: fsync d1/d8/d10/d16/d1d/d92/fe9 0 2024-09-16T09:45:37.056 INFO:tasks.workunit.client.1.smithi114.stdout:2/895: stat d1/d8/d10/d16/d1d/d92/da7/d3e 0 2024-09-16T09:45:37.057 INFO:tasks.workunit.client.1.smithi114.stdout:6/835: symlink d6/d2d/d46/d9c/l101 0 2024-09-16T09:45:37.058 INFO:tasks.workunit.client.1.smithi114.stdout:1/784: dwrite d4/d2b/d2f/d3a/d9d/fc9 [0,4194304] 0 2024-09-16T09:45:37.059 INFO:tasks.workunit.client.1.smithi114.stdout:8/750: dread d4/db/d3e/d71/d78/d8d/da9/fb7 [0,4194304] 0 2024-09-16T09:45:37.060 INFO:tasks.workunit.client.1.smithi114.stdout:0/751: creat d1f/d20/d48/f10f x:0 0 0 2024-09-16T09:45:37.060 INFO:tasks.workunit.client.1.smithi114.stdout:0/752: dread - d1f/ddf/df5/ffc zero size 2024-09-16T09:45:37.060 INFO:tasks.workunit.client.1.smithi114.stdout:0/753: stat l18 0 2024-09-16T09:45:37.060 INFO:tasks.workunit.client.1.smithi114.stdout:0/754: write d1f/d27/d47/d56/fef [542125,86820] 0 2024-09-16T09:45:37.063 INFO:tasks.workunit.client.1.smithi114.stdout:9/770: getdents d3/da/d10/d23/d43/d1e/d25/dc0 0 2024-09-16T09:45:37.065 INFO:tasks.workunit.client.1.smithi114.stdout:2/896: rmdir d1/dec/d12d 0 2024-09-16T09:45:37.065 INFO:tasks.workunit.client.1.smithi114.stdout:2/897: read - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/df9/d105/f134 zero size 2024-09-16T09:45:37.067 INFO:tasks.workunit.client.1.smithi114.stdout:6/836: mknod d6/da/d10/d40/d82/c102 0 2024-09-16T09:45:37.070 INFO:tasks.workunit.client.1.smithi114.stdout:9/771: mknod d3/da/d10/d23/d29/c108 0 2024-09-16T09:45:37.070 INFO:tasks.workunit.client.1.smithi114.stdout:3/860: sync 2024-09-16T09:45:37.070 INFO:tasks.workunit.client.1.smithi114.stdout:3/861: truncate dc/de/d1f/f29 849246 0 2024-09-16T09:45:37.071 INFO:tasks.workunit.client.1.smithi114.stdout:3/862: chown dc/de/d17/d2d/d41/d11e/d4e/l9b 145190 1 2024-09-16T09:45:37.072 INFO:tasks.workunit.client.1.smithi114.stdout:2/898: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 3694036 0 2024-09-16T09:45:37.075 INFO:tasks.workunit.client.1.smithi114.stdout:6/837: dread d6/da/d10/f4b [0,4194304] 0 2024-09-16T09:45:37.075 INFO:tasks.workunit.client.1.smithi114.stdout:6/838: stat d6/da/d36/l41 0 2024-09-16T09:45:37.075 INFO:tasks.workunit.client.1.smithi114.stdout:6/839: write d6/da/d10/d40/fb7 [4481473,81669] 0 2024-09-16T09:45:37.076 INFO:tasks.workunit.client.1.smithi114.stdout:9/772: rename d3/da/d10/d23/d43/d1e/l31 to d3/da/d10/d23/d43/d1e/d7b/l109 0 2024-09-16T09:45:37.076 INFO:tasks.workunit.client.1.smithi114.stdout:9/773: write d3/da/d10/d23/d43/d82/fa9 [4887103,62891] 0 2024-09-16T09:45:37.078 INFO:tasks.workunit.client.1.smithi114.stdout:1/785: dwrite d4/d2b/d2f/d3a/d9d/d41/d42/fb6 [0,4194304] 0 2024-09-16T09:45:37.078 INFO:tasks.workunit.client.1.smithi114.stdout:1/786: stat d4/d2b/d16/d71/d72/fb5 0 2024-09-16T09:45:37.078 INFO:tasks.workunit.client.1.smithi114.stdout:6/840: creat d6/d2d/d46/dcc/dad/f103 x:0 0 0 2024-09-16T09:45:37.079 INFO:tasks.workunit.client.1.smithi114.stdout:9/774: creat d3/da/d10/d23/d29/d2c/d6b/db9/f10a x:0 0 0 2024-09-16T09:45:37.082 INFO:tasks.workunit.client.1.smithi114.stdout:1/787: creat d4/f108 x:0 0 0 2024-09-16T09:45:37.083 INFO:tasks.workunit.client.1.smithi114.stdout:6/841: creat d6/f104 x:0 0 0 2024-09-16T09:45:37.085 INFO:tasks.workunit.client.1.smithi114.stdout:1/788: unlink d4/d2b/c61 0 2024-09-16T09:45:37.086 INFO:tasks.workunit.client.1.smithi114.stdout:6/842: unlink d6/d2d/d46/d9c/fba 0 2024-09-16T09:45:37.087 INFO:tasks.workunit.client.1.smithi114.stdout:9/775: mkdir d3/da/d10/d23/d43/d1e/d10b 0 2024-09-16T09:45:37.087 INFO:tasks.workunit.client.1.smithi114.stdout:0/755: dwrite d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/fe2 [0,4194304] 0 2024-09-16T09:45:37.088 INFO:tasks.workunit.client.1.smithi114.stdout:1/789: creat d4/d2b/d29/da0/f109 x:0 0 0 2024-09-16T09:45:37.091 INFO:tasks.workunit.client.1.smithi114.stdout:9/776: creat d3/d7d/f10c x:0 0 0 2024-09-16T09:45:37.097 INFO:tasks.workunit.client.1.smithi114.stdout:0/756: truncate d1f/d22/d2e/d46/d7f/daf/fd2 5872945 0 2024-09-16T09:45:37.097 INFO:tasks.workunit.client.1.smithi114.stdout:1/790: link d4/d2b/f90 d4/d2b/d2f/d3a/f10a 0 2024-09-16T09:45:37.097 INFO:tasks.workunit.client.1.smithi114.stdout:1/791: truncate d4/d2b/d16/d71/d72/d75/fd4 212700 0 2024-09-16T09:45:37.097 INFO:tasks.workunit.client.1.smithi114.stdout:2/899: dwrite d1/f2c [0,4194304] 0 2024-09-16T09:45:37.098 INFO:tasks.workunit.client.1.smithi114.stdout:2/900: write d1/d8/d10/f50 [5159510,56580] 0 2024-09-16T09:45:37.098 INFO:tasks.workunit.client.1.smithi114.stdout:2/901: chown d1/d8/d10/d16/d60/db7/ced 3 1 2024-09-16T09:45:37.098 INFO:tasks.workunit.client.1.smithi114.stdout:9/777: symlink d3/da/d10/d23/d29/d2c/d45/d93/l10d 0 2024-09-16T09:45:37.100 INFO:tasks.workunit.client.1.smithi114.stdout:0/757: rmdir d1f/d20 39 2024-09-16T09:45:37.101 INFO:tasks.workunit.client.1.smithi114.stdout:1/792: symlink d4/d2b/d16/d71/d72/l10b 0 2024-09-16T09:45:37.102 INFO:tasks.workunit.client.1.smithi114.stdout:2/902: truncate d1/d8/d10/d16/d1d/f5f 786180 0 2024-09-16T09:45:37.102 INFO:tasks.workunit.client.1.smithi114.stdout:2/903: write d1/d8/d10/f18 [5900726,48232] 0 2024-09-16T09:45:37.102 INFO:tasks.workunit.client.1.smithi114.stdout:2/904: readlink d1/d9e/daf/le4 0 2024-09-16T09:45:37.103 INFO:tasks.workunit.client.1.smithi114.stdout:9/778: truncate d3/da/d10/d23/d43/fa6 234023 0 2024-09-16T09:45:37.103 INFO:tasks.workunit.client.1.smithi114.stdout:9/779: chown d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/db5/fb6 12612137 1 2024-09-16T09:45:37.103 INFO:tasks.workunit.client.1.smithi114.stdout:9/780: read d3/da/d10/d23/d29/d2c/d6b/f56 [2860881,63514] 0 2024-09-16T09:45:37.104 INFO:tasks.workunit.client.1.smithi114.stdout:9/781: mknod d3/da/d10/d23/d43/d82/c10e 0 2024-09-16T09:45:37.104 INFO:tasks.workunit.client.1.smithi114.stdout:9/782: truncate d3/da/d10/d23/d43/d82/dc5/ff3 73020 0 2024-09-16T09:45:37.104 INFO:tasks.workunit.client.1.smithi114.stdout:9/783: chown d3/da/d10/d23/d29/d2c/d45/f61 327946982 1 2024-09-16T09:45:37.105 INFO:tasks.workunit.client.1.smithi114.stdout:6/843: dwrite d6/da/d10/fa3 [0,4194304] 0 2024-09-16T09:45:37.105 INFO:tasks.workunit.client.1.smithi114.stdout:9/784: stat d3/da/d10/d23/c2b 0 2024-09-16T09:45:37.105 INFO:tasks.workunit.client.1.smithi114.stdout:6/844: truncate d6/da/f1e 847370 0 2024-09-16T09:45:37.106 INFO:tasks.workunit.client.1.smithi114.stdout:0/758: read d1f/d27/d47/d56/d7e/fe1 [146685,62312] 0 2024-09-16T09:45:37.107 INFO:tasks.workunit.client.1.smithi114.stdout:6/845: mknod d6/d2d/d46/dcc/d62/d77/d7b/c105 0 2024-09-16T09:45:37.110 INFO:tasks.workunit.client.1.smithi114.stdout:6/846: unlink d6/da/d48/db0/dfc/le1 0 2024-09-16T09:45:37.112 INFO:tasks.workunit.client.1.smithi114.stdout:6/847: creat d6/da/db3/dd1/dec/f106 x:0 0 0 2024-09-16T09:45:37.112 INFO:tasks.workunit.client.1.smithi114.stdout:6/848: chown d6/d2d/d46/dcc/f6b 0 1 2024-09-16T09:45:37.113 INFO:tasks.workunit.client.1.smithi114.stdout:6/849: read d6/da/f45 [228748,6744] 0 2024-09-16T09:45:37.114 INFO:tasks.workunit.client.1.smithi114.stdout:6/850: fdatasync d6/da/dbb/dd3/feb 0 2024-09-16T09:45:37.114 INFO:tasks.workunit.client.1.smithi114.stdout:6/851: write d6/f22 [803946,99311] 0 2024-09-16T09:45:37.115 INFO:tasks.workunit.client.1.smithi114.stdout:2/905: dread d1/fe6 [0,4194304] 0 2024-09-16T09:45:37.115 INFO:tasks.workunit.client.1.smithi114.stdout:2/906: dread - d1/d8/f8b zero size 2024-09-16T09:45:37.118 INFO:tasks.workunit.client.1.smithi114.stdout:0/759: write d1f/d22/d2e/d46/d7f/d8d/f95 [4030861,65498] 0 2024-09-16T09:45:37.118 INFO:tasks.workunit.client.1.smithi114.stdout:0/760: write d1f/d22/d2e/f90 [243704,86691] 0 2024-09-16T09:45:37.118 INFO:tasks.workunit.client.1.smithi114.stdout:0/761: chown d1f/d20/d48/d75/la5 1 1 2024-09-16T09:45:37.118 INFO:tasks.workunit.client.1.smithi114.stdout:0/762: fdatasync d1f/d20/d48/f78 0 2024-09-16T09:45:37.118 INFO:tasks.workunit.client.1.smithi114.stdout:6/852: rename d6/da/dbb/dd3/feb to d6/da/d48/db0/dfc/f107 0 2024-09-16T09:45:37.121 INFO:tasks.workunit.client.1.smithi114.stdout:0/763: getdents d1f/d27/d55 0 2024-09-16T09:45:37.123 INFO:tasks.workunit.client.1.smithi114.stdout:0/764: getdents d1f/d22/d2e/d46/d7f 0 2024-09-16T09:45:37.124 INFO:tasks.workunit.client.1.smithi114.stdout:0/765: mkdir d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/d110 0 2024-09-16T09:45:37.124 INFO:tasks.workunit.client.1.smithi114.stdout:0/766: getdents d1f/d2d/d7a/d107 0 2024-09-16T09:45:37.128 INFO:tasks.workunit.client.1.smithi114.stdout:9/785: dwrite d3/da/d10/d23/d29/d2c/d70/f7c [0,4194304] 0 2024-09-16T09:45:37.128 INFO:tasks.workunit.client.1.smithi114.stdout:9/786: chown d3/da/d10/d23/d43/d1e/d7b/leb 17069 1 2024-09-16T09:45:37.130 INFO:tasks.workunit.client.1.smithi114.stdout:1/793: dwrite d4/d2b/f27 [0,4194304] 0 2024-09-16T09:45:37.130 INFO:tasks.workunit.client.1.smithi114.stdout:6/853: write d6/da/d36/f4f [2389506,103225] 0 2024-09-16T09:45:37.133 INFO:tasks.workunit.client.1.smithi114.stdout:9/787: creat d3/d7d/f10f x:0 0 0 2024-09-16T09:45:37.137 INFO:tasks.workunit.client.1.smithi114.stdout:1/794: truncate d4/d2b/d29/da0/db1/ff3 2589623 0 2024-09-16T09:45:37.138 INFO:tasks.workunit.client.1.smithi114.stdout:1/795: truncate d4/d2b/d16/f65 4167688 0 2024-09-16T09:45:37.145 INFO:tasks.workunit.client.1.smithi114.stdout:6/854: rename d6/da/d10/d92/cdd to d6/d2d/d46/dcc/d62/d77/d7b/de7/c108 0 2024-09-16T09:45:37.147 INFO:tasks.workunit.client.1.smithi114.stdout:9/788: link d3/da/d10/d23/d43/d1e/d25/ffc d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d/f110 0 2024-09-16T09:45:37.147 INFO:tasks.workunit.client.1.smithi114.stdout:9/789: chown d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/cc3 5287 1 2024-09-16T09:45:37.148 INFO:tasks.workunit.client.1.smithi114.stdout:1/796: link d4/d2b/d29/l3b d4/d2b/d16/d47/l10c 0 2024-09-16T09:45:37.149 INFO:tasks.workunit.client.1.smithi114.stdout:6/855: mknod d6/da/db3/dd1/dec/c109 0 2024-09-16T09:45:37.150 INFO:tasks.workunit.client.1.smithi114.stdout:9/790: creat d3/da/d10/d23/d43/d1e/d10b/f111 x:0 0 0 2024-09-16T09:45:37.150 INFO:tasks.workunit.client.1.smithi114.stdout:9/791: chown d3/da/d10/d23/d29/d2c/d45/f64 669 1 2024-09-16T09:45:37.150 INFO:tasks.workunit.client.1.smithi114.stdout:6/856: rmdir d6/da/d10/d40 39 2024-09-16T09:45:37.151 INFO:tasks.workunit.client.1.smithi114.stdout:9/792: symlink d3/da/d10/d23/d43/d1e/d4c/l112 0 2024-09-16T09:45:37.151 INFO:tasks.workunit.client.1.smithi114.stdout:6/857: mknod d6/d2d/d46/dcc/c10a 0 2024-09-16T09:45:37.152 INFO:tasks.workunit.client.1.smithi114.stdout:9/793: symlink d3/da/d10/d23/d29/ded/l113 0 2024-09-16T09:45:37.153 INFO:tasks.workunit.client.1.smithi114.stdout:9/794: write d3/da/d10/d23/d29/ded/fd7 [1883767,27065] 0 2024-09-16T09:45:37.153 INFO:tasks.workunit.client.1.smithi114.stdout:9/795: dread - d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d/f110 zero size 2024-09-16T09:45:37.153 INFO:tasks.workunit.client.1.smithi114.stdout:6/858: truncate d6/d2d/d46/dcc/d62/faa 277757 0 2024-09-16T09:45:37.154 INFO:tasks.workunit.client.1.smithi114.stdout:9/796: creat d3/da/d10/d23/d43/d1e/f114 x:0 0 0 2024-09-16T09:45:37.157 INFO:tasks.workunit.client.1.smithi114.stdout:6/859: rename d6/da/fb4 to d6/d2d/d46/dcc/dad/f10b 0 2024-09-16T09:45:37.158 INFO:tasks.workunit.client.1.smithi114.stdout:6/860: symlink d6/da/dbb/dd3/l10c 0 2024-09-16T09:45:37.162 INFO:tasks.workunit.client.1.smithi114.stdout:1/797: dwrite d4/d2b/d16/d71/d72/d75/db4/dbb/fc1 [0,4194304] 0 2024-09-16T09:45:37.162 INFO:tasks.workunit.client.1.smithi114.stdout:1/798: chown d4/f26 2296052 1 2024-09-16T09:45:37.179 INFO:tasks.workunit.client.1.smithi114.stdout:4/778: sync 2024-09-16T09:45:37.180 INFO:tasks.workunit.client.1.smithi114.stdout:6/861: dwrite d6/da/fe5 [0,4194304] 0 2024-09-16T09:45:37.181 INFO:tasks.workunit.client.1.smithi114.stdout:1/799: dwrite d4/d2b/d16/d47/da7/f63 [4194304,4194304] 0 2024-09-16T09:45:37.181 INFO:tasks.workunit.client.1.smithi114.stdout:1/800: write d4/ffe [1080098,49968] 0 2024-09-16T09:45:37.185 INFO:tasks.workunit.client.1.smithi114.stdout:4/779: rename d0/d26/d3c/d3e/d4b/f92 to d0/d26/d29/d9f/f112 0 2024-09-16T09:45:37.186 INFO:tasks.workunit.client.1.smithi114.stdout:6/862: mknod d6/da/dbb/dd3/c10d 0 2024-09-16T09:45:37.186 INFO:tasks.workunit.client.1.smithi114.stdout:6/863: truncate d6/d64/fed 409950 0 2024-09-16T09:45:37.188 INFO:tasks.workunit.client.1.smithi114.stdout:6/864: truncate d6/da/d36/f3b 7818824 0 2024-09-16T09:45:37.190 INFO:tasks.workunit.client.1.smithi114.stdout:6/865: creat d6/dea/f10e x:0 0 0 2024-09-16T09:45:37.192 INFO:tasks.workunit.client.1.smithi114.stdout:6/866: truncate d6/d64/f91 3785044 0 2024-09-16T09:45:37.194 INFO:tasks.workunit.client.1.smithi114.stdout:6/867: mkdir d6/d2d/d46/dcc/d10f 0 2024-09-16T09:45:37.212 INFO:tasks.workunit.client.1.smithi114.stdout:4/780: dwrite d0/d26/d3c/d3e/d4b/fd9 [0,4194304] 0 2024-09-16T09:45:37.213 INFO:tasks.workunit.client.1.smithi114.stdout:1/801: dwrite d4/d2b/d2f/d3a/f10a [0,4194304] 0 2024-09-16T09:45:37.216 INFO:tasks.workunit.client.1.smithi114.stdout:4/781: rename d0/fe to d0/d26/d29/d2b/d58/dfd/f113 0 2024-09-16T09:45:37.218 INFO:tasks.workunit.client.1.smithi114.stdout:1/802: symlink d4/d2b/d16/d71/de5/df1/l10d 0 2024-09-16T09:45:37.218 INFO:tasks.workunit.client.1.smithi114.stdout:1/803: chown d4/d2b/d2f/f4c 96267 1 2024-09-16T09:45:37.232 INFO:tasks.workunit.client.1.smithi114.stdout:1/804: write d4/d2b/d2f/d3a/f4f [3180060,81362] 0 2024-09-16T09:45:37.232 INFO:tasks.workunit.client.1.smithi114.stdout:1/805: dread - d4/d2b/d2f/d3a/d9d/fcd zero size 2024-09-16T09:45:37.233 INFO:tasks.workunit.client.1.smithi114.stdout:1/806: mkdir d4/d2b/d10e 0 2024-09-16T09:45:37.233 INFO:tasks.workunit.client.1.smithi114.stdout:1/807: write d4/d2b/d16/d47/da7/dd7/ff2 [823202,79413] 0 2024-09-16T09:45:37.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/808: link d4/d2b/d16/d71/d72/fa3 d4/d2b/d16/d71/de5/f10f 0 2024-09-16T09:45:37.235 INFO:tasks.workunit.client.1.smithi114.stdout:1/809: rename d4/d2b/d16/d71/d72/c7a to d4/d2b/d16/d71/de5/c110 0 2024-09-16T09:45:37.236 INFO:tasks.workunit.client.1.smithi114.stdout:1/810: rmdir d4/d2b/d16/d71/d72/d75/db4 39 2024-09-16T09:45:37.236 INFO:tasks.workunit.client.1.smithi114.stdout:1/811: dread - d4/d2b/d2f/d3a/fdd zero size 2024-09-16T09:45:37.236 INFO:tasks.workunit.client.1.smithi114.stdout:1/812: symlink d4/d2b/d16/d71/d72/deb/l111 0 2024-09-16T09:45:37.237 INFO:tasks.workunit.client.1.smithi114.stdout:1/813: mkdir d4/d2b/d2f/d112 0 2024-09-16T09:45:37.239 INFO:tasks.workunit.client.1.smithi114.stdout:1/814: link d4/d2b/f53 d4/d2b/d16/d71/de5/f113 0 2024-09-16T09:45:37.239 INFO:tasks.workunit.client.1.smithi114.stdout:1/815: write d4/d2b/d2f/d3a/fdf [1430175,21895] 0 2024-09-16T09:45:37.239 INFO:tasks.workunit.client.1.smithi114.stdout:6/868: dwrite f5 [4194304,4194304] 0 2024-09-16T09:45:37.243 INFO:tasks.workunit.client.1.smithi114.stdout:4/782: dwrite d0/d13/f6f [0,4194304] 0 2024-09-16T09:45:37.262 INFO:tasks.workunit.client.1.smithi114.stdout:4/783: dread d0/d13/fed [0,4194304] 0 2024-09-16T09:45:37.263 INFO:tasks.workunit.client.1.smithi114.stdout:4/784: read d0/d26/d3c/d3e/d5a/d5d/ff4 [154335,123178] 0 2024-09-16T09:45:37.263 INFO:tasks.workunit.client.1.smithi114.stdout:4/785: readlink d0/d26/d3c/d3e/d4b/ldd 0 2024-09-16T09:45:37.272 INFO:tasks.workunit.client.1.smithi114.stdout:1/816: dwrite d4/d2b/d16/d71/d72/fef [4194304,4194304] 0 2024-09-16T09:45:37.273 INFO:tasks.workunit.client.1.smithi114.stdout:1/817: truncate d4/d2b/d16/d71/d72/fce 911648 0 2024-09-16T09:45:37.273 INFO:tasks.workunit.client.1.smithi114.stdout:1/818: read d4/d2b/d2f/f4c [2013502,8364] 0 2024-09-16T09:45:37.273 INFO:tasks.workunit.client.1.smithi114.stdout:6/869: dwrite d6/ff3 [0,4194304] 0 2024-09-16T09:45:37.274 INFO:tasks.workunit.client.1.smithi114.stdout:4/786: dread d0/d13/fed [0,4194304] 0 2024-09-16T09:45:37.274 INFO:tasks.workunit.client.1.smithi114.stdout:4/787: dread - d0/d26/d3c/d3e/d4b/fe4 zero size 2024-09-16T09:45:37.276 INFO:tasks.workunit.client.1.smithi114.stdout:1/819: creat d4/d2b/d29/da0/f114 x:0 0 0 2024-09-16T09:45:37.276 INFO:tasks.workunit.client.1.smithi114.stdout:1/820: write d4/d2b/d2f/d3a/fab [730970,125421] 0 2024-09-16T09:45:37.281 INFO:tasks.workunit.client.1.smithi114.stdout:6/870: mknod d6/c110 0 2024-09-16T09:45:37.282 INFO:tasks.workunit.client.1.smithi114.stdout:4/788: mkdir d0/d26/d3c/d3e/d5a/d5d/d70/d114 0 2024-09-16T09:45:37.282 INFO:tasks.workunit.client.1.smithi114.stdout:4/789: truncate d0/d26/d3c/d45/ff7 163747 0 2024-09-16T09:45:37.284 INFO:tasks.workunit.client.1.smithi114.stdout:5/753: sync 2024-09-16T09:45:37.284 INFO:tasks.workunit.client.1.smithi114.stdout:6/871: creat d6/da/d48/db0/dfc/f111 x:0 0 0 2024-09-16T09:45:37.285 INFO:tasks.workunit.client.1.smithi114.stdout:4/790: creat d0/d26/d29/f115 x:0 0 0 2024-09-16T09:45:37.286 INFO:tasks.workunit.client.1.smithi114.stdout:5/754: mknod d3/d24/d84/d7a/d43/d4c/db2/db7/cfd 0 2024-09-16T09:45:37.286 INFO:tasks.workunit.client.1.smithi114.stdout:4/791: truncate d0/d13/d56/d7e/fbc 1998396 0 2024-09-16T09:45:37.287 INFO:tasks.workunit.client.1.smithi114.stdout:0/767: sync 2024-09-16T09:45:37.287 INFO:tasks.workunit.client.1.smithi114.stdout:0/768: fsync d1f/d20/fa3 0 2024-09-16T09:45:37.287 INFO:tasks.workunit.client.1.smithi114.stdout:8/751: sync 2024-09-16T09:45:37.287 INFO:tasks.workunit.client.1.smithi114.stdout:2/907: sync 2024-09-16T09:45:37.287 INFO:tasks.workunit.client.1.smithi114.stdout:7/861: sync 2024-09-16T09:45:37.288 INFO:tasks.workunit.client.1.smithi114.stdout:3/863: sync 2024-09-16T09:45:37.288 INFO:tasks.workunit.client.1.smithi114.stdout:5/755: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/cfe 0 2024-09-16T09:45:37.289 INFO:tasks.workunit.client.1.smithi114.stdout:2/908: dread d1/d8/d10/d16/d60/db7/deb/d12b/fdf [0,4194304] 0 2024-09-16T09:45:37.289 INFO:tasks.workunit.client.1.smithi114.stdout:0/769: link d1f/d27/l28 d1f/d27/d55/dce/l111 0 2024-09-16T09:45:37.292 INFO:tasks.workunit.client.1.smithi114.stdout:7/862: rename d2/df/f3a to d2/d9/db1/dfc/f123 0 2024-09-16T09:45:37.296 INFO:tasks.workunit.client.1.smithi114.stdout:5/756: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/de8/cff 0 2024-09-16T09:45:37.297 INFO:tasks.workunit.client.1.smithi114.stdout:9/797: sync 2024-09-16T09:45:37.298 INFO:tasks.workunit.client.1.smithi114.stdout:2/909: dread d1/d8/d10/d16/d1d/d92/da7/d148/f6f [0,4194304] 0 2024-09-16T09:45:37.299 INFO:tasks.workunit.client.1.smithi114.stdout:6/872: dread d6/da/d36/f3b [4194304,4194304] 0 2024-09-16T09:45:37.299 INFO:tasks.workunit.client.1.smithi114.stdout:3/864: rename dc/de/d18/d78/f73 to dc/de/d18/dfe/f12e 0 2024-09-16T09:45:37.301 INFO:tasks.workunit.client.1.smithi114.stdout:7/863: rename d2/df/df9/ca0 to d2/df/df9/c124 0 2024-09-16T09:45:37.301 INFO:tasks.workunit.client.1.smithi114.stdout:7/864: readlink d2/d9/d2b/l7d 0 2024-09-16T09:45:37.302 INFO:tasks.workunit.client.1.smithi114.stdout:9/798: mkdir d3/da/d10/d23/d29/d2c/d45/d93/d115 0 2024-09-16T09:45:37.304 INFO:tasks.workunit.client.1.smithi114.stdout:2/910: rmdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63 39 2024-09-16T09:45:37.304 INFO:tasks.workunit.client.1.smithi114.stdout:2/911: chown d1/d8/d10/d16/d60/lf8 58 1 2024-09-16T09:45:37.304 INFO:tasks.workunit.client.1.smithi114.stdout:2/912: write d1/d8/d10/d16/d1d/f1e [1624767,16363] 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:2/913: readlink d1/d8/d10/d16/d1d/d92/lbd 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:2/914: truncate d1/d8/d10/d16/d1d/d92/fe9 2076311 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:2/915: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/f112 366593506 1 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:4/792: dread d0/d26/d3c/ffb [0,4194304] 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:4/793: fsync d0/d26/f8b 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:4/794: readlink d0/d26/d29/d2b/dc7/ldb 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:4/795: fsync d0/d26/d40/da6/f107 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:6/873: mknod d6/d64/df6/c112 0 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:6/874: chown d6/l32 4 1 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:6/875: dread - d6/da/db3/fe8 zero size 2024-09-16T09:45:37.305 INFO:tasks.workunit.client.1.smithi114.stdout:9/799: creat d3/da/d10/d23/d29/d3f/d85/f116 x:0 0 0 2024-09-16T09:45:37.306 INFO:tasks.workunit.client.1.smithi114.stdout:9/800: chown d3/da/lf5 5163825 1 2024-09-16T09:45:37.306 INFO:tasks.workunit.client.1.smithi114.stdout:9/801: rename d3/f7f to d3/da/d10/d23/d29/d2c/d45/f117 0 2024-09-16T09:45:37.307 INFO:tasks.workunit.client.1.smithi114.stdout:0/770: dread d1f/d27/d47/d56/fb7 [0,4194304] 0 2024-09-16T09:45:37.310 INFO:tasks.workunit.client.1.smithi114.stdout:0/771: link d1f/d20/fc9 d1f/d2d/d7a/ddd/f112 0 2024-09-16T09:45:37.310 INFO:tasks.workunit.client.1.smithi114.stdout:4/796: dread d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 [0,4194304] 0 2024-09-16T09:45:37.311 INFO:tasks.workunit.client.1.smithi114.stdout:0/772: truncate d1f/d27/d47/d56/d7e/ff9 958557 0 2024-09-16T09:45:37.311 INFO:tasks.workunit.client.1.smithi114.stdout:0/773: chown d1f/d9e/fc1 29532400 1 2024-09-16T09:45:37.313 INFO:tasks.workunit.client.1.smithi114.stdout:0/774: creat d1f/d27/de6/f113 x:0 0 0 2024-09-16T09:45:37.314 INFO:tasks.workunit.client.1.smithi114.stdout:4/797: mkdir d0/d13/d56/d7e/d116 0 2024-09-16T09:45:37.314 INFO:tasks.workunit.client.1.smithi114.stdout:4/798: read d0/d26/d3c/d3e/d5a/d5d/f60 [95275,64921] 0 2024-09-16T09:45:37.314 INFO:tasks.workunit.client.1.smithi114.stdout:7/865: dread d2/df/f10 [0,4194304] 0 2024-09-16T09:45:37.316 INFO:tasks.workunit.client.1.smithi114.stdout:7/866: mkdir d2/d9/d2b/d2e/d3e/d89/d125 0 2024-09-16T09:45:37.316 INFO:tasks.workunit.client.1.smithi114.stdout:3/865: write dc/d38/f9c [3602561,32883] 0 2024-09-16T09:45:37.317 INFO:tasks.workunit.client.1.smithi114.stdout:3/866: fsync dc/de/d18/dfe/ffb 0 2024-09-16T09:45:37.318 INFO:tasks.workunit.client.1.smithi114.stdout:7/867: symlink d2/d9/d2b/d78/d99/ddd/dea/l126 0 2024-09-16T09:45:37.319 INFO:tasks.workunit.client.1.smithi114.stdout:7/868: mkdir d2/d9/db1/d127 0 2024-09-16T09:45:37.323 INFO:tasks.workunit.client.1.smithi114.stdout:2/916: write d1/d8/d82/f8d [2062271,14814] 0 2024-09-16T09:45:37.329 INFO:tasks.workunit.client.1.smithi114.stdout:5/757: dwrite d3/d24/d84/d7a/d43/f91 [0,4194304] 0 2024-09-16T09:45:37.332 INFO:tasks.workunit.client.1.smithi114.stdout:5/758: creat d3/d24/d84/d7a/d43/d58/da0/f100 x:0 0 0 2024-09-16T09:45:37.333 INFO:tasks.workunit.client.1.smithi114.stdout:5/759: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/f8b 1729603911 1 2024-09-16T09:45:37.334 INFO:tasks.workunit.client.1.smithi114.stdout:5/760: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/c101 0 2024-09-16T09:45:37.335 INFO:tasks.workunit.client.1.smithi114.stdout:5/761: creat d3/d24/f102 x:0 0 0 2024-09-16T09:45:37.336 INFO:tasks.workunit.client.1.smithi114.stdout:5/762: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6/fea 1 1 2024-09-16T09:45:37.336 INFO:tasks.workunit.client.1.smithi114.stdout:5/763: write d3/f18 [594053,47574] 0 2024-09-16T09:45:37.337 INFO:tasks.workunit.client.1.smithi114.stdout:5/764: creat d3/d24/d84/d7a/d43/d58/da0/f103 x:0 0 0 2024-09-16T09:45:37.338 INFO:tasks.workunit.client.1.smithi114.stdout:5/765: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/l104 0 2024-09-16T09:45:37.338 INFO:tasks.workunit.client.1.smithi114.stdout:5/766: chown d3/d24/d7d/da6/dfc 1 1 2024-09-16T09:45:37.338 INFO:tasks.workunit.client.1.smithi114.stdout:5/767: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc/c105 0 2024-09-16T09:45:37.346 INFO:tasks.workunit.client.1.smithi114.stdout:8/752: dwrite d4/db/f4d [4194304,4194304] 0 2024-09-16T09:45:37.346 INFO:tasks.workunit.client.1.smithi114.stdout:6/876: dwrite d6/da/f4a [0,4194304] 0 2024-09-16T09:45:37.348 INFO:tasks.workunit.client.1.smithi114.stdout:8/753: mkdir d4/db/d3e/d47/d101 0 2024-09-16T09:45:37.348 INFO:tasks.workunit.client.1.smithi114.stdout:8/754: stat d4/db/d3e/d71/d78/d8d/da9/ff3 0 2024-09-16T09:45:37.349 INFO:tasks.workunit.client.1.smithi114.stdout:4/799: dwrite d0/d26/f88 [0,4194304] 0 2024-09-16T09:45:37.350 INFO:tasks.workunit.client.1.smithi114.stdout:9/802: dwrite d3/da/d10/d23/d29/d3f/d85/f116 [0,4194304] 0 2024-09-16T09:45:37.351 INFO:tasks.workunit.client.1.smithi114.stdout:0/775: dwrite d1f/d27/d47/f64 [0,4194304] 0 2024-09-16T09:45:37.351 INFO:tasks.workunit.client.1.smithi114.stdout:2/917: dwrite d1/d8/d10/d16/d60/db7/f113 [0,4194304] 0 2024-09-16T09:45:37.351 INFO:tasks.workunit.client.1.smithi114.stdout:2/918: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/l5d 1869528 1 2024-09-16T09:45:37.351 INFO:tasks.workunit.client.1.smithi114.stdout:2/919: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/fc3 [2477510,81980] 0 2024-09-16T09:45:37.352 INFO:tasks.workunit.client.1.smithi114.stdout:6/877: creat d6/da/d10/d92/f113 x:0 0 0 2024-09-16T09:45:37.352 INFO:tasks.workunit.client.1.smithi114.stdout:5/768: write d3/d24/d84/d7a/d43/d58/f74 [5154353,12142] 0 2024-09-16T09:45:37.353 INFO:tasks.workunit.client.1.smithi114.stdout:8/755: creat d4/dae/d54/f102 x:0 0 0 2024-09-16T09:45:37.356 INFO:tasks.workunit.client.1.smithi114.stdout:4/800: rename d0/d26/d3c/d3e/d5a/fa1 to d0/d26/d40/d75/d7f/de1/f117 0 2024-09-16T09:45:37.362 INFO:tasks.workunit.client.1.smithi114.stdout:9/803: mknod d3/da/d10/d23/d43/d1e/d78/c118 0 2024-09-16T09:45:37.362 INFO:tasks.workunit.client.1.smithi114.stdout:9/804: chown d3/da/d10/d23/d29/d3f/f76 23 1 2024-09-16T09:45:37.362 INFO:tasks.workunit.client.1.smithi114.stdout:9/805: fdatasync d3/da/d10/d23/d29/d2c/f35 0 2024-09-16T09:45:37.365 INFO:tasks.workunit.client.1.smithi114.stdout:7/869: getdents d2/d9/d2b/d2e/d3e/d89 0 2024-09-16T09:45:37.368 INFO:tasks.workunit.client.1.smithi114.stdout:2/920: mkdir d1/d8/d10/d16/d60/db7/d154 0 2024-09-16T09:45:37.369 INFO:tasks.workunit.client.1.smithi114.stdout:5/769: creat d3/d1f/d8c/f106 x:0 0 0 2024-09-16T09:45:37.370 INFO:tasks.workunit.client.1.smithi114.stdout:5/770: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/fae 114 1 2024-09-16T09:45:37.370 INFO:tasks.workunit.client.1.smithi114.stdout:5/771: fdatasync d3/d24/d7d/f9b 0 2024-09-16T09:45:37.370 INFO:tasks.workunit.client.1.smithi114.stdout:6/878: dwrite d6/d2d/d46/dcc/d62/d77/fac [0,4194304] 0 2024-09-16T09:45:37.370 INFO:tasks.workunit.client.1.smithi114.stdout:8/756: rmdir d4/dae/d54/db3/dfe 0 2024-09-16T09:45:37.372 INFO:tasks.workunit.client.1.smithi114.stdout:8/757: dread d4/dae/d9c/f9d [0,4194304] 0 2024-09-16T09:45:37.373 INFO:tasks.workunit.client.1.smithi114.stdout:0/776: rename d1f/d20/cb6 to d1f/d2d/d7a/ddc/c114 0 2024-09-16T09:45:37.377 INFO:tasks.workunit.client.1.smithi114.stdout:4/801: unlink d0/d26/d29/d2b/d58/dfd/f113 0 2024-09-16T09:45:37.377 INFO:tasks.workunit.client.1.smithi114.stdout:9/806: getdents d3/daa 0 2024-09-16T09:45:37.377 INFO:tasks.workunit.client.1.smithi114.stdout:7/870: symlink d2/d9/d2b/d78/d9f/l128 0 2024-09-16T09:45:37.378 INFO:tasks.workunit.client.1.smithi114.stdout:2/921: stat d1/d8/d10/d16/d1d/d92/da3/c149 0 2024-09-16T09:45:37.380 INFO:tasks.workunit.client.1.smithi114.stdout:5/772: creat d3/d24/d84/d7a/d43/f107 x:0 0 0 2024-09-16T09:45:37.382 INFO:tasks.workunit.client.1.smithi114.stdout:8/758: getdents d4/db/d3e/d71/d78/d8d/da9 0 2024-09-16T09:45:37.383 INFO:tasks.workunit.client.1.smithi114.stdout:4/802: dread d0/d26/d29/f14 [0,4194304] 0 2024-09-16T09:45:37.383 INFO:tasks.workunit.client.1.smithi114.stdout:0/777: creat d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/f115 x:0 0 0 2024-09-16T09:45:37.385 INFO:tasks.workunit.client.1.smithi114.stdout:6/879: dwrite d6/fcb [0,4194304] 0 2024-09-16T09:45:37.385 INFO:tasks.workunit.client.1.smithi114.stdout:6/880: readlink d6/d2d/d46/d9c/l101 0 2024-09-16T09:45:37.386 INFO:tasks.workunit.client.1.smithi114.stdout:9/807: rename d3/da/d10/d23/d43/d1e/d7b/fa3 to d3/da/d10/d23/d43/d1e/d25/dc0/dfb/f119 0 2024-09-16T09:45:37.386 INFO:tasks.workunit.client.1.smithi114.stdout:2/922: creat d1/d8/d10/d16/d1d/d92/da7/f155 x:0 0 0 2024-09-16T09:45:37.386 INFO:tasks.workunit.client.1.smithi114.stdout:2/923: fdatasync d1/d8/d10/d16/d60/db7/fbb 0 2024-09-16T09:45:37.388 INFO:tasks.workunit.client.1.smithi114.stdout:5/773: unlink d3/d24/d7d/fc9 0 2024-09-16T09:45:37.388 INFO:tasks.workunit.client.1.smithi114.stdout:5/774: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6/fea 0 2024-09-16T09:45:37.390 INFO:tasks.workunit.client.1.smithi114.stdout:2/924: mknod d1/d8/d10/d16/d60/db7/deb/d136/c156 0 2024-09-16T09:45:37.393 INFO:tasks.workunit.client.1.smithi114.stdout:5/775: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/ddc to d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d108 0 2024-09-16T09:45:37.395 INFO:tasks.workunit.client.1.smithi114.stdout:9/808: dread d3/da/f46 [0,4194304] 0 2024-09-16T09:45:37.395 INFO:tasks.workunit.client.1.smithi114.stdout:0/778: dread d1f/d22/d2e/f6c [4194304,4194304] 0 2024-09-16T09:45:37.397 INFO:tasks.workunit.client.1.smithi114.stdout:5/776: creat d3/d24/d84/d7a/d43/d4c/d92/d78/f109 x:0 0 0 2024-09-16T09:45:37.397 INFO:tasks.workunit.client.1.smithi114.stdout:5/777: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/f8b [501167,114167] 0 2024-09-16T09:45:37.398 INFO:tasks.workunit.client.1.smithi114.stdout:5/778: truncate d3/d24/d84/d7a/d43/f51 5177183 0 2024-09-16T09:45:37.399 INFO:tasks.workunit.client.1.smithi114.stdout:5/779: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f 0 2024-09-16T09:45:37.402 INFO:tasks.workunit.client.1.smithi114.stdout:5/780: symlink d3/d24/d84/d7a/d43/d4c/d6d/l10a 0 2024-09-16T09:45:37.404 INFO:tasks.workunit.client.1.smithi114.stdout:5/781: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d10b 0 2024-09-16T09:45:37.407 INFO:tasks.workunit.client.1.smithi114.stdout:0/779: dread d1f/d22/d2e/f40 [0,4194304] 0 2024-09-16T09:45:37.417 INFO:tasks.workunit.client.1.smithi114.stdout:4/803: dwrite d0/d26/d3c/d3e/d4b/d46/db3/fca [0,4194304] 0 2024-09-16T09:45:37.426 INFO:tasks.workunit.client.1.smithi114.stdout:6/881: dwrite d6/da/d10/f4b [0,4194304] 0 2024-09-16T09:45:37.426 INFO:tasks.workunit.client.1.smithi114.stdout:2/925: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/f103 [0,4194304] 0 2024-09-16T09:45:37.426 INFO:tasks.workunit.client.1.smithi114.stdout:5/782: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/f8b [0,4194304] 0 2024-09-16T09:45:37.427 INFO:tasks.workunit.client.1.smithi114.stdout:2/926: write d1/d8/d10/d16/f8c [920509,121149] 0 2024-09-16T09:45:37.427 INFO:tasks.workunit.client.1.smithi114.stdout:2/927: dread - d1/d9e/d141/f102 zero size 2024-09-16T09:45:37.428 INFO:tasks.workunit.client.1.smithi114.stdout:9/809: dwrite d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:37.428 INFO:tasks.workunit.client.1.smithi114.stdout:9/810: chown d3/daa/c103 1792 1 2024-09-16T09:45:37.428 INFO:tasks.workunit.client.1.smithi114.stdout:9/811: write d3/da/d10/d23/d43/d82/f3e [44635,119059] 0 2024-09-16T09:45:37.429 INFO:tasks.workunit.client.1.smithi114.stdout:6/882: creat d6/da/db3/dd1/f114 x:0 0 0 2024-09-16T09:45:37.429 INFO:tasks.workunit.client.1.smithi114.stdout:6/883: rename d6/da/d48/db0 to d6/da/d48/db0/d115 22 2024-09-16T09:45:37.429 INFO:tasks.workunit.client.1.smithi114.stdout:5/783: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/d98/d10c 0 2024-09-16T09:45:37.431 INFO:tasks.workunit.client.1.smithi114.stdout:5/784: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6 0 2024-09-16T09:45:37.432 INFO:tasks.workunit.client.1.smithi114.stdout:5/785: creat d3/d24/d84/d7a/d43/d4c/f10d x:0 0 0 2024-09-16T09:45:37.433 INFO:tasks.workunit.client.1.smithi114.stdout:0/780: dwrite d1f/d22/fba [4194304,4194304] 0 2024-09-16T09:45:37.434 INFO:tasks.workunit.client.1.smithi114.stdout:0/781: readlink d1f/d20/d48/d75/l83 0 2024-09-16T09:45:37.434 INFO:tasks.workunit.client.1.smithi114.stdout:6/884: write d6/da/d10/d40/d82/fda [468111,101466] 0 2024-09-16T09:45:37.443 INFO:tasks.workunit.client.1.smithi114.stdout:6/885: write d6/da/f1e [713946,821] 0 2024-09-16T09:45:37.445 INFO:tasks.workunit.client.1.smithi114.stdout:4/804: dwrite d0/d26/d3c/d3e/d4b/d46/f80 [0,4194304] 0 2024-09-16T09:45:37.445 INFO:tasks.workunit.client.1.smithi114.stdout:4/805: write d0/d26/d29/d2b/f61 [1082973,66194] 0 2024-09-16T09:45:37.445 INFO:tasks.workunit.client.1.smithi114.stdout:4/806: rename d0 to d0/d13/d25/d118 22 2024-09-16T09:45:37.445 INFO:tasks.workunit.client.1.smithi114.stdout:4/807: chown d0/d13 46686 1 2024-09-16T09:45:37.446 INFO:tasks.workunit.client.1.smithi114.stdout:4/808: dread d0/f64 [0,4194304] 0 2024-09-16T09:45:37.447 INFO:tasks.workunit.client.1.smithi114.stdout:5/786: write d3/f20 [5899248,49739] 0 2024-09-16T09:45:37.447 INFO:tasks.workunit.client.1.smithi114.stdout:5/787: chown d3/d1f/f27 5531641 1 2024-09-16T09:45:37.447 INFO:tasks.workunit.client.1.smithi114.stdout:5/788: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f55 0 2024-09-16T09:45:37.447 INFO:tasks.workunit.client.1.smithi114.stdout:5/789: chown d3/d24/d84/d7a/d43/d4c/d92 7 1 2024-09-16T09:45:37.460 INFO:tasks.workunit.client.1.smithi114.stdout:2/928: dwrite d1/d8/d10/f67 [0,4194304] 0 2024-09-16T09:45:37.462 INFO:tasks.workunit.client.1.smithi114.stdout:2/929: dread d1/d8/f7a [0,4194304] 0 2024-09-16T09:45:37.463 INFO:tasks.workunit.client.1.smithi114.stdout:5/790: write d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 [3842776,67912] 0 2024-09-16T09:45:37.463 INFO:tasks.workunit.client.1.smithi114.stdout:5/791: truncate d3/d24/d84/d7a/d43/f107 223770 0 2024-09-16T09:45:37.466 INFO:tasks.workunit.client.1.smithi114.stdout:5/792: unlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/fc3 0 2024-09-16T09:45:37.467 INFO:tasks.workunit.client.1.smithi114.stdout:9/812: dread d3/da/d10/d23/d43/d82/f3e [0,4194304] 0 2024-09-16T09:45:37.468 INFO:tasks.workunit.client.1.smithi114.stdout:9/813: symlink d3/da/d10/d23/d29/l11a 0 2024-09-16T09:45:37.469 INFO:tasks.workunit.client.1.smithi114.stdout:0/782: dwrite d1f/d27/d47/d56/f62 [0,4194304] 0 2024-09-16T09:45:37.469 INFO:tasks.workunit.client.1.smithi114.stdout:9/814: creat d3/daa/f11b x:0 0 0 2024-09-16T09:45:37.470 INFO:tasks.workunit.client.1.smithi114.stdout:0/783: unlink d1f/d22/cee 0 2024-09-16T09:45:37.472 INFO:tasks.workunit.client.1.smithi114.stdout:9/815: rmdir d3/da/d10/d23/d29/ded/d100 0 2024-09-16T09:45:37.472 INFO:tasks.workunit.client.1.smithi114.stdout:4/809: dwrite d0/f11 [4194304,4194304] 0 2024-09-16T09:45:37.472 INFO:tasks.workunit.client.1.smithi114.stdout:9/816: read d3/da/d10/d23/d43/d82/dc5/ff3 [41178,18207] 0 2024-09-16T09:45:37.472 INFO:tasks.workunit.client.1.smithi114.stdout:6/886: dwrite d6/da/d48/db0/dfc/f100 [0,4194304] 0 2024-09-16T09:45:37.473 INFO:tasks.workunit.client.1.smithi114.stdout:0/784: truncate d1f/d20/f51 28566 0 2024-09-16T09:45:37.480 INFO:tasks.workunit.client.1.smithi114.stdout:9/817: truncate d3/da/d10/f21 5426358 0 2024-09-16T09:45:37.481 INFO:tasks.workunit.client.1.smithi114.stdout:6/887: creat d6/da/db3/f116 x:0 0 0 2024-09-16T09:45:37.482 INFO:tasks.workunit.client.1.smithi114.stdout:0/785: symlink d1f/d27/de6/l116 0 2024-09-16T09:45:37.482 INFO:tasks.workunit.client.1.smithi114.stdout:0/786: chown d1f/d22/d2e/d46/d7f/d8d/fc5 188382 1 2024-09-16T09:45:37.482 INFO:tasks.workunit.client.1.smithi114.stdout:0/787: chown d1f/d22/d2e/lfa 17 1 2024-09-16T09:45:37.483 INFO:tasks.workunit.client.1.smithi114.stdout:9/818: unlink d3/da/d10/d23/d43/d1e/d25/ffc 0 2024-09-16T09:45:37.484 INFO:tasks.workunit.client.1.smithi114.stdout:6/888: mkdir d6/d117 0 2024-09-16T09:45:37.484 INFO:tasks.workunit.client.1.smithi114.stdout:0/788: creat d1f/d22/d2e/d46/d7f/daf/f117 x:0 0 0 2024-09-16T09:45:37.486 INFO:tasks.workunit.client.1.smithi114.stdout:9/819: symlink d3/da/d10/d23/d43/d1e/da0/l11c 0 2024-09-16T09:45:37.486 INFO:tasks.workunit.client.1.smithi114.stdout:9/820: fdatasync d3/fc 0 2024-09-16T09:45:37.486 INFO:tasks.workunit.client.1.smithi114.stdout:9/821: chown d3/da/d10/d23/d29/d87/f106 1 1 2024-09-16T09:45:37.486 INFO:tasks.workunit.client.1.smithi114.stdout:0/789: rmdir d1f/d27/db9 39 2024-09-16T09:45:37.486 INFO:tasks.workunit.client.1.smithi114.stdout:0/790: chown d1f/d22/d2e/d46/d7f/df4 5912 1 2024-09-16T09:45:37.487 INFO:tasks.workunit.client.1.smithi114.stdout:0/791: write d1f/d22/faa [484134,90551] 0 2024-09-16T09:45:37.487 INFO:tasks.workunit.client.1.smithi114.stdout:0/792: mkdir d1f/d22/d118 0 2024-09-16T09:45:37.491 INFO:tasks.workunit.client.1.smithi114.stdout:2/930: dwrite d1/d8/d10/d16/f30 [0,4194304] 0 2024-09-16T09:45:37.493 INFO:tasks.workunit.client.1.smithi114.stdout:2/931: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/f157 x:0 0 0 2024-09-16T09:45:37.494 INFO:tasks.workunit.client.1.smithi114.stdout:2/932: mknod d1/d8/d10/d16/dd9/c158 0 2024-09-16T09:45:37.494 INFO:tasks.workunit.client.1.smithi114.stdout:2/933: dread - d1/d8/d10/d16/d1d/d92/da7/f100 zero size 2024-09-16T09:45:37.495 INFO:tasks.workunit.client.1.smithi114.stdout:2/934: unlink d1/d8/d10/d16/d60/db7/deb/f12a 0 2024-09-16T09:45:37.496 INFO:tasks.workunit.client.1.smithi114.stdout:4/810: dwrite d0/d13/f4c [4194304,4194304] 0 2024-09-16T09:45:37.496 INFO:tasks.workunit.client.1.smithi114.stdout:2/935: link d1/d8/d10/d16/l3f d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/l159 0 2024-09-16T09:45:37.498 INFO:tasks.workunit.client.1.smithi114.stdout:4/811: mknod d0/d26/d3c/d3e/d4b/d46/df3/c119 0 2024-09-16T09:45:37.499 INFO:tasks.workunit.client.1.smithi114.stdout:6/889: write d6/d2d/d46/dcc/d62/d77/fac [4156841,76501] 0 2024-09-16T09:45:37.499 INFO:tasks.workunit.client.1.smithi114.stdout:5/793: dwrite d3/d24/d84/d7a/d43/d4c/f10d [0,4194304] 0 2024-09-16T09:45:37.501 INFO:tasks.workunit.client.1.smithi114.stdout:4/812: rename d0/d26/d29/d2b/dc7 to d0/d53/d11a 0 2024-09-16T09:45:37.501 INFO:tasks.workunit.client.1.smithi114.stdout:4/813: chown d0/d26/d29/d2b/l97 19 1 2024-09-16T09:45:37.501 INFO:tasks.workunit.client.1.smithi114.stdout:4/814: fdatasync d0/d26/d3c/d3e/d4b/fd6 0 2024-09-16T09:45:37.501 INFO:tasks.workunit.client.1.smithi114.stdout:9/822: fsync d3/daa/f11b 0 2024-09-16T09:45:37.505 INFO:tasks.workunit.client.1.smithi114.stdout:6/890: mkdir d6/da/d48/db0/dfc/d118 0 2024-09-16T09:45:37.505 INFO:tasks.workunit.client.1.smithi114.stdout:5/794: getdents d3/d24/d7d/da6 0 2024-09-16T09:45:37.506 INFO:tasks.workunit.client.1.smithi114.stdout:4/815: symlink d0/d26/d29/de9/l11b 0 2024-09-16T09:45:37.507 INFO:tasks.workunit.client.1.smithi114.stdout:9/823: mknod d3/da/d10/d23/d43/c11d 0 2024-09-16T09:45:37.507 INFO:tasks.workunit.client.1.smithi114.stdout:2/936: dread d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/f61 [0,4194304] 0 2024-09-16T09:45:37.508 INFO:tasks.workunit.client.1.smithi114.stdout:6/891: creat d6/da/d48/db0/dfc/d118/f119 x:0 0 0 2024-09-16T09:45:37.509 INFO:tasks.workunit.client.1.smithi114.stdout:5/795: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/l10e 0 2024-09-16T09:45:37.511 INFO:tasks.workunit.client.1.smithi114.stdout:2/937: creat d1/d8/d10/d16/f15a x:0 0 0 2024-09-16T09:45:37.512 INFO:tasks.workunit.client.1.smithi114.stdout:2/938: dread d1/d8/d10/d16/f27 [0,4194304] 0 2024-09-16T09:45:37.513 INFO:tasks.workunit.client.1.smithi114.stdout:6/892: unlink d6/da/d36/l41 0 2024-09-16T09:45:37.513 INFO:tasks.workunit.client.1.smithi114.stdout:2/939: write d1/d8/d10/d16/d1d/d130/f13d [92283,119861] 0 2024-09-16T09:45:37.513 INFO:tasks.workunit.client.1.smithi114.stdout:2/940: dread - d1/ffd zero size 2024-09-16T09:45:37.514 INFO:tasks.workunit.client.1.smithi114.stdout:4/816: symlink d0/d26/d40/d75/d7f/l11c 0 2024-09-16T09:45:37.515 INFO:tasks.workunit.client.1.smithi114.stdout:9/824: mkdir d3/da/d10/d23/d43/d1e/d11e 0 2024-09-16T09:45:37.516 INFO:tasks.workunit.client.1.smithi114.stdout:6/893: mkdir d6/dea/d11a 0 2024-09-16T09:45:37.516 INFO:tasks.workunit.client.1.smithi114.stdout:6/894: fsync d6/d2d/d46/dcc/d62/faa 0 2024-09-16T09:45:37.516 INFO:tasks.workunit.client.1.smithi114.stdout:6/895: chown d6/d2d/l2f 6068 1 2024-09-16T09:45:37.517 INFO:tasks.workunit.client.1.smithi114.stdout:2/941: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/d15b 0 2024-09-16T09:45:37.517 INFO:tasks.workunit.client.1.smithi114.stdout:2/942: chown d1/d8/d10/d16/d1d/d92/da7/d148/c4c 111 1 2024-09-16T09:45:37.517 INFO:tasks.workunit.client.1.smithi114.stdout:2/943: write d1/d9e/daf/f13e [3368741,76910] 0 2024-09-16T09:45:37.518 INFO:tasks.workunit.client.1.smithi114.stdout:5/796: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d10f 0 2024-09-16T09:45:37.520 INFO:tasks.workunit.client.1.smithi114.stdout:4/817: creat d0/d26/d29/d9f/f11d x:0 0 0 2024-09-16T09:45:37.521 INFO:tasks.workunit.client.1.smithi114.stdout:6/896: mkdir d6/d2d/d46/dcc/d10f/d11b 0 2024-09-16T09:45:37.522 INFO:tasks.workunit.client.1.smithi114.stdout:4/818: creat d0/d13/d56/d7e/d116/f11e x:0 0 0 2024-09-16T09:45:37.528 INFO:tasks.workunit.client.1.smithi114.stdout:9/825: dread d3/da/d10/d23/d29/d2c/d45/f64 [0,4194304] 0 2024-09-16T09:45:37.528 INFO:tasks.workunit.client.1.smithi114.stdout:2/944: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f56 [1344982,91531] 0 2024-09-16T09:45:37.531 INFO:tasks.workunit.client.1.smithi114.stdout:9/826: symlink d3/da/d10/d23/d29/dd1/l11f 0 2024-09-16T09:45:37.532 INFO:tasks.workunit.client.1.smithi114.stdout:6/897: dread d6/ff3 [0,4194304] 0 2024-09-16T09:45:37.533 INFO:tasks.workunit.client.1.smithi114.stdout:6/898: write d6/f88 [987692,104967] 0 2024-09-16T09:45:37.533 INFO:tasks.workunit.client.1.smithi114.stdout:6/899: write d6/da/d10/d92/f113 [129868,75869] 0 2024-09-16T09:45:37.535 INFO:tasks.workunit.client.1.smithi114.stdout:2/945: rename d1/d8/d10/d16/d1d/d92/da7/d148/fdc to d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/f15c 0 2024-09-16T09:45:37.535 INFO:tasks.workunit.client.1.smithi114.stdout:2/946: truncate d1/d8/d10/d16/d60/f14a 308945 0 2024-09-16T09:45:37.536 INFO:tasks.workunit.client.1.smithi114.stdout:2/947: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d90/l11f 39974 1 2024-09-16T09:45:37.538 INFO:tasks.workunit.client.1.smithi114.stdout:2/948: unlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/f104 0 2024-09-16T09:45:37.538 INFO:tasks.workunit.client.1.smithi114.stdout:3/867: sync 2024-09-16T09:45:37.539 INFO:tasks.workunit.client.1.smithi114.stdout:1/821: sync 2024-09-16T09:45:37.539 INFO:tasks.workunit.client.1.smithi114.stdout:1/822: readlink d4/la9 0 2024-09-16T09:45:37.539 INFO:tasks.workunit.client.1.smithi114.stdout:1/823: readlink d4/d2b/d16/d71/lcb 0 2024-09-16T09:45:37.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/949: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/f15d x:0 0 0 2024-09-16T09:45:37.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/950: read - d1/d8/d10/d16/d60/db7/deb/d12b/fca zero size 2024-09-16T09:45:37.540 INFO:tasks.workunit.client.1.smithi114.stdout:2/951: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/f114 [940770,18352] 0 2024-09-16T09:45:37.541 INFO:tasks.workunit.client.1.smithi114.stdout:9/827: dread d3/da/d10/d23/d43/d82/f3e [0,4194304] 0 2024-09-16T09:45:37.542 INFO:tasks.workunit.client.1.smithi114.stdout:1/824: unlink d4/d2b/d2f/d3a/d9d/d41/d42/d58/f5c 0 2024-09-16T09:45:37.543 INFO:tasks.workunit.client.1.smithi114.stdout:3/868: creat dc/de/d18/d78/d8d/f12f x:0 0 0 2024-09-16T09:45:37.543 INFO:tasks.workunit.client.1.smithi114.stdout:3/869: fdatasync dc/de/d17/d79/dab/fe5 0 2024-09-16T09:45:37.544 INFO:tasks.workunit.client.1.smithi114.stdout:2/952: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/f15e x:0 0 0 2024-09-16T09:45:37.546 INFO:tasks.workunit.client.1.smithi114.stdout:3/870: unlink dc/de/d17/d2d/db4/fc8 0 2024-09-16T09:45:37.547 INFO:tasks.workunit.client.1.smithi114.stdout:6/900: getdents d6/da/d48/db0/dfc 0 2024-09-16T09:45:37.549 INFO:tasks.workunit.client.1.smithi114.stdout:2/953: rename d1/d8/d10/d16/d60/db7/deb/d136/c156 to d1/d8/d10/c15f 0 2024-09-16T09:45:37.549 INFO:tasks.workunit.client.1.smithi114.stdout:2/954: write d1/d8/d10/d16/d1d/d92/da3/fc2 [4786569,45416] 0 2024-09-16T09:45:37.549 INFO:tasks.workunit.client.1.smithi114.stdout:2/955: dread - d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/f110 zero size 2024-09-16T09:45:37.551 INFO:tasks.workunit.client.1.smithi114.stdout:6/901: link d6/fc d6/da/d48/db0/dfc/d118/f11c 0 2024-09-16T09:45:37.551 INFO:tasks.workunit.client.1.smithi114.stdout:6/902: readlink d6/da/d48/ldc 0 2024-09-16T09:45:37.551 INFO:tasks.workunit.client.1.smithi114.stdout:6/903: read - d6/da/db3/dd1/dec/f106 zero size 2024-09-16T09:45:37.553 INFO:tasks.workunit.client.1.smithi114.stdout:5/797: dwrite d3/d24/d84/d7a/d43/d4c/f7b [0,4194304] 0 2024-09-16T09:45:37.555 INFO:tasks.workunit.client.1.smithi114.stdout:4/819: dwrite d0/d26/d29/f115 [0,4194304] 0 2024-09-16T09:45:37.555 INFO:tasks.workunit.client.1.smithi114.stdout:4/820: fsync d0/f1f 0 2024-09-16T09:45:37.555 INFO:tasks.workunit.client.1.smithi114.stdout:4/821: chown d0/d26/d3c/d3e/d4b/d46/l47 13699517 1 2024-09-16T09:45:37.555 INFO:tasks.workunit.client.1.smithi114.stdout:3/871: dread dc/de/d17/d2d/d41/d11e/d3d/f6c [0,4194304] 0 2024-09-16T09:45:37.557 INFO:tasks.workunit.client.1.smithi114.stdout:5/798: getdents d3/d24/d84/d7a/d43/d4c/db2/db7 0 2024-09-16T09:45:37.565 INFO:tasks.workunit.client.1.smithi114.stdout:1/825: write d4/d2b/d16/d47/d83/f8c [2780368,6579] 0 2024-09-16T09:45:37.566 INFO:tasks.workunit.client.1.smithi114.stdout:4/822: symlink d0/d13/d56/l11f 0 2024-09-16T09:45:37.566 INFO:tasks.workunit.client.1.smithi114.stdout:4/823: write d0/d26/f8b [86085,105308] 0 2024-09-16T09:45:37.567 INFO:tasks.workunit.client.1.smithi114.stdout:9/828: dwrite d3/da/d10/f21 [0,4194304] 0 2024-09-16T09:45:37.569 INFO:tasks.workunit.client.1.smithi114.stdout:3/872: unlink dc/l69 0 2024-09-16T09:45:37.569 INFO:tasks.workunit.client.1.smithi114.stdout:3/873: chown dc/de/d17/d79/dab/fe5 473709884 1 2024-09-16T09:45:37.569 INFO:tasks.workunit.client.1.smithi114.stdout:3/874: chown dc/de/cca 57 1 2024-09-16T09:45:37.572 INFO:tasks.workunit.client.1.smithi114.stdout:5/799: rename d3/d24/d84/f2a to d3/d24/d7d/d96/f110 0 2024-09-16T09:45:37.575 INFO:tasks.workunit.client.1.smithi114.stdout:1/826: creat d4/d2b/d16/d71/d72/f115 x:0 0 0 2024-09-16T09:45:37.577 INFO:tasks.workunit.client.1.smithi114.stdout:5/800: dread d3/d1f/ff7 [0,4194304] 0 2024-09-16T09:45:37.580 INFO:tasks.workunit.client.1.smithi114.stdout:7/871: sync 2024-09-16T09:45:37.580 INFO:tasks.workunit.client.1.smithi114.stdout:7/872: stat d2/d9/d2b/f57 0 2024-09-16T09:45:37.581 INFO:tasks.workunit.client.1.smithi114.stdout:3/875: write dc/de/d17/d2d/d41/f42 [786582,26903] 0 2024-09-16T09:45:37.581 INFO:tasks.workunit.client.1.smithi114.stdout:3/876: fsync dc/de/d17/d2d/d41/d11e/d98/f12b 0 2024-09-16T09:45:37.581 INFO:tasks.workunit.client.1.smithi114.stdout:7/873: rmdir d2/d9/db1/dfc 39 2024-09-16T09:45:37.583 INFO:tasks.workunit.client.1.smithi114.stdout:3/877: creat dc/de/d17/d2d/d41/d11e/d4e/df8/f130 x:0 0 0 2024-09-16T09:45:37.585 INFO:tasks.workunit.client.1.smithi114.stdout:1/827: write d4/d2b/d2f/d3a/d9d/d41/d42/f5a [1161563,3842] 0 2024-09-16T09:45:37.586 INFO:tasks.workunit.client.1.smithi114.stdout:9/829: write d3/da/d10/d23/f7e [1676194,2191] 0 2024-09-16T09:45:37.586 INFO:tasks.workunit.client.1.smithi114.stdout:1/828: symlink d4/d2b/d16/d71/de5/df1/l116 0 2024-09-16T09:45:37.587 INFO:tasks.workunit.client.1.smithi114.stdout:9/830: rename d3/da/l44 to d3/da/d10/d23/d43/d1e/d7b/l120 0 2024-09-16T09:45:37.587 INFO:tasks.workunit.client.1.smithi114.stdout:1/829: mkdir d4/d2b/d2f/d3a/db0/d117 0 2024-09-16T09:45:37.589 INFO:tasks.workunit.client.1.smithi114.stdout:9/831: creat d3/daa/def/f121 x:0 0 0 2024-09-16T09:45:37.589 INFO:tasks.workunit.client.1.smithi114.stdout:9/832: read - d3/da/fec zero size 2024-09-16T09:45:37.589 INFO:tasks.workunit.client.1.smithi114.stdout:9/833: chown d3/da/d10/d23/d29/d87/lfe 8068 1 2024-09-16T09:45:37.589 INFO:tasks.workunit.client.1.smithi114.stdout:1/830: getdents d4/d2b/d29/da0 0 2024-09-16T09:45:37.591 INFO:tasks.workunit.client.1.smithi114.stdout:9/834: mknod d3/da/d10/c122 0 2024-09-16T09:45:37.591 INFO:tasks.workunit.client.1.smithi114.stdout:7/874: dread d2/f4a [0,4194304] 0 2024-09-16T09:45:37.591 INFO:tasks.workunit.client.1.smithi114.stdout:1/831: symlink d4/d2b/d2f/d3a/d9d/d41/d42/d58/l118 0 2024-09-16T09:45:37.593 INFO:tasks.workunit.client.1.smithi114.stdout:9/835: rename d3/da/f11 to d3/da/d10/d23/d29/ded/f123 0 2024-09-16T09:45:37.593 INFO:tasks.workunit.client.1.smithi114.stdout:9/836: truncate d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/db5/fb6 483754 0 2024-09-16T09:45:37.593 INFO:tasks.workunit.client.1.smithi114.stdout:9/837: truncate d3/da/d10/d23/d29/d2c/d6b/d68/f9a 4205766 0 2024-09-16T09:45:37.593 INFO:tasks.workunit.client.1.smithi114.stdout:9/838: chown d3/daa/def/f121 740 1 2024-09-16T09:45:37.594 INFO:tasks.workunit.client.1.smithi114.stdout:7/875: truncate d2/d9/d2b/d2e/d77/ff2 535502 0 2024-09-16T09:45:37.594 INFO:tasks.workunit.client.1.smithi114.stdout:7/876: chown d2/d9/d51/d84/dda/ce7 288087278 1 2024-09-16T09:45:37.594 INFO:tasks.workunit.client.1.smithi114.stdout:5/801: dread d3/d24/d84/dbc/fd4 [0,4194304] 0 2024-09-16T09:45:37.594 INFO:tasks.workunit.client.1.smithi114.stdout:4/824: dwrite d0/d26/d3c/d3e/d4b/fd6 [0,4194304] 0 2024-09-16T09:45:37.594 INFO:tasks.workunit.client.1.smithi114.stdout:4/825: chown d0/d26/d3c/d3e/d4b/d46/db3 1840 1 2024-09-16T09:45:37.594 INFO:tasks.workunit.client.1.smithi114.stdout:4/826: write d0/d26/d3c/d45/fc1 [441603,3904] 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:1/832: creat d4/d2b/d16/d71/d72/d75/db4/f119 x:0 0 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:1/833: getdents d4/d2b/d29/da0 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:1/834: fsync d4/d2b/d16/f1b 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:1/835: stat d4/d2b/d16/d47 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:9/839: symlink d3/daa/d107/l124 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:2/956: dwrite d1/fe [4194304,4194304] 0 2024-09-16T09:45:37.595 INFO:tasks.workunit.client.1.smithi114.stdout:6/904: dwrite d6/da/d36/f3f [4194304,4194304] 0 2024-09-16T09:45:37.596 INFO:tasks.workunit.client.1.smithi114.stdout:5/802: mknod d3/d1f/d8c/c111 0 2024-09-16T09:45:37.597 INFO:tasks.workunit.client.1.smithi114.stdout:4/827: rename d0/d26/d2e/f7b to d0/f120 0 2024-09-16T09:45:37.597 INFO:tasks.workunit.client.1.smithi114.stdout:4/828: chown d0/d26/d29/d9f/da0/cee 14615 1 2024-09-16T09:45:37.598 INFO:tasks.workunit.client.1.smithi114.stdout:7/877: dread d2/d9/d2b/d2e/d22/d66/db0/fcf [0,4194304] 0 2024-09-16T09:45:37.598 INFO:tasks.workunit.client.1.smithi114.stdout:1/836: creat d4/d2b/d16/d71/de5/df1/f11a x:0 0 0 2024-09-16T09:45:37.599 INFO:tasks.workunit.client.1.smithi114.stdout:1/837: fdatasync d4/d2b/d2f/d3a/d9d/fc9 0 2024-09-16T09:45:37.599 INFO:tasks.workunit.client.1.smithi114.stdout:9/840: creat d3/da/d10/d23/d43/d1e/d25/f125 x:0 0 0 2024-09-16T09:45:37.601 INFO:tasks.workunit.client.1.smithi114.stdout:2/957: creat d1/d8/d10/d16/d1d/d92/da7/d148/f160 x:0 0 0 2024-09-16T09:45:37.607 INFO:tasks.workunit.client.1.smithi114.stdout:7/878: dread d2/f2c [0,4194304] 0 2024-09-16T09:45:37.611 INFO:tasks.workunit.client.1.smithi114.stdout:2/958: write d1/f2c [274458,78285] 0 2024-09-16T09:45:37.611 INFO:tasks.workunit.client.1.smithi114.stdout:2/959: truncate d1/f86 1376146 0 2024-09-16T09:45:37.611 INFO:tasks.workunit.client.1.smithi114.stdout:2/960: read d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f65 [1077629,35230] 0 2024-09-16T09:45:37.611 INFO:tasks.workunit.client.1.smithi114.stdout:2/961: write d1/d8/d10/d16/d1d/f5c [1028092,12086] 0 2024-09-16T09:45:37.612 INFO:tasks.workunit.client.1.smithi114.stdout:5/803: symlink d3/d24/d84/dbc/l112 0 2024-09-16T09:45:37.612 INFO:tasks.workunit.client.1.smithi114.stdout:5/804: write d3/d1f/d8c/fd3 [928986,68744] 0 2024-09-16T09:45:37.614 INFO:tasks.workunit.client.1.smithi114.stdout:3/878: dwrite dc/de/d18/d78/d5c/da5/f115 [0,4194304] 0 2024-09-16T09:45:37.614 INFO:tasks.workunit.client.1.smithi114.stdout:4/829: dwrite d0/d13/f22 [4194304,4194304] 0 2024-09-16T09:45:37.614 INFO:tasks.workunit.client.1.smithi114.stdout:4/830: stat d0/f11 0 2024-09-16T09:45:37.614 INFO:tasks.workunit.client.1.smithi114.stdout:4/831: stat d0/d26/d2e/dc0 0 2024-09-16T09:45:37.615 INFO:tasks.workunit.client.1.smithi114.stdout:6/905: rename d6/da/d36 to d6/d2d/d46/dcc/d62/d11d 0 2024-09-16T09:45:37.615 INFO:tasks.workunit.client.1.smithi114.stdout:6/906: write d6/da/d76/fe9 [4239310,25431] 0 2024-09-16T09:45:37.615 INFO:tasks.workunit.client.1.smithi114.stdout:6/907: write d6/da/d48/fbd [325108,54031] 0 2024-09-16T09:45:37.616 INFO:tasks.workunit.client.1.smithi114.stdout:1/838: unlink d4/fb3 0 2024-09-16T09:45:37.616 INFO:tasks.workunit.client.1.smithi114.stdout:1/839: write d4/d2b/d2f/d3a/d9d/d41/d42/f5a [3109521,70287] 0 2024-09-16T09:45:37.616 INFO:tasks.workunit.client.1.smithi114.stdout:1/840: chown d4/d2b/d16/d47/da7/cbf 3 1 2024-09-16T09:45:37.617 INFO:tasks.workunit.client.1.smithi114.stdout:9/841: getdents d3/da/d10/d23/d43/d1e/da0 0 2024-09-16T09:45:37.617 INFO:tasks.workunit.client.1.smithi114.stdout:9/842: stat d3/da/d10/d23/d43/d1e/d78/lf8 0 2024-09-16T09:45:37.618 INFO:tasks.workunit.client.1.smithi114.stdout:7/879: mknod d2/d9/d2b/d78/c129 0 2024-09-16T09:45:37.621 INFO:tasks.workunit.client.1.smithi114.stdout:2/962: symlink d1/d8/d10/d16/dd9/d116/l161 0 2024-09-16T09:45:37.621 INFO:tasks.workunit.client.1.smithi114.stdout:2/963: write d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/f143 [1006303,10913] 0 2024-09-16T09:45:37.621 INFO:tasks.workunit.client.1.smithi114.stdout:2/964: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/f143 1290045 0 2024-09-16T09:45:37.621 INFO:tasks.workunit.client.1.smithi114.stdout:2/965: readlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/l3d 0 2024-09-16T09:45:37.626 INFO:tasks.workunit.client.1.smithi114.stdout:4/832: rmdir d0/d26/d29/de9 39 2024-09-16T09:45:37.626 INFO:tasks.workunit.client.1.smithi114.stdout:6/908: write d6/da/d76/f8a [299929,42507] 0 2024-09-16T09:45:37.626 INFO:tasks.workunit.client.1.smithi114.stdout:4/833: read d0/d26/f48 [150300,90043] 0 2024-09-16T09:45:37.627 INFO:tasks.workunit.client.1.smithi114.stdout:1/841: mkdir d4/d2b/d2f/d3a/db0/d117/d11b 0 2024-09-16T09:45:37.629 INFO:tasks.workunit.client.1.smithi114.stdout:7/880: rename d2/c34 to d2/d9/d2b/d2e/c12a 0 2024-09-16T09:45:37.630 INFO:tasks.workunit.client.1.smithi114.stdout:2/966: mkdir d1/d8/d10/d16/d60/db7/deb/d117/d162 0 2024-09-16T09:45:37.630 INFO:tasks.workunit.client.1.smithi114.stdout:2/967: read d1/d8/d10/d16/d1d/d92/da3/fc2 [441698,122918] 0 2024-09-16T09:45:37.631 INFO:tasks.workunit.client.1.smithi114.stdout:5/805: rename d3/f20 to d3/f113 0 2024-09-16T09:45:37.633 INFO:tasks.workunit.client.1.smithi114.stdout:6/909: getdents d6/da/dbb/dd3 0 2024-09-16T09:45:37.633 INFO:tasks.workunit.client.1.smithi114.stdout:6/910: readlink d6/da/d10/d40/lde 0 2024-09-16T09:45:37.636 INFO:tasks.workunit.client.1.smithi114.stdout:7/881: link d2/d9/d51/d84/lbe d2/d9/d2b/d2e/d22/l12b 0 2024-09-16T09:45:37.636 INFO:tasks.workunit.client.1.smithi114.stdout:0/793: sync 2024-09-16T09:45:37.636 INFO:tasks.workunit.client.1.smithi114.stdout:8/759: sync 2024-09-16T09:45:37.636 INFO:tasks.workunit.client.1.smithi114.stdout:2/968: mknod d1/d8/d10/d16/d60/db7/deb/d117/d162/c163 0 2024-09-16T09:45:37.638 INFO:tasks.workunit.client.1.smithi114.stdout:3/879: dwrite dc/de/f12c [0,4194304] 0 2024-09-16T09:45:37.639 INFO:tasks.workunit.client.1.smithi114.stdout:4/834: write d0/d26/f88 [2673935,16144] 0 2024-09-16T09:45:37.639 INFO:tasks.workunit.client.1.smithi114.stdout:9/843: dwrite d3/da/d10/d23/d29/d2c/d6b/db9/f10a [0,4194304] 0 2024-09-16T09:45:37.639 INFO:tasks.workunit.client.1.smithi114.stdout:0/794: rmdir d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/d110 0 2024-09-16T09:45:37.642 INFO:tasks.workunit.client.1.smithi114.stdout:8/760: creat d4/db/d39/f103 x:0 0 0 2024-09-16T09:45:37.642 INFO:tasks.workunit.client.1.smithi114.stdout:8/761: chown d4/d6d 1 1 2024-09-16T09:45:37.644 INFO:tasks.workunit.client.1.smithi114.stdout:2/969: symlink d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d9f/l164 0 2024-09-16T09:45:37.644 INFO:tasks.workunit.client.1.smithi114.stdout:1/842: dwrite d4/d2b/d16/d71/d72/d75/db4/f119 [0,4194304] 0 2024-09-16T09:45:37.647 INFO:tasks.workunit.client.1.smithi114.stdout:5/806: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/cd9 to d3/d24/d84/c114 0 2024-09-16T09:45:37.647 INFO:tasks.workunit.client.1.smithi114.stdout:5/807: truncate d3/d24/d84/d7a/d43/d4c/db2/db7/fd2 1516925 0 2024-09-16T09:45:37.647 INFO:tasks.workunit.client.1.smithi114.stdout:5/808: write d3/d1f/ff7 [857045,9486] 0 2024-09-16T09:45:37.647 INFO:tasks.workunit.client.1.smithi114.stdout:1/843: dread d4/d2b/d16/d71/d72/d75/fd4 [0,4194304] 0 2024-09-16T09:45:37.648 INFO:tasks.workunit.client.1.smithi114.stdout:3/880: getdents dc/de/d18/d78/d5c/d6e 0 2024-09-16T09:45:37.648 INFO:tasks.workunit.client.1.smithi114.stdout:3/881: write dc/de/d17/d2d/db4/f128 [65664,112683] 0 2024-09-16T09:45:37.651 INFO:tasks.workunit.client.1.smithi114.stdout:9/844: creat d3/da/d10/d23/d43/d1e/da0/f126 x:0 0 0 2024-09-16T09:45:37.651 INFO:tasks.workunit.client.1.smithi114.stdout:9/845: chown d3/da/d10/f26 26079 1 2024-09-16T09:45:37.651 INFO:tasks.workunit.client.1.smithi114.stdout:0/795: creat d1f/d20/d48/d75/f119 x:0 0 0 2024-09-16T09:45:37.653 INFO:tasks.workunit.client.1.smithi114.stdout:7/882: rename d2/d9/d2b/d2e/c62 to d2/d9/d2b/d78/d99/ddd/dea/c12c 0 2024-09-16T09:45:37.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/809: creat d3/d24/d84/db9/f115 x:0 0 0 2024-09-16T09:45:37.654 INFO:tasks.workunit.client.1.smithi114.stdout:5/810: write d3/d24/d84/f4f [488319,15030] 0 2024-09-16T09:45:37.654 INFO:tasks.workunit.client.1.smithi114.stdout:0/796: rmdir d1f/d27/d55/dce 39 2024-09-16T09:45:37.655 INFO:tasks.workunit.client.1.smithi114.stdout:8/762: rename d4/db/d68/d28 to d4/dae/d54/d104 0 2024-09-16T09:45:37.655 INFO:tasks.workunit.client.1.smithi114.stdout:7/883: dread d2/d9/f19 [0,4194304] 0 2024-09-16T09:45:37.658 INFO:tasks.workunit.client.1.smithi114.stdout:3/882: rename dc/de/d18/d78/d5c/d6e/l122 to dc/de/d17/d2d/d41/l131 0 2024-09-16T09:45:37.658 INFO:tasks.workunit.client.1.smithi114.stdout:3/883: fdatasync dc/de/d17/d2d/d41/d11e/fd9 0 2024-09-16T09:45:37.658 INFO:tasks.workunit.client.1.smithi114.stdout:8/763: symlink d4/db/d68/l105 0 2024-09-16T09:45:37.658 INFO:tasks.workunit.client.1.smithi114.stdout:7/884: getdents d2/d9/d2b/d2e/d3e/d79/d102 0 2024-09-16T09:45:37.660 INFO:tasks.workunit.client.1.smithi114.stdout:9/846: rename d3/da/d10/d23/d43/d1e/d4c/l74 to d3/da/d10/d23/d29/d2c/d70/l127 0 2024-09-16T09:45:37.660 INFO:tasks.workunit.client.1.smithi114.stdout:3/884: truncate dc/de/d18/f22 3766436 0 2024-09-16T09:45:37.661 INFO:tasks.workunit.client.1.smithi114.stdout:8/764: symlink d4/dae/d54/db3/l106 0 2024-09-16T09:45:37.662 INFO:tasks.workunit.client.1.smithi114.stdout:5/811: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/ld0 to d3/d24/d84/d7a/d43/l116 0 2024-09-16T09:45:37.663 INFO:tasks.workunit.client.1.smithi114.stdout:5/812: fsync d3/d24/d84/d7a/d43/d58/da0/f103 0 2024-09-16T09:45:37.663 INFO:tasks.workunit.client.1.smithi114.stdout:9/847: link d3/da/d10/d23/d43/d1e/d78/lf8 d3/da/d10/d23/d43/d1e/d25/d88/l128 0 2024-09-16T09:45:37.664 INFO:tasks.workunit.client.1.smithi114.stdout:9/848: creat d3/da/f129 x:0 0 0 2024-09-16T09:45:37.666 INFO:tasks.workunit.client.1.smithi114.stdout:9/849: mknod d3/da/d10/d23/d43/d1e/d25/c12a 0 2024-09-16T09:45:37.671 INFO:tasks.workunit.client.1.smithi114.stdout:0/797: dread d1f/d27/fac [0,4194304] 0 2024-09-16T09:45:37.673 INFO:tasks.workunit.client.1.smithi114.stdout:5/813: write d3/d24/d84/d7a/f88 [310151,33163] 0 2024-09-16T09:45:37.674 INFO:tasks.workunit.client.1.smithi114.stdout:0/798: rename d1f/d27/d47/d56/f62 to d1f/d27/de6/f11a 0 2024-09-16T09:45:37.674 INFO:tasks.workunit.client.1.smithi114.stdout:6/911: dwrite d6/d2d/d46/dcc/d62/d77/fac [0,4194304] 0 2024-09-16T09:45:37.674 INFO:tasks.workunit.client.1.smithi114.stdout:2/970: dwrite d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/f110 [0,4194304] 0 2024-09-16T09:45:37.674 INFO:tasks.workunit.client.1.smithi114.stdout:2/971: stat d1/l1f 0 2024-09-16T09:45:37.675 INFO:tasks.workunit.client.1.smithi114.stdout:5/814: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f117 x:0 0 0 2024-09-16T09:45:37.676 INFO:tasks.workunit.client.1.smithi114.stdout:4/835: dwrite d0/f103 [0,4194304] 0 2024-09-16T09:45:37.676 INFO:tasks.workunit.client.1.smithi114.stdout:3/885: write dc/de/d18/fd7 [1064313,20843] 0 2024-09-16T09:45:37.677 INFO:tasks.workunit.client.1.smithi114.stdout:1/844: dwrite d4/d2b/d16/f51 [0,4194304] 0 2024-09-16T09:45:37.679 INFO:tasks.workunit.client.1.smithi114.stdout:0/799: link d1f/d2d/l68 d1f/d2d/d7a/d107/l11b 0 2024-09-16T09:45:37.680 INFO:tasks.workunit.client.1.smithi114.stdout:6/912: unlink d6/d2d/ce4 0 2024-09-16T09:45:37.686 INFO:tasks.workunit.client.1.smithi114.stdout:5/815: mknod d3/d24/d84/db9/c118 0 2024-09-16T09:45:37.692 INFO:tasks.workunit.client.1.smithi114.stdout:4/836: mkdir d0/d13/db0/d121 0 2024-09-16T09:45:37.693 INFO:tasks.workunit.client.1.smithi114.stdout:3/886: creat dc/de/d18/d78/d5c/d5d/d8a/f132 x:0 0 0 2024-09-16T09:45:37.694 INFO:tasks.workunit.client.1.smithi114.stdout:1/845: write d4/d2b/d16/d71/d81/fe3 [2100642,99771] 0 2024-09-16T09:45:37.696 INFO:tasks.workunit.client.1.smithi114.stdout:4/837: rmdir d0/d26/d40/de3 0 2024-09-16T09:45:37.697 INFO:tasks.workunit.client.1.smithi114.stdout:7/885: dwrite d2/fab [0,4194304] 0 2024-09-16T09:45:37.698 INFO:tasks.workunit.client.1.smithi114.stdout:9/850: dwrite d3/f49 [0,4194304] 0 2024-09-16T09:45:37.698 INFO:tasks.workunit.client.1.smithi114.stdout:9/851: fsync d3/da/d10/d23/d43/f18 0 2024-09-16T09:45:37.698 INFO:tasks.workunit.client.1.smithi114.stdout:3/887: mknod dc/de/d1f/c133 0 2024-09-16T09:45:37.698 INFO:tasks.workunit.client.1.smithi114.stdout:3/888: fdatasync dc/de/d17/d2d/d41/d11e/d3d/f6c 0 2024-09-16T09:45:37.698 INFO:tasks.workunit.client.1.smithi114.stdout:8/765: dwrite d4/dae/d9c/fca [0,4194304] 0 2024-09-16T09:45:37.698 INFO:tasks.workunit.client.1.smithi114.stdout:8/766: fsync d4/dae/d54/d104/f77 0 2024-09-16T09:45:37.700 INFO:tasks.workunit.client.1.smithi114.stdout:1/846: symlink d4/d2b/d2f/d3a/d9d/d41/l11c 0 2024-09-16T09:45:37.700 INFO:tasks.workunit.client.1.smithi114.stdout:4/838: symlink d0/d26/d2e/dc0/l122 0 2024-09-16T09:45:37.701 INFO:tasks.workunit.client.1.smithi114.stdout:7/886: symlink d2/d9/d2b/d59/l12d 0 2024-09-16T09:45:37.706 INFO:tasks.workunit.client.1.smithi114.stdout:2/972: dwrite d1/d8/d10/d16/d60/db7/fbb [0,4194304] 0 2024-09-16T09:45:37.706 INFO:tasks.workunit.client.1.smithi114.stdout:2/973: chown d1/d8/d10/d16/d1d/fc7 498 1 2024-09-16T09:45:37.706 INFO:tasks.workunit.client.1.smithi114.stdout:2/974: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/fa0 8620799 0 2024-09-16T09:45:37.706 INFO:tasks.workunit.client.1.smithi114.stdout:2/975: fdatasync d1/d8/d10/d16/d1d/d92/da7/f155 0 2024-09-16T09:45:37.706 INFO:tasks.workunit.client.1.smithi114.stdout:9/852: unlink d3/da/d10/d23/d29/c108 0 2024-09-16T09:45:37.709 INFO:tasks.workunit.client.1.smithi114.stdout:6/913: dread d6/da/d10/f33 [0,4194304] 0 2024-09-16T09:45:37.712 INFO:tasks.workunit.client.1.smithi114.stdout:3/889: link dc/de/d18/d78/d5c/f8f dc/de/d18/d78/d5c/d6e/dc1/f134 0 2024-09-16T09:45:37.713 INFO:tasks.workunit.client.1.smithi114.stdout:1/847: creat d4/d2b/d2f/d112/f11d x:0 0 0 2024-09-16T09:45:37.713 INFO:tasks.workunit.client.1.smithi114.stdout:1/848: chown d4/d2b/f53 25816856 1 2024-09-16T09:45:37.714 INFO:tasks.workunit.client.1.smithi114.stdout:4/839: mkdir d0/d26/d3c/d123 0 2024-09-16T09:45:37.714 INFO:tasks.workunit.client.1.smithi114.stdout:4/840: fsync d0/d26/d40/d75/d7f/d87/fab 0 2024-09-16T09:45:37.715 INFO:tasks.workunit.client.1.smithi114.stdout:7/887: rename d2/d9/db1/dfc to d2/d9/d2b/d2e/d93/d117/d12e 0 2024-09-16T09:45:37.718 INFO:tasks.workunit.client.1.smithi114.stdout:7/888: dread d2/d9/d2b/d2e/d22/d27/d4d/fa4 [0,4194304] 0 2024-09-16T09:45:37.718 INFO:tasks.workunit.client.1.smithi114.stdout:7/889: truncate d2/d9/db1/fe8 685461 0 2024-09-16T09:45:37.718 INFO:tasks.workunit.client.1.smithi114.stdout:7/890: chown d2/d9/d2b/d59/dca/l11f 20 1 2024-09-16T09:45:37.724 INFO:tasks.workunit.client.1.smithi114.stdout:2/976: creat d1/d8/d10/d16/d60/db7/deb/d12b/f165 x:0 0 0 2024-09-16T09:45:37.724 INFO:tasks.workunit.client.1.smithi114.stdout:8/767: dwrite d4/db/d91/fef [0,4194304] 0 2024-09-16T09:45:37.725 INFO:tasks.workunit.client.1.smithi114.stdout:9/853: link d3/da/d10/d23/d43/d82/cdf d3/da/d10/d23/d29/d2c/d6b/d9d/c12b 0 2024-09-16T09:45:37.726 INFO:tasks.workunit.client.1.smithi114.stdout:4/841: dread d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:37.726 INFO:tasks.workunit.client.1.smithi114.stdout:6/914: mknod d6/da/d48/c11e 0 2024-09-16T09:45:37.726 INFO:tasks.workunit.client.1.smithi114.stdout:6/915: chown d6/da/d10/d40/fa0 3814 1 2024-09-16T09:45:37.727 INFO:tasks.workunit.client.1.smithi114.stdout:3/890: mkdir dc/de/d17/d79/dfc/d135 0 2024-09-16T09:45:37.728 INFO:tasks.workunit.client.1.smithi114.stdout:1/849: truncate d4/d2b/d16/d47/f95 581935 0 2024-09-16T09:45:37.731 INFO:tasks.workunit.client.1.smithi114.stdout:7/891: creat d2/d9/d51/d84/dda/f12f x:0 0 0 2024-09-16T09:45:37.732 INFO:tasks.workunit.client.1.smithi114.stdout:2/977: dread d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d68/d90/f137 [0,4194304] 0 2024-09-16T09:45:37.735 INFO:tasks.workunit.client.1.smithi114.stdout:8/768: creat d4/db/d91/f107 x:0 0 0 2024-09-16T09:45:37.735 INFO:tasks.workunit.client.1.smithi114.stdout:4/842: read d0/f11 [7428648,93890] 0 2024-09-16T09:45:37.735 INFO:tasks.workunit.client.1.smithi114.stdout:8/769: write d4/dae/d54/db3/fe8 [880063,67499] 0 2024-09-16T09:45:37.736 INFO:tasks.workunit.client.1.smithi114.stdout:9/854: creat d3/da/d10/d23/d29/d3f/f12c x:0 0 0 2024-09-16T09:45:37.738 INFO:tasks.workunit.client.1.smithi114.stdout:3/891: mknod dc/de/d1f/c136 0 2024-09-16T09:45:37.739 INFO:tasks.workunit.client.1.smithi114.stdout:1/850: truncate d4/d2b/d2f/d3a/dc5/fe9 74921 0 2024-09-16T09:45:37.739 INFO:tasks.workunit.client.1.smithi114.stdout:2/978: truncate d1/d8/d10/d16/d1d/d92/da7/d148/f94 102644 0 2024-09-16T09:45:37.739 INFO:tasks.workunit.client.1.smithi114.stdout:2/979: dread - d1/d8/d10/d16/d1d/d92/da7/d148/f160 zero size 2024-09-16T09:45:37.742 INFO:tasks.workunit.client.1.smithi114.stdout:9/855: rename d3/da/d10/d23/d29/d2c/d70/l127 to d3/da/d10/d23/d29/d2c/d6b/db9/l12d 0 2024-09-16T09:45:37.744 INFO:tasks.workunit.client.1.smithi114.stdout:7/892: dread d2/d9/d2b/d2e/d77/f56 [0,4194304] 0 2024-09-16T09:45:37.745 INFO:tasks.workunit.client.1.smithi114.stdout:9/856: rename d3/c40 to d3/da/d10/d23/d43/d1e/d10b/c12e 0 2024-09-16T09:45:37.750 INFO:tasks.workunit.client.1.smithi114.stdout:7/893: rename d2/df/fce to d2/d9/d2b/d2e/d22/f130 0 2024-09-16T09:45:37.757 INFO:tasks.workunit.client.1.smithi114.stdout:8/770: dread d4/db/d39/d3c/fa7 [0,4194304] 0 2024-09-16T09:45:37.758 INFO:tasks.workunit.client.1.smithi114.stdout:6/916: dwrite d6/d2d/f34 [0,4194304] 0 2024-09-16T09:45:37.758 INFO:tasks.workunit.client.1.smithi114.stdout:6/917: write d6/da/db3/dd1/f114 [405769,98793] 0 2024-09-16T09:45:37.758 INFO:tasks.workunit.client.1.smithi114.stdout:6/918: fdatasync d6/da/f45 0 2024-09-16T09:45:37.759 INFO:tasks.workunit.client.1.smithi114.stdout:8/771: mknod d4/dc3/c108 0 2024-09-16T09:45:37.760 INFO:tasks.workunit.client.1.smithi114.stdout:6/919: creat d6/da/db3/dd1/dec/f11f x:0 0 0 2024-09-16T09:45:37.761 INFO:tasks.workunit.client.1.smithi114.stdout:8/772: truncate d4/db/dd/fba 56846 0 2024-09-16T09:45:37.761 INFO:tasks.workunit.client.1.smithi114.stdout:9/857: dread d3/da/d10/d23/d29/d2c/d6b/db9/fc8 [0,4194304] 0 2024-09-16T09:45:37.762 INFO:tasks.workunit.client.1.smithi114.stdout:6/920: symlink d6/dea/d11a/l120 0 2024-09-16T09:45:37.762 INFO:tasks.workunit.client.1.smithi114.stdout:6/921: fsync d6/d2d/d46/dcc/d62/d11d/fa4 0 2024-09-16T09:45:37.764 INFO:tasks.workunit.client.1.smithi114.stdout:7/894: write d2/d9/d2b/d59/d7f/fa8 [1982772,102216] 0 2024-09-16T09:45:37.764 INFO:tasks.workunit.client.1.smithi114.stdout:9/858: creat d3/da/d10/d23/d29/d2c/d6b/f12f x:0 0 0 2024-09-16T09:45:37.764 INFO:tasks.workunit.client.1.smithi114.stdout:6/922: getdents d6/da/dbb 0 2024-09-16T09:45:37.767 INFO:tasks.workunit.client.1.smithi114.stdout:7/895: creat d2/d9/d2b/d2e/d93/f131 x:0 0 0 2024-09-16T09:45:37.767 INFO:tasks.workunit.client.1.smithi114.stdout:9/859: symlink d3/da/d10/d23/d43/l130 0 2024-09-16T09:45:37.770 INFO:tasks.workunit.client.1.smithi114.stdout:4/843: dwrite d0/d13/fac [0,4194304] 0 2024-09-16T09:45:37.770 INFO:tasks.workunit.client.1.smithi114.stdout:4/844: stat d0/d53/d11a/dc8/fdc 0 2024-09-16T09:45:37.772 INFO:tasks.workunit.client.1.smithi114.stdout:7/896: write d2/d9/d2b/d2e/d22/d27/d4d/f97 [1398888,112868] 0 2024-09-16T09:45:37.772 INFO:tasks.workunit.client.1.smithi114.stdout:7/897: stat d2/d9/f12 0 2024-09-16T09:45:37.773 INFO:tasks.workunit.client.1.smithi114.stdout:9/860: dread d3/da/d10/d23/d43/d1e/d4c/d8c/faf [0,4194304] 0 2024-09-16T09:45:37.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/845: mkdir d0/d26/d3c/d3e/d4b/d46/df3/d124 0 2024-09-16T09:45:37.775 INFO:tasks.workunit.client.1.smithi114.stdout:3/892: dwrite dc/d38/f92 [0,4194304] 0 2024-09-16T09:45:37.775 INFO:tasks.workunit.client.1.smithi114.stdout:3/893: readlink dc/l91 0 2024-09-16T09:45:37.777 INFO:tasks.workunit.client.1.smithi114.stdout:2/980: dwrite d1/d8/d10/d16/d60/db7/f14e [0,4194304] 0 2024-09-16T09:45:37.778 INFO:tasks.workunit.client.1.smithi114.stdout:3/894: write dc/de/d1f/f23 [292267,61861] 0 2024-09-16T09:45:37.779 INFO:tasks.workunit.client.1.smithi114.stdout:8/773: truncate d4/db/dd/fba 156922 0 2024-09-16T09:45:37.782 INFO:tasks.workunit.client.1.smithi114.stdout:2/981: creat d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d63/f166 x:0 0 0 2024-09-16T09:45:37.784 INFO:tasks.workunit.client.1.smithi114.stdout:3/895: mkdir dc/de/d18/dfe/db2/dd8/d137 0 2024-09-16T09:45:37.785 INFO:tasks.workunit.client.1.smithi114.stdout:2/982: symlink d1/d8/d10/d16/d60/db7/deb/l167 0 2024-09-16T09:45:37.787 INFO:tasks.workunit.client.1.smithi114.stdout:2/983: truncate d1/d8/d10/d16/d1d/d92/da7/d148/f6f 2368554 0 2024-09-16T09:45:37.787 INFO:tasks.workunit.client.1.smithi114.stdout:2/984: chown d1/d8/d10/d16/d60/db7/deb/f12e 3833551 1 2024-09-16T09:45:37.789 INFO:tasks.workunit.client.1.smithi114.stdout:2/985: dread d1/d8/f72 [0,4194304] 0 2024-09-16T09:45:37.790 INFO:tasks.workunit.client.1.smithi114.stdout:2/986: creat d1/d8/d10/d16/d60/db7/deb/d136/d142/f168 x:0 0 0 2024-09-16T09:45:37.794 INFO:tasks.workunit.client.1.smithi114.stdout:3/896: read dc/de/d18/dfe/d7f/fbe [1045601,98191] 0 2024-09-16T09:45:37.794 INFO:tasks.workunit.client.1.smithi114.stdout:3/897: fsync dc/de/d18/d78/d5c/d6e/dc1/f134 0 2024-09-16T09:45:37.795 INFO:tasks.workunit.client.1.smithi114.stdout:3/898: mknod dc/d38/d3f/c138 0 2024-09-16T09:45:37.796 INFO:tasks.workunit.client.1.smithi114.stdout:3/899: mknod dc/de/d18/d78/d5c/d5d/c139 0 2024-09-16T09:45:37.800 INFO:tasks.workunit.client.1.smithi114.stdout:6/923: dwrite d6/da/d76/f8a [0,4194304] 0 2024-09-16T09:45:37.800 INFO:tasks.workunit.client.1.smithi114.stdout:6/924: fsync d6/d2d/d46/dcc/d62/d11d/fa9 0 2024-09-16T09:45:37.800 INFO:tasks.workunit.client.1.smithi114.stdout:6/925: write d6/da/d10/f47 [1219063,120159] 0 2024-09-16T09:45:37.801 INFO:tasks.workunit.client.1.smithi114.stdout:3/900: dread dc/de/d1f/f29 [0,4194304] 0 2024-09-16T09:45:37.801 INFO:tasks.workunit.client.1.smithi114.stdout:3/901: readlink dc/l91 0 2024-09-16T09:45:37.801 INFO:tasks.workunit.client.1.smithi114.stdout:6/926: truncate d6/da/d10/f56 89880 0 2024-09-16T09:45:37.803 INFO:tasks.workunit.client.1.smithi114.stdout:7/898: dwrite d2/d9/d2b/d2e/d3e/ffe [0,4194304] 0 2024-09-16T09:45:37.803 INFO:tasks.workunit.client.1.smithi114.stdout:3/902: creat dc/de/d18/d78/d8d/f13a x:0 0 0 2024-09-16T09:45:37.803 INFO:tasks.workunit.client.1.smithi114.stdout:3/903: truncate dc/de/d18/d78/d5c/da5/f11f 754761 0 2024-09-16T09:45:37.805 INFO:tasks.workunit.client.1.smithi114.stdout:6/927: link d6/d2d/d46/dcc/d62/d11d/f4f d6/d2d/d46/f121 0 2024-09-16T09:45:37.805 INFO:tasks.workunit.client.1.smithi114.stdout:6/928: chown d6/da/f67 0 1 2024-09-16T09:45:37.806 INFO:tasks.workunit.client.1.smithi114.stdout:4/846: dwrite d0/f64 [0,4194304] 0 2024-09-16T09:45:37.806 INFO:tasks.workunit.client.1.smithi114.stdout:4/847: stat d0/d26/d29/dbe 0 2024-09-16T09:45:37.807 INFO:tasks.workunit.client.1.smithi114.stdout:7/899: mkdir d2/d9/d2b/d2e/d93/d117/d12e/d132 0 2024-09-16T09:45:37.807 INFO:tasks.workunit.client.1.smithi114.stdout:7/900: dread - d2/d9/d2b/fb3 zero size 2024-09-16T09:45:37.807 INFO:tasks.workunit.client.1.smithi114.stdout:6/929: creat d6/f122 x:0 0 0 2024-09-16T09:45:37.808 INFO:tasks.workunit.client.1.smithi114.stdout:9/861: dwrite d3/d7d/f10c [0,4194304] 0 2024-09-16T09:45:37.808 INFO:tasks.workunit.client.1.smithi114.stdout:8/774: dwrite d4/dae/d54/f102 [0,4194304] 0 2024-09-16T09:45:37.810 INFO:tasks.workunit.client.1.smithi114.stdout:7/901: mknod d2/d9/d2b/d2e/d77/c133 0 2024-09-16T09:45:37.816 INFO:tasks.workunit.client.1.smithi114.stdout:3/904: dread dc/de/d18/d78/f64 [0,4194304] 0 2024-09-16T09:45:37.816 INFO:tasks.workunit.client.1.smithi114.stdout:3/905: chown dc/de/d17/d2d/d41/d11e/d4e/l9b 34653 1 2024-09-16T09:45:37.818 INFO:tasks.workunit.client.1.smithi114.stdout:6/930: dread d6/da/d10/f47 [0,4194304] 0 2024-09-16T09:45:37.821 INFO:tasks.workunit.client.1.smithi114.stdout:9/862: creat d3/da/d10/d23/d29/d2c/d45/d93/d115/f131 x:0 0 0 2024-09-16T09:45:37.821 INFO:tasks.workunit.client.1.smithi114.stdout:9/863: read d3/ff [1819597,105163] 0 2024-09-16T09:45:37.825 INFO:tasks.workunit.client.1.smithi114.stdout:8/775: mkdir d4/db/d3e/d71/d78/d8d/ddb/d109 0 2024-09-16T09:45:37.826 INFO:tasks.workunit.client.1.smithi114.stdout:8/776: chown d4/dc3/c108 7 1 2024-09-16T09:45:37.826 INFO:tasks.workunit.client.1.smithi114.stdout:8/777: chown d4/db/dd/de4/dea/ff5 23612 1 2024-09-16T09:45:37.826 INFO:tasks.workunit.client.1.smithi114.stdout:8/778: chown d4/db/d39/d3c/d86 11 1 2024-09-16T09:45:37.826 INFO:tasks.workunit.client.1.smithi114.stdout:8/779: write d4/db/dd/de4/dea/ff5 [54831,85302] 0 2024-09-16T09:45:37.826 INFO:tasks.workunit.client.1.smithi114.stdout:7/902: dwrite d2/d9/d2b/d59/ff0 [0,4194304] 0 2024-09-16T09:45:37.827 INFO:tasks.workunit.client.1.smithi114.stdout:7/903: write d2/d9/d2b/d78/fb6 [1310476,75924] 0 2024-09-16T09:45:37.827 INFO:tasks.workunit.client.1.smithi114.stdout:9/864: link d3/da/d10/d23/d29/d2c/d6b/f5f d3/da/d10/d23/d43/d1e/d4c/d8c/f132 0 2024-09-16T09:45:37.831 INFO:tasks.workunit.client.1.smithi114.stdout:5/816: sync 2024-09-16T09:45:37.831 INFO:tasks.workunit.client.1.smithi114.stdout:0/800: sync 2024-09-16T09:45:37.831 INFO:tasks.workunit.client.1.smithi114.stdout:1/851: sync 2024-09-16T09:45:37.832 INFO:tasks.workunit.client.1.smithi114.stdout:5/817: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/l119 0 2024-09-16T09:45:37.833 INFO:tasks.workunit.client.1.smithi114.stdout:5/818: stat d3/d24/d7d/da6/cda 0 2024-09-16T09:45:37.833 INFO:tasks.workunit.client.1.smithi114.stdout:0/801: mknod d1f/d22/d2e/d46/d7f/d8d/c11c 0 2024-09-16T09:45:37.834 INFO:tasks.workunit.client.1.smithi114.stdout:1/852: creat d4/d2b/f11e x:0 0 0 2024-09-16T09:45:37.834 INFO:tasks.workunit.client.1.smithi114.stdout:5/819: mkdir d3/d24/d84/d7a/d43/d4c/d92/d11a 0 2024-09-16T09:45:37.835 INFO:tasks.workunit.client.1.smithi114.stdout:5/820: write d3/d24/d84/d7a/d43/d4c/d6d/d79/f8d [1201907,53034] 0 2024-09-16T09:45:37.837 INFO:tasks.workunit.client.1.smithi114.stdout:1/853: mkdir d4/d2b/d29/da0/d11f 0 2024-09-16T09:45:37.837 INFO:tasks.workunit.client.1.smithi114.stdout:3/906: dwrite dc/de/d18/f35 [0,4194304] 0 2024-09-16T09:45:37.837 INFO:tasks.workunit.client.1.smithi114.stdout:5/821: rmdir d3/d1f 39 2024-09-16T09:45:37.838 INFO:tasks.workunit.client.1.smithi114.stdout:3/907: mknod dc/de/d17/d2d/db4/d6a/c13b 0 2024-09-16T09:45:37.839 INFO:tasks.workunit.client.1.smithi114.stdout:3/908: stat dc/de/d18/d117 0 2024-09-16T09:45:37.839 INFO:tasks.workunit.client.1.smithi114.stdout:3/909: dread - dc/de/d17/d2d/d41/d11e/d98/f12b zero size 2024-09-16T09:45:37.840 INFO:tasks.workunit.client.1.smithi114.stdout:3/910: mkdir dc/de/d18/d78/d5c/d5d/d8a/d13c 0 2024-09-16T09:45:37.840 INFO:tasks.workunit.client.1.smithi114.stdout:0/802: dread d1f/d22/d2e/f6a [0,4194304] 0 2024-09-16T09:45:37.845 INFO:tasks.workunit.client.1.smithi114.stdout:9/865: dread d3/da/d10/d23/d29/d3f/d85/fbd [0,4194304] 0 2024-09-16T09:45:37.850 INFO:tasks.workunit.client.1.smithi114.stdout:5/822: dread d3/d24/d84/d7a/d43/d4c/d92/f6f [0,4194304] 0 2024-09-16T09:45:37.854 INFO:tasks.workunit.client.1.smithi114.stdout:1/854: dread d4/d2b/d2f/d3a/d56/f7d [0,4194304] 0 2024-09-16T09:45:37.854 INFO:tasks.workunit.client.1.smithi114.stdout:1/855: truncate d4/d2b/d2f/d3a/f4f 8780021 0 2024-09-16T09:45:37.859 INFO:tasks.workunit.client.1.smithi114.stdout:7/904: dwrite d2/f1c [4194304,4194304] 0 2024-09-16T09:45:37.862 INFO:tasks.workunit.client.1.smithi114.stdout:7/905: creat d2/d9/d2b/d2e/d3e/d79/f134 x:0 0 0 2024-09-16T09:45:37.862 INFO:tasks.workunit.client.1.smithi114.stdout:7/906: chown d2/d9/d2b/d78/d99/ddd 47855111 1 2024-09-16T09:45:37.863 INFO:tasks.workunit.client.1.smithi114.stdout:7/907: rename d2/d9/d2b/d2e/d93/d117/d12e/f123 to d2/d9/d2b/d59/f135 0 2024-09-16T09:45:37.865 INFO:tasks.workunit.client.1.smithi114.stdout:7/908: rename d2/d9/d2b/d59/ff0 to d2/d9/d2b/d2e/d3e/d79/d11a/f136 0 2024-09-16T09:45:37.865 INFO:tasks.workunit.client.1.smithi114.stdout:7/909: truncate d2/d9/db1/fe8 1576331 0 2024-09-16T09:45:37.865 INFO:tasks.workunit.client.1.smithi114.stdout:7/910: mkdir d2/d9/d2b/d2e/d3e/d89/d137 0 2024-09-16T09:45:37.866 INFO:tasks.workunit.client.1.smithi114.stdout:7/911: truncate d2/d9/d2b/d59/d7f/fa8 3847687 0 2024-09-16T09:45:37.866 INFO:tasks.workunit.client.1.smithi114.stdout:7/912: chown d2/d9/d2b/d2e/d22/d27/fdb 972 1 2024-09-16T09:45:37.867 INFO:tasks.workunit.client.1.smithi114.stdout:7/913: creat d2/d9/d2b/d78/d99/ddd/def/f138 x:0 0 0 2024-09-16T09:45:37.869 INFO:tasks.workunit.client.1.smithi114.stdout:7/914: link d2/d9/d2b/d2e/d3e/d79/d102/c11d d2/d9/c139 0 2024-09-16T09:45:37.871 INFO:tasks.workunit.client.1.smithi114.stdout:1/856: dread d4/d2b/d16/f51 [0,4194304] 0 2024-09-16T09:45:37.875 INFO:tasks.workunit.client.1.smithi114.stdout:8/780: dwrite d4/db/d39/d3c/d4e/f92 [0,4194304] 0 2024-09-16T09:45:37.875 INFO:tasks.workunit.client.1.smithi114.stdout:8/781: rename d4/db/d3e/d71/d78 to d4/db/d3e/d71/d78/d8d/da9/d10a 22 2024-09-16T09:45:37.875 INFO:tasks.workunit.client.1.smithi114.stdout:8/782: chown d4/db/d91/fab 4150 1 2024-09-16T09:45:37.876 INFO:tasks.workunit.client.1.smithi114.stdout:3/911: dwrite dc/de/d17/d2d/d41/d9e/fde [4194304,4194304] 0 2024-09-16T09:45:37.876 INFO:tasks.workunit.client.1.smithi114.stdout:6/931: dwrite d6/da/d10/f71 [0,4194304] 0 2024-09-16T09:45:37.876 INFO:tasks.workunit.client.1.smithi114.stdout:6/932: chown d6/da/d10/d40 3 1 2024-09-16T09:45:37.876 INFO:tasks.workunit.client.1.smithi114.stdout:6/933: write d6/da/d48/db0/dfc/f100 [5221340,73278] 0 2024-09-16T09:45:37.876 INFO:tasks.workunit.client.1.smithi114.stdout:6/934: fsync d6/f22 0 2024-09-16T09:45:37.877 INFO:tasks.workunit.client.1.smithi114.stdout:6/935: chown d6/d2d/d46/dcc/d62/d77/f8e 5120443 1 2024-09-16T09:45:37.877 INFO:tasks.workunit.client.1.smithi114.stdout:8/783: creat d4/db/d3e/d71/f10b x:0 0 0 2024-09-16T09:45:37.878 INFO:tasks.workunit.client.1.smithi114.stdout:3/912: creat dc/de/d17/d2d/d41/d11e/d98/f13d x:0 0 0 2024-09-16T09:45:37.882 INFO:tasks.workunit.client.1.smithi114.stdout:6/936: rename d6/da/d48/c11e to d6/d117/c123 0 2024-09-16T09:45:37.883 INFO:tasks.workunit.client.1.smithi114.stdout:8/784: creat d4/db/d39/d3c/d86/f10c x:0 0 0 2024-09-16T09:45:37.883 INFO:tasks.workunit.client.1.smithi114.stdout:8/785: dread - d4/db/d3e/d71/d78/d7a/fc6 zero size 2024-09-16T09:45:37.883 INFO:tasks.workunit.client.1.smithi114.stdout:3/913: creat dc/de/d17/d2d/d41/de4/f13e x:0 0 0 2024-09-16T09:45:37.883 INFO:tasks.workunit.client.1.smithi114.stdout:3/914: write dc/de/d18/d78/d5c/d5d/d50/f11b [370574,88427] 0 2024-09-16T09:45:37.884 INFO:tasks.workunit.client.1.smithi114.stdout:6/937: mkdir d6/d2d/d46/dcc/d62/d77/d124 0 2024-09-16T09:45:37.884 INFO:tasks.workunit.client.1.smithi114.stdout:3/915: creat dc/de/d17/f13f x:0 0 0 2024-09-16T09:45:37.885 INFO:tasks.workunit.client.1.smithi114.stdout:6/938: truncate d6/d2d/d46/dcc/d62/d11d/f3f 174707 0 2024-09-16T09:45:37.886 INFO:tasks.workunit.client.1.smithi114.stdout:9/866: dwrite d3/da/d10/d23/d29/d2c/d6b/d9d/fe1 [0,4194304] 0 2024-09-16T09:45:37.887 INFO:tasks.workunit.client.1.smithi114.stdout:5/823: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fa9 [0,4194304] 0 2024-09-16T09:45:37.889 INFO:tasks.workunit.client.1.smithi114.stdout:9/867: mkdir d3/daa/def/d133 0 2024-09-16T09:45:37.895 INFO:tasks.workunit.client.1.smithi114.stdout:9/868: symlink d3/da/d10/d23/d43/d1e/d78/db2/l134 0 2024-09-16T09:45:37.895 INFO:tasks.workunit.client.1.smithi114.stdout:9/869: write d3/da/d10/d23/d43/d82/f3e [209816,306] 0 2024-09-16T09:45:37.895 INFO:tasks.workunit.client.1.smithi114.stdout:9/870: chown d3/da/d10/d23/d43/lb4 1454473221 1 2024-09-16T09:45:37.898 INFO:tasks.workunit.client.1.smithi114.stdout:3/916: write dc/de/d17/f74 [986025,39882] 0 2024-09-16T09:45:37.898 INFO:tasks.workunit.client.1.smithi114.stdout:3/917: read - dc/de/d18/d78/d8d/f13a zero size 2024-09-16T09:45:37.898 INFO:tasks.workunit.client.1.smithi114.stdout:7/915: dwrite d2/d55/f116 [0,4194304] 0 2024-09-16T09:45:37.898 INFO:tasks.workunit.client.1.smithi114.stdout:6/939: write d6/fc [2193854,97174] 0 2024-09-16T09:45:37.899 INFO:tasks.workunit.client.1.smithi114.stdout:5/824: read d3/d24/d7d/f99 [145902,45211] 0 2024-09-16T09:45:37.901 INFO:tasks.workunit.client.1.smithi114.stdout:3/918: creat dc/de/d17/d2d/d41/d11e/da7/f140 x:0 0 0 2024-09-16T09:45:37.903 INFO:tasks.workunit.client.1.smithi114.stdout:7/916: unlink d2/d9/d2b/d2e/d22/d27/d4d/fa4 0 2024-09-16T09:45:37.904 INFO:tasks.workunit.client.1.smithi114.stdout:6/940: creat d6/d64/df6/f125 x:0 0 0 2024-09-16T09:45:37.904 INFO:tasks.workunit.client.1.smithi114.stdout:6/941: fsync d6/d2d/f3a 0 2024-09-16T09:45:37.905 INFO:tasks.workunit.client.1.smithi114.stdout:5/825: dread d3/d24/d84/dbc/fd4 [0,4194304] 0 2024-09-16T09:45:37.905 INFO:tasks.workunit.client.1.smithi114.stdout:7/917: dread d2/d9/d2b/d78/d99/ddd/fe4 [0,4194304] 0 2024-09-16T09:45:37.905 INFO:tasks.workunit.client.1.smithi114.stdout:5/826: write d3/d1f/fdb [649938,114260] 0 2024-09-16T09:45:37.905 INFO:tasks.workunit.client.1.smithi114.stdout:8/786: dwrite d4/db/dd/f13 [0,4194304] 0 2024-09-16T09:45:37.905 INFO:tasks.workunit.client.1.smithi114.stdout:6/942: rename d6/da/f3e to d6/da/d10/d92/f126 0 2024-09-16T09:45:37.908 INFO:tasks.workunit.client.1.smithi114.stdout:7/918: unlink d2/d9/d2b/d2e/f122 0 2024-09-16T09:45:37.908 INFO:tasks.workunit.client.1.smithi114.stdout:7/919: dread - d2/d9/d2b/d2e/d3e/d79/f118 zero size 2024-09-16T09:45:37.909 INFO:tasks.workunit.client.1.smithi114.stdout:5/827: symlink d3/d24/d84/d7a/d43/d4c/d92/l11b 0 2024-09-16T09:45:37.909 INFO:tasks.workunit.client.1.smithi114.stdout:5/828: chown d3/d24/d84/d7a/d43/d4c/d6d/c70 2 1 2024-09-16T09:45:37.909 INFO:tasks.workunit.client.1.smithi114.stdout:5/829: write d3/d24/d84/d7a/f88 [1703278,121188] 0 2024-09-16T09:45:37.913 INFO:tasks.workunit.client.1.smithi114.stdout:6/943: rename d6/c66 to d6/da/d76/c127 0 2024-09-16T09:45:37.914 INFO:tasks.workunit.client.1.smithi114.stdout:6/944: dread d6/d64/fed [0,4194304] 0 2024-09-16T09:45:37.914 INFO:tasks.workunit.client.1.smithi114.stdout:6/945: read d6/da/f1e [594300,125785] 0 2024-09-16T09:45:37.914 INFO:tasks.workunit.client.1.smithi114.stdout:5/830: unlink d3/d1f/f27 0 2024-09-16T09:45:37.915 INFO:tasks.workunit.client.1.smithi114.stdout:3/919: dread dc/d38/f66 [0,4194304] 0 2024-09-16T09:45:37.920 INFO:tasks.workunit.client.1.smithi114.stdout:6/946: rename d6/d2d/d46/dcc/d62/d11d/fa9 to d6/da/d48/f128 0 2024-09-16T09:45:37.921 INFO:tasks.workunit.client.1.smithi114.stdout:6/947: fdatasync d6/f23 0 2024-09-16T09:45:37.921 INFO:tasks.workunit.client.1.smithi114.stdout:8/787: dread d4/dae/f70 [0,4194304] 0 2024-09-16T09:45:37.921 INFO:tasks.workunit.client.1.smithi114.stdout:5/831: mknod d3/d24/d84/d7a/d43/d4c/db2/db7/c11c 0 2024-09-16T09:45:37.921 INFO:tasks.workunit.client.1.smithi114.stdout:3/920: mknod dc/de/d18/d78/c141 0 2024-09-16T09:45:37.921 INFO:tasks.workunit.client.1.smithi114.stdout:7/920: read d2/d9/d2b/d2e/d22/fb2 [1320466,19507] 0 2024-09-16T09:45:37.922 INFO:tasks.workunit.client.1.smithi114.stdout:5/832: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d10b/f11d x:0 0 0 2024-09-16T09:45:37.922 INFO:tasks.workunit.client.1.smithi114.stdout:5/833: write d3/d24/d84/db9/f115 [888979,27988] 0 2024-09-16T09:45:37.922 INFO:tasks.workunit.client.1.smithi114.stdout:5/834: fdatasync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6/fea 0 2024-09-16T09:45:37.923 INFO:tasks.workunit.client.1.smithi114.stdout:5/835: write d3/d24/d84/d7a/d43/d4c/db2/db7/fd2 [928184,117406] 0 2024-09-16T09:45:37.923 INFO:tasks.workunit.client.1.smithi114.stdout:3/921: dread dc/de/d18/d78/d5c/d5d/d50/f11b [0,4194304] 0 2024-09-16T09:45:37.926 INFO:tasks.workunit.client.1.smithi114.stdout:5/836: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/f11e x:0 0 0 2024-09-16T09:45:37.926 INFO:tasks.workunit.client.1.smithi114.stdout:7/921: dread d2/d9/d2b/d78/fb6 [0,4194304] 0 2024-09-16T09:45:37.926 INFO:tasks.workunit.client.1.smithi114.stdout:7/922: dread - d2/d9/d51/d84/dda/f12f zero size 2024-09-16T09:45:37.926 INFO:tasks.workunit.client.1.smithi114.stdout:3/922: getdents dc/de/d17/d2d/db4 0 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:5/837: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/l11f 0 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:5/838: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/l6a 0 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:5/839: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a 7199 1 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:2/987: sync 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:2/988: chown d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d8f/lc1 78864587 1 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:2/989: fdatasync d1/f2c 0 2024-09-16T09:45:37.929 INFO:tasks.workunit.client.1.smithi114.stdout:8/788: dread d4/dae/d54/d104/f51 [0,4194304] 0 2024-09-16T09:45:37.930 INFO:tasks.workunit.client.1.smithi114.stdout:3/923: rename dc/de/d18/d78/d5c/cf4 to dc/de/d17/d2d/d41/de4/c142 0 2024-09-16T09:45:37.931 INFO:tasks.workunit.client.1.smithi114.stdout:2/990: symlink d1/d8/d10/d16/d60/db7/deb/d136/l169 0 2024-09-16T09:45:37.932 INFO:tasks.workunit.client.1.smithi114.stdout:8/789: chown d4/db/d39/d3c/dec/ff4 27 1 2024-09-16T09:45:37.934 INFO:tasks.workunit.client.1.smithi114.stdout:5/840: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d108/de8/ff3 to d3/d24/d84/d7a/d43/d4c/d92/f120 0 2024-09-16T09:45:37.935 INFO:tasks.workunit.client.1.smithi114.stdout:3/924: symlink dc/de/d18/dfe/db2/dd8/d11d/l143 0 2024-09-16T09:45:37.936 INFO:tasks.workunit.client.1.smithi114.stdout:2/991: mknod d1/d8/d10/d16/d60/db7/deb/d117/d162/c16a 0 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:2/992: write d1/d8/d10/d16/dd9/f121 [627638,103942] 0 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:7/923: read d2/f5 [2831082,80324] 0 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:3/925: mknod dc/de/d17/c144 0 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:3/926: chown dc/de/d17/d2d/d41/d11e/da7 24307 1 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:7/924: stat d2/d9/d2b/d2e/d22/fb2 0 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:3/927: chown dc/d38/l39 2 1 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:7/925: fdatasync d2/d9/f19 0 2024-09-16T09:45:37.937 INFO:tasks.workunit.client.1.smithi114.stdout:3/928: dread - dc/de/d18/d78/d5c/d5d/fcb zero size 2024-09-16T09:45:37.938 INFO:tasks.workunit.client.1.smithi114.stdout:7/926: write d2/d9/d2b/d78/d99/f9b [4791703,223] 0 2024-09-16T09:45:37.938 INFO:tasks.workunit.client.1.smithi114.stdout:7/927: fsync d2/d55/f116 0 2024-09-16T09:45:37.938 INFO:tasks.workunit.client.1.smithi114.stdout:2/993: creat d1/d9e/f16b x:0 0 0 2024-09-16T09:45:37.938 INFO:tasks.workunit.client.1.smithi114.stdout:3/929: rmdir dc/de/d18/d78/d5c/d6e/dc1 39 2024-09-16T09:45:37.940 INFO:tasks.workunit.client.1.smithi114.stdout:7/928: creat d2/d9/d2b/d78/d9f/d10d/f13a x:0 0 0 2024-09-16T09:45:37.941 INFO:tasks.workunit.client.1.smithi114.stdout:2/994: unlink d1/d8/d10/f49 0 2024-09-16T09:45:37.948 INFO:tasks.workunit.client.1.smithi114.stdout:5/841: dread d3/d24/d84/d7a/d43/d4c/f10d [0,4194304] 0 2024-09-16T09:45:37.948 INFO:tasks.workunit.client.1.smithi114.stdout:4/848: sync 2024-09-16T09:45:37.949 INFO:tasks.workunit.client.1.smithi114.stdout:8/790: dwrite d4/db/f22 [4194304,4194304] 0 2024-09-16T09:45:37.950 INFO:tasks.workunit.client.1.smithi114.stdout:5/842: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f121 x:0 0 0 2024-09-16T09:45:37.950 INFO:tasks.workunit.client.1.smithi114.stdout:5/843: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f117 [551029,81402] 0 2024-09-16T09:45:37.950 INFO:tasks.workunit.client.1.smithi114.stdout:5/844: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/fbe [2496005,4830] 0 2024-09-16T09:45:37.951 INFO:tasks.workunit.client.1.smithi114.stdout:5/845: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/l82 0 2024-09-16T09:45:37.951 INFO:tasks.workunit.client.1.smithi114.stdout:5/846: write d3/f5 [4984237,2563] 0 2024-09-16T09:45:37.951 INFO:tasks.workunit.client.1.smithi114.stdout:5/847: chown d3/d24/d7d/d96 9761 1 2024-09-16T09:45:37.951 INFO:tasks.workunit.client.1.smithi114.stdout:4/849: creat d0/d53/d11a/dc8/f125 x:0 0 0 2024-09-16T09:45:37.951 INFO:tasks.workunit.client.1.smithi114.stdout:3/930: write dc/de/d18/dfe/db2/dd8/f110 [1048801,18333] 0 2024-09-16T09:45:37.954 INFO:tasks.workunit.client.1.smithi114.stdout:8/791: dread d4/f40 [0,4194304] 0 2024-09-16T09:45:37.955 INFO:tasks.workunit.client.1.smithi114.stdout:5/848: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a 0 2024-09-16T09:45:37.957 INFO:tasks.workunit.client.1.smithi114.stdout:4/850: link d0/d26/d3c/d3e/d5a/d5d/c10c d0/d26/d40/da6/d106/c126 0 2024-09-16T09:45:37.960 INFO:tasks.workunit.client.1.smithi114.stdout:2/995: dwrite d1/d8/d10/d16/d60/db7/f113 [0,4194304] 0 2024-09-16T09:45:37.961 INFO:tasks.workunit.client.1.smithi114.stdout:3/931: truncate dc/de/d18/f35 1181196 0 2024-09-16T09:45:37.961 INFO:tasks.workunit.client.1.smithi114.stdout:3/932: dread - dc/de/d18/d78/d5c/d5d/d8a/f132 zero size 2024-09-16T09:45:37.963 INFO:tasks.workunit.client.1.smithi114.stdout:8/792: rename d4/db/d3e/d71/c96 to d4/db/d3e/d71/d78/df0/c10d 0 2024-09-16T09:45:37.963 INFO:tasks.workunit.client.1.smithi114.stdout:7/929: fsync d2/d9/d2b/d78/d9f/d10d/f13a 0 2024-09-16T09:45:37.963 INFO:tasks.workunit.client.1.smithi114.stdout:7/930: chown d2/d9/d2b/d2e/d22 8304241 1 2024-09-16T09:45:37.963 INFO:tasks.workunit.client.1.smithi114.stdout:8/793: write d4/db/d3e/d71/d78/d8d/fc2 [404680,75656] 0 2024-09-16T09:45:37.963 INFO:tasks.workunit.client.1.smithi114.stdout:8/794: truncate d4/db/d91/fef 4207955 0 2024-09-16T09:45:37.964 INFO:tasks.workunit.client.1.smithi114.stdout:5/849: truncate d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 1331960 0 2024-09-16T09:45:37.966 INFO:tasks.workunit.client.1.smithi114.stdout:4/851: link d0/d26/d3c/d3e/d4b/fe4 d0/d13/f127 0 2024-09-16T09:45:37.966 INFO:tasks.workunit.client.1.smithi114.stdout:4/852: chown d0/d26/d3c/d3e/d4b 0 1 2024-09-16T09:45:37.967 INFO:tasks.workunit.client.1.smithi114.stdout:4/853: dread - d0/d26/d2e/f7d zero size 2024-09-16T09:45:37.967 INFO:tasks.workunit.client.1.smithi114.stdout:8/795: mkdir d4/db/d39/d3c/d10e 0 2024-09-16T09:45:37.967 INFO:tasks.workunit.client.1.smithi114.stdout:8/796: write d4/d1f/db9/fe7 [1005470,75677] 0 2024-09-16T09:45:37.968 INFO:tasks.workunit.client.1.smithi114.stdout:4/854: rmdir d0/d13/db0 39 2024-09-16T09:45:37.970 INFO:tasks.workunit.client.1.smithi114.stdout:4/855: unlink d0/d26/d3c/d3e/d4b/fe4 0 2024-09-16T09:45:37.972 INFO:tasks.workunit.client.1.smithi114.stdout:3/933: write dc/de/d18/dfe/d7f/fc0 [3313463,63808] 0 2024-09-16T09:45:37.975 INFO:tasks.workunit.client.1.smithi114.stdout:3/934: getdents dc/de/d17/d2d/db4/d26 0 2024-09-16T09:45:37.978 INFO:tasks.workunit.client.1.smithi114.stdout:3/935: creat dc/de/d17/d2d/d41/d11e/da7/f145 x:0 0 0 2024-09-16T09:45:37.982 INFO:tasks.workunit.client.1.smithi114.stdout:3/936: dread dc/de/d18/d78/d5c/d6e/dc1/fc5 [0,4194304] 0 2024-09-16T09:45:37.983 INFO:tasks.workunit.client.1.smithi114.stdout:3/937: chown dc/de/d18/d78/d5c/d6e/dc1/fed 892131 1 2024-09-16T09:45:37.983 INFO:tasks.workunit.client.1.smithi114.stdout:2/996: dwrite d1/d8/d10/d16/d1d/d92/da7/d148/f160 [0,4194304] 0 2024-09-16T09:45:37.983 INFO:tasks.workunit.client.1.smithi114.stdout:8/797: write d4/dae/f7b [2021115,62004] 0 2024-09-16T09:45:37.985 INFO:tasks.workunit.client.1.smithi114.stdout:3/938: dread dc/de/d18/d78/d5c/d6e/fb3 [0,4194304] 0 2024-09-16T09:45:37.985 INFO:tasks.workunit.client.1.smithi114.stdout:3/939: readlink dc/de/d17/d2d/d41/l5a 0 2024-09-16T09:45:37.985 INFO:tasks.workunit.client.1.smithi114.stdout:3/940: dread - dc/de/d18/d78/d5c/d6e/ffd zero size 2024-09-16T09:45:37.987 INFO:tasks.workunit.client.1.smithi114.stdout:2/997: mkdir d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d5e/d16c 0 2024-09-16T09:45:37.987 INFO:tasks.workunit.client.1.smithi114.stdout:2/998: truncate d1/d8/d10/d16/d1d/d92/da7/d3e/d5b/d78/d120/d138/f143 1865028 0 2024-09-16T09:45:37.989 INFO:tasks.workunit.client.1.smithi114.stdout:2/999: creat d1/d8/d10/d16/d1d/d92/da7/d3e/f16d x:0 0 0 2024-09-16T09:45:37.991 INFO:tasks.workunit.client.1.smithi114.stdout:5/850: dwrite d3/d24/d84/dbc/fe6 [0,4194304] 0 2024-09-16T09:45:38.005 INFO:tasks.workunit.client.1.smithi114.stdout:7/931: dwrite d2/d9/f23 [0,4194304] 0 2024-09-16T09:45:38.006 INFO:tasks.workunit.client.1.smithi114.stdout:5/851: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/ff0 [0,4194304] 0 2024-09-16T09:45:38.006 INFO:tasks.workunit.client.1.smithi114.stdout:5/852: chown d3/d24 13098546 1 2024-09-16T09:45:38.008 INFO:tasks.workunit.client.1.smithi114.stdout:7/932: stat d2/d9/d2b/d2e/l8d 0 2024-09-16T09:45:38.008 INFO:tasks.workunit.client.1.smithi114.stdout:7/933: fsync d2/d9/d2b/d2e/fe2 0 2024-09-16T09:45:38.008 INFO:tasks.workunit.client.1.smithi114.stdout:5/853: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/f3d [0,4194304] 0 2024-09-16T09:45:38.009 INFO:tasks.workunit.client.1.smithi114.stdout:7/934: write d2/d9/d2b/d2e/d22/d66/db0/fcf [17853,20759] 0 2024-09-16T09:45:38.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/854: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab 0 2024-09-16T09:45:38.009 INFO:tasks.workunit.client.1.smithi114.stdout:7/935: chown d2/d9/d2b/d2e/d22/d27/d64/l10a 11535 1 2024-09-16T09:45:38.009 INFO:tasks.workunit.client.1.smithi114.stdout:5/855: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6 0 2024-09-16T09:45:38.010 INFO:tasks.workunit.client.1.smithi114.stdout:7/936: symlink d2/d9/d51/d84/dda/l13b 0 2024-09-16T09:45:38.010 INFO:tasks.workunit.client.1.smithi114.stdout:7/937: unlink d2/d9/d2b/d2e/d22/fb2 0 2024-09-16T09:45:38.019 INFO:tasks.workunit.client.1.smithi114.stdout:7/938: dread d2/f2c [0,4194304] 0 2024-09-16T09:45:38.019 INFO:tasks.workunit.client.1.smithi114.stdout:7/939: read - d2/d9/d51/d84/dda/fec zero size 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:7/940: mknod d2/d9/d2b/d59/d7f/c13c 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:7/941: write d2/d9/d51/f111 [516205,15248] 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:7/942: write d2/d9/d2b/d2e/d3e/d79/f118 [508384,28071] 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:7/943: truncate d2/d9/d2b/d2e/d22/d27/d4d/fe9 253964 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:7/944: readlink d2/d9/d2b/d2e/d3e/d89/l92 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:7/945: write d2/d9/f23 [4725126,90659] 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:4/856: dwrite d0/d13/f127 [0,4194304] 0 2024-09-16T09:45:38.021 INFO:tasks.workunit.client.1.smithi114.stdout:3/941: dwrite dc/de/d17/d2d/d41/d11e/fd9 [0,4194304] 0 2024-09-16T09:45:38.022 INFO:tasks.workunit.client.1.smithi114.stdout:7/946: write d2/d9/d2b/d2e/d77/ff2 [98096,97803] 0 2024-09-16T09:45:38.022 INFO:tasks.workunit.client.1.smithi114.stdout:7/947: chown d2/d9/d2b/d2e/d3e/d89 470765 1 2024-09-16T09:45:38.022 INFO:tasks.workunit.client.1.smithi114.stdout:5/856: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fe1 [0,4194304] 0 2024-09-16T09:45:38.023 INFO:tasks.workunit.client.1.smithi114.stdout:8/798: dwrite d4/db/d39/d3c/d86/fd6 [0,4194304] 0 2024-09-16T09:45:38.030 INFO:tasks.workunit.client.1.smithi114.stdout:4/857: dread d0/d26/d3c/ffb [0,4194304] 0 2024-09-16T09:45:38.030 INFO:tasks.workunit.client.1.smithi114.stdout:7/948: symlink d2/d9/d2b/d78/d9f/d10d/l13d 0 2024-09-16T09:45:38.031 INFO:tasks.workunit.client.1.smithi114.stdout:7/949: write d2/df/df9/dbd/fee [174015,62542] 0 2024-09-16T09:45:38.031 INFO:tasks.workunit.client.1.smithi114.stdout:7/950: stat d2/d9/d51/lb8 0 2024-09-16T09:45:38.032 INFO:tasks.workunit.client.1.smithi114.stdout:5/857: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/d98 0 2024-09-16T09:45:38.032 INFO:tasks.workunit.client.1.smithi114.stdout:5/858: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/c90 23520555 1 2024-09-16T09:45:38.032 INFO:tasks.workunit.client.1.smithi114.stdout:5/859: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d108/ldd 0 2024-09-16T09:45:38.033 INFO:tasks.workunit.client.1.smithi114.stdout:1/857: sync 2024-09-16T09:45:38.033 INFO:tasks.workunit.client.1.smithi114.stdout:0/803: sync 2024-09-16T09:45:38.035 INFO:tasks.workunit.client.1.smithi114.stdout:3/942: dwrite dc/de/d18/d78/d5c/d5d/d50/dea/f106 [0,4194304] 0 2024-09-16T09:45:38.035 INFO:tasks.workunit.client.1.smithi114.stdout:8/799: creat d4/db/d3e/d47/d101/f10f x:0 0 0 2024-09-16T09:45:38.037 INFO:tasks.workunit.client.1.smithi114.stdout:4/858: link d0/d26/d3c/d74/d9c/fad d0/d26/d3c/d74/d9c/f128 0 2024-09-16T09:45:38.040 INFO:tasks.workunit.client.1.smithi114.stdout:1/858: rename d4/d2b/d16/d47/da7/la1 to d4/d2b/d2f/d3a/d9d/d41/d42/l120 0 2024-09-16T09:45:38.042 INFO:tasks.workunit.client.1.smithi114.stdout:9/871: sync 2024-09-16T09:45:38.042 INFO:tasks.workunit.client.1.smithi114.stdout:6/948: sync 2024-09-16T09:45:38.042 INFO:tasks.workunit.client.1.smithi114.stdout:8/800: truncate d4/db/d91/fab 3439379 0 2024-09-16T09:45:38.045 INFO:tasks.workunit.client.1.smithi114.stdout:5/860: symlink d3/d24/d84/d7a/d43/d4c/d6d/d9e/l122 0 2024-09-16T09:45:38.046 INFO:tasks.workunit.client.1.smithi114.stdout:1/859: rename d4/cf to d4/d2b/d16/d71/de5/df1/c121 0 2024-09-16T09:45:38.047 INFO:tasks.workunit.client.1.smithi114.stdout:6/949: mkdir d6/dea/d11a/d129 0 2024-09-16T09:45:38.049 INFO:tasks.workunit.client.1.smithi114.stdout:0/804: dread d1f/d2d/f2f [4194304,4194304] 0 2024-09-16T09:45:38.049 INFO:tasks.workunit.client.1.smithi114.stdout:5/861: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1/f123 x:0 0 0 2024-09-16T09:45:38.051 INFO:tasks.workunit.client.1.smithi114.stdout:1/860: getdents d4/d2b/d29 0 2024-09-16T09:45:38.052 INFO:tasks.workunit.client.1.smithi114.stdout:7/951: dwrite d2/d9/d2b/d2e/d22/f130 [0,4194304] 0 2024-09-16T09:45:38.053 INFO:tasks.workunit.client.1.smithi114.stdout:7/952: dread - d2/d9/d51/d84/dda/f107 zero size 2024-09-16T09:45:38.054 INFO:tasks.workunit.client.1.smithi114.stdout:6/950: creat d6/d2d/d46/dcc/d10f/f12a x:0 0 0 2024-09-16T09:45:38.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/805: mkdir d1f/d27/de6/d11d 0 2024-09-16T09:45:38.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/806: chown d1f/d27/d47/d56/lab 15 1 2024-09-16T09:45:38.055 INFO:tasks.workunit.client.1.smithi114.stdout:1/861: dread d4/d2b/d29/da0/db1/fbc [0,4194304] 0 2024-09-16T09:45:38.056 INFO:tasks.workunit.client.1.smithi114.stdout:5/862: rename d3/d24/d84/d7a/d43/d4c/f54 to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6/f124 0 2024-09-16T09:45:38.057 INFO:tasks.workunit.client.1.smithi114.stdout:7/953: unlink d2/d9/d2b/d2e/d93/cc4 0 2024-09-16T09:45:38.058 INFO:tasks.workunit.client.1.smithi114.stdout:6/951: creat d6/d64/df6/f12b x:0 0 0 2024-09-16T09:45:38.058 INFO:tasks.workunit.client.1.smithi114.stdout:0/807: link d1f/f84 d1f/d27/f11e 0 2024-09-16T09:45:38.059 INFO:tasks.workunit.client.1.smithi114.stdout:1/862: creat d4/d2b/d2f/d3a/d9d/d41/d42/f122 x:0 0 0 2024-09-16T09:45:38.061 INFO:tasks.workunit.client.1.smithi114.stdout:5/863: unlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/ccc 0 2024-09-16T09:45:38.061 INFO:tasks.workunit.client.1.smithi114.stdout:5/864: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f9c 1298869031 1 2024-09-16T09:45:38.062 INFO:tasks.workunit.client.1.smithi114.stdout:0/808: truncate d1f/d22/d2e/d46/d7f/daf/fd2 3941292 0 2024-09-16T09:45:38.064 INFO:tasks.workunit.client.1.smithi114.stdout:1/863: mknod d4/d2b/d16/d71/d81/ddc/c123 0 2024-09-16T09:45:38.064 INFO:tasks.workunit.client.1.smithi114.stdout:1/864: chown d4/d2b/d2f/d3a/d9d/d41 477 1 2024-09-16T09:45:38.065 INFO:tasks.workunit.client.1.smithi114.stdout:1/865: mknod d4/d2b/d16/d71/d72/deb/c124 0 2024-09-16T09:45:38.068 INFO:tasks.workunit.client.1.smithi114.stdout:1/866: unlink d4/d2b/d16/d47/da7/cbf 0 2024-09-16T09:45:38.068 INFO:tasks.workunit.client.1.smithi114.stdout:5/865: dread d3/d1f/d8c/fd3 [0,4194304] 0 2024-09-16T09:45:38.069 INFO:tasks.workunit.client.1.smithi114.stdout:1/867: mkdir d4/d2b/d16/d71/d125 0 2024-09-16T09:45:38.070 INFO:tasks.workunit.client.1.smithi114.stdout:5/866: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/l125 0 2024-09-16T09:45:38.071 INFO:tasks.workunit.client.1.smithi114.stdout:1/868: symlink d4/d2b/d2f/d3a/d9d/d41/d42/d58/l126 0 2024-09-16T09:45:38.072 INFO:tasks.workunit.client.1.smithi114.stdout:5/867: symlink d3/d24/d84/d7a/d43/d4c/l126 0 2024-09-16T09:45:38.073 INFO:tasks.workunit.client.1.smithi114.stdout:1/869: mknod d4/d2b/d16/d71/de5/df1/c127 0 2024-09-16T09:45:38.075 INFO:tasks.workunit.client.1.smithi114.stdout:5/868: link d3/d24/d84/dbc/fe6 d3/d1f/f127 0 2024-09-16T09:45:38.075 INFO:tasks.workunit.client.1.smithi114.stdout:5/869: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f81 660857431 1 2024-09-16T09:45:38.076 INFO:tasks.workunit.client.1.smithi114.stdout:5/870: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/c128 0 2024-09-16T09:45:38.077 INFO:tasks.workunit.client.1.smithi114.stdout:5/871: rmdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f 39 2024-09-16T09:45:38.079 INFO:tasks.workunit.client.1.smithi114.stdout:1/870: dread d4/d2b/f53 [0,4194304] 0 2024-09-16T09:45:38.081 INFO:tasks.workunit.client.1.smithi114.stdout:1/871: link d4/d2b/d16/d47/c82 d4/d2b/d16/d71/d81/ddc/c128 0 2024-09-16T09:45:38.081 INFO:tasks.workunit.client.1.smithi114.stdout:1/872: getdents d4/d2b/d2f/d3a/db0/d117/d11b 0 2024-09-16T09:45:38.081 INFO:tasks.workunit.client.1.smithi114.stdout:1/873: mkdir d4/d2b/d16/d71/d81/d129 0 2024-09-16T09:45:38.083 INFO:tasks.workunit.client.1.smithi114.stdout:1/874: link d4/d2b/d16/d47/fb2 d4/d2b/d16/d47/da7/dd7/f12a 0 2024-09-16T09:45:38.084 INFO:tasks.workunit.client.1.smithi114.stdout:1/875: creat d4/d2b/d29/da0/f12b x:0 0 0 2024-09-16T09:45:38.085 INFO:tasks.workunit.client.1.smithi114.stdout:1/876: fsync d4/d2b/d2f/d3a/dc5/fe1 0 2024-09-16T09:45:38.085 INFO:tasks.workunit.client.1.smithi114.stdout:3/943: dwrite dc/de/d18/d78/d5c/da5/f115 [0,4194304] 0 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:3/944: write dc/de/d17/d2d/db4/f1e [4413060,61260] 0 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:1/877: rmdir d4/d2b/d2f/d112 39 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:3/945: fsync dc/de/d18/d78/d8d/fff 0 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:1/878: chown d4/d2b/d16/f19 643 1 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:3/946: write dc/de/d17/d2d/d41/de4/f13e [771580,113645] 0 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:3/947: stat dc/de/d17/d2d/db4/d26 0 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:4/859: dwrite d0/d13/d25/ff0 [0,4194304] 0 2024-09-16T09:45:38.086 INFO:tasks.workunit.client.1.smithi114.stdout:9/872: dwrite d3/da/d10/f1b [0,4194304] 0 2024-09-16T09:45:38.087 INFO:tasks.workunit.client.1.smithi114.stdout:6/952: dwrite d6/da/d10/d40/f43 [0,4194304] 0 2024-09-16T09:45:38.087 INFO:tasks.workunit.client.1.smithi114.stdout:6/953: chown d6/fdb 90005 1 2024-09-16T09:45:38.087 INFO:tasks.workunit.client.1.smithi114.stdout:1/879: rename d4/d2b/d2f/d3a/d9d/d41/d42/d58/f6d to d4/d2b/d16/d71/d72/d75/f12c 0 2024-09-16T09:45:38.089 INFO:tasks.workunit.client.1.smithi114.stdout:0/809: dwrite d1f/d22/d2e/d46/d7f/daf/f106 [0,4194304] 0 2024-09-16T09:45:38.091 INFO:tasks.workunit.client.1.smithi114.stdout:4/860: mkdir d0/d26/d3c/d129 0 2024-09-16T09:45:38.092 INFO:tasks.workunit.client.1.smithi114.stdout:5/872: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a/f60 [0,4194304] 0 2024-09-16T09:45:38.097 INFO:tasks.workunit.client.1.smithi114.stdout:6/954: creat d6/da/d76/f12c x:0 0 0 2024-09-16T09:45:38.097 INFO:tasks.workunit.client.1.smithi114.stdout:6/955: chown d6/da/d48/db0/ff4 357 1 2024-09-16T09:45:38.097 INFO:tasks.workunit.client.1.smithi114.stdout:6/956: write d6/da/d76/f12c [766025,107737] 0 2024-09-16T09:45:38.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/948: rename dc/de/d17/d2d/d41/d11e/d98/fdc to dc/de/d18/d78/d5c/f146 0 2024-09-16T09:45:38.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/949: dread - dc/de/d18/d78/d8d/f12f zero size 2024-09-16T09:45:38.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/950: chown dc/de/d17/d2d/d41/d11e/d3d/fbb 0 1 2024-09-16T09:45:38.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/951: chown dc/de/d18/d78/d5c/d6e/dc1/fed 129348 1 2024-09-16T09:45:38.099 INFO:tasks.workunit.client.1.smithi114.stdout:3/952: dread - dc/de/d17/d2d/d41/d11e/d98/f13d zero size 2024-09-16T09:45:38.100 INFO:tasks.workunit.client.1.smithi114.stdout:1/880: mknod d4/d2b/d2f/d3a/d9d/c12d 0 2024-09-16T09:45:38.102 INFO:tasks.workunit.client.1.smithi114.stdout:9/873: dwrite d3/da/d10/d23/d43/d1e/da0/fda [4194304,4194304] 0 2024-09-16T09:45:38.104 INFO:tasks.workunit.client.1.smithi114.stdout:0/810: creat d1f/d20/d48/f11f x:0 0 0 2024-09-16T09:45:38.105 INFO:tasks.workunit.client.1.smithi114.stdout:4/861: getdents d0/d26/d29/d2b 0 2024-09-16T09:45:38.106 INFO:tasks.workunit.client.1.smithi114.stdout:5/873: rmdir d3/d24/d7d/da6 39 2024-09-16T09:45:38.107 INFO:tasks.workunit.client.1.smithi114.stdout:0/811: dread d1f/d2d/d7a/ddd/ff1 [4194304,4194304] 0 2024-09-16T09:45:38.108 INFO:tasks.workunit.client.1.smithi114.stdout:6/957: mknod d6/d2d/d46/dcc/c12d 0 2024-09-16T09:45:38.108 INFO:tasks.workunit.client.1.smithi114.stdout:6/958: truncate d6/da/db3/fe8 1465 0 2024-09-16T09:45:38.109 INFO:tasks.workunit.client.1.smithi114.stdout:1/881: mkdir d4/d2b/d16/d71/de5/df1/d12e 0 2024-09-16T09:45:38.112 INFO:tasks.workunit.client.1.smithi114.stdout:9/874: creat d3/da/d10/d23/d29/d2c/d45/f135 x:0 0 0 2024-09-16T09:45:38.114 INFO:tasks.workunit.client.1.smithi114.stdout:5/874: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/c129 0 2024-09-16T09:45:38.115 INFO:tasks.workunit.client.1.smithi114.stdout:0/812: mkdir d1f/d22/d2e/d46/d7f/df4/d120 0 2024-09-16T09:45:38.117 INFO:tasks.workunit.client.1.smithi114.stdout:4/862: write d0/d26/d40/f44 [2310578,120326] 0 2024-09-16T09:45:38.118 INFO:tasks.workunit.client.1.smithi114.stdout:9/875: mkdir d3/da/d10/d23/d43/d82/dc5/dd5/d136 0 2024-09-16T09:45:38.118 INFO:tasks.workunit.client.1.smithi114.stdout:9/876: readlink d3/da/d10/d23/d29/ded/ld8 0 2024-09-16T09:45:38.119 INFO:tasks.workunit.client.1.smithi114.stdout:9/877: fsync d3/da/d10/d23/d43/d1e/d25/f6f 0 2024-09-16T09:45:38.119 INFO:tasks.workunit.client.1.smithi114.stdout:9/878: read d3/da/d10/d23/d43/d1e/d25/dc0/dfb/f119 [91128,25000] 0 2024-09-16T09:45:38.119 INFO:tasks.workunit.client.1.smithi114.stdout:9/879: write d3/da/d10/d23/d43/d1e/da0/f126 [300132,124331] 0 2024-09-16T09:45:38.120 INFO:tasks.workunit.client.1.smithi114.stdout:0/813: link d1f/d22/fa0 d1f/d20/d48/f121 0 2024-09-16T09:45:38.121 INFO:tasks.workunit.client.1.smithi114.stdout:1/882: dread d4/d2b/d16/d71/d81/fe3 [0,4194304] 0 2024-09-16T09:45:38.121 INFO:tasks.workunit.client.1.smithi114.stdout:1/883: readlink d4/d2b/d16/d71/d72/l10b 0 2024-09-16T09:45:38.123 INFO:tasks.workunit.client.1.smithi114.stdout:3/953: dwrite dc/de/d18/d78/d5c/d6e/ffd [0,4194304] 0 2024-09-16T09:45:38.128 INFO:tasks.workunit.client.1.smithi114.stdout:9/880: creat d3/da/d10/d23/d43/d82/dc5/dd5/f137 x:0 0 0 2024-09-16T09:45:38.128 INFO:tasks.workunit.client.1.smithi114.stdout:5/875: mkdir d3/d24/d84/d12a 0 2024-09-16T09:45:38.129 INFO:tasks.workunit.client.1.smithi114.stdout:0/814: symlink d1f/d2d/d7a/d107/l122 0 2024-09-16T09:45:38.129 INFO:tasks.workunit.client.1.smithi114.stdout:6/959: dwrite d6/d2d/d46/fd4 [0,4194304] 0 2024-09-16T09:45:38.130 INFO:tasks.workunit.client.1.smithi114.stdout:1/884: link d4/d2b/d16/d47/f6e d4/d2b/d2f/d3a/d9d/d41/d42/f12f 0 2024-09-16T09:45:38.130 INFO:tasks.workunit.client.1.smithi114.stdout:1/885: dread - d4/d2b/d16/d47/f4b zero size 2024-09-16T09:45:38.130 INFO:tasks.workunit.client.1.smithi114.stdout:1/886: chown d4/d2b/d2f/fad 3884 1 2024-09-16T09:45:38.130 INFO:tasks.workunit.client.1.smithi114.stdout:6/960: write d6/f22 [233045,41974] 0 2024-09-16T09:45:38.133 INFO:tasks.workunit.client.1.smithi114.stdout:3/954: symlink dc/de/d17/d2d/d41/l147 0 2024-09-16T09:45:38.135 INFO:tasks.workunit.client.1.smithi114.stdout:9/881: creat d3/da/d10/d23/d43/d1e/d25/d88/f138 x:0 0 0 2024-09-16T09:45:38.137 INFO:tasks.workunit.client.1.smithi114.stdout:5/876: mkdir d3/d1f/d8c/d12b 0 2024-09-16T09:45:38.139 INFO:tasks.workunit.client.1.smithi114.stdout:0/815: mkdir d1f/d20/d48/d123 0 2024-09-16T09:45:38.142 INFO:tasks.workunit.client.1.smithi114.stdout:3/955: truncate dc/de/d18/dfe/f12e 2533030 0 2024-09-16T09:45:38.142 INFO:tasks.workunit.client.1.smithi114.stdout:9/882: rmdir d3/da/d10/d23/d43/d1e/da0 39 2024-09-16T09:45:38.144 INFO:tasks.workunit.client.1.smithi114.stdout:0/816: rename d1f/d27/fac to d1f/d20/d48/f124 0 2024-09-16T09:45:38.145 INFO:tasks.workunit.client.1.smithi114.stdout:0/817: stat d1f/d20/d48/d75 0 2024-09-16T09:45:38.145 INFO:tasks.workunit.client.1.smithi114.stdout:3/956: mknod dc/de/d18/c148 0 2024-09-16T09:45:38.145 INFO:tasks.workunit.client.1.smithi114.stdout:3/957: fdatasync dc/de/d17/d79/fe9 0 2024-09-16T09:45:38.146 INFO:tasks.workunit.client.1.smithi114.stdout:4/863: dwrite d0/d26/d29/d2b/d58/f8a [0,4194304] 0 2024-09-16T09:45:38.146 INFO:tasks.workunit.client.1.smithi114.stdout:9/883: creat d3/da/d10/d23/d43/d1e/d25/dc0/dfb/f139 x:0 0 0 2024-09-16T09:45:38.146 INFO:tasks.workunit.client.1.smithi114.stdout:9/884: dread - d3/da/d10/d23/d43/d82/dc5/fd6 zero size 2024-09-16T09:45:38.147 INFO:tasks.workunit.client.1.smithi114.stdout:5/877: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/f12c x:0 0 0 2024-09-16T09:45:38.148 INFO:tasks.workunit.client.1.smithi114.stdout:0/818: rmdir d1f/d20/d48/d123 0 2024-09-16T09:45:38.149 INFO:tasks.workunit.client.1.smithi114.stdout:3/958: creat dc/de/d17/d72/f149 x:0 0 0 2024-09-16T09:45:38.151 INFO:tasks.workunit.client.1.smithi114.stdout:1/887: dwrite d4/d2b/d2f/d3a/f40 [0,4194304] 0 2024-09-16T09:45:38.151 INFO:tasks.workunit.client.1.smithi114.stdout:1/888: write d4/ff4 [336376,89298] 0 2024-09-16T09:45:38.153 INFO:tasks.workunit.client.1.smithi114.stdout:9/885: creat d3/da/d10/d23/d43/d82/dc5/dd5/d136/f13a x:0 0 0 2024-09-16T09:45:38.154 INFO:tasks.workunit.client.1.smithi114.stdout:6/961: dwrite d6/da/db3/dd1/dec/f106 [0,4194304] 0 2024-09-16T09:45:38.154 INFO:tasks.workunit.client.1.smithi114.stdout:3/959: mknod dc/d38/c14a 0 2024-09-16T09:45:38.154 INFO:tasks.workunit.client.1.smithi114.stdout:3/960: chown dc/de/d18/dfe/db2/dd8/f127 10641075 1 2024-09-16T09:45:38.155 INFO:tasks.workunit.client.1.smithi114.stdout:3/961: write dc/de/d18/d78/d5c/fe3 [824009,110776] 0 2024-09-16T09:45:38.157 INFO:tasks.workunit.client.1.smithi114.stdout:1/889: truncate d4/d2b/d16/f51 2248938 0 2024-09-16T09:45:38.159 INFO:tasks.workunit.client.1.smithi114.stdout:5/878: write d3/d24/d84/d7a/d43/f91 [1216716,70526] 0 2024-09-16T09:45:38.161 INFO:tasks.workunit.client.1.smithi114.stdout:6/962: creat d6/d2d/f12e x:0 0 0 2024-09-16T09:45:38.162 INFO:tasks.workunit.client.1.smithi114.stdout:1/890: rename d4/d2b/c2c to d4/d2b/d29/c130 0 2024-09-16T09:45:38.163 INFO:tasks.workunit.client.1.smithi114.stdout:9/886: mkdir d3/da/d10/d23/d43/d1e/d13b 0 2024-09-16T09:45:38.164 INFO:tasks.workunit.client.1.smithi114.stdout:4/864: dread d0/d13/fac [0,4194304] 0 2024-09-16T09:45:38.164 INFO:tasks.workunit.client.1.smithi114.stdout:4/865: fdatasync d0/f21 0 2024-09-16T09:45:38.167 INFO:tasks.workunit.client.1.smithi114.stdout:6/963: rmdir d6/d2d/d46/dcc/dad 39 2024-09-16T09:45:38.167 INFO:tasks.workunit.client.1.smithi114.stdout:6/964: truncate d6/d2d/d46/f83 1255195 0 2024-09-16T09:45:38.168 INFO:tasks.workunit.client.1.smithi114.stdout:4/866: link d0/d26/d3c/d74/d9c/ce0 d0/d26/d3c/d3e/d5a/d5d/d70/d83/c12a 0 2024-09-16T09:45:38.172 INFO:tasks.workunit.client.1.smithi114.stdout:5/879: dread d3/d24/d84/dbc/fe6 [0,4194304] 0 2024-09-16T09:45:38.172 INFO:tasks.workunit.client.1.smithi114.stdout:0/819: dwrite d1f/d22/d2e/d46/d7f/d8d/fc5 [0,4194304] 0 2024-09-16T09:45:38.177 INFO:tasks.workunit.client.1.smithi114.stdout:5/880: truncate d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f9c 346966 0 2024-09-16T09:45:38.178 INFO:tasks.workunit.client.1.smithi114.stdout:5/881: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/d98 0 2024-09-16T09:45:38.178 INFO:tasks.workunit.client.1.smithi114.stdout:0/820: symlink d1f/d27/d55/dce/l125 0 2024-09-16T09:45:38.178 INFO:tasks.workunit.client.1.smithi114.stdout:9/887: dread d3/da/d10/d23/d29/d2c/d6b/f63 [0,4194304] 0 2024-09-16T09:45:38.178 INFO:tasks.workunit.client.1.smithi114.stdout:0/821: write d1f/d27/d47/d56/d7e/f10e [771884,60796] 0 2024-09-16T09:45:38.179 INFO:tasks.workunit.client.1.smithi114.stdout:1/891: dread d4/d2b/d2f/d3a/d9d/fc9 [0,4194304] 0 2024-09-16T09:45:38.179 INFO:tasks.workunit.client.1.smithi114.stdout:1/892: chown d4/d2b/d29/d107 47774 1 2024-09-16T09:45:38.183 INFO:tasks.workunit.client.1.smithi114.stdout:1/893: mkdir d4/d2b/d131 0 2024-09-16T09:45:38.186 INFO:tasks.workunit.client.1.smithi114.stdout:1/894: creat d4/d2b/d16/d71/d72/f132 x:0 0 0 2024-09-16T09:45:38.186 INFO:tasks.workunit.client.1.smithi114.stdout:1/895: stat d4/d2b/d16/d71/de5 0 2024-09-16T09:45:38.188 INFO:tasks.workunit.client.1.smithi114.stdout:1/896: getdents d4/d2b/d2f/d3a 0 2024-09-16T09:45:38.190 INFO:tasks.workunit.client.1.smithi114.stdout:1/897: mkdir d4/d2b/d16/d71/d72/d75/db4/dbb/d133 0 2024-09-16T09:45:38.190 INFO:tasks.workunit.client.1.smithi114.stdout:1/898: write d4/d2b/d16/d71/d72/d75/fe8 [804541,15095] 0 2024-09-16T09:45:38.193 INFO:tasks.workunit.client.1.smithi114.stdout:1/899: rename d4/d2b/d2f/d3a/d56/l6c to d4/d2b/d29/da0/d11f/l134 0 2024-09-16T09:45:38.193 INFO:tasks.workunit.client.1.smithi114.stdout:1/900: write d4/d2b/d16/f84 [1665757,64226] 0 2024-09-16T09:45:38.194 INFO:tasks.workunit.client.1.smithi114.stdout:1/901: chown d4/d2b/d2f/d3a/fab 101804 1 2024-09-16T09:45:38.194 INFO:tasks.workunit.client.1.smithi114.stdout:1/902: write d4/d2b/d2f/d3a/dc5/fff [906800,34138] 0 2024-09-16T09:45:38.194 INFO:tasks.workunit.client.1.smithi114.stdout:1/903: readlink d4/d2b/d16/l31 0 2024-09-16T09:45:38.195 INFO:tasks.workunit.client.1.smithi114.stdout:1/904: rename d4/d2b/d16/d47/f48 to d4/d2b/d16/d71/d72/deb/f135 0 2024-09-16T09:45:38.195 INFO:tasks.workunit.client.1.smithi114.stdout:1/905: truncate d4/d2b/d16/d71/d72/deb/f135 1942099 0 2024-09-16T09:45:38.196 INFO:tasks.workunit.client.1.smithi114.stdout:1/906: creat d4/d2b/d16/d71/d72/f136 x:0 0 0 2024-09-16T09:45:38.197 INFO:tasks.workunit.client.1.smithi114.stdout:1/907: mkdir d4/d2b/d2f/d3a/d9d/d41/d42/d58/d137 0 2024-09-16T09:45:38.198 INFO:tasks.workunit.client.1.smithi114.stdout:4/867: dwrite d0/d26/d3c/d3e/d4b/d46/ff5 [4194304,4194304] 0 2024-09-16T09:45:38.202 INFO:tasks.workunit.client.1.smithi114.stdout:4/868: dread d0/d26/d3c/d45/fc1 [0,4194304] 0 2024-09-16T09:45:38.202 INFO:tasks.workunit.client.1.smithi114.stdout:4/869: write d0/f11 [6660786,90905] 0 2024-09-16T09:45:38.208 INFO:tasks.workunit.client.1.smithi114.stdout:6/965: dwrite d6/da/d48/f58 [0,4194304] 0 2024-09-16T09:45:38.210 INFO:tasks.workunit.client.1.smithi114.stdout:6/966: symlink d6/da/d76/l12f 0 2024-09-16T09:45:38.210 INFO:tasks.workunit.client.1.smithi114.stdout:6/967: truncate d6/da/d10/d40/d82/fda 1145638 0 2024-09-16T09:45:38.211 INFO:tasks.workunit.client.1.smithi114.stdout:6/968: readlink d6/d2d/d46/dcc/d62/l99 0 2024-09-16T09:45:38.215 INFO:tasks.workunit.client.1.smithi114.stdout:6/969: dread d6/da/d10/f9d [0,4194304] 0 2024-09-16T09:45:38.216 INFO:tasks.workunit.client.1.smithi114.stdout:0/822: dwrite d1f/d27/f96 [0,4194304] 0 2024-09-16T09:45:38.217 INFO:tasks.workunit.client.1.smithi114.stdout:6/970: creat d6/d2d/d46/dcc/d62/d77/d7b/f130 x:0 0 0 2024-09-16T09:45:38.217 INFO:tasks.workunit.client.1.smithi114.stdout:5/882: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fa9 [0,4194304] 0 2024-09-16T09:45:38.221 INFO:tasks.workunit.client.1.smithi114.stdout:6/971: rename d6/d2d/d46/dcc/la5 to d6/d2d/d46/dcc/l131 0 2024-09-16T09:45:38.221 INFO:tasks.workunit.client.1.smithi114.stdout:1/908: dwrite d4/d2b/d16/d71/d72/ff5 [0,4194304] 0 2024-09-16T09:45:38.221 INFO:tasks.workunit.client.1.smithi114.stdout:1/909: write d4/d2b/d16/d71/d72/d75/db4/dbb/f103 [164951,14585] 0 2024-09-16T09:45:38.221 INFO:tasks.workunit.client.1.smithi114.stdout:1/910: write d4/d2b/f11e [759353,60022] 0 2024-09-16T09:45:38.222 INFO:tasks.workunit.client.1.smithi114.stdout:1/911: chown d4/d2b/d16/d47/d83 14 1 2024-09-16T09:45:38.222 INFO:tasks.workunit.client.1.smithi114.stdout:6/972: symlink d6/d117/l132 0 2024-09-16T09:45:38.223 INFO:tasks.workunit.client.1.smithi114.stdout:9/888: dwrite d3/da/d10/d23/d43/d1e/d4c/d8c/fd4 [4194304,4194304] 0 2024-09-16T09:45:38.225 INFO:tasks.workunit.client.1.smithi114.stdout:1/912: rename d4/d2b/d16/d71/d81/ddc/c123 to d4/d2b/d16/d71/c138 0 2024-09-16T09:45:38.233 INFO:tasks.workunit.client.1.smithi114.stdout:9/889: mkdir d3/da/d10/d23/de9/d13c 0 2024-09-16T09:45:38.234 INFO:tasks.workunit.client.1.smithi114.stdout:1/913: rename d4/d2b/d2f/d3a/d9d/d41/d42/l89 to d4/d2b/d16/d71/d72/d75/db4/dbb/d133/l139 0 2024-09-16T09:45:38.238 INFO:tasks.workunit.client.1.smithi114.stdout:9/890: rename d3/da/d10/d23/d43/d82/cde to d3/da/d10/d23/d43/d1e/d25/dc0/c13d 0 2024-09-16T09:45:38.239 INFO:tasks.workunit.client.1.smithi114.stdout:4/870: dwrite d0/d26/d29/f1d [0,4194304] 0 2024-09-16T09:45:38.239 INFO:tasks.workunit.client.1.smithi114.stdout:0/823: dread d1f/d27/d47/f60 [0,4194304] 0 2024-09-16T09:45:38.239 INFO:tasks.workunit.client.1.smithi114.stdout:1/914: creat d4/d2b/d2f/d112/f13a x:0 0 0 2024-09-16T09:45:38.247 INFO:tasks.workunit.client.1.smithi114.stdout:9/891: dread d3/da/d10/d23/d43/f16 [0,4194304] 0 2024-09-16T09:45:38.247 INFO:tasks.workunit.client.1.smithi114.stdout:9/892: write d3/da/d10/d23/d29/d2c/d6b/d68/f9a [2313882,76833] 0 2024-09-16T09:45:38.249 INFO:tasks.workunit.client.1.smithi114.stdout:4/871: mknod d0/d26/df1/c12b 0 2024-09-16T09:45:38.250 INFO:tasks.workunit.client.1.smithi114.stdout:1/915: rmdir d4/d2b 39 2024-09-16T09:45:38.252 INFO:tasks.workunit.client.1.smithi114.stdout:9/893: unlink d3/da/d10/d23/d43/l22 0 2024-09-16T09:45:38.252 INFO:tasks.workunit.client.1.smithi114.stdout:4/872: fdatasync d0/d13/f86 0 2024-09-16T09:45:38.253 INFO:tasks.workunit.client.1.smithi114.stdout:6/973: dwrite d6/da/d10/d92/fc0 [0,4194304] 0 2024-09-16T09:45:38.253 INFO:tasks.workunit.client.1.smithi114.stdout:6/974: fsync d6/da/d10/d92/ff0 0 2024-09-16T09:45:38.253 INFO:tasks.workunit.client.1.smithi114.stdout:6/975: fdatasync d6/d2d/d46/dcc/d62/f7e 0 2024-09-16T09:45:38.253 INFO:tasks.workunit.client.1.smithi114.stdout:6/976: write d6/d2d/f54 [7383340,125002] 0 2024-09-16T09:45:38.253 INFO:tasks.workunit.client.1.smithi114.stdout:1/916: creat d4/d2b/d2f/d3a/d9d/d41/d42/d58/f13b x:0 0 0 2024-09-16T09:45:38.254 INFO:tasks.workunit.client.1.smithi114.stdout:1/917: stat d4/d2b/d2f/d3a/dc5/f106 0 2024-09-16T09:45:38.254 INFO:tasks.workunit.client.1.smithi114.stdout:1/918: write d4/d2b/d2f/d3a/fd5 [982708,7419] 0 2024-09-16T09:45:38.254 INFO:tasks.workunit.client.1.smithi114.stdout:4/873: write d0/d13/d56/d7e/d116/f11e [312151,90896] 0 2024-09-16T09:45:38.255 INFO:tasks.workunit.client.1.smithi114.stdout:6/977: symlink d6/d64/df6/l133 0 2024-09-16T09:45:38.255 INFO:tasks.workunit.client.1.smithi114.stdout:1/919: mknod d4/d101/c13c 0 2024-09-16T09:45:38.255 INFO:tasks.workunit.client.1.smithi114.stdout:1/920: readlink d4/d2b/d2f/d3a/d9d/d41/l57 0 2024-09-16T09:45:38.255 INFO:tasks.workunit.client.1.smithi114.stdout:1/921: chown d4/d2b/d2f/d3a/db0/d117 3 1 2024-09-16T09:45:38.256 INFO:tasks.workunit.client.1.smithi114.stdout:6/978: symlink d6/d64/l134 0 2024-09-16T09:45:38.258 INFO:tasks.workunit.client.1.smithi114.stdout:1/922: rename d4/ce to d4/d2b/d16/d71/c13d 0 2024-09-16T09:45:38.260 INFO:tasks.workunit.client.1.smithi114.stdout:6/979: truncate d6/da/d48/db0/dfc/f100 4623377 0 2024-09-16T09:45:38.266 INFO:tasks.workunit.client.1.smithi114.stdout:0/824: dwrite d1f/d27/de6/f10a [0,4194304] 0 2024-09-16T09:45:38.285 INFO:tasks.workunit.client.1.smithi114.stdout:4/874: dwrite d0/d26/d3c/f2d [0,4194304] 0 2024-09-16T09:45:38.286 INFO:tasks.workunit.client.1.smithi114.stdout:8/801: sync 2024-09-16T09:45:38.286 INFO:tasks.workunit.client.1.smithi114.stdout:7/954: sync 2024-09-16T09:45:38.290 INFO:tasks.workunit.client.1.smithi114.stdout:1/923: dwrite d4/d2b/d16/d71/d72/d75/db4/dbb/fc1 [0,4194304] 0 2024-09-16T09:45:38.290 INFO:tasks.workunit.client.1.smithi114.stdout:1/924: dread - d4/d2b/fd9 zero size 2024-09-16T09:45:38.290 INFO:tasks.workunit.client.1.smithi114.stdout:1/925: write d4/d2b/f11e [898172,77432] 0 2024-09-16T09:45:38.292 INFO:tasks.workunit.client.1.smithi114.stdout:6/980: dwrite d6/d2d/f87 [0,4194304] 0 2024-09-16T09:45:38.292 INFO:tasks.workunit.client.1.smithi114.stdout:4/875: dread d0/d13/fac [0,4194304] 0 2024-09-16T09:45:38.292 INFO:tasks.workunit.client.1.smithi114.stdout:4/876: stat d0/c5f 0 2024-09-16T09:45:38.292 INFO:tasks.workunit.client.1.smithi114.stdout:0/825: dwrite d1f/fc4 [0,4194304] 0 2024-09-16T09:45:38.294 INFO:tasks.workunit.client.1.smithi114.stdout:1/926: rename d4/d2b/d2f/d3a/d9d/c45 to d4/d2b/d29/da0/d11f/c13e 0 2024-09-16T09:45:38.296 INFO:tasks.workunit.client.1.smithi114.stdout:4/877: creat d0/d26/d40/d75/d7f/d87/f12c x:0 0 0 2024-09-16T09:45:38.297 INFO:tasks.workunit.client.1.smithi114.stdout:4/878: dread - d0/d26/d29/d2b/d58/fc9 zero size 2024-09-16T09:45:38.297 INFO:tasks.workunit.client.1.smithi114.stdout:7/955: write d2/d9/d2b/d2e/d77/f56 [3884030,2684] 0 2024-09-16T09:45:38.298 INFO:tasks.workunit.client.1.smithi114.stdout:7/956: fdatasync d2/df/df9/f9e 0 2024-09-16T09:45:38.300 INFO:tasks.workunit.client.1.smithi114.stdout:1/927: mknod d4/d2b/d29/c13f 0 2024-09-16T09:45:38.300 INFO:tasks.workunit.client.1.smithi114.stdout:0/826: link c12 d1f/d2d/d7a/ddc/c126 0 2024-09-16T09:45:38.300 INFO:tasks.workunit.client.1.smithi114.stdout:1/928: chown d4/ffe 14 1 2024-09-16T09:45:38.300 INFO:tasks.workunit.client.1.smithi114.stdout:1/929: read d4/ffe [331390,45694] 0 2024-09-16T09:45:38.300 INFO:tasks.workunit.client.1.smithi114.stdout:1/930: fsync d4/d2b/d16/f7c 0 2024-09-16T09:45:38.302 INFO:tasks.workunit.client.1.smithi114.stdout:1/931: creat d4/d2b/d16/d47/d83/f140 x:0 0 0 2024-09-16T09:45:38.305 INFO:tasks.workunit.client.1.smithi114.stdout:1/932: creat d4/d2b/d16/d71/de5/df1/d12e/f141 x:0 0 0 2024-09-16T09:45:38.305 INFO:tasks.workunit.client.1.smithi114.stdout:1/933: write d4/f108 [150492,45896] 0 2024-09-16T09:45:38.305 INFO:tasks.workunit.client.1.smithi114.stdout:1/934: stat d4/d2b/d29/da0/f12b 0 2024-09-16T09:45:38.305 INFO:tasks.workunit.client.1.smithi114.stdout:1/935: readlink d4/l11 0 2024-09-16T09:45:38.306 INFO:tasks.workunit.client.1.smithi114.stdout:1/936: symlink d4/d2b/d16/d47/d83/l142 0 2024-09-16T09:45:38.306 INFO:tasks.workunit.client.1.smithi114.stdout:1/937: dread - d4/d2b/d16/d71/d72/f115 zero size 2024-09-16T09:45:38.307 INFO:tasks.workunit.client.1.smithi114.stdout:8/802: dwrite d4/db/d91/fab [0,4194304] 0 2024-09-16T09:45:38.307 INFO:tasks.workunit.client.1.smithi114.stdout:1/938: symlink d4/d2b/d16/d47/l143 0 2024-09-16T09:45:38.308 INFO:tasks.workunit.client.1.smithi114.stdout:8/803: mknod d4/db/d91/c110 0 2024-09-16T09:45:38.308 INFO:tasks.workunit.client.1.smithi114.stdout:8/804: write d4/db/f4d [8953957,93696] 0 2024-09-16T09:45:38.308 INFO:tasks.workunit.client.1.smithi114.stdout:1/939: truncate d4/d2b/d2f/d3a/f10a 2993968 0 2024-09-16T09:45:38.310 INFO:tasks.workunit.client.1.smithi114.stdout:8/805: rename d4/db/d3e/d47/d101/f10f to d4/db/dd/f111 0 2024-09-16T09:45:38.310 INFO:tasks.workunit.client.1.smithi114.stdout:6/981: write d6/da/d48/db0/dfc/f100 [83180,63943] 0 2024-09-16T09:45:38.311 INFO:tasks.workunit.client.1.smithi114.stdout:1/940: creat d4/d2b/d29/da0/f144 x:0 0 0 2024-09-16T09:45:38.314 INFO:tasks.workunit.client.1.smithi114.stdout:8/806: symlink d4/db/d3e/l112 0 2024-09-16T09:45:38.316 INFO:tasks.workunit.client.1.smithi114.stdout:8/807: truncate d4/d1f/f35 2065926 0 2024-09-16T09:45:38.318 INFO:tasks.workunit.client.1.smithi114.stdout:0/827: dread d1f/d22/d2e/f6c [8388608,4194304] 0 2024-09-16T09:45:38.318 INFO:tasks.workunit.client.1.smithi114.stdout:0/828: write d1f/d22/d2e/d46/d7f/fd8 [1290809,88694] 0 2024-09-16T09:45:38.318 INFO:tasks.workunit.client.1.smithi114.stdout:8/808: creat d4/db/d39/d3c/d86/f113 x:0 0 0 2024-09-16T09:45:38.319 INFO:tasks.workunit.client.1.smithi114.stdout:4/879: dwrite d0/f103 [4194304,4194304] 0 2024-09-16T09:45:38.320 INFO:tasks.workunit.client.1.smithi114.stdout:8/809: rename d4/db/d39/d3c/d4e/d82/d72/d59/le9 to d4/db/d39/d3c/l114 0 2024-09-16T09:45:38.321 INFO:tasks.workunit.client.1.smithi114.stdout:8/810: stat d4/dc3/c108 0 2024-09-16T09:45:38.321 INFO:tasks.workunit.client.1.smithi114.stdout:8/811: readlink d4/dae/d54/l7d 0 2024-09-16T09:45:38.322 INFO:tasks.workunit.client.1.smithi114.stdout:4/880: mknod d0/d26/d3c/d3e/d4b/d46/df3/d124/c12d 0 2024-09-16T09:45:38.323 INFO:tasks.workunit.client.1.smithi114.stdout:8/812: mkdir d4/dae/d9c/d115 0 2024-09-16T09:45:38.324 INFO:tasks.workunit.client.1.smithi114.stdout:4/881: mknod d0/d26/d3c/d3e/c12e 0 2024-09-16T09:45:38.325 INFO:tasks.workunit.client.1.smithi114.stdout:4/882: write - open d0/d13/f127 failed 14 2024-09-16T09:45:38.325 INFO:tasks.workunit.client.1.smithi114.stdout:4/883: fsync d0/d13/d25/fa5 0 2024-09-16T09:45:38.326 INFO:tasks.workunit.client.1.smithi114.stdout:4/884: symlink d0/d26/d29/de9/l12f 0 2024-09-16T09:45:38.326 INFO:tasks.workunit.client.1.smithi114.stdout:4/885: getdents d0/d26/df1 0 2024-09-16T09:45:38.326 INFO:tasks.workunit.client.1.smithi114.stdout:4/886: readlink d0/d26/d2e/l7c 0 2024-09-16T09:45:38.329 INFO:tasks.workunit.client.1.smithi114.stdout:0/829: read d1f/d27/de6/f10a [3779806,63927] 0 2024-09-16T09:45:38.331 INFO:tasks.workunit.client.1.smithi114.stdout:0/830: mknod d1f/d2d/d7a/ddd/c127 0 2024-09-16T09:45:38.332 INFO:tasks.workunit.client.1.smithi114.stdout:0/831: link d1f/d20/d48/l10d d1f/d2d/l128 0 2024-09-16T09:45:38.332 INFO:tasks.workunit.client.1.smithi114.stdout:0/832: readlink d1f/d20/d48/lbd 0 2024-09-16T09:45:38.333 INFO:tasks.workunit.client.1.smithi114.stdout:6/982: dwrite d6/da/d10/fa3 [0,4194304] 0 2024-09-16T09:45:38.333 INFO:tasks.workunit.client.1.smithi114.stdout:7/957: dwrite d2/d9/f7b [0,4194304] 0 2024-09-16T09:45:38.333 INFO:tasks.workunit.client.1.smithi114.stdout:7/958: read - d2/d9/d2b/d78/d99/ddd/def/f138 zero size 2024-09-16T09:45:38.333 INFO:tasks.workunit.client.1.smithi114.stdout:0/833: mkdir d1f/d22/d2e/d46/d7f/d129 0 2024-09-16T09:45:38.336 INFO:tasks.workunit.client.1.smithi114.stdout:6/983: rename d6/da/d48/db0/cd7 to d6/da/d76/c135 0 2024-09-16T09:45:38.336 INFO:tasks.workunit.client.1.smithi114.stdout:6/984: getdents d6/d2d/d46/dcc/d62/d77/d124 0 2024-09-16T09:45:38.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/834: unlink d1f/d22/d2e/d46/d7f/d8d/dbb/fd6 0 2024-09-16T09:45:38.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/835: chown d1f/d22/l67 48 1 2024-09-16T09:45:38.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/836: chown d1f 9 1 2024-09-16T09:45:38.338 INFO:tasks.workunit.client.1.smithi114.stdout:0/837: fdatasync d1f/d22/d2e/d46/f5f 0 2024-09-16T09:45:38.340 INFO:tasks.workunit.client.1.smithi114.stdout:7/959: rename d2/d9/d51/d10e to d2/d9/d2b/d59/d13e 0 2024-09-16T09:45:38.340 INFO:tasks.workunit.client.1.smithi114.stdout:7/960: write d2/d9/d2b/d2e/d22/d27/f40 [7167608,46213] 0 2024-09-16T09:45:38.341 INFO:tasks.workunit.client.1.smithi114.stdout:0/838: symlink d1f/d27/d55/dce/l12a 0 2024-09-16T09:45:38.343 INFO:tasks.workunit.client.1.smithi114.stdout:7/961: rename d2/lc2 to d2/d55/l13f 0 2024-09-16T09:45:38.344 INFO:tasks.workunit.client.1.smithi114.stdout:7/962: readlink d2/d9/d2b/d78/d99/ddd/dea/l126 0 2024-09-16T09:45:38.344 INFO:tasks.workunit.client.1.smithi114.stdout:6/985: mknod d6/da/d10/c136 0 2024-09-16T09:45:38.344 INFO:tasks.workunit.client.1.smithi114.stdout:6/986: truncate d6/da/d10/f9d 743311 0 2024-09-16T09:45:38.346 INFO:tasks.workunit.client.1.smithi114.stdout:0/839: symlink d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/l12b 0 2024-09-16T09:45:38.347 INFO:tasks.workunit.client.1.smithi114.stdout:7/963: rename d2/d9/d2b/d2e/d22/d27/d4d/d72/c121 to d2/d9/d2b/d59/d13e/c140 0 2024-09-16T09:45:38.348 INFO:tasks.workunit.client.1.smithi114.stdout:7/964: chown d2/d9/d2b/d2e/d3e/d89 1255 1 2024-09-16T09:45:38.350 INFO:tasks.workunit.client.1.smithi114.stdout:6/987: creat d6/d2d/d46/d9c/f137 x:0 0 0 2024-09-16T09:45:38.351 INFO:tasks.workunit.client.1.smithi114.stdout:7/965: link d2/df/la2 d2/d9/d2b/d2e/l141 0 2024-09-16T09:45:38.351 INFO:tasks.workunit.client.1.smithi114.stdout:4/887: dwrite d0/d26/d3c/d74/d9c/f128 [0,4194304] 0 2024-09-16T09:45:38.351 INFO:tasks.workunit.client.1.smithi114.stdout:4/888: write d0/d26/d3c/d45/ff7 [386919,123548] 0 2024-09-16T09:45:38.351 INFO:tasks.workunit.client.1.smithi114.stdout:4/889: stat d0/d26/d3c/d3e/d4b/d46/db3/fa8 0 2024-09-16T09:45:38.353 INFO:tasks.workunit.client.1.smithi114.stdout:7/966: rename d2/d9/d2b/d78/c129 to d2/d9/d2b/d78/d99/ddd/c142 0 2024-09-16T09:45:38.360 INFO:tasks.workunit.client.1.smithi114.stdout:4/890: creat d0/d26/d29/d9f/f130 x:0 0 0 2024-09-16T09:45:38.363 INFO:tasks.workunit.client.1.smithi114.stdout:7/967: unlink d2/d9/c139 0 2024-09-16T09:45:38.363 INFO:tasks.workunit.client.1.smithi114.stdout:7/968: chown d2/d9/d51 0 1 2024-09-16T09:45:38.365 INFO:tasks.workunit.client.1.smithi114.stdout:8/813: dread d4/d1f/f35 [0,4194304] 0 2024-09-16T09:45:38.366 INFO:tasks.workunit.client.1.smithi114.stdout:7/969: rename d2/d9/d2b/d2e/d22/d66/db0/fcf to d2/d9/d2b/d2e/d22/d66/f143 0 2024-09-16T09:45:38.368 INFO:tasks.workunit.client.1.smithi114.stdout:7/970: mknod d2/d9/d51/d84/dda/c144 0 2024-09-16T09:45:38.370 INFO:tasks.workunit.client.1.smithi114.stdout:0/840: dwrite d1f/d22/d2e/d46/d7f/d8d/dbb/fda [0,4194304] 0 2024-09-16T09:45:38.371 INFO:tasks.workunit.client.1.smithi114.stdout:0/841: write d1f/f74 [2012970,12296] 0 2024-09-16T09:45:38.372 INFO:tasks.workunit.client.1.smithi114.stdout:6/988: dwrite d6/da/db3/dd1/dec/f11f [0,4194304] 0 2024-09-16T09:45:38.372 INFO:tasks.workunit.client.1.smithi114.stdout:6/989: truncate d6/d64/df6/f125 221232 0 2024-09-16T09:45:38.372 INFO:tasks.workunit.client.1.smithi114.stdout:6/990: write d6/d2d/d46/f5a [541578,124162] 0 2024-09-16T09:45:38.372 INFO:tasks.workunit.client.1.smithi114.stdout:6/991: dread - d6/d2d/f12e zero size 2024-09-16T09:45:38.374 INFO:tasks.workunit.client.1.smithi114.stdout:4/891: write d0/d26/d29/f1d [1497895,54920] 0 2024-09-16T09:45:38.377 INFO:tasks.workunit.client.1.smithi114.stdout:0/842: creat d1f/d22/d2e/d46/d7f/d8d/dbb/f12c x:0 0 0 2024-09-16T09:45:38.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:38 smithi111 ceph-mon[27997]: pgmap v242: 65 pgs: 65 active+clean; 1.8 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 178 MiB/s rd, 245 MiB/s wr, 477 op/s 2024-09-16T09:45:38.382 INFO:tasks.workunit.client.1.smithi114.stdout:6/992: creat d6/d2d/d46/dcc/d62/d77/d124/f138 x:0 0 0 2024-09-16T09:45:38.384 INFO:tasks.workunit.client.1.smithi114.stdout:4/892: mkdir d0/d26/d2e/d131 0 2024-09-16T09:45:38.387 INFO:tasks.workunit.client.1.smithi114.stdout:6/993: rename d6/da/d48/db0/dfc to d6/d2d/d46/dcc/d139 0 2024-09-16T09:45:38.387 INFO:tasks.workunit.client.1.smithi114.stdout:0/843: mkdir d1f/d27/d47/d56/d7e/d12d 0 2024-09-16T09:45:38.389 INFO:tasks.workunit.client.1.smithi114.stdout:6/994: truncate d6/d2d/d46/dcc/d62/d11d/f4f 1293114 0 2024-09-16T09:45:38.389 INFO:tasks.workunit.client.1.smithi114.stdout:6/995: readlink d6/d2d/lb1 0 2024-09-16T09:45:38.390 INFO:tasks.workunit.client.1.smithi114.stdout:6/996: mkdir d6/dea/d11a/d13a 0 2024-09-16T09:45:38.390 INFO:tasks.workunit.client.1.smithi114.stdout:6/997: truncate d6/d2d/d46/fcd 5229765 0 2024-09-16T09:45:38.390 INFO:tasks.workunit.client.1.smithi114.stdout:6/998: write d6/d2d/d46/fcd [3813852,46718] 0 2024-09-16T09:45:38.392 INFO:tasks.workunit.client.1.smithi114.stdout:6/999: truncate d6/d2d/f3a 228893 0 2024-09-16T09:45:38.395 INFO:tasks.workunit.client.1.smithi114.stdout:7/971: dwrite d2/f2c [0,4194304] 0 2024-09-16T09:45:38.395 INFO:tasks.workunit.client.1.smithi114.stdout:8/814: dwrite d4/db/d3e/f4f [0,4194304] 0 2024-09-16T09:45:38.395 INFO:tasks.workunit.client.1.smithi114.stdout:7/972: read d2/d9/d2b/f57 [2003044,115257] 0 2024-09-16T09:45:38.395 INFO:tasks.workunit.client.1.smithi114.stdout:7/973: write d2/f5 [5047894,26359] 0 2024-09-16T09:45:38.396 INFO:tasks.workunit.client.1.smithi114.stdout:5/883: sync 2024-09-16T09:45:38.396 INFO:tasks.workunit.client.1.smithi114.stdout:3/962: sync 2024-09-16T09:45:38.396 INFO:tasks.workunit.client.1.smithi114.stdout:3/963: readlink dc/de/d17/d2d/d41/d11e/lf0 0 2024-09-16T09:45:38.396 INFO:tasks.workunit.client.1.smithi114.stdout:3/964: write dc/de/d1f/f80 [1487460,50710] 0 2024-09-16T09:45:38.396 INFO:tasks.workunit.client.1.smithi114.stdout:5/884: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/fa3 [64904,44113] 0 2024-09-16T09:45:38.397 INFO:tasks.workunit.client.1.smithi114.stdout:4/893: dread d0/d13/d25/ff0 [0,4194304] 0 2024-09-16T09:45:38.399 INFO:tasks.workunit.client.1.smithi114.stdout:8/815: link d4/db/d3e/d71/d78/l85 d4/dae/d54/db3/l116 0 2024-09-16T09:45:38.400 INFO:tasks.workunit.client.1.smithi114.stdout:7/974: creat d2/d9/d2b/d2e/d77/f145 x:0 0 0 2024-09-16T09:45:38.400 INFO:tasks.workunit.client.1.smithi114.stdout:7/975: fsync d2/d9/d2b/d2e/f45 0 2024-09-16T09:45:38.402 INFO:tasks.workunit.client.1.smithi114.stdout:3/965: creat dc/de/d1f/f14b x:0 0 0 2024-09-16T09:45:38.402 INFO:tasks.workunit.client.1.smithi114.stdout:3/966: fsync dc/de/d17/d2d/d41/d11e/d4e/f67 0 2024-09-16T09:45:38.403 INFO:tasks.workunit.client.1.smithi114.stdout:3/967: write dc/de/d17/fee [556544,44278] 0 2024-09-16T09:45:38.404 INFO:tasks.workunit.client.1.smithi114.stdout:0/844: dwrite d1f/d20/fa3 [0,4194304] 0 2024-09-16T09:45:38.404 INFO:tasks.workunit.client.1.smithi114.stdout:5/885: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/db1 to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/d12d 0 2024-09-16T09:45:38.405 INFO:tasks.workunit.client.1.smithi114.stdout:4/894: mknod d0/d26/d3c/d3e/d5a/d5d/d70/d114/c132 0 2024-09-16T09:45:38.405 INFO:tasks.workunit.client.1.smithi114.stdout:4/895: chown d0/d13/f86 202127664 1 2024-09-16T09:45:38.407 INFO:tasks.workunit.client.1.smithi114.stdout:7/976: truncate d2/d9/d2b/d78/d99/f9a 2439962 0 2024-09-16T09:45:38.407 INFO:tasks.workunit.client.1.smithi114.stdout:9/894: sync 2024-09-16T09:45:38.409 INFO:tasks.workunit.client.1.smithi114.stdout:3/968: symlink dc/de/d18/d78/d5c/da5/l14c 0 2024-09-16T09:45:38.410 INFO:tasks.workunit.client.1.smithi114.stdout:8/816: dread d4/dae/f9b [4194304,4194304] 0 2024-09-16T09:45:38.410 INFO:tasks.workunit.client.1.smithi114.stdout:0/845: getdents d1f/d27/d55/dce 0 2024-09-16T09:45:38.411 INFO:tasks.workunit.client.1.smithi114.stdout:5/886: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/c12e 0 2024-09-16T09:45:38.413 INFO:tasks.workunit.client.1.smithi114.stdout:4/896: unlink d0/d26/d2e/f7d 0 2024-09-16T09:45:38.415 INFO:tasks.workunit.client.1.smithi114.stdout:9/895: creat d3/da/d10/d23/d43/d1e/d25/d88/f13e x:0 0 0 2024-09-16T09:45:38.415 INFO:tasks.workunit.client.1.smithi114.stdout:9/896: stat d3/da/d10/d23/d29/d87 0 2024-09-16T09:45:38.416 INFO:tasks.workunit.client.1.smithi114.stdout:3/969: symlink dc/de/d17/d79/l14d 0 2024-09-16T09:45:38.416 INFO:tasks.workunit.client.1.smithi114.stdout:3/970: dread - dc/de/d17/f13f zero size 2024-09-16T09:45:38.418 INFO:tasks.workunit.client.1.smithi114.stdout:8/817: creat d4/dae/d54/f117 x:0 0 0 2024-09-16T09:45:38.419 INFO:tasks.workunit.client.1.smithi114.stdout:0/846: mknod d1f/d20/d48/d75/c12e 0 2024-09-16T09:45:38.419 INFO:tasks.workunit.client.1.smithi114.stdout:0/847: read d1f/d20/d48/f73 [2161808,6682] 0 2024-09-16T09:45:38.419 INFO:tasks.workunit.client.1.smithi114.stdout:7/977: dread d2/d9/fc [4194304,4194304] 0 2024-09-16T09:45:38.421 INFO:tasks.workunit.client.1.smithi114.stdout:5/887: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/def/c12f 0 2024-09-16T09:45:38.422 INFO:tasks.workunit.client.1.smithi114.stdout:9/897: unlink d3/da/d10/d23/d29/d87/fa4 0 2024-09-16T09:45:38.424 INFO:tasks.workunit.client.1.smithi114.stdout:4/897: dread d0/d26/d29/d2b/d58/f8a [0,4194304] 0 2024-09-16T09:45:38.424 INFO:tasks.workunit.client.1.smithi114.stdout:3/971: unlink dc/de/d18/d78/d5c/d5d/d50/f11b 0 2024-09-16T09:45:38.425 INFO:tasks.workunit.client.1.smithi114.stdout:3/972: truncate dc/de/d18/d78/d5c/da5/f11f 1218208 0 2024-09-16T09:45:38.425 INFO:tasks.workunit.client.1.smithi114.stdout:0/848: dread f15 [0,4194304] 0 2024-09-16T09:45:38.430 INFO:tasks.workunit.client.1.smithi114.stdout:8/818: rename d4/dae/d54/l7d to d4/dae/d9c/l118 0 2024-09-16T09:45:38.431 INFO:tasks.workunit.client.1.smithi114.stdout:5/888: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb 0 2024-09-16T09:45:38.433 INFO:tasks.workunit.client.1.smithi114.stdout:4/898: symlink d0/l133 0 2024-09-16T09:45:38.433 INFO:tasks.workunit.client.1.smithi114.stdout:4/899: dread - d0/d26/d3c/d3e/d5a/d5d/d70/fbf zero size 2024-09-16T09:45:38.434 INFO:tasks.workunit.client.1.smithi114.stdout:3/973: dread dc/d38/f9c [0,4194304] 0 2024-09-16T09:45:38.434 INFO:tasks.workunit.client.1.smithi114.stdout:3/974: fdatasync dc/de/d17/d2d/d41/d11e/d4e/f67 0 2024-09-16T09:45:38.434 INFO:tasks.workunit.client.1.smithi114.stdout:0/849: rmdir d1f/ddf/df5 39 2024-09-16T09:45:38.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:38 smithi114 ceph-mon[35635]: pgmap v242: 65 pgs: 65 active+clean; 1.8 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 178 MiB/s rd, 245 MiB/s wr, 477 op/s 2024-09-16T09:45:38.437 INFO:tasks.workunit.client.1.smithi114.stdout:7/978: rename d2/d9/d2b/d2e/d22/d27/c41 to d2/d9/d2b/d2e/d93/d117/c146 0 2024-09-16T09:45:38.437 INFO:tasks.workunit.client.1.smithi114.stdout:7/979: stat d2/df/cbf 0 2024-09-16T09:45:38.438 INFO:tasks.workunit.client.1.smithi114.stdout:5/889: getdents d3/d24/d84/d7a/d43/d4c/d6d/d9e 0 2024-09-16T09:45:38.439 INFO:tasks.workunit.client.1.smithi114.stdout:4/900: mknod d0/d26/d3c/d3e/d5a/d5d/ddf/c134 0 2024-09-16T09:45:38.440 INFO:tasks.workunit.client.1.smithi114.stdout:3/975: rmdir dc/de/d17/d79/dfc 39 2024-09-16T09:45:38.441 INFO:tasks.workunit.client.1.smithi114.stdout:7/980: unlink d2/d9/d2b/dcc/cde 0 2024-09-16T09:45:38.443 INFO:tasks.workunit.client.1.smithi114.stdout:9/898: dread d3/da/d10/d23/f7e [4194304,4194304] 0 2024-09-16T09:45:38.443 INFO:tasks.workunit.client.1.smithi114.stdout:5/890: rmdir d3/d24/d84/d7a/d43/d4c 39 2024-09-16T09:45:38.445 INFO:tasks.workunit.client.1.smithi114.stdout:4/901: mknod d0/d26/d3c/d3e/d5a/d5d/c135 0 2024-09-16T09:45:38.447 INFO:tasks.workunit.client.1.smithi114.stdout:7/981: symlink d2/d9/d2b/d78/d99/ddd/dea/l147 0 2024-09-16T09:45:38.447 INFO:tasks.workunit.client.1.smithi114.stdout:8/819: dwrite d4/dae/d54/d104/f89 [0,4194304] 0 2024-09-16T09:45:38.447 INFO:tasks.workunit.client.1.smithi114.stdout:7/982: write d2/d9/d2b/d78/d99/ddd/def/f138 [931772,50696] 0 2024-09-16T09:45:38.447 INFO:tasks.workunit.client.1.smithi114.stdout:7/983: chown d2/d9/d2b/d2e/d77 130755837 1 2024-09-16T09:45:38.448 INFO:tasks.workunit.client.1.smithi114.stdout:5/891: creat d3/d24/f130 x:0 0 0 2024-09-16T09:45:38.448 INFO:tasks.workunit.client.1.smithi114.stdout:5/892: read d3/d24/d84/d7a/d43/f48 [11041293,4198] 0 2024-09-16T09:45:38.454 INFO:tasks.workunit.client.1.smithi114.stdout:5/893: mknod d3/d24/d84/dbc/c131 0 2024-09-16T09:45:38.455 INFO:tasks.workunit.client.1.smithi114.stdout:1/941: sync 2024-09-16T09:45:38.456 INFO:tasks.workunit.client.1.smithi114.stdout:5/894: symlink d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/l132 0 2024-09-16T09:45:38.457 INFO:tasks.workunit.client.1.smithi114.stdout:1/942: getdents d4/d2b/d2f 0 2024-09-16T09:45:38.459 INFO:tasks.workunit.client.1.smithi114.stdout:1/943: symlink d4/d2b/d2f/d3a/d9d/l145 0 2024-09-16T09:45:38.459 INFO:tasks.workunit.client.1.smithi114.stdout:1/944: write d4/d2b/d16/d47/d83/f8c [4245741,18891] 0 2024-09-16T09:45:38.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/945: mkdir d4/d2b/d16/d71/d72/d75/db4/dbb/d146 0 2024-09-16T09:45:38.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/946: getdents d4/d2b/d16/d71/d81/d129 0 2024-09-16T09:45:38.460 INFO:tasks.workunit.client.1.smithi114.stdout:1/947: write d4/d2b/d2f/d3a/d9d/d41/d42/f5a [4999275,121354] 0 2024-09-16T09:45:38.461 INFO:tasks.workunit.client.1.smithi114.stdout:1/948: creat d4/d2b/d16/d71/d72/d75/db4/f147 x:0 0 0 2024-09-16T09:45:38.463 INFO:tasks.workunit.client.1.smithi114.stdout:1/949: mkdir d4/d2b/d16/d71/de5/de6/d148 0 2024-09-16T09:45:38.464 INFO:tasks.workunit.client.1.smithi114.stdout:1/950: mknod d4/d2b/c149 0 2024-09-16T09:45:38.465 INFO:tasks.workunit.client.1.smithi114.stdout:5/895: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/fa3 [0,4194304] 0 2024-09-16T09:45:38.466 INFO:tasks.workunit.client.1.smithi114.stdout:1/951: mknod d4/d2b/d16/d71/c14a 0 2024-09-16T09:45:38.467 INFO:tasks.workunit.client.1.smithi114.stdout:5/896: write d3/d1f/d8c/fd3 [447033,54836] 0 2024-09-16T09:45:38.467 INFO:tasks.workunit.client.1.smithi114.stdout:5/897: dread - d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/f121 zero size 2024-09-16T09:45:38.467 INFO:tasks.workunit.client.1.smithi114.stdout:5/898: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/cf2 193033692 1 2024-09-16T09:45:38.467 INFO:tasks.workunit.client.1.smithi114.stdout:1/952: mkdir d4/d2b/d16/d71/d81/ddc/d14b 0 2024-09-16T09:45:38.469 INFO:tasks.workunit.client.1.smithi114.stdout:5/899: rename d3/d24/d84/d7a/d43/d4c/d92/f120 to d3/d24/d84/d7a/d43/d4c/d6d/d79/f133 0 2024-09-16T09:45:38.471 INFO:tasks.workunit.client.1.smithi114.stdout:1/953: dread d4/d2b/d16/d71/de5/f113 [0,4194304] 0 2024-09-16T09:45:38.482 INFO:tasks.workunit.client.1.smithi114.stdout:9/899: dwrite d3/da/d10/d23/d43/d82/f75 [4194304,4194304] 0 2024-09-16T09:45:38.482 INFO:tasks.workunit.client.1.smithi114.stdout:9/900: truncate d3/d7d/f10f 956555 0 2024-09-16T09:45:38.482 INFO:tasks.workunit.client.1.smithi114.stdout:9/901: write d3/da/d10/d23/d43/fa1 [179093,78566] 0 2024-09-16T09:45:38.482 INFO:tasks.workunit.client.1.smithi114.stdout:9/902: dread - d3/daa/def/ff2 zero size 2024-09-16T09:45:38.483 INFO:tasks.workunit.client.1.smithi114.stdout:8/820: dwrite d4/db/dd/f111 [0,4194304] 0 2024-09-16T09:45:38.483 INFO:tasks.workunit.client.1.smithi114.stdout:0/850: dwrite d1f/ddf/df5/ffc [0,4194304] 0 2024-09-16T09:45:38.483 INFO:tasks.workunit.client.1.smithi114.stdout:0/851: read d1f/d22/f49 [427772,119681] 0 2024-09-16T09:45:38.483 INFO:tasks.workunit.client.1.smithi114.stdout:4/902: dwrite d0/d26/d3c/d3e/d4b/fd6 [4194304,4194304] 0 2024-09-16T09:45:38.484 INFO:tasks.workunit.client.1.smithi114.stdout:3/976: dwrite dc/de/d17/d2d/d41/d11e/da7/f140 [0,4194304] 0 2024-09-16T09:45:38.484 INFO:tasks.workunit.client.1.smithi114.stdout:3/977: chown dc/de/d18/d78/d8d/fd3 5701 1 2024-09-16T09:45:38.485 INFO:tasks.workunit.client.1.smithi114.stdout:9/903: truncate d3/da/d10/d23/d43/f18 2687317 0 2024-09-16T09:45:38.487 INFO:tasks.workunit.client.1.smithi114.stdout:8/821: rename d4/db/d39/d3c/d86/f113 to d4/dc3/f119 0 2024-09-16T09:45:38.490 INFO:tasks.workunit.client.1.smithi114.stdout:9/904: rmdir d3/da/d10/d23/d29/d2c/d6b/d9d/ddc 39 2024-09-16T09:45:38.493 INFO:tasks.workunit.client.1.smithi114.stdout:8/822: symlink d4/db/d68/l11a 0 2024-09-16T09:45:38.493 INFO:tasks.workunit.client.1.smithi114.stdout:8/823: fdatasync d4/db/fd1 0 2024-09-16T09:45:38.493 INFO:tasks.workunit.client.1.smithi114.stdout:8/824: dread - d4/dae/d54/f117 zero size 2024-09-16T09:45:38.494 INFO:tasks.workunit.client.1.smithi114.stdout:8/825: creat d4/dae/d9c/f11b x:0 0 0 2024-09-16T09:45:38.494 INFO:tasks.workunit.client.1.smithi114.stdout:8/826: dread - d4/db/d39/d3c/d4e/d82/d72/fdf zero size 2024-09-16T09:45:38.494 INFO:tasks.workunit.client.1.smithi114.stdout:8/827: chown d4/d1f/db9 262820317 1 2024-09-16T09:45:38.519 INFO:tasks.workunit.client.1.smithi114.stdout:1/954: dwrite d4/d2b/f9 [0,4194304] 0 2024-09-16T09:45:38.520 INFO:tasks.workunit.client.1.smithi114.stdout:0/852: dwrite d1f/d22/d2e/d46/d7f/d8d/ff3 [0,4194304] 0 2024-09-16T09:45:38.520 INFO:tasks.workunit.client.1.smithi114.stdout:4/903: dwrite d0/d26/d3c/d74/ff8 [0,4194304] 0 2024-09-16T09:45:38.520 INFO:tasks.workunit.client.1.smithi114.stdout:8/828: dwrite d4/db/d3e/f4f [0,4194304] 0 2024-09-16T09:45:38.523 INFO:tasks.workunit.client.1.smithi114.stdout:0/853: creat d1f/d27/f12f x:0 0 0 2024-09-16T09:45:38.523 INFO:tasks.workunit.client.1.smithi114.stdout:0/854: fdatasync d1f/d20/f34 0 2024-09-16T09:45:38.526 INFO:tasks.workunit.client.1.smithi114.stdout:8/829: creat d4/db/d39/d94/f11c x:0 0 0 2024-09-16T09:45:38.527 INFO:tasks.workunit.client.1.smithi114.stdout:0/855: unlink f16 0 2024-09-16T09:45:38.529 INFO:tasks.workunit.client.1.smithi114.stdout:1/955: write d4/d2b/d16/d71/d72/d75/db4/f119 [2372688,63171] 0 2024-09-16T09:45:38.529 INFO:tasks.workunit.client.1.smithi114.stdout:0/856: mkdir d1f/d22/d118/d130 0 2024-09-16T09:45:38.531 INFO:tasks.workunit.client.1.smithi114.stdout:1/956: mknod d4/d2b/d2f/d3a/d9d/c14c 0 2024-09-16T09:45:38.536 INFO:tasks.workunit.client.1.smithi114.stdout:4/904: dwrite d0/d26/d3c/d3e/d5a/d5d/d70/d83/f99 [0,4194304] 0 2024-09-16T09:45:38.536 INFO:tasks.workunit.client.1.smithi114.stdout:8/830: dread d4/db/d3e/d71/d78/d8d/da9/ff3 [0,4194304] 0 2024-09-16T09:45:38.536 INFO:tasks.workunit.client.1.smithi114.stdout:8/831: write d4/db/d68/d30/f33 [520439,113272] 0 2024-09-16T09:45:38.541 INFO:tasks.workunit.client.1.smithi114.stdout:0/857: dread d1f/d27/d47/f64 [0,4194304] 0 2024-09-16T09:45:38.541 INFO:tasks.workunit.client.1.smithi114.stdout:4/905: rename d0/f103 to d0/d13/d56/f136 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:8/832: mknod d4/db/c11d 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:8/833: chown d4/l37 87 1 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:8/834: read d4/db/dd/fa8 [1251298,72858] 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:0/858: getdents d1f/ddf 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:0/859: chown d1f/d27 79 1 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:8/835: write d4/fc7 [241930,83368] 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:0/860: dread d1f/d27/d47/d56/d7e/ff9 [0,4194304] 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:4/906: link d0/l28 d0/d26/d3c/d3e/d4b/d46/df3/d124/l137 0 2024-09-16T09:45:38.545 INFO:tasks.workunit.client.1.smithi114.stdout:4/907: dread - d0/d26/d29/d2b/ff6 zero size 2024-09-16T09:45:38.547 INFO:tasks.workunit.client.1.smithi114.stdout:8/836: symlink d4/db/d3e/d71/d78/d8d/ddb/d109/l11e 0 2024-09-16T09:45:38.547 INFO:tasks.workunit.client.1.smithi114.stdout:8/837: write d4/db/d39/d3c/d4e/f66 [1942474,47975] 0 2024-09-16T09:45:38.550 INFO:tasks.workunit.client.1.smithi114.stdout:8/838: rmdir d4/db/d3e/d47/d101 0 2024-09-16T09:45:38.550 INFO:tasks.workunit.client.1.smithi114.stdout:8/839: read - d4/db/dd/fb2 zero size 2024-09-16T09:45:38.552 INFO:tasks.workunit.client.1.smithi114.stdout:8/840: creat d4/db/dd/de4/dea/f11f x:0 0 0 2024-09-16T09:45:38.553 INFO:tasks.workunit.client.1.smithi114.stdout:8/841: link d4/db/d68/l11a d4/dae/d54/l120 0 2024-09-16T09:45:38.553 INFO:tasks.workunit.client.1.smithi114.stdout:0/861: dread d1f/d22/d2e/d46/d7f/fd8 [0,4194304] 0 2024-09-16T09:45:38.556 INFO:tasks.workunit.client.1.smithi114.stdout:0/862: symlink d1f/d22/d2e/d46/d7f/d8d/dbb/l131 0 2024-09-16T09:45:38.556 INFO:tasks.workunit.client.1.smithi114.stdout:0/863: chown d1f/d20/lae 5 1 2024-09-16T09:45:38.558 INFO:tasks.workunit.client.1.smithi114.stdout:8/842: link d4/db/d39/d3c/d86/ca5 d4/dae/d54/db3/c121 0 2024-09-16T09:45:38.559 INFO:tasks.workunit.client.1.smithi114.stdout:4/908: dwrite d0/d26/f8b [0,4194304] 0 2024-09-16T09:45:38.560 INFO:tasks.workunit.client.1.smithi114.stdout:0/864: creat d1f/d22/d2e/d46/f132 x:0 0 0 2024-09-16T09:45:38.561 INFO:tasks.workunit.client.1.smithi114.stdout:8/843: unlink d4/db/d39/d3c/d4e/d82/d72/cd8 0 2024-09-16T09:45:38.561 INFO:tasks.workunit.client.1.smithi114.stdout:8/844: dread - d4/dae/d9c/fde zero size 2024-09-16T09:45:38.562 INFO:tasks.workunit.client.1.smithi114.stdout:0/865: creat d1f/d20/f133 x:0 0 0 2024-09-16T09:45:38.565 INFO:tasks.workunit.client.1.smithi114.stdout:0/866: dread d1f/d27/d47/d56/fe0 [0,4194304] 0 2024-09-16T09:45:38.565 INFO:tasks.workunit.client.1.smithi114.stdout:0/867: truncate d1f/d22/d2e/d46/f108 879038 0 2024-09-16T09:45:38.566 INFO:tasks.workunit.client.1.smithi114.stdout:8/845: truncate d4/db/d39/d3c/d4e/f66 1794084 0 2024-09-16T09:45:38.566 INFO:tasks.workunit.client.1.smithi114.stdout:8/846: stat d4/db/d3e/f7c 0 2024-09-16T09:45:38.566 INFO:tasks.workunit.client.1.smithi114.stdout:0/868: fsync d1f/d20/d48/f11f 0 2024-09-16T09:45:38.567 INFO:tasks.workunit.client.1.smithi114.stdout:8/847: truncate d4/db/d3e/d71/d78/d8d/da9/ff3 3702548 0 2024-09-16T09:45:38.568 INFO:tasks.workunit.client.1.smithi114.stdout:4/909: dread d0/d13/d25/fb7 [0,4194304] 0 2024-09-16T09:45:38.568 INFO:tasks.workunit.client.1.smithi114.stdout:0/869: truncate f1e 378320 0 2024-09-16T09:45:38.568 INFO:tasks.workunit.client.1.smithi114.stdout:0/870: chown d1f/d27/f11e 9989 1 2024-09-16T09:45:38.569 INFO:tasks.workunit.client.1.smithi114.stdout:8/848: creat d4/db/dd/da1/f122 x:0 0 0 2024-09-16T09:45:38.570 INFO:tasks.workunit.client.1.smithi114.stdout:4/910: truncate d0/f21 5895171 0 2024-09-16T09:45:38.571 INFO:tasks.workunit.client.1.smithi114.stdout:0/871: symlink d1f/d22/d2e/d46/d7f/d129/l134 0 2024-09-16T09:45:38.580 INFO:tasks.workunit.client.1.smithi114.stdout:0/872: dread f6 [0,4194304] 0 2024-09-16T09:45:38.581 INFO:tasks.workunit.client.1.smithi114.stdout:0/873: creat d1f/d20/f135 x:0 0 0 2024-09-16T09:45:38.583 INFO:tasks.workunit.client.1.smithi114.stdout:7/984: sync 2024-09-16T09:45:38.584 INFO:tasks.workunit.client.1.smithi114.stdout:7/985: dread d2/d9/d2b/d2e/d22/d66/db0/fc1 [0,4194304] 0 2024-09-16T09:45:38.587 INFO:tasks.workunit.client.1.smithi114.stdout:7/986: dread d2/d9/d2b/d78/fb6 [0,4194304] 0 2024-09-16T09:45:38.605 INFO:tasks.workunit.client.1.smithi114.stdout:7/987: dwrite d2/d9/d2b/d2e/d22/f130 [0,4194304] 0 2024-09-16T09:45:38.606 INFO:tasks.workunit.client.1.smithi114.stdout:7/988: truncate d2/d9/d2b/f61 7746030 0 2024-09-16T09:45:38.614 INFO:tasks.workunit.client.1.smithi114.stdout:7/989: dread d2/d9/d2b/d78/d99/f9b [0,4194304] 0 2024-09-16T09:45:38.635 INFO:tasks.workunit.client.1.smithi114.stdout:7/990: dwrite d2/d9/d2b/d2e/d22/d66/db0/fc1 [0,4194304] 0 2024-09-16T09:45:38.637 INFO:tasks.workunit.client.1.smithi114.stdout:7/991: mkdir d2/d9/d2b/d59/d13e/d148 0 2024-09-16T09:45:38.638 INFO:tasks.workunit.client.1.smithi114.stdout:7/992: symlink d2/d9/d2b/d2e/d22/d66/db0/l149 0 2024-09-16T09:45:38.639 INFO:tasks.workunit.client.1.smithi114.stdout:7/993: creat d2/d9/d2b/d78/f14a x:0 0 0 2024-09-16T09:45:38.640 INFO:tasks.workunit.client.1.smithi114.stdout:7/994: symlink d2/d9/d2b/d2e/d93/d117/d12e/l14b 0 2024-09-16T09:45:38.640 INFO:tasks.workunit.client.1.smithi114.stdout:9/905: sync 2024-09-16T09:45:38.640 INFO:tasks.workunit.client.1.smithi114.stdout:5/900: sync 2024-09-16T09:45:38.640 INFO:tasks.workunit.client.1.smithi114.stdout:3/978: sync 2024-09-16T09:45:38.640 INFO:tasks.workunit.client.1.smithi114.stdout:5/901: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f9a [821806,25676] 0 2024-09-16T09:45:38.640 INFO:tasks.workunit.client.1.smithi114.stdout:5/902: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/d12d/f123 [408932,94586] 0 2024-09-16T09:45:38.641 INFO:tasks.workunit.client.1.smithi114.stdout:7/995: mknod d2/d9/d2b/d2e/d22/d27/d64/dc0/c14c 0 2024-09-16T09:45:38.641 INFO:tasks.workunit.client.1.smithi114.stdout:7/996: fsync d2/d9/d2b/fb3 0 2024-09-16T09:45:38.641 INFO:tasks.workunit.client.1.smithi114.stdout:7/997: fsync d2/d9/d2b/d2e/d93/ffb 0 2024-09-16T09:45:38.642 INFO:tasks.workunit.client.1.smithi114.stdout:7/998: chown d2/d9/d2b/d2e/d93/d117/d12e/d132 477 1 2024-09-16T09:45:38.642 INFO:tasks.workunit.client.1.smithi114.stdout:7/999: chown d2/d9/d2b/d2e/d93/d117/d119/f11c 535239201 1 2024-09-16T09:45:38.642 INFO:tasks.workunit.client.1.smithi114.stdout:3/979: mknod dc/de/d18/dfe/db2/dd8/d11d/c14e 0 2024-09-16T09:45:38.642 INFO:tasks.workunit.client.1.smithi114.stdout:3/980: dread dc/de/d18/d78/d5c/d6e/fb3 [0,4194304] 0 2024-09-16T09:45:38.649 INFO:tasks.workunit.client.1.smithi114.stdout:9/906: dread d3/da/d10/d23/d29/ded/f123 [0,4194304] 0 2024-09-16T09:45:38.650 INFO:tasks.workunit.client.1.smithi114.stdout:9/907: symlink d3/da/d10/d23/d43/d1e/d4c/l13f 0 2024-09-16T09:45:38.653 INFO:tasks.workunit.client.1.smithi114.stdout:5/903: dwrite d3/d1f/ff7 [0,4194304] 0 2024-09-16T09:45:38.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/904: unlink d3/d24/d84/d7a/d43/d58/c85 0 2024-09-16T09:45:38.657 INFO:tasks.workunit.client.1.smithi114.stdout:5/905: truncate d3/f25 1132891 0 2024-09-16T09:45:38.658 INFO:tasks.workunit.client.1.smithi114.stdout:5/906: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/d12d/d134 0 2024-09-16T09:45:38.658 INFO:tasks.workunit.client.1.smithi114.stdout:5/907: fdatasync d3/d24/d84/d7a/d43/d4c/d92/f6f 0 2024-09-16T09:45:38.658 INFO:tasks.workunit.client.1.smithi114.stdout:5/908: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/f8b 40590890 1 2024-09-16T09:45:38.658 INFO:tasks.workunit.client.1.smithi114.stdout:9/908: dread d3/ff [0,4194304] 0 2024-09-16T09:45:38.658 INFO:tasks.workunit.client.1.smithi114.stdout:9/909: chown d3/da/d10/d23/d43/d1e/f114 202855 1 2024-09-16T09:45:38.659 INFO:tasks.workunit.client.1.smithi114.stdout:5/909: truncate d3/d24/d84/d7a/d43/d4c/d92/f6f 2572366 0 2024-09-16T09:45:38.659 INFO:tasks.workunit.client.1.smithi114.stdout:5/910: write d3/d24/d84/dbc/fd8 [992636,93784] 0 2024-09-16T09:45:38.659 INFO:tasks.workunit.client.1.smithi114.stdout:5/911: chown d3/d24/d84/d7a/d43/d4c/d6d/l10a 976 1 2024-09-16T09:45:38.660 INFO:tasks.workunit.client.1.smithi114.stdout:5/912: symlink d3/d24/d84/d7a/d43/d4c/d92/d78/l135 0 2024-09-16T09:45:38.661 INFO:tasks.workunit.client.1.smithi114.stdout:9/910: mkdir d3/da/d10/d23/d29/d87/d140 0 2024-09-16T09:45:38.661 INFO:tasks.workunit.client.1.smithi114.stdout:9/911: chown d3/da/d10/d23/d29/d2c/d6b/f56 140678953 1 2024-09-16T09:45:38.661 INFO:tasks.workunit.client.1.smithi114.stdout:5/913: dread d3/d24/d84/d7a/d43/f51 [4194304,4194304] 0 2024-09-16T09:45:38.661 INFO:tasks.workunit.client.1.smithi114.stdout:5/914: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d5a 0 2024-09-16T09:45:38.661 INFO:tasks.workunit.client.1.smithi114.stdout:5/915: rmdir d3/d24/d84 39 2024-09-16T09:45:38.664 INFO:tasks.workunit.client.1.smithi114.stdout:5/916: mkdir d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/d98/d136 0 2024-09-16T09:45:38.669 INFO:tasks.workunit.client.1.smithi114.stdout:9/912: dread d3/da/d10/d23/d29/f4b [0,4194304] 0 2024-09-16T09:45:38.669 INFO:tasks.workunit.client.1.smithi114.stdout:9/913: write d3/ff [5190040,57393] 0 2024-09-16T09:45:38.669 INFO:tasks.workunit.client.1.smithi114.stdout:9/914: chown d3/da/d10/d23/d29/ded/fd7 139271493 1 2024-09-16T09:45:38.672 INFO:tasks.workunit.client.1.smithi114.stdout:9/915: creat d3/da/d10/d23/f141 x:0 0 0 2024-09-16T09:45:38.700 INFO:tasks.workunit.client.1.smithi114.stdout:5/917: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d9e/fb0 [0,4194304] 0 2024-09-16T09:45:38.702 INFO:tasks.workunit.client.1.smithi114.stdout:1/957: sync 2024-09-16T09:45:38.703 INFO:tasks.workunit.client.1.smithi114.stdout:1/958: chown d4/la9 0 1 2024-09-16T09:45:38.711 INFO:tasks.workunit.client.1.smithi114.stdout:1/959: write d4/d2b/f1e [332535,20887] 0 2024-09-16T09:45:38.711 INFO:tasks.workunit.client.1.smithi114.stdout:1/960: write d4/d2b/d16/d47/d83/f97 [416242,127251] 0 2024-09-16T09:45:38.713 INFO:tasks.workunit.client.1.smithi114.stdout:5/918: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/f8b [0,4194304] 0 2024-09-16T09:45:38.713 INFO:tasks.workunit.client.1.smithi114.stdout:5/919: write d3/d24/d84/d7a/d43/d4c/d6d/fe7 [603217,95867] 0 2024-09-16T09:45:38.720 INFO:tasks.workunit.client.1.smithi114.stdout:1/961: write d4/d2b/d2f/d3a/f10a [2973427,69422] 0 2024-09-16T09:45:38.720 INFO:tasks.workunit.client.1.smithi114.stdout:1/962: read d4/d2b/d16/f84 [2386198,70460] 0 2024-09-16T09:45:38.720 INFO:tasks.workunit.client.1.smithi114.stdout:1/963: chown d4/c6 2557 1 2024-09-16T09:45:38.723 INFO:tasks.workunit.client.1.smithi114.stdout:5/920: dread d3/d24/d7d/d96/f110 [0,4194304] 0 2024-09-16T09:45:38.726 INFO:tasks.workunit.client.1.smithi114.stdout:5/921: write d3/d24/d84/dbc/fe6 [2290909,125904] 0 2024-09-16T09:45:38.727 INFO:tasks.workunit.client.1.smithi114.stdout:5/922: unlink d3/d24/d84/f4f 0 2024-09-16T09:45:38.728 INFO:tasks.workunit.client.1.smithi114.stdout:5/923: creat d3/d24/d84/dbc/f137 x:0 0 0 2024-09-16T09:45:38.729 INFO:tasks.workunit.client.1.smithi114.stdout:1/964: dread d4/d2b/d16/d71/f7b [0,4194304] 0 2024-09-16T09:45:38.729 INFO:tasks.workunit.client.1.smithi114.stdout:1/965: truncate d4/d2b/d2f/d3a/f100 337304 0 2024-09-16T09:45:38.729 INFO:tasks.workunit.client.1.smithi114.stdout:5/924: creat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/dc6/f138 x:0 0 0 2024-09-16T09:45:38.730 INFO:tasks.workunit.client.1.smithi114.stdout:5/925: link d3/d24/d84/d7a/d43/d4c/d92/f6f d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d10b/f139 0 2024-09-16T09:45:38.731 INFO:tasks.workunit.client.1.smithi114.stdout:5/926: unlink d3/d24/d84/d7a/d43/d4c/d92/l11b 0 2024-09-16T09:45:38.732 INFO:tasks.workunit.client.1.smithi114.stdout:5/927: mkdir d3/d24/d84/d7a/d13a 0 2024-09-16T09:45:38.736 INFO:tasks.workunit.client.1.smithi114.stdout:5/928: dread d3/d24/d84/db9/f115 [0,4194304] 0 2024-09-16T09:45:38.737 INFO:tasks.workunit.client.1.smithi114.stdout:1/966: write d4/d2b/d29/f49 [1656700,95300] 0 2024-09-16T09:45:38.737 INFO:tasks.workunit.client.1.smithi114.stdout:5/929: link d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f55 d3/d24/d84/d7a/d43/f13b 0 2024-09-16T09:45:38.737 INFO:tasks.workunit.client.1.smithi114.stdout:5/930: fsync d3/d24/d84/d7a/d43/d4c/d92/d78/f109 0 2024-09-16T09:45:38.739 INFO:tasks.workunit.client.1.smithi114.stdout:1/967: creat d4/d2b/d16/d71/d81/ddc/d14b/f14d x:0 0 0 2024-09-16T09:45:38.739 INFO:tasks.workunit.client.1.smithi114.stdout:1/968: write d4/d2b/d2f/d3a/dc5/fe9 [778353,49065] 0 2024-09-16T09:45:38.741 INFO:tasks.workunit.client.1.smithi114.stdout:1/969: symlink d4/d2b/d2f/d3a/d9d/d41/d42/d58/l14e 0 2024-09-16T09:45:38.743 INFO:tasks.workunit.client.1.smithi114.stdout:1/970: creat d4/d2b/f14f x:0 0 0 2024-09-16T09:45:38.745 INFO:tasks.workunit.client.1.smithi114.stdout:1/971: mkdir d4/d2b/d16/d47/d150 0 2024-09-16T09:45:38.745 INFO:tasks.workunit.client.1.smithi114.stdout:1/972: write d4/d2b/d16/d71/d72/d75/db4/dbb/f103 [1193770,54162] 0 2024-09-16T09:45:38.745 INFO:tasks.workunit.client.1.smithi114.stdout:1/973: truncate d4/d2b/f11e 1597668 0 2024-09-16T09:45:38.746 INFO:tasks.workunit.client.1.smithi114.stdout:1/974: truncate d4/d2b/d16/d47/da7/ff9 240605 0 2024-09-16T09:45:38.746 INFO:tasks.workunit.client.1.smithi114.stdout:1/975: read - d4/d2b/d16/d71/d72/f115 zero size 2024-09-16T09:45:38.747 INFO:tasks.workunit.client.1.smithi114.stdout:1/976: creat d4/d2b/d16/d71/d81/d129/f151 x:0 0 0 2024-09-16T09:45:38.762 INFO:tasks.workunit.client.1.smithi114.stdout:5/931: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/fb6 [0,4194304] 0 2024-09-16T09:45:38.767 INFO:tasks.workunit.client.1.smithi114.stdout:1/977: dwrite d4/d2b/d16/d71/d72/d75/f77 [0,4194304] 0 2024-09-16T09:45:38.771 INFO:tasks.workunit.client.1.smithi114.stdout:8/849: sync 2024-09-16T09:45:38.771 INFO:tasks.workunit.client.1.smithi114.stdout:4/911: sync 2024-09-16T09:45:38.771 INFO:tasks.workunit.client.1.smithi114.stdout:8/850: truncate d4/db/d39/f103 335367 0 2024-09-16T09:45:38.772 INFO:tasks.workunit.client.1.smithi114.stdout:8/851: chown d4/db/d3e/f7f 149 1 2024-09-16T09:45:38.772 INFO:tasks.workunit.client.1.smithi114.stdout:8/852: chown d4/db/d3e/d71/f10b 5579738 1 2024-09-16T09:45:38.772 INFO:tasks.workunit.client.1.smithi114.stdout:5/932: write d3/f5 [3010405,51440] 0 2024-09-16T09:45:38.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/912: truncate d0/d26/d40/d75/d7f/d87/f8d 3748745 0 2024-09-16T09:45:38.773 INFO:tasks.workunit.client.1.smithi114.stdout:8/853: symlink d4/db/d39/d3c/l123 0 2024-09-16T09:45:38.773 INFO:tasks.workunit.client.1.smithi114.stdout:4/913: symlink d0/d26/d3c/d3e/d5a/d5d/ddf/l138 0 2024-09-16T09:45:38.774 INFO:tasks.workunit.client.1.smithi114.stdout:3/981: sync 2024-09-16T09:45:38.774 INFO:tasks.workunit.client.1.smithi114.stdout:0/874: sync 2024-09-16T09:45:38.775 INFO:tasks.workunit.client.1.smithi114.stdout:9/916: sync 2024-09-16T09:45:38.775 INFO:tasks.workunit.client.1.smithi114.stdout:4/914: getdents d0/d26/d3c/d3e/d5a/d5d/d70 0 2024-09-16T09:45:38.776 INFO:tasks.workunit.client.1.smithi114.stdout:3/982: write dc/de/d1f/f29 [779343,112668] 0 2024-09-16T09:45:38.777 INFO:tasks.workunit.client.1.smithi114.stdout:3/983: mkdir dc/de/d18/d117/d14f 0 2024-09-16T09:45:38.779 INFO:tasks.workunit.client.1.smithi114.stdout:3/984: rename dc/d38/d3f/f129 to dc/d38/d3f/df9/f150 0 2024-09-16T09:45:38.779 INFO:tasks.workunit.client.1.smithi114.stdout:3/985: write dc/de/d17/d2d/d41/f6f [624563,1372] 0 2024-09-16T09:45:38.779 INFO:tasks.workunit.client.1.smithi114.stdout:3/986: chown dc/de/d18/d78/d5c/ce6 76742 1 2024-09-16T09:45:38.779 INFO:tasks.workunit.client.1.smithi114.stdout:5/933: dread d3/d1f/f127 [0,4194304] 0 2024-09-16T09:45:38.780 INFO:tasks.workunit.client.1.smithi114.stdout:3/987: unlink dc/de/d18/d78/d5c/d6e/dc1/fc3 0 2024-09-16T09:45:38.786 INFO:tasks.workunit.client.1.smithi114.stdout:3/988: dread dc/de/f34 [0,4194304] 0 2024-09-16T09:45:38.786 INFO:tasks.workunit.client.1.smithi114.stdout:0/875: dread d1f/d27/d47/f60 [0,4194304] 0 2024-09-16T09:45:38.787 INFO:tasks.workunit.client.1.smithi114.stdout:3/989: truncate dc/de/d18/d78/d5c/f146 2601018 0 2024-09-16T09:45:38.788 INFO:tasks.workunit.client.1.smithi114.stdout:0/876: link d1f/d27/d55/f71 d1f/d27/f136 0 2024-09-16T09:45:38.789 INFO:tasks.workunit.client.1.smithi114.stdout:8/854: write d4/db/d91/fab [1776152,116956] 0 2024-09-16T09:45:38.790 INFO:tasks.workunit.client.1.smithi114.stdout:1/978: dwrite d4/d2b/d2f/d3a/d9d/ffc [0,4194304] 0 2024-09-16T09:45:38.791 INFO:tasks.workunit.client.1.smithi114.stdout:4/915: write d0/d26/f90 [544376,99346] 0 2024-09-16T09:45:38.791 INFO:tasks.workunit.client.1.smithi114.stdout:3/990: creat dc/de/d18/d78/f151 x:0 0 0 2024-09-16T09:45:38.795 INFO:tasks.workunit.client.1.smithi114.stdout:4/916: creat d0/d26/d29/f139 x:0 0 0 2024-09-16T09:45:38.795 INFO:tasks.workunit.client.1.smithi114.stdout:3/991: truncate dc/de/d18/f30 255588 0 2024-09-16T09:45:38.795 INFO:tasks.workunit.client.1.smithi114.stdout:3/992: rename dc to dc/de/d18/d78/d5c/d152 22 2024-09-16T09:45:38.796 INFO:tasks.workunit.client.1.smithi114.stdout:4/917: rmdir d0/d53 39 2024-09-16T09:45:38.798 INFO:tasks.workunit.client.1.smithi114.stdout:3/993: mknod dc/de/d17/d2d/d41/d11e/da7/c153 0 2024-09-16T09:45:38.798 INFO:tasks.workunit.client.1.smithi114.stdout:5/934: dread d3/d24/d84/d7a/d43/d4c/f7b [0,4194304] 0 2024-09-16T09:45:38.798 INFO:tasks.workunit.client.1.smithi114.stdout:1/979: read d4/f6f [21809,115601] 0 2024-09-16T09:45:38.799 INFO:tasks.workunit.client.1.smithi114.stdout:4/918: symlink d0/d26/d3c/d3e/d4b/d46/l13a 0 2024-09-16T09:45:38.800 INFO:tasks.workunit.client.1.smithi114.stdout:8/855: dread d4/d1f/f42 [0,4194304] 0 2024-09-16T09:45:38.800 INFO:tasks.workunit.client.1.smithi114.stdout:5/935: unlink d3/d24/d7d/d96/lec 0 2024-09-16T09:45:38.801 INFO:tasks.workunit.client.1.smithi114.stdout:8/856: creat d4/db/d3e/d71/d78/df0/f124 x:0 0 0 2024-09-16T09:45:38.803 INFO:tasks.workunit.client.1.smithi114.stdout:5/936: mkdir d3/d24/d7d/da6/dfc/d13c 0 2024-09-16T09:45:38.803 INFO:tasks.workunit.client.1.smithi114.stdout:8/857: truncate d4/dae/d9c/fca 2912313 0 2024-09-16T09:45:38.804 INFO:tasks.workunit.client.1.smithi114.stdout:8/858: readlink d4/db/d68/l26 0 2024-09-16T09:45:38.804 INFO:tasks.workunit.client.1.smithi114.stdout:8/859: chown d4/db/d3e/f7c 1408222557 1 2024-09-16T09:45:38.805 INFO:tasks.workunit.client.1.smithi114.stdout:9/917: dwrite d3/da/d10/d23/d29/d2c/d45/ffa [0,4194304] 0 2024-09-16T09:45:38.806 INFO:tasks.workunit.client.1.smithi114.stdout:0/877: dwrite d1f/d22/d2e/d46/d7f/d8d/fc5 [4194304,4194304] 0 2024-09-16T09:45:38.807 INFO:tasks.workunit.client.1.smithi114.stdout:9/918: mkdir d3/da/d10/d23/d29/d87/d140/d142 0 2024-09-16T09:45:38.808 INFO:tasks.workunit.client.1.smithi114.stdout:9/919: dread d3/d7d/f10f [0,4194304] 0 2024-09-16T09:45:38.809 INFO:tasks.workunit.client.1.smithi114.stdout:9/920: fdatasync d3/da/d10/d23/d29/d2c/d45/f8a 0 2024-09-16T09:45:38.809 INFO:tasks.workunit.client.1.smithi114.stdout:8/860: dread d4/d6d/f8e [0,4194304] 0 2024-09-16T09:45:38.809 INFO:tasks.workunit.client.1.smithi114.stdout:8/861: truncate d4/db/d3e/d71/d78/d7a/fc6 424751 0 2024-09-16T09:45:38.810 INFO:tasks.workunit.client.1.smithi114.stdout:8/862: fdatasync d4/db/dd/fb2 0 2024-09-16T09:45:38.810 INFO:tasks.workunit.client.1.smithi114.stdout:8/863: write d4/db/dd/fa8 [1856866,53372] 0 2024-09-16T09:45:38.810 INFO:tasks.workunit.client.1.smithi114.stdout:0/878: mkdir d1f/d22/d2e/d46/d137 0 2024-09-16T09:45:38.812 INFO:tasks.workunit.client.1.smithi114.stdout:8/864: mknod d4/dae/d54/c125 0 2024-09-16T09:45:38.813 INFO:tasks.workunit.client.1.smithi114.stdout:8/865: write d4/dae/d54/d104/dc1/dfa/f100 [704721,35415] 0 2024-09-16T09:45:38.815 INFO:tasks.workunit.client.1.smithi114.stdout:0/879: creat d1f/d22/d2e/d46/f138 x:0 0 0 2024-09-16T09:45:38.815 INFO:tasks.workunit.client.1.smithi114.stdout:0/880: read - d1f/d22/d2e/d46/d7f/d8d/f101 zero size 2024-09-16T09:45:38.816 INFO:tasks.workunit.client.1.smithi114.stdout:4/919: dread d0/d26/d3c/d3e/d4b/d46/f80 [4194304,4194304] 0 2024-09-16T09:45:38.818 INFO:tasks.workunit.client.1.smithi114.stdout:8/866: rename d4/db/d39/d3c/f95 to d4/db/d39/d3c/d4e/d82/d72/d59/da0/f126 0 2024-09-16T09:45:38.818 INFO:tasks.workunit.client.1.smithi114.stdout:5/937: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/fbe [0,4194304] 0 2024-09-16T09:45:38.819 INFO:tasks.workunit.client.1.smithi114.stdout:0/881: rmdir d1f/d20 39 2024-09-16T09:45:38.820 INFO:tasks.workunit.client.1.smithi114.stdout:3/994: dwrite dc/de/d18/d78/d5c/d5d/d50/fd0 [4194304,4194304] 0 2024-09-16T09:45:38.820 INFO:tasks.workunit.client.1.smithi114.stdout:4/920: symlink d0/d26/df1/l13b 0 2024-09-16T09:45:38.820 INFO:tasks.workunit.client.1.smithi114.stdout:4/921: dread - d0/d26/d29/d2b/d58/fc9 zero size 2024-09-16T09:45:38.824 INFO:tasks.workunit.client.1.smithi114.stdout:0/882: symlink d1f/d2d/d7a/ddd/l139 0 2024-09-16T09:45:38.824 INFO:tasks.workunit.client.1.smithi114.stdout:0/883: fsync d1f/d22/d2e/d46/d7f/d8d/f95 0 2024-09-16T09:45:38.824 INFO:tasks.workunit.client.1.smithi114.stdout:0/884: chown d1f/d22/d2e/f90 335456241 1 2024-09-16T09:45:38.825 INFO:tasks.workunit.client.1.smithi114.stdout:3/995: truncate dc/de/d17/d2d/db4/f128 48952 0 2024-09-16T09:45:38.825 INFO:tasks.workunit.client.1.smithi114.stdout:9/921: dwrite d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d/f110 [0,4194304] 0 2024-09-16T09:45:38.826 INFO:tasks.workunit.client.1.smithi114.stdout:4/922: creat d0/d26/d3c/d129/f13c x:0 0 0 2024-09-16T09:45:38.829 INFO:tasks.workunit.client.1.smithi114.stdout:0/885: getdents d1f/d2d 0 2024-09-16T09:45:38.829 INFO:tasks.workunit.client.1.smithi114.stdout:0/886: readlink d1f/d27/d47/d56/l59 0 2024-09-16T09:45:38.829 INFO:tasks.workunit.client.1.smithi114.stdout:0/887: chown d1f/d27/d47/d56 18352049 1 2024-09-16T09:45:38.829 INFO:tasks.workunit.client.1.smithi114.stdout:0/888: dread - d1f/d22/d2e/d46/f138 zero size 2024-09-16T09:45:38.829 INFO:tasks.workunit.client.1.smithi114.stdout:0/889: chown d1f/d22/l43 267406698 1 2024-09-16T09:45:38.833 INFO:tasks.workunit.client.1.smithi114.stdout:9/922: creat d3/daa/def/d133/f143 x:0 0 0 2024-09-16T09:45:38.835 INFO:tasks.workunit.client.1.smithi114.stdout:4/923: mknod d0/d26/d29/c13d 0 2024-09-16T09:45:38.836 INFO:tasks.workunit.client.1.smithi114.stdout:0/890: mkdir d1f/d27/d55/d13a 0 2024-09-16T09:45:38.838 INFO:tasks.workunit.client.1.smithi114.stdout:4/924: getdents d0/d26/d3c/d3e/d5a/d5d/d70/d114 0 2024-09-16T09:45:38.838 INFO:tasks.workunit.client.1.smithi114.stdout:4/925: readlink d0/d26/d3c/d3e/d5a/d5d/ddf/l10f 0 2024-09-16T09:45:38.838 INFO:tasks.workunit.client.1.smithi114.stdout:4/926: chown d0/d26/d3c/d45 1 1 2024-09-16T09:45:38.838 INFO:tasks.workunit.client.1.smithi114.stdout:4/927: getdents d0/d26/d3c/d3e/d5a/d5d/d70/d114 0 2024-09-16T09:45:38.839 INFO:tasks.workunit.client.1.smithi114.stdout:4/928: mknod d0/d26/d3c/d123/c13e 0 2024-09-16T09:45:38.839 INFO:tasks.workunit.client.1.smithi114.stdout:0/891: dread d1f/d27/d47/d56/d7e/fe1 [0,4194304] 0 2024-09-16T09:45:38.841 INFO:tasks.workunit.client.1.smithi114.stdout:4/929: mknod d0/d26/d3c/d3e/d5a/d5d/d70/d83/c13f 0 2024-09-16T09:45:38.843 INFO:tasks.workunit.client.1.smithi114.stdout:4/930: rmdir d0/d26/d3c/d74/d9c 39 2024-09-16T09:45:38.843 INFO:tasks.workunit.client.1.smithi114.stdout:5/938: dwrite d3/d24/d84/d7a/d43/d4c/f10d [0,4194304] 0 2024-09-16T09:45:38.845 INFO:tasks.workunit.client.1.smithi114.stdout:4/931: rename d0/d26/d3c/d3e/d4b/d46/df3/lfa to d0/d26/d2e/d131/l140 0 2024-09-16T09:45:38.848 INFO:tasks.workunit.client.1.smithi114.stdout:5/939: mknod d3/d24/d7d/d96/c13d 0 2024-09-16T09:45:38.851 INFO:tasks.workunit.client.1.smithi114.stdout:5/940: mkdir d3/d24/d84/d7a/d43/d4c/db2/db5/d13e 0 2024-09-16T09:45:38.851 INFO:tasks.workunit.client.1.smithi114.stdout:5/941: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/fa3 [1074027,37825] 0 2024-09-16T09:45:38.851 INFO:tasks.workunit.client.1.smithi114.stdout:5/942: mknod d3/d24/d84/d7a/d43/d58/c13f 0 2024-09-16T09:45:38.851 INFO:tasks.workunit.client.1.smithi114.stdout:5/943: readlink d3/l6c 0 2024-09-16T09:45:38.853 INFO:tasks.workunit.client.1.smithi114.stdout:5/944: link d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/l119 d3/d24/d84/d12a/l140 0 2024-09-16T09:45:38.856 INFO:tasks.workunit.client.1.smithi114.stdout:4/932: write d0/d13/d25/f9b [1773959,39477] 0 2024-09-16T09:45:38.856 INFO:tasks.workunit.client.1.smithi114.stdout:8/867: dwrite d4/dae/d54/d104/f77 [0,4194304] 0 2024-09-16T09:45:38.856 INFO:tasks.workunit.client.1.smithi114.stdout:8/868: truncate d4/db/fd1 791602 0 2024-09-16T09:45:38.856 INFO:tasks.workunit.client.1.smithi114.stdout:8/869: chown d4/db/d39/d3c/d86/ca5 46 1 2024-09-16T09:45:38.857 INFO:tasks.workunit.client.1.smithi114.stdout:4/933: creat d0/d26/d40/da6/f141 x:0 0 0 2024-09-16T09:45:38.857 INFO:tasks.workunit.client.1.smithi114.stdout:4/934: fsync d0/d26/d29/d2b/ff6 0 2024-09-16T09:45:38.858 INFO:tasks.workunit.client.1.smithi114.stdout:8/870: unlink d4/dc3/f119 0 2024-09-16T09:45:38.859 INFO:tasks.workunit.client.1.smithi114.stdout:4/935: creat d0/d26/d3c/d3e/d5a/d5d/d70/d83/f142 x:0 0 0 2024-09-16T09:45:38.861 INFO:tasks.workunit.client.1.smithi114.stdout:4/936: creat d0/d53/d11a/f143 x:0 0 0 2024-09-16T09:45:38.861 INFO:tasks.workunit.client.1.smithi114.stdout:5/945: dread d3/d1f/ff7 [0,4194304] 0 2024-09-16T09:45:38.862 INFO:tasks.workunit.client.1.smithi114.stdout:4/937: mknod d0/d26/d3c/d3e/d4b/d46/db3/c144 0 2024-09-16T09:45:38.862 INFO:tasks.workunit.client.1.smithi114.stdout:9/923: dwrite d3/da/d10/d23/d43/d1e/d25/d88/f9e [0,4194304] 0 2024-09-16T09:45:38.863 INFO:tasks.workunit.client.1.smithi114.stdout:0/892: dwrite d1f/d27/d55/dce/fed [0,4194304] 0 2024-09-16T09:45:38.863 INFO:tasks.workunit.client.1.smithi114.stdout:0/893: readlink d1f/d27/d47/d56/l63 0 2024-09-16T09:45:38.864 INFO:tasks.workunit.client.1.smithi114.stdout:4/938: unlink d0/d26/d3c/d3e/d4b/fba 0 2024-09-16T09:45:38.865 INFO:tasks.workunit.client.1.smithi114.stdout:9/924: mkdir d3/da/d10/d23/d29/d3f/d85/d144 0 2024-09-16T09:45:38.867 INFO:tasks.workunit.client.1.smithi114.stdout:0/894: fsync d1f/d20/d48/f91 0 2024-09-16T09:45:38.867 INFO:tasks.workunit.client.1.smithi114.stdout:0/895: chown d1f/ddf/c100 234538 1 2024-09-16T09:45:38.867 INFO:tasks.workunit.client.1.smithi114.stdout:0/896: write d1f/d27/d55/fb4 [1496931,111327] 0 2024-09-16T09:45:38.867 INFO:tasks.workunit.client.1.smithi114.stdout:0/897: fsync d1f/d20/fad 0 2024-09-16T09:45:38.867 INFO:tasks.workunit.client.1.smithi114.stdout:0/898: stat d1f/d9e/fc1 0 2024-09-16T09:45:38.867 INFO:tasks.workunit.client.1.smithi114.stdout:8/871: dread d4/db/d3e/d71/f3d [0,4194304] 0 2024-09-16T09:45:38.868 INFO:tasks.workunit.client.1.smithi114.stdout:4/939: rmdir d0/d26/d29/d9f/da0 39 2024-09-16T09:45:38.868 INFO:tasks.workunit.client.1.smithi114.stdout:4/940: stat d0/d26/d3c/d45/f67 0 2024-09-16T09:45:38.869 INFO:tasks.workunit.client.1.smithi114.stdout:9/925: mknod d3/da/d10/d23/d29/d2c/d6b/c145 0 2024-09-16T09:45:38.870 INFO:tasks.workunit.client.1.smithi114.stdout:9/926: dread - d3/da/d10/d23/d29/d2c/d6b/fd2 zero size 2024-09-16T09:45:38.870 INFO:tasks.workunit.client.1.smithi114.stdout:9/927: chown d3/da/d10/d23/d29/ded 4 1 2024-09-16T09:45:38.870 INFO:tasks.workunit.client.1.smithi114.stdout:4/941: rmdir d0/d26/d3c/d3e/d5a/d5d/d70/d83 39 2024-09-16T09:45:38.872 INFO:tasks.workunit.client.1.smithi114.stdout:9/928: mkdir d3/da/d10/d23/d43/d1e/d25/d88/d146 0 2024-09-16T09:45:38.872 INFO:tasks.workunit.client.1.smithi114.stdout:4/942: creat d0/d26/d3c/d3e/d5a/d5d/ddf/f145 x:0 0 0 2024-09-16T09:45:38.877 INFO:tasks.workunit.client.1.smithi114.stdout:8/872: dread d4/db/d39/d3c/d4e/f92 [0,4194304] 0 2024-09-16T09:45:38.878 INFO:tasks.workunit.client.1.smithi114.stdout:8/873: read d4/f40 [2147242,13300] 0 2024-09-16T09:45:38.881 INFO:tasks.workunit.client.1.smithi114.stdout:9/929: dread d3/da/d10/d23/d29/d3f/d85/fbd [0,4194304] 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/899: dwrite d1f/d27/fa1 [0,4194304] 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/900: fsync d1f/d27/d47/f64 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/901: truncate d1f/d27/d55/f9a 7112810 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:0/902: mkdir d1f/d22/d2e/d46/d7f/df4/d13b 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:4/943: dwrite d0/d26/d3c/d3e/d5a/d5d/d70/d83/f142 [0,4194304] 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:8/874: dread d4/db/d3e/d47/f5e [0,4194304] 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:8/875: truncate d4/db/dd/fb2 957290 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:4/944: write d0/d26/d3c/d3e/d5a/d5d/f60 [70166,28064] 0 2024-09-16T09:45:38.932 INFO:tasks.workunit.client.1.smithi114.stdout:4/945: read d0/d26/d3c/d3e/d4b/d46/db3/fc5 [17846,86020] 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:8/876: rename d4/db/f4d to d4/db/d3e/d71/d78/d8d/ddb/d109/f127 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/980: sync 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/981: read d4/f108 [165300,50359] 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/982: truncate d4/d2b/f53 1396675 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/983: truncate d4/d2b/d16/d71/d72/fb5 4269131 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/984: creat d4/d2b/d2f/f152 x:0 0 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:1/985: mkdir d4/d2b/d16/d47/da7/d153 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:9/930: dwrite d3/da/d10/d23/d43/d1e/d10b/f111 [0,4194304] 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:9/931: stat d3/da/d10/d23/d29/l11a 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:4/946: dwrite d0/d13/f22 [4194304,4194304] 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:4/947: mknod d0/d26/d29/d2b/d58/c146 0 2024-09-16T09:45:38.933 INFO:tasks.workunit.client.1.smithi114.stdout:4/948: mkdir d0/d26/d3c/d123/d147 0 2024-09-16T09:45:38.934 INFO:tasks.workunit.client.1.smithi114.stdout:1/986: dwrite d4/d2b/d29/da0/db1/fd2 [0,4194304] 0 2024-09-16T09:45:38.934 INFO:tasks.workunit.client.1.smithi114.stdout:8/877: dwrite d4/db/d39/f103 [0,4194304] 0 2024-09-16T09:45:38.934 INFO:tasks.workunit.client.1.smithi114.stdout:4/949: dread d0/d26/d40/d75/fe8 [0,4194304] 0 2024-09-16T09:45:38.934 INFO:tasks.workunit.client.1.smithi114.stdout:9/932: dwrite d3/daa/f11b [0,4194304] 0 2024-09-16T09:45:38.941 INFO:tasks.workunit.client.1.smithi114.stdout:9/933: getdents d3/da 0 2024-09-16T09:45:38.943 INFO:tasks.workunit.client.1.smithi114.stdout:9/934: creat d3/da/d10/d23/d29/d2c/d45/f147 x:0 0 0 2024-09-16T09:45:38.949 INFO:tasks.workunit.client.1.smithi114.stdout:9/935: write d3/da/d10/d23/d29/d2c/d6b/db9/fc8 [3688043,16905] 0 2024-09-16T09:45:38.949 INFO:tasks.workunit.client.1.smithi114.stdout:9/936: dread - d3/da/d10/d23/d29/d2c/d45/f147 zero size 2024-09-16T09:45:38.949 INFO:tasks.workunit.client.1.smithi114.stdout:9/937: write d3/da/d10/f26 [1404917,37875] 0 2024-09-16T09:45:38.951 INFO:tasks.workunit.client.1.smithi114.stdout:9/938: creat d3/da/d10/d23/de9/d13c/f148 x:0 0 0 2024-09-16T09:45:38.952 INFO:tasks.workunit.client.1.smithi114.stdout:4/950: dread d0/d13/f6f [4194304,4194304] 0 2024-09-16T09:45:38.961 INFO:tasks.workunit.client.1.smithi114.stdout:8/878: dwrite d4/dae/d54/d104/f7e [0,4194304] 0 2024-09-16T09:45:38.965 INFO:tasks.workunit.client.1.smithi114.stdout:1/987: dwrite d4/d2b/d16/d71/d72/fa3 [0,4194304] 0 2024-09-16T09:45:38.970 INFO:tasks.workunit.client.1.smithi114.stdout:1/988: symlink d4/d2b/d16/d71/d72/d75/db4/dbb/d146/l154 0 2024-09-16T09:45:38.970 INFO:tasks.workunit.client.1.smithi114.stdout:1/989: fsync d4/fa4 0 2024-09-16T09:45:38.977 INFO:tasks.workunit.client.1.smithi114.stdout:3/996: sync 2024-09-16T09:45:38.977 INFO:tasks.workunit.client.1.smithi114.stdout:3/997: fsync dc/de/d17/d2d/db4/f1e 0 2024-09-16T09:45:38.979 INFO:tasks.workunit.client.1.smithi114.stdout:1/990: write d4/d2b/d16/f65 [1344369,104171] 0 2024-09-16T09:45:38.981 INFO:tasks.workunit.client.1.smithi114.stdout:1/991: unlink d4/d2b/d16/d47/da7/dd7/lde 0 2024-09-16T09:45:38.983 INFO:tasks.workunit.client.1.smithi114.stdout:3/998: dread dc/de/d1f/f80 [0,4194304] 0 2024-09-16T09:45:38.983 INFO:tasks.workunit.client.1.smithi114.stdout:3/999: chown dc/d38 29736929 1 2024-09-16T09:45:38.990 INFO:tasks.workunit.client.1.smithi114.stdout:4/951: dwrite d0/d26/d3c/d3e/d4b/d46/ff5 [0,4194304] 0 2024-09-16T09:45:38.990 INFO:tasks.workunit.client.1.smithi114.stdout:9/939: dwrite d3/da/d10/d23/d29/d2c/f35 [0,4194304] 0 2024-09-16T09:45:38.991 INFO:tasks.workunit.client.1.smithi114.stdout:4/952: chown d0/d26/d29/d2b/c3d 2 1 2024-09-16T09:45:38.991 INFO:tasks.workunit.client.1.smithi114.stdout:4/953: fsync d0/fd2 0 2024-09-16T09:45:38.991 INFO:tasks.workunit.client.1.smithi114.stdout:9/940: readlink d3/da/d10/d23/d43/d1e/d4c/l13f 0 2024-09-16T09:45:38.991 INFO:tasks.workunit.client.1.smithi114.stdout:8/879: dwrite d4/db/dd/f13 [0,4194304] 0 2024-09-16T09:45:38.992 INFO:tasks.workunit.client.1.smithi114.stdout:1/992: dread d4/d2b/d2f/f5d [0,4194304] 0 2024-09-16T09:45:38.992 INFO:tasks.workunit.client.1.smithi114.stdout:1/993: getdents d4/d2b/d16/d71/d72/d75/db4 0 2024-09-16T09:45:38.993 INFO:tasks.workunit.client.1.smithi114.stdout:1/994: mknod d4/d2b/d16/d71/de5/de6/d148/c155 0 2024-09-16T09:45:38.994 INFO:tasks.workunit.client.1.smithi114.stdout:1/995: symlink d4/d2b/d16/d71/de5/de6/d148/l156 0 2024-09-16T09:45:38.995 INFO:tasks.workunit.client.1.smithi114.stdout:1/996: mkdir d4/d2b/d16/d71/d72/d75/db4/dbb/d133/d157 0 2024-09-16T09:45:38.996 INFO:tasks.workunit.client.1.smithi114.stdout:1/997: link d4/f94 d4/d2b/d29/da0/db1/f158 0 2024-09-16T09:45:38.998 INFO:tasks.workunit.client.1.smithi114.stdout:5/946: sync 2024-09-16T09:45:38.998 INFO:tasks.workunit.client.1.smithi114.stdout:0/903: sync 2024-09-16T09:45:38.999 INFO:tasks.workunit.client.1.smithi114.stdout:8/880: dread d4/db/d39/d3c/d86/f8c [0,4194304] 0 2024-09-16T09:45:38.999 INFO:tasks.workunit.client.1.smithi114.stdout:5/947: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/def/c141 0 2024-09-16T09:45:38.999 INFO:tasks.workunit.client.1.smithi114.stdout:5/948: fsync d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f94 0 2024-09-16T09:45:39.000 INFO:tasks.workunit.client.1.smithi114.stdout:0/904: creat d1f/d22/d2e/d46/d137/f13c x:0 0 0 2024-09-16T09:45:39.000 INFO:tasks.workunit.client.1.smithi114.stdout:8/881: creat d4/db/d91/f128 x:0 0 0 2024-09-16T09:45:39.001 INFO:tasks.workunit.client.1.smithi114.stdout:4/954: dread d0/f85 [0,4194304] 0 2024-09-16T09:45:39.001 INFO:tasks.workunit.client.1.smithi114.stdout:4/955: fdatasync d0/d26/d3c/d3e/d5a/d5d/d70/d83/f109 0 2024-09-16T09:45:39.002 INFO:tasks.workunit.client.1.smithi114.stdout:0/905: dread d1f/d22/fb5 [0,4194304] 0 2024-09-16T09:45:39.002 INFO:tasks.workunit.client.1.smithi114.stdout:0/906: fsync d1f/d20/fc9 0 2024-09-16T09:45:39.002 INFO:tasks.workunit.client.1.smithi114.stdout:0/907: fsync d1f/d22/d2e/d46/d7f/fd8 0 2024-09-16T09:45:39.002 INFO:tasks.workunit.client.1.smithi114.stdout:0/908: chown d1f/d22/d2e/d46/d7f/d8d/ff3 1 1 2024-09-16T09:45:39.003 INFO:tasks.workunit.client.1.smithi114.stdout:4/956: creat d0/d26/d3c/d3e/d5a/f148 x:0 0 0 2024-09-16T09:45:39.004 INFO:tasks.workunit.client.1.smithi114.stdout:4/957: symlink d0/d26/d2e/dc0/l149 0 2024-09-16T09:45:39.005 INFO:tasks.workunit.client.1.smithi114.stdout:9/941: read d3/da/d10/d23/d43/f33 [3802937,100677] 0 2024-09-16T09:45:39.007 INFO:tasks.workunit.client.1.smithi114.stdout:4/958: creat d0/d53/d11a/f14a x:0 0 0 2024-09-16T09:45:39.008 INFO:tasks.workunit.client.1.smithi114.stdout:9/942: creat d3/da/d10/d23/d29/d87/d140/d142/f149 x:0 0 0 2024-09-16T09:45:39.009 INFO:tasks.workunit.client.1.smithi114.stdout:4/959: mkdir d0/d53/d14b 0 2024-09-16T09:45:39.010 INFO:tasks.workunit.client.1.smithi114.stdout:4/960: symlink d0/d26/d3c/d3e/d5a/l14c 0 2024-09-16T09:45:39.011 INFO:tasks.workunit.client.1.smithi114.stdout:0/909: dread d1f/d20/d48/f73 [0,4194304] 0 2024-09-16T09:45:39.011 INFO:tasks.workunit.client.1.smithi114.stdout:4/961: creat d0/d26/d29/d2b/d58/daf/f14d x:0 0 0 2024-09-16T09:45:39.012 INFO:tasks.workunit.client.1.smithi114.stdout:4/962: mknod d0/d26/d40/d75/d7f/de1/c14e 0 2024-09-16T09:45:39.013 INFO:tasks.workunit.client.1.smithi114.stdout:4/963: creat d0/d26/d3c/d3e/d5a/d5d/d70/d114/f14f x:0 0 0 2024-09-16T09:45:39.014 INFO:tasks.workunit.client.1.smithi114.stdout:4/964: rmdir d0/d26/d3c/d129 39 2024-09-16T09:45:39.014 INFO:tasks.workunit.client.1.smithi114.stdout:1/998: dread d4/d2b/f14 [0,4194304] 0 2024-09-16T09:45:39.015 INFO:tasks.workunit.client.1.smithi114.stdout:1/999: unlink d4/d2b/d2f/d3a/fe2 0 2024-09-16T09:45:39.015 INFO:tasks.workunit.client.1.smithi114.stdout:8/882: dread d4/db/d68/d30/f41 [0,4194304] 0 2024-09-16T09:45:39.016 INFO:tasks.workunit.client.1.smithi114.stdout:0/910: write d1f/d27/d47/d56/fef [334006,34664] 0 2024-09-16T09:45:39.016 INFO:tasks.workunit.client.1.smithi114.stdout:0/911: stat d1f/d20/l5b 0 2024-09-16T09:45:39.016 INFO:tasks.workunit.client.1.smithi114.stdout:9/943: write d3/da/d10/d23/d29/d2c/f35 [2593536,69944] 0 2024-09-16T09:45:39.017 INFO:tasks.workunit.client.1.smithi114.stdout:9/944: fdatasync d3/da/d10/d23/d43/d82/f75 0 2024-09-16T09:45:39.017 INFO:tasks.workunit.client.1.smithi114.stdout:8/883: mknod d4/db/d39/d3c/c129 0 2024-09-16T09:45:39.017 INFO:tasks.workunit.client.1.smithi114.stdout:8/884: creat d4/db/d39/d3c/d4e/d82/d72/d59/f12a x:0 0 0 2024-09-16T09:45:39.019 INFO:tasks.workunit.client.1.smithi114.stdout:8/885: creat d4/db/d3e/d47/f12b x:0 0 0 2024-09-16T09:45:39.019 INFO:tasks.workunit.client.1.smithi114.stdout:8/886: read - d4/db/d39/d3c/d86/f10c zero size 2024-09-16T09:45:39.026 INFO:tasks.workunit.client.1.smithi114.stdout:0/912: read d1f/d20/f34 [3295837,55163] 0 2024-09-16T09:45:39.027 INFO:tasks.workunit.client.1.smithi114.stdout:5/949: dwrite d3/d24/d84/d7a/d43/d58/da0/f103 [0,4194304] 0 2024-09-16T09:45:39.028 INFO:tasks.workunit.client.1.smithi114.stdout:5/950: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/d61/d10b/f139 [3009321,116641] 0 2024-09-16T09:45:39.028 INFO:tasks.workunit.client.1.smithi114.stdout:5/951: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fe3 [523790,17711] 0 2024-09-16T09:45:39.028 INFO:tasks.workunit.client.1.smithi114.stdout:0/913: link d1f/d2d/ld5 d1f/d27/d55/dce/l13d 0 2024-09-16T09:45:39.030 INFO:tasks.workunit.client.1.smithi114.stdout:9/945: write d3/da/d10/f21 [3457102,66466] 0 2024-09-16T09:45:39.030 INFO:tasks.workunit.client.1.smithi114.stdout:9/946: chown d3/daa/d107 23435155 1 2024-09-16T09:45:39.031 INFO:tasks.workunit.client.1.smithi114.stdout:4/965: dwrite d0/d26/d3c/d74/d9c/fbb [0,4194304] 0 2024-09-16T09:45:39.032 INFO:tasks.workunit.client.1.smithi114.stdout:9/947: symlink d3/da/d10/l14a 0 2024-09-16T09:45:39.032 INFO:tasks.workunit.client.1.smithi114.stdout:5/952: dread d3/d24/d84/dbc/fd4 [0,4194304] 0 2024-09-16T09:45:39.032 INFO:tasks.workunit.client.1.smithi114.stdout:9/948: write d3/da/d10/d23/d43/d1e/d25/f125 [749770,62666] 0 2024-09-16T09:45:39.033 INFO:tasks.workunit.client.1.smithi114.stdout:9/949: rename d3/da/d10/d23/d29/d2c/d6b/d68/d81/d9b/ce3 to d3/da/d10/d23/de9/c14b 0 2024-09-16T09:45:39.034 INFO:tasks.workunit.client.1.smithi114.stdout:9/950: fdatasync d3/da/d10/d23/d43/d1e/d7b/fbc 0 2024-09-16T09:45:39.034 INFO:tasks.workunit.client.1.smithi114.stdout:9/951: fsync d3/da/d10/d23/d29/f4b 0 2024-09-16T09:45:39.034 INFO:tasks.workunit.client.1.smithi114.stdout:9/952: creat d3/da/f14c x:0 0 0 2024-09-16T09:45:39.034 INFO:tasks.workunit.client.1.smithi114.stdout:9/953: stat d3/da/d10/d23/d43/c11d 0 2024-09-16T09:45:39.035 INFO:tasks.workunit.client.1.smithi114.stdout:9/954: creat d3/da/d10/d23/d29/d3f/d85/f14d x:0 0 0 2024-09-16T09:45:39.035 INFO:tasks.workunit.client.1.smithi114.stdout:9/955: read - d3/da/d10/d23/d29/d3f/d85/f9c zero size 2024-09-16T09:45:39.036 INFO:tasks.workunit.client.1.smithi114.stdout:9/956: truncate d3/fc 1170492 0 2024-09-16T09:45:39.036 INFO:tasks.workunit.client.1.smithi114.stdout:9/957: fdatasync d3/da/d10/d23/d29/d2c/d45/f117 0 2024-09-16T09:45:39.037 INFO:tasks.workunit.client.1.smithi114.stdout:9/958: rmdir d3/da/d10/d23/d29/dd1 39 2024-09-16T09:45:39.037 INFO:tasks.workunit.client.1.smithi114.stdout:9/959: fdatasync d3/da/d10/d23/d43/d1e/d25/d88/f13e 0 2024-09-16T09:45:39.045 INFO:tasks.workunit.client.1.smithi114.stdout:0/914: dread d1f/d22/d2e/d46/d7f/d8d/dbb/fda [0,4194304] 0 2024-09-16T09:45:39.045 INFO:tasks.workunit.client.1.smithi114.stdout:8/887: dwrite d4/db/d3e/d71/f3d [4194304,4194304] 0 2024-09-16T09:45:39.047 INFO:tasks.workunit.client.1.smithi114.stdout:0/915: rename d1f/d22/d2e/c97 to d1f/d22/d2e/d46/d7f/d8d/dbb/ddb/c13e 0 2024-09-16T09:45:39.050 INFO:tasks.workunit.client.1.smithi114.stdout:8/888: unlink d4/db/d39/d3c/d86/f10c 0 2024-09-16T09:45:39.050 INFO:tasks.workunit.client.1.smithi114.stdout:8/889: truncate d4/db/d3e/d71/d78/d8d/da9/fd4 1436941 0 2024-09-16T09:45:39.050 INFO:tasks.workunit.client.1.smithi114.stdout:8/890: write d4/d1f/f35 [2713022,12576] 0 2024-09-16T09:45:39.050 INFO:tasks.workunit.client.1.smithi114.stdout:0/916: mkdir d1f/d9e/d13f 0 2024-09-16T09:45:39.050 INFO:tasks.workunit.client.1.smithi114.stdout:0/917: chown d1f/d22/fba 2894 1 2024-09-16T09:45:39.052 INFO:tasks.workunit.client.1.smithi114.stdout:4/966: dread d0/d13/fac [0,4194304] 0 2024-09-16T09:45:39.052 INFO:tasks.workunit.client.1.smithi114.stdout:8/891: mknod d4/db/d39/d3c/d10e/c12c 0 2024-09-16T09:45:39.053 INFO:tasks.workunit.client.1.smithi114.stdout:0/918: rmdir d1f/d20/d48 39 2024-09-16T09:45:39.054 INFO:tasks.workunit.client.1.smithi114.stdout:8/892: creat d4/db/d3e/d71/d78/f12d x:0 0 0 2024-09-16T09:45:39.054 INFO:tasks.workunit.client.1.smithi114.stdout:8/893: chown d4/dae/d54/db3/fe8 94416 1 2024-09-16T09:45:39.054 INFO:tasks.workunit.client.1.smithi114.stdout:8/894: write d4/db/d3e/f7c [936180,91954] 0 2024-09-16T09:45:39.054 INFO:tasks.workunit.client.1.smithi114.stdout:5/953: dread d3/d24/d84/d7a/d43/d4c/d92/f97 [0,4194304] 0 2024-09-16T09:45:39.054 INFO:tasks.workunit.client.1.smithi114.stdout:0/919: symlink d1f/ddf/l140 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/920: dread - d1f/d22/d2e/d46/d137/f13c zero size 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/921: write d1f/d27/d55/fd3 [1048471,3970] 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/922: readlink d1f/d22/l8c 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/923: write d1f/d27/d55/fd3 [1641853,76723] 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/924: fdatasync f6 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/925: write d1f/d20/f3d [439292,26654] 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/926: fdatasync d1f/d22/d2e/f6c 0 2024-09-16T09:45:39.055 INFO:tasks.workunit.client.1.smithi114.stdout:0/927: stat d1f/d22/d2e/d46/d7f/cd0 0 2024-09-16T09:45:39.057 INFO:tasks.workunit.client.1.smithi114.stdout:8/895: symlink d4/db/d39/d3c/d4e/d82/d72/l12e 0 2024-09-16T09:45:39.060 INFO:tasks.workunit.client.1.smithi114.stdout:8/896: creat d4/db/d39/d3c/d10e/f12f x:0 0 0 2024-09-16T09:45:39.062 INFO:tasks.workunit.client.1.smithi114.stdout:8/897: mkdir d4/db/d39/d3c/d84/d130 0 2024-09-16T09:45:39.063 INFO:tasks.workunit.client.1.smithi114.stdout:8/898: write d4/dae/d54/d104/dac/fb8 [707068,37987] 0 2024-09-16T09:45:39.063 INFO:tasks.workunit.client.1.smithi114.stdout:9/960: dwrite d3/da/d10/d23/d29/ded/fb1 [0,4194304] 0 2024-09-16T09:45:39.067 INFO:tasks.workunit.client.1.smithi114.stdout:8/899: rename d4/db/d39/d3c/d4e/d62/l76 to d4/dae/d54/d104/l131 0 2024-09-16T09:45:39.067 INFO:tasks.workunit.client.1.smithi114.stdout:8/900: fdatasync d4/d1f/db9/fe7 0 2024-09-16T09:45:39.071 INFO:tasks.workunit.client.1.smithi114.stdout:4/967: dwrite d0/d26/d3c/d45/f67 [0,4194304] 0 2024-09-16T09:45:39.071 INFO:tasks.workunit.client.1.smithi114.stdout:4/968: chown d0/d26/d3c/d3e/d5a 19853508 1 2024-09-16T09:45:39.071 INFO:tasks.workunit.client.1.smithi114.stdout:4/969: chown d0/d26/d40/c10b 5 1 2024-09-16T09:45:39.074 INFO:tasks.workunit.client.1.smithi114.stdout:9/961: creat d3/da/d10/d23/d29/d2c/d6b/db9/f14e x:0 0 0 2024-09-16T09:45:39.082 INFO:tasks.workunit.client.1.smithi114.stdout:9/962: rmdir d3/da/d10/d23/d29/d2c/d6b/db9 39 2024-09-16T09:45:39.083 INFO:tasks.workunit.client.1.smithi114.stdout:8/901: symlink d4/db/d39/d3c/dec/l132 0 2024-09-16T09:45:39.084 INFO:tasks.workunit.client.1.smithi114.stdout:4/970: unlink d0/d13/c8c 0 2024-09-16T09:45:39.085 INFO:tasks.workunit.client.1.smithi114.stdout:9/963: link d3/da/d10/d23/d29/d2c/d6b/d68/f9a d3/da/f14f 0 2024-09-16T09:45:39.086 INFO:tasks.workunit.client.1.smithi114.stdout:8/902: mknod d4/db/d39/d3c/d84/c133 0 2024-09-16T09:45:39.087 INFO:tasks.workunit.client.1.smithi114.stdout:4/971: rename d0/l24 to d0/d26/d3c/d74/d9c/l150 0 2024-09-16T09:45:39.088 INFO:tasks.workunit.client.1.smithi114.stdout:9/964: symlink d3/da/d10/d23/d43/d1e/d7b/l150 0 2024-09-16T09:45:39.090 INFO:tasks.workunit.client.1.smithi114.stdout:9/965: link d3/f49 d3/da/d10/d23/d43/d1e/da0/f151 0 2024-09-16T09:45:39.091 INFO:tasks.workunit.client.1.smithi114.stdout:9/966: chown d3/da/d10/d23/d43/d82/f75 8 1 2024-09-16T09:45:39.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/972: rename d0/d13/fed to d0/d13/d56/d7e/f151 0 2024-09-16T09:45:39.092 INFO:tasks.workunit.client.1.smithi114.stdout:4/973: write d0/d26/f88 [953448,84096] 0 2024-09-16T09:45:39.093 INFO:tasks.workunit.client.1.smithi114.stdout:9/967: symlink d3/da/d10/d23/d29/d2c/d45/l152 0 2024-09-16T09:45:39.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/974: symlink d0/d53/d14b/l152 0 2024-09-16T09:45:39.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/975: write d0/d13/d56/d7e/f151 [25409,65746] 0 2024-09-16T09:45:39.095 INFO:tasks.workunit.client.1.smithi114.stdout:4/976: chown d0/d26/d29/c19 49 1 2024-09-16T09:45:39.097 INFO:tasks.workunit.client.1.smithi114.stdout:9/968: unlink d3/da/d10/d23/d29/d2c/d45/fca 0 2024-09-16T09:45:39.099 INFO:tasks.workunit.client.1.smithi114.stdout:9/969: mknod d3/d7d/c153 0 2024-09-16T09:45:39.100 INFO:tasks.workunit.client.1.smithi114.stdout:9/970: dread d3/da/d10/d23/d43/d1e/d78/fcb [0,4194304] 0 2024-09-16T09:45:39.100 INFO:tasks.workunit.client.1.smithi114.stdout:8/903: dwrite d4/db/d39/d3c/d86/fd6 [4194304,4194304] 0 2024-09-16T09:45:39.100 INFO:tasks.workunit.client.1.smithi114.stdout:8/904: fdatasync d4/d1f/db9/fc9 0 2024-09-16T09:45:39.101 INFO:tasks.workunit.client.1.smithi114.stdout:9/971: mknod d3/da/d10/d23/d29/ded/c154 0 2024-09-16T09:45:39.101 INFO:tasks.workunit.client.1.smithi114.stdout:9/972: stat d3/da/d10/d23/d43/d1e/d11e 0 2024-09-16T09:45:39.103 INFO:tasks.workunit.client.1.smithi114.stdout:8/905: creat d4/dae/d54/f134 x:0 0 0 2024-09-16T09:45:39.103 INFO:tasks.workunit.client.1.smithi114.stdout:8/906: chown d4/dae/d54/d104/fd9 7 1 2024-09-16T09:45:39.103 INFO:tasks.workunit.client.1.smithi114.stdout:8/907: write d4/db/d91/f107 [240354,62667] 0 2024-09-16T09:45:39.103 INFO:tasks.workunit.client.1.smithi114.stdout:8/908: chown d4/dae/d54/d104/lcf 2349 1 2024-09-16T09:45:39.103 INFO:tasks.workunit.client.1.smithi114.stdout:8/909: read d4/dae/d54/d104/dac/fb8 [603112,15147] 0 2024-09-16T09:45:39.104 INFO:tasks.workunit.client.1.smithi114.stdout:8/910: rmdir d4/dc3 39 2024-09-16T09:45:39.105 INFO:tasks.workunit.client.1.smithi114.stdout:8/911: creat d4/db/d39/d3c/f135 x:0 0 0 2024-09-16T09:45:39.106 INFO:tasks.workunit.client.1.smithi114.stdout:8/912: readlink d4/dc3/ld7 0 2024-09-16T09:45:39.107 INFO:tasks.workunit.client.1.smithi114.stdout:9/973: dread d3/da/f55 [0,4194304] 0 2024-09-16T09:45:39.107 INFO:tasks.workunit.client.1.smithi114.stdout:8/913: rename d4/db/d39/d94/f11c to d4/db/d3e/d71/d78/f136 0 2024-09-16T09:45:39.107 INFO:tasks.workunit.client.1.smithi114.stdout:8/914: chown d4/dae/cc0 0 1 2024-09-16T09:45:39.109 INFO:tasks.workunit.client.1.smithi114.stdout:4/977: dwrite d0/d26/d3c/d129/f13c [0,4194304] 0 2024-09-16T09:45:39.110 INFO:tasks.workunit.client.1.smithi114.stdout:4/978: dread - d0/d53/d11a/f143 zero size 2024-09-16T09:45:39.114 INFO:tasks.workunit.client.1.smithi114.stdout:4/979: write d0/d13/d25/fb7 [1008816,56056] 0 2024-09-16T09:45:39.114 INFO:tasks.workunit.client.1.smithi114.stdout:4/980: write d0/d26/d29/d9f/f11d [28654,742] 0 2024-09-16T09:45:39.116 INFO:tasks.workunit.client.1.smithi114.stdout:4/981: mknod d0/d13/d56/d7e/d116/c153 0 2024-09-16T09:45:39.116 INFO:tasks.workunit.client.1.smithi114.stdout:4/982: stat d0/d26/d3c/d3e/d4b/d46/fa3 0 2024-09-16T09:45:39.116 INFO:tasks.workunit.client.1.smithi114.stdout:9/974: read d3/da/d10/d23/d43/d1e/f5e [3233224,30448] 0 2024-09-16T09:45:39.117 INFO:tasks.workunit.client.1.smithi114.stdout:4/983: mknod d0/d26/d3c/d3e/d5a/c154 0 2024-09-16T09:45:39.117 INFO:tasks.workunit.client.1.smithi114.stdout:4/984: fdatasync d0/f64 0 2024-09-16T09:45:39.117 INFO:tasks.workunit.client.1.smithi114.stdout:4/985: fsync d0/d26/d40/d75/d7f/d87/fab 0 2024-09-16T09:45:39.118 INFO:tasks.workunit.client.1.smithi114.stdout:9/975: symlink d3/da/d10/d23/d43/d1e/d78/l155 0 2024-09-16T09:45:39.118 INFO:tasks.workunit.client.1.smithi114.stdout:9/976: read d3/da/d10/d23/d43/fa6 [172877,19545] 0 2024-09-16T09:45:39.119 INFO:tasks.workunit.client.1.smithi114.stdout:4/986: mknod d0/d26/d29/c155 0 2024-09-16T09:45:39.119 INFO:tasks.workunit.client.1.smithi114.stdout:4/987: stat d0/d26/d3c/d3e/d4b/d46/db3/c144 0 2024-09-16T09:45:39.121 INFO:tasks.workunit.client.1.smithi114.stdout:4/988: rename d0/d26/d3c/d74/ff8 to d0/d26/d2e/f156 0 2024-09-16T09:45:39.121 INFO:tasks.workunit.client.1.smithi114.stdout:4/989: stat d0/d26/f88 0 2024-09-16T09:45:39.127 INFO:tasks.workunit.client.1.smithi114.stdout:8/915: dwrite d4/db/f6e [0,4194304] 0 2024-09-16T09:45:39.130 INFO:tasks.workunit.client.1.smithi114.stdout:8/916: symlink d4/db/d3e/d71/d78/d8d/ddb/d109/l137 0 2024-09-16T09:45:39.133 INFO:tasks.workunit.client.1.smithi114.stdout:8/917: write d4/db/d39/d3c/d4e/f92 [3609148,93943] 0 2024-09-16T09:45:39.133 INFO:tasks.workunit.client.1.smithi114.stdout:8/918: chown d4/db/d3e/d71/d78/d8d 6834 1 2024-09-16T09:45:39.138 INFO:tasks.workunit.client.1.smithi114.stdout:9/977: dwrite d3/da/d10/d23/d29/d2c/d45/f61 [4194304,4194304] 0 2024-09-16T09:45:39.139 INFO:tasks.workunit.client.1.smithi114.stdout:9/978: stat d3/da/d10/d23/d43/d82/c10e 0 2024-09-16T09:45:39.139 INFO:tasks.workunit.client.1.smithi114.stdout:9/979: mkdir d3/da/d10/d23/d43/d1e/d25/dc0/d156 0 2024-09-16T09:45:39.140 INFO:tasks.workunit.client.1.smithi114.stdout:4/990: dwrite d0/d26/d29/d9f/f112 [0,4194304] 0 2024-09-16T09:45:39.141 INFO:tasks.workunit.client.1.smithi114.stdout:9/980: rename d3/da/d10/d23/d29/d2c/d45/cac to d3/da/d10/d23/d29/d3f/c157 0 2024-09-16T09:45:39.141 INFO:tasks.workunit.client.1.smithi114.stdout:9/981: chown d3/daa/def/d133 10747378 1 2024-09-16T09:45:39.144 INFO:tasks.workunit.client.1.smithi114.stdout:4/991: rename d0/d26/d40/d75/l81 to d0/d26/d3c/d3e/l157 0 2024-09-16T09:45:39.144 INFO:tasks.workunit.client.1.smithi114.stdout:4/992: truncate d0/d26/d3c/d3e/d4b/f8f 356510 0 2024-09-16T09:45:39.144 INFO:tasks.workunit.client.1.smithi114.stdout:4/993: truncate d0/d53/d11a/dc8/fdc 182860 0 2024-09-16T09:45:39.145 INFO:tasks.workunit.client.1.smithi114.stdout:9/982: symlink d3/da/d10/d23/d43/d1e/d10b/l158 0 2024-09-16T09:45:39.145 INFO:tasks.workunit.client.1.smithi114.stdout:8/919: dread d4/db/d3e/d71/d78/d8d/ddb/d109/f127 [0,4194304] 0 2024-09-16T09:45:39.145 INFO:tasks.workunit.client.1.smithi114.stdout:4/994: creat d0/d13/f158 x:0 0 0 2024-09-16T09:45:39.145 INFO:tasks.workunit.client.1.smithi114.stdout:4/995: write d0/d26/d3c/d3e/d4b/d46/f68 [5214863,61647] 0 2024-09-16T09:45:39.146 INFO:tasks.workunit.client.1.smithi114.stdout:9/983: dread d3/da/d10/d23/d43/fa6 [0,4194304] 0 2024-09-16T09:45:39.148 INFO:tasks.workunit.client.1.smithi114.stdout:4/996: fdatasync d0/d26/d3c/d3e/d4b/d46/f68 0 2024-09-16T09:45:39.148 INFO:tasks.workunit.client.1.smithi114.stdout:5/954: sync 2024-09-16T09:45:39.148 INFO:tasks.workunit.client.1.smithi114.stdout:0/928: sync 2024-09-16T09:45:39.149 INFO:tasks.workunit.client.1.smithi114.stdout:0/929: rmdir d1f/d22/d2e/d46/d7f 39 2024-09-16T09:45:39.149 INFO:tasks.workunit.client.1.smithi114.stdout:0/930: read f6 [2882434,9020] 0 2024-09-16T09:45:39.150 INFO:tasks.workunit.client.1.smithi114.stdout:4/997: mkdir d0/d13/d56/d7e/d116/d159 0 2024-09-16T09:45:39.152 INFO:tasks.workunit.client.1.smithi114.stdout:4/998: symlink d0/d13/db0/d121/l15a 0 2024-09-16T09:45:39.154 INFO:tasks.workunit.client.1.smithi114.stdout:4/999: creat d0/d13/d25/f15b x:0 0 0 2024-09-16T09:45:39.154 INFO:tasks.workunit.client.1.smithi114.stdout:9/984: dread d3/da/d10/d23/d43/d1e/d4c/fb7 [0,4194304] 0 2024-09-16T09:45:39.156 INFO:tasks.workunit.client.1.smithi114.stdout:9/985: symlink d3/da/d10/d23/d29/d2c/d45/d93/d115/l159 0 2024-09-16T09:45:39.158 INFO:tasks.workunit.client.1.smithi114.stdout:9/986: symlink d3/da/d10/d23/d29/l15a 0 2024-09-16T09:45:39.159 INFO:tasks.workunit.client.1.smithi114.stdout:9/987: chown d3/da/d10/d23/d29/d87/c95 0 1 2024-09-16T09:45:39.159 INFO:tasks.workunit.client.1.smithi114.stdout:9/988: write d3/da/d10/d23/d43/d1e/d25/dc0/dfb/f139 [833434,47281] 0 2024-09-16T09:45:39.162 INFO:tasks.workunit.client.1.smithi114.stdout:9/989: rename d3/da/d10/d23/d29/d87/cf6 to d3/da/d10/d23/d29/d2c/d6b/d68/d81/d8d/c15b 0 2024-09-16T09:45:39.162 INFO:tasks.workunit.client.1.smithi114.stdout:9/990: fsync d3/da/d10/d23/d43/d1e/d4c/d8c/fc7 0 2024-09-16T09:45:39.164 INFO:tasks.workunit.client.1.smithi114.stdout:9/991: unlink d3/da/d10/d23/d43/d1e/d4c/d8c/fe2 0 2024-09-16T09:45:39.166 INFO:tasks.workunit.client.1.smithi114.stdout:9/992: mkdir d3/da/d10/d23/d43/d82/dc5/d15c 0 2024-09-16T09:45:39.166 INFO:tasks.workunit.client.1.smithi114.stdout:9/993: truncate d3/da/d10/d23/d29/d2c/f8e 5239135 0 2024-09-16T09:45:39.175 INFO:tasks.workunit.client.1.smithi114.stdout:8/920: dwrite d4/db/d68/d30/fbd [0,4194304] 0 2024-09-16T09:45:39.176 INFO:tasks.workunit.client.1.smithi114.stdout:8/921: read d4/db/d3e/d71/d78/d8d/fc2 [398326,114683] 0 2024-09-16T09:45:39.177 INFO:tasks.workunit.client.1.smithi114.stdout:5/955: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/dbb/fc1 [0,4194304] 0 2024-09-16T09:45:39.177 INFO:tasks.workunit.client.1.smithi114.stdout:5/956: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/f94 [4949610,90016] 0 2024-09-16T09:45:39.177 INFO:tasks.workunit.client.1.smithi114.stdout:5/957: truncate d3/d24/d84/d7a/d43/d4c/d6d/fe7 1060977 0 2024-09-16T09:45:39.177 INFO:tasks.workunit.client.1.smithi114.stdout:0/931: dwrite d1f/d27/db9/fe3 [0,4194304] 0 2024-09-16T09:45:39.178 INFO:tasks.workunit.client.1.smithi114.stdout:8/922: creat d4/db/f138 x:0 0 0 2024-09-16T09:45:39.180 INFO:tasks.workunit.client.1.smithi114.stdout:5/958: symlink d3/d24/d84/d7a/d43/d58/da0/l142 0 2024-09-16T09:45:39.180 INFO:tasks.workunit.client.1.smithi114.stdout:5/959: stat d3/d24/d84/d7a/d43/ff5 0 2024-09-16T09:45:39.183 INFO:tasks.workunit.client.1.smithi114.stdout:0/932: dread d1f/d27/d55/fd3 [0,4194304] 0 2024-09-16T09:45:39.191 INFO:tasks.workunit.client.1.smithi114.stdout:5/960: mknod d3/d24/d84/d7a/d43/d4c/c143 0 2024-09-16T09:45:39.192 INFO:tasks.workunit.client.1.smithi114.stdout:0/933: getdents d1f/d22/d2e 0 2024-09-16T09:45:39.193 INFO:tasks.workunit.client.1.smithi114.stdout:5/961: mkdir d3/d24/d7d/da6/dfc/d144 0 2024-09-16T09:45:39.194 INFO:tasks.workunit.client.1.smithi114.stdout:0/934: creat d1f/d22/d2e/d46/d7f/df4/f141 x:0 0 0 2024-09-16T09:45:39.194 INFO:tasks.workunit.client.1.smithi114.stdout:0/935: write d1f/d22/d2e/d46/d7f/d8d/f101 [1032877,128984] 0 2024-09-16T09:45:39.194 INFO:tasks.workunit.client.1.smithi114.stdout:8/923: dwrite d4/db/d3e/d71/d78/f136 [0,4194304] 0 2024-09-16T09:45:39.195 INFO:tasks.workunit.client.1.smithi114.stdout:5/962: unlink d3/l7 0 2024-09-16T09:45:39.195 INFO:tasks.workunit.client.1.smithi114.stdout:5/963: chown d3/d24/d84/d7a/d43/d4c/db2/db7/fd2 57533 1 2024-09-16T09:45:39.195 INFO:tasks.workunit.client.1.smithi114.stdout:0/936: write d1f/d20/d48/f4e [3501943,3235] 0 2024-09-16T09:45:39.197 INFO:tasks.workunit.client.1.smithi114.stdout:8/924: creat d4/db/d39/f139 x:0 0 0 2024-09-16T09:45:39.198 INFO:tasks.workunit.client.1.smithi114.stdout:0/937: link d1f/d22/faa d1f/d27/de6/d11d/f142 0 2024-09-16T09:45:39.199 INFO:tasks.workunit.client.1.smithi114.stdout:8/925: mknod d4/db/d3e/d47/c13a 0 2024-09-16T09:45:39.204 INFO:tasks.workunit.client.1.smithi114.stdout:5/964: write d3/d24/d84/d7a/d43/f51 [567264,113370] 0 2024-09-16T09:45:39.207 INFO:tasks.workunit.client.1.smithi114.stdout:8/926: read d4/dae/d54/d104/f89 [2736113,21388] 0 2024-09-16T09:45:39.207 INFO:tasks.workunit.client.1.smithi114.stdout:8/927: dread - d4/db/d39/f139 zero size 2024-09-16T09:45:39.215 INFO:tasks.workunit.client.1.smithi114.stdout:8/928: dread d4/dae/d54/d104/f7e [0,4194304] 0 2024-09-16T09:45:39.216 INFO:tasks.workunit.client.1.smithi114.stdout:8/929: creat d4/d1f/db9/f13b x:0 0 0 2024-09-16T09:45:39.216 INFO:tasks.workunit.client.1.smithi114.stdout:8/930: chown d4/d1f 5 1 2024-09-16T09:45:39.216 INFO:tasks.workunit.client.1.smithi114.stdout:8/931: symlink d4/dae/d54/l13c 0 2024-09-16T09:45:39.217 INFO:tasks.workunit.client.1.smithi114.stdout:8/932: dread - d4/db/d39/d3c/f135 zero size 2024-09-16T09:45:39.217 INFO:tasks.workunit.client.1.smithi114.stdout:8/933: creat d4/db/d3e/d71/d78/d7a/f13d x:0 0 0 2024-09-16T09:45:39.221 INFO:tasks.workunit.client.1.smithi114.stdout:8/934: dread d4/db/d39/f8f [0,4194304] 0 2024-09-16T09:45:39.221 INFO:tasks.workunit.client.1.smithi114.stdout:8/935: chown d4/db/dd/fb2 1782 1 2024-09-16T09:45:39.221 INFO:tasks.workunit.client.1.smithi114.stdout:8/936: dread - d4/dae/d9c/fde zero size 2024-09-16T09:45:39.222 INFO:tasks.workunit.client.1.smithi114.stdout:5/965: dwrite d3/d24/d84/db9/f115 [0,4194304] 0 2024-09-16T09:45:39.222 INFO:tasks.workunit.client.1.smithi114.stdout:5/966: write d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/d72/d52/fbe [4737457,25587] 0 2024-09-16T09:45:39.222 INFO:tasks.workunit.client.1.smithi114.stdout:0/938: dwrite d1f/d20/f133 [0,4194304] 0 2024-09-16T09:45:39.222 INFO:tasks.workunit.client.1.smithi114.stdout:8/937: creat d4/d1f/f13e x:0 0 0 2024-09-16T09:45:39.224 INFO:tasks.workunit.client.1.smithi114.stdout:0/939: mknod d1f/d22/d2e/d46/d7f/d129/c143 0 2024-09-16T09:45:39.226 INFO:tasks.workunit.client.1.smithi114.stdout:0/940: creat d1f/d9e/d13f/f144 x:0 0 0 2024-09-16T09:45:39.228 INFO:tasks.workunit.client.1.smithi114.stdout:0/941: rename d1f/d27/d47/d56/d7e/f10e to d1f/d27/db9/f145 0 2024-09-16T09:45:39.229 INFO:tasks.workunit.client.1.smithi114.stdout:0/942: symlink d1f/d22/d2e/d46/d7f/df4/d120/l146 0 2024-09-16T09:45:39.230 INFO:tasks.workunit.client.1.smithi114.stdout:0/943: rmdir d1f/d2d/d7a 39 2024-09-16T09:45:39.230 INFO:tasks.workunit.client.1.smithi114.stdout:5/967: dread d3/d24/d84/d7a/d43/d4c/d6d/d9e/fc2 [4194304,4194304] 0 2024-09-16T09:45:39.230 INFO:tasks.workunit.client.1.smithi114.stdout:0/944: mknod d1f/d27/d47/d56/c147 0 2024-09-16T09:45:39.232 INFO:tasks.workunit.client.1.smithi114.stdout:0/945: mkdir d1f/d27/db9/d148 0 2024-09-16T09:45:39.236 INFO:tasks.workunit.client.1.smithi114.stdout:8/938: dwrite d4/db/d3e/d47/fa2 [0,4194304] 0 2024-09-16T09:45:39.238 INFO:tasks.workunit.client.1.smithi114.stdout:9/994: sync 2024-09-16T09:45:39.239 INFO:tasks.workunit.client.1.smithi114.stdout:8/939: stat d4/c36 0 2024-09-16T09:45:39.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/995: creat d3/d7d/f15d x:0 0 0 2024-09-16T09:45:39.240 INFO:tasks.workunit.client.1.smithi114.stdout:9/996: fdatasync d3/da/d10/f26 0 2024-09-16T09:45:39.241 INFO:tasks.workunit.client.1.smithi114.stdout:8/940: mkdir d4/db/d3e/d71/d78/d8d/d13f 0 2024-09-16T09:45:39.243 INFO:tasks.workunit.client.1.smithi114.stdout:9/997: symlink d3/daa/l15e 0 2024-09-16T09:45:39.245 INFO:tasks.workunit.client.1.smithi114.stdout:9/998: mkdir d3/da/d10/d23/d29/d2c/d6b/d9d/ddc/d15f 0 2024-09-16T09:45:39.246 INFO:tasks.workunit.client.1.smithi114.stdout:9/999: getdents d3/da/d10/d23/d43/d1e/d78/db2 0 2024-09-16T09:45:39.254 INFO:tasks.workunit.client.1.smithi114.stdout:8/941: dread d4/d6d/fb1 [4194304,4194304] 0 2024-09-16T09:45:39.256 INFO:tasks.workunit.client.1.smithi114.stdout:8/942: truncate d4/d1f/f35 395111 0 2024-09-16T09:45:39.256 INFO:tasks.workunit.client.1.smithi114.stdout:8/943: write d4/db/d3e/f97 [325413,92395] 0 2024-09-16T09:45:39.257 INFO:tasks.workunit.client.1.smithi114.stdout:8/944: mkdir d4/db/d3e/d71/d78/d140 0 2024-09-16T09:45:39.257 INFO:tasks.workunit.client.1.smithi114.stdout:8/945: chown d4/d1f/db9 1 1 2024-09-16T09:45:39.258 INFO:tasks.workunit.client.1.smithi114.stdout:8/946: mknod d4/dae/d54/d104/dc1/dfa/c141 0 2024-09-16T09:45:39.258 INFO:tasks.workunit.client.1.smithi114.stdout:5/968: dwrite d3/d24/d84/d7a/d43/d4c/d6d/d79/db4/fae [0,4194304] 0 2024-09-16T09:45:39.258 INFO:tasks.workunit.client.1.smithi114.stdout:5/969: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/f11e [4967,23618] 0 2024-09-16T09:45:39.258 INFO:tasks.workunit.client.1.smithi114.stdout:0/946: dwrite d1f/f65 [0,4194304] 0 2024-09-16T09:45:39.259 INFO:tasks.workunit.client.1.smithi114.stdout:0/947: write d1f/d22/d2e/d46/d7f/d8d/f95 [5058259,16833] 0 2024-09-16T09:45:39.259 INFO:tasks.workunit.client.1.smithi114.stdout:8/947: link d4/dae/d9c/l118 d4/db/d39/d3c/d84/d130/l142 0 2024-09-16T09:45:39.265 INFO:tasks.workunit.client.1.smithi114.stdout:8/948: mknod d4/db/d39/d3c/d4e/d82/d72/c143 0 2024-09-16T09:45:39.269 INFO:tasks.workunit.client.1.smithi114.stdout:0/948: dread d1f/d27/f96 [0,4194304] 0 2024-09-16T09:45:39.269 INFO:tasks.workunit.client.1.smithi114.stdout:8/949: write d4/d6d/fb1 [3021797,72868] 0 2024-09-16T09:45:39.274 INFO:tasks.workunit.client.1.smithi114.stdout:8/950: dread d4/db/d3e/f97 [0,4194304] 0 2024-09-16T09:45:39.274 INFO:tasks.workunit.client.1.smithi114.stdout:8/951: stat d4/db/fd1 0 2024-09-16T09:45:39.274 INFO:tasks.workunit.client.1.smithi114.stdout:8/952: mknod d4/db/d3e/d71/d78/d140/c144 0 2024-09-16T09:45:39.275 INFO:tasks.workunit.client.1.smithi114.stdout:8/953: creat d4/dae/f145 x:0 0 0 2024-09-16T09:45:39.276 INFO:tasks.workunit.client.1.smithi114.stdout:8/954: creat d4/db/d3e/d71/d78/d8d/d13f/f146 x:0 0 0 2024-09-16T09:45:39.277 INFO:tasks.workunit.client.1.smithi114.stdout:8/955: mknod d4/db/d3e/d71/d78/d8d/ddb/c147 0 2024-09-16T09:45:39.283 INFO:tasks.workunit.client.1.smithi114.stdout:0/949: dwrite d1f/d2d/d7a/ddd/f112 [0,4194304] 0 2024-09-16T09:45:39.284 INFO:tasks.workunit.client.1.smithi114.stdout:0/950: mknod d1f/d27/d55/d13a/c149 0 2024-09-16T09:45:39.284 INFO:tasks.workunit.client.1.smithi114.stdout:0/951: chown d1f/d27/d47/d56/fe0 1825 1 2024-09-16T09:45:39.284 INFO:tasks.workunit.client.1.smithi114.stdout:0/952: fsync d1f/fc4 0 2024-09-16T09:45:39.285 INFO:tasks.workunit.client.1.smithi114.stdout:0/953: creat d1f/d22/d2e/d46/d7f/daf/f14a x:0 0 0 2024-09-16T09:45:39.286 INFO:tasks.workunit.client.1.smithi114.stdout:0/954: mknod d1f/d22/d2e/d46/d137/c14b 0 2024-09-16T09:45:39.293 INFO:tasks.workunit.client.1.smithi114.stdout:8/956: dwrite d4/d1f/f13e [0,4194304] 0 2024-09-16T09:45:39.293 INFO:tasks.workunit.client.1.smithi114.stdout:8/957: chown d4/db/d3e/l112 5018 1 2024-09-16T09:45:39.294 INFO:tasks.workunit.client.1.smithi114.stdout:8/958: dread d4/d1f/f35 [0,4194304] 0 2024-09-16T09:45:39.294 INFO:tasks.workunit.client.1.smithi114.stdout:8/959: write d4/dae/d54/d104/f77 [4197942,708] 0 2024-09-16T09:45:39.295 INFO:tasks.workunit.client.1.smithi114.stdout:8/960: mkdir d4/db/d39/d3c/d4e/d82/d72/d59/da0/d148 0 2024-09-16T09:45:39.297 INFO:tasks.workunit.client.1.smithi114.stdout:8/961: rename d4/d1f/l58 to d4/db/d39/d3c/d84/l149 0 2024-09-16T09:45:39.305 INFO:tasks.workunit.client.1.smithi114.stdout:0/955: dwrite d1f/d22/fba [4194304,4194304] 0 2024-09-16T09:45:39.315 INFO:tasks.workunit.client.1.smithi114.stdout:8/962: dwrite d4/d1f/db9/fe7 [0,4194304] 0 2024-09-16T09:45:39.320 INFO:tasks.workunit.client.1.smithi114.stdout:8/963: write d4/db/d3e/d71/d78/d8d/ddb/d109/f127 [5176376,36471] 0 2024-09-16T09:45:39.320 INFO:tasks.workunit.client.1.smithi114.stdout:8/964: getdents d4/dc3 0 2024-09-16T09:45:39.320 INFO:tasks.workunit.client.1.smithi114.stdout:8/965: fsync d4/db/d68/d30/f33 0 2024-09-16T09:45:39.321 INFO:tasks.workunit.client.1.smithi114.stdout:8/966: write d4/dae/d54/db3/fe8 [402014,16532] 0 2024-09-16T09:45:39.330 INFO:tasks.workunit.client.1.smithi114.stdout:8/967: dread d4/db/d3e/f4f [0,4194304] 0 2024-09-16T09:45:39.330 INFO:tasks.workunit.client.1.smithi114.stdout:8/968: readlink d4/dc3/ld7 0 2024-09-16T09:45:39.332 INFO:tasks.workunit.client.1.smithi114.stdout:8/969: unlink d4/dae/d54/d104/f77 0 2024-09-16T09:45:39.332 INFO:tasks.workunit.client.1.smithi114.stdout:8/970: symlink d4/db/d39/d3c/d4e/l14a 0 2024-09-16T09:45:39.333 INFO:tasks.workunit.client.1.smithi114.stdout:8/971: symlink d4/dae/d54/d104/dc1/l14b 0 2024-09-16T09:45:39.334 INFO:tasks.workunit.client.1.smithi114.stdout:8/972: write d4/db/d91/fab [1818913,25946] 0 2024-09-16T09:45:39.334 INFO:tasks.workunit.client.1.smithi114.stdout:8/973: readlink d4/db/d39/d3c/d4e/d62/ldc 0 2024-09-16T09:45:39.335 INFO:tasks.workunit.client.1.smithi114.stdout:8/974: link d4/dae/d54/d104/f67 d4/db/d3e/d71/d78/d8d/da9/f14c 0 2024-09-16T09:45:39.352 INFO:tasks.workunit.client.1.smithi114.stdout:8/975: dwrite d4/d1f/db9/fc9 [0,4194304] 0 2024-09-16T09:45:39.354 INFO:tasks.workunit.client.1.smithi114.stdout:8/976: creat d4/db/d3e/d71/d78/d8d/f14d x:0 0 0 2024-09-16T09:45:39.355 INFO:tasks.workunit.client.1.smithi114.stdout:8/977: mknod d4/db/d39/d3c/dec/c14e 0 2024-09-16T09:45:39.356 INFO:tasks.workunit.client.1.smithi114.stdout:8/978: creat d4/db/d39/d3c/d4e/d82/d72/d59/da0/d148/f14f x:0 0 0 2024-09-16T09:45:39.365 INFO:tasks.workunit.client.1.smithi114.stdout:5/970: sync 2024-09-16T09:45:39.366 INFO:tasks.workunit.client.1.smithi114.stdout:5/971: write d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f81 [231607,28613] 0 2024-09-16T09:45:39.368 INFO:tasks.workunit.client.1.smithi114.stdout:5/972: rename d3/d24/d84/d12a/l140 to d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/d75/d98/l145 0 2024-09-16T09:45:39.368 INFO:tasks.workunit.client.1.smithi114.stdout:5/973: stat d3 0 2024-09-16T09:45:39.369 INFO:tasks.workunit.client.1.smithi114.stdout:8/979: dwrite d4/fc7 [0,4194304] 0 2024-09-16T09:45:39.370 INFO:tasks.workunit.client.1.smithi114.stdout:5/974: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/f81 to d3/d24/d84/d7a/d43/d4c/d92/f146 0 2024-09-16T09:45:39.370 INFO:tasks.workunit.client.1.smithi114.stdout:5/975: chown d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/l82 68459 1 2024-09-16T09:45:39.370 INFO:tasks.workunit.client.1.smithi114.stdout:5/976: readlink d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/l86 0 2024-09-16T09:45:39.372 INFO:tasks.workunit.client.1.smithi114.stdout:5/977: mknod d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/c147 0 2024-09-16T09:45:39.374 INFO:tasks.workunit.client.1.smithi114.stdout:0/956: sync 2024-09-16T09:45:39.381 INFO:tasks.workunit.client.1.smithi114.stdout:0/957: write d1f/d27/fa1 [610922,109010] 0 2024-09-16T09:45:39.381 INFO:tasks.workunit.client.1.smithi114.stdout:0/958: write d1f/d27/d55/f71 [2351184,77737] 0 2024-09-16T09:45:39.383 INFO:tasks.workunit.client.1.smithi114.stdout:0/959: link d1f/d2d/d7a/ddd/ff1 d1f/ddf/df5/f14c 0 2024-09-16T09:45:39.383 INFO:tasks.workunit.client.1.smithi114.stdout:0/960: stat c12 0 2024-09-16T09:45:39.383 INFO:tasks.workunit.client.1.smithi114.stdout:0/961: fdatasync d1f/d20/f3d 0 2024-09-16T09:45:39.384 INFO:tasks.workunit.client.1.smithi114.stdout:0/962: mkdir d1f/d2d/d7a/ddd/d14d 0 2024-09-16T09:45:39.385 INFO:tasks.workunit.client.1.smithi114.stdout:0/963: getdents d1f/d27/d55/dce 0 2024-09-16T09:45:39.385 INFO:tasks.workunit.client.1.smithi114.stdout:0/964: write d1f/d22/fd9 [726571,38152] 0 2024-09-16T09:45:39.386 INFO:tasks.workunit.client.1.smithi114.stdout:0/965: creat d1f/d20/d48/d75/f14e x:0 0 0 2024-09-16T09:45:39.386 INFO:tasks.workunit.client.1.smithi114.stdout:0/966: stat d1f/d22/d2e/d46/d7f/daf/cc2 0 2024-09-16T09:45:39.399 INFO:tasks.workunit.client.1.smithi114.stdout:0/967: dwrite d1f/d9e/fbc [0,4194304] 0 2024-09-16T09:45:39.412 INFO:tasks.workunit.client.1.smithi114.stdout:0/968: dwrite d1f/d20/d48/f73 [0,4194304] 0 2024-09-16T09:45:39.413 INFO:tasks.workunit.client.1.smithi114.stdout:0/969: rename d1f/d22/l8c to d1f/d22/d2e/d46/d7f/df4/d13b/l14f 0 2024-09-16T09:45:39.414 INFO:tasks.workunit.client.1.smithi114.stdout:0/970: truncate d1f/d22/d2e/d46/d7f/d8d/ff3 3074578 0 2024-09-16T09:45:39.415 INFO:tasks.workunit.client.1.smithi114.stdout:0/971: creat d1f/d27/db9/f150 x:0 0 0 2024-09-16T09:45:39.416 INFO:tasks.workunit.client.1.smithi114.stdout:0/972: mkdir d1f/d27/de6/d11d/d151 0 2024-09-16T09:45:39.423 INFO:tasks.workunit.client.1.smithi114.stdout:0/973: dread f19 [0,4194304] 0 2024-09-16T09:45:39.431 INFO:tasks.workunit.client.1.smithi114.stdout:0/974: dread d1f/d2d/d7a/ddd/ff1 [8388608,4194304] 0 2024-09-16T09:45:39.433 INFO:tasks.workunit.client.1.smithi114.stdout:0/975: rename d1f/d27/d47/la6 to d1f/d22/d2e/d46/d7f/d8d/dbb/d10b/l152 0 2024-09-16T09:45:39.434 INFO:tasks.workunit.client.1.smithi114.stdout:0/976: creat d1f/d27/d55/f153 x:0 0 0 2024-09-16T09:45:39.449 INFO:tasks.workunit.client.1.smithi114.stdout:0/977: dwrite d1f/d9e/fbc [0,4194304] 0 2024-09-16T09:45:39.460 INFO:tasks.workunit.client.1.smithi114.stdout:0/978: write d1f/d20/d48/ffe [51314,107790] 0 2024-09-16T09:45:39.460 INFO:tasks.workunit.client.1.smithi114.stdout:0/979: chown d1f/fc7 14636 1 2024-09-16T09:45:39.460 INFO:tasks.workunit.client.1.smithi114.stdout:0/980: chown d1f/d22/d2e/d46/d7f/daf 219236154 1 2024-09-16T09:45:39.462 INFO:tasks.workunit.client.1.smithi114.stdout:0/981: getdents d1f/d22/d2e/d46/d7f/df4/d13b 0 2024-09-16T09:45:39.462 INFO:tasks.workunit.client.1.smithi114.stdout:0/982: chown d1f/d22/d2e/d46/f138 606 1 2024-09-16T09:45:39.467 INFO:tasks.workunit.client.1.smithi114.stdout:8/980: sync 2024-09-16T09:45:39.468 INFO:tasks.workunit.client.1.smithi114.stdout:8/981: link d4/db/d39/f103 d4/db/d3e/d71/d78/df0/f150 0 2024-09-16T09:45:39.477 INFO:tasks.workunit.client.1.smithi114.stdout:8/982: dread d4/db/d39/f103 [0,4194304] 0 2024-09-16T09:45:39.478 INFO:tasks.workunit.client.1.smithi114.stdout:0/983: dwrite d1f/d27/f136 [0,4194304] 0 2024-09-16T09:45:39.478 INFO:tasks.workunit.client.1.smithi114.stdout:8/983: rmdir d4/d1f 39 2024-09-16T09:45:39.479 INFO:tasks.workunit.client.1.smithi114.stdout:8/984: mkdir d4/db/d3e/d71/d78/d151 0 2024-09-16T09:45:39.486 INFO:tasks.workunit.client.1.smithi114.stdout:0/984: dread d1f/d20/d48/f73 [0,4194304] 0 2024-09-16T09:45:39.486 INFO:tasks.workunit.client.1.smithi114.stdout:0/985: chown d1f/d27/d47/l98 331 1 2024-09-16T09:45:39.488 INFO:tasks.workunit.client.1.smithi114.stdout:0/986: rename d1f/d22/c9c to d1f/d27/db9/d148/c154 0 2024-09-16T09:45:39.488 INFO:tasks.workunit.client.1.smithi114.stdout:0/987: fsync d1f/d22/d2e/d46/d7f/d8d/f101 0 2024-09-16T09:45:39.488 INFO:tasks.workunit.client.1.smithi114.stdout:8/985: dread d4/db/fa4 [0,4194304] 0 2024-09-16T09:45:39.488 INFO:tasks.workunit.client.1.smithi114.stdout:0/988: chown d1f/d20/d48/d75/l80 504 1 2024-09-16T09:45:39.488 INFO:tasks.workunit.client.1.smithi114.stdout:8/986: symlink d4/db/dd/da1/l152 0 2024-09-16T09:45:39.489 INFO:tasks.workunit.client.1.smithi114.stdout:0/989: creat d1f/d2d/f155 x:0 0 0 2024-09-16T09:45:39.490 INFO:tasks.workunit.client.1.smithi114.stdout:0/990: rename d1f/d22/d2e/d46/d7f/daf/fd2 to d1f/d27/d47/d56/f156 0 2024-09-16T09:45:39.490 INFO:tasks.workunit.client.1.smithi114.stdout:0/991: chown d1f/d20/d48/f10f 3779536 1 2024-09-16T09:45:39.491 INFO:tasks.workunit.client.1.smithi114.stdout:0/992: mknod d1f/d22/d2e/d46/d7f/c157 0 2024-09-16T09:45:39.492 INFO:tasks.workunit.client.1.smithi114.stdout:0/993: getdents d1f/d27/d55/dce 0 2024-09-16T09:45:39.492 INFO:tasks.workunit.client.1.smithi114.stdout:0/994: rename d1f/d2d/d7a/ddd to d1f/d27/d55/dce/d158 0 2024-09-16T09:45:39.493 INFO:tasks.workunit.client.1.smithi114.stdout:0/995: stat d1f/d22/d2e/d46/d7f/daf/cc2 0 2024-09-16T09:45:39.497 INFO:tasks.workunit.client.1.smithi114.stdout:0/996: dread d1f/d27/d55/fb4 [0,4194304] 0 2024-09-16T09:45:39.499 INFO:tasks.workunit.client.1.smithi114.stdout:0/997: truncate d1f/d27/d55/dce/fed 3769836 0 2024-09-16T09:45:39.511 INFO:tasks.workunit.client.1.smithi114.stdout:8/987: dwrite d4/db/d3e/d71/d78/d8d/da9/fb7 [0,4194304] 0 2024-09-16T09:45:39.514 INFO:tasks.workunit.client.1.smithi114.stdout:8/988: creat d4/db/d3e/d71/d78/d8d/da9/f153 x:0 0 0 2024-09-16T09:45:39.514 INFO:tasks.workunit.client.1.smithi114.stdout:0/998: dread d1f/d20/d48/ffe [4194304,4194304] 0 2024-09-16T09:45:39.515 INFO:tasks.workunit.client.1.smithi114.stdout:8/989: creat d4/db/d3e/d71/d78/d8d/da9/f154 x:0 0 0 2024-09-16T09:45:39.517 INFO:tasks.workunit.client.1.smithi114.stdout:5/978: sync 2024-09-16T09:45:39.519 INFO:tasks.workunit.client.1.smithi114.stdout:5/979: mkdir d3/d1f/d148 0 2024-09-16T09:45:39.519 INFO:tasks.workunit.client.1.smithi114.stdout:5/980: chown d3/d24/d84/d7a/d43/d4c/d92/l68 11200 1 2024-09-16T09:45:39.524 INFO:tasks.workunit.client.1.smithi114.stdout:8/990: dread d4/db/d39/d3c/fa7 [0,4194304] 0 2024-09-16T09:45:39.525 INFO:tasks.workunit.client.1.smithi114.stdout:8/991: getdents d4/db/d39/d3c/d4e/d82/d72/d59 0 2024-09-16T09:45:39.536 INFO:tasks.workunit.client.1.smithi114.stdout:8/992: dread d4/db/d3e/d71/f87 [0,4194304] 0 2024-09-16T09:45:39.538 INFO:tasks.workunit.client.1.smithi114.stdout:8/993: mknod d4/db/d3e/d71/d78/c155 0 2024-09-16T09:45:39.538 INFO:tasks.workunit.client.1.smithi114.stdout:8/994: chown d4/db/d3e/d71/d78/d8d/fc2 13469 1 2024-09-16T09:45:39.538 INFO:tasks.workunit.client.1.smithi114.stdout:8/995: getdents d4/db/d3e/d71/d78/d151 0 2024-09-16T09:45:39.539 INFO:tasks.workunit.client.1.smithi114.stdout:8/996: mkdir d4/dae/d54/db3/d156 0 2024-09-16T09:45:39.539 INFO:tasks.workunit.client.1.smithi114.stdout:8/997: chown d4/c9 5499 1 2024-09-16T09:45:39.539 INFO:tasks.workunit.client.1.smithi114.stdout:0/999: dwrite d1f/d22/d2e/d46/d7f/d8d/dbb/fde [0,4194304] 0 2024-09-16T09:45:39.539 INFO:tasks.workunit.client.1.smithi114.stdout:5/981: dwrite d3/f18 [0,4194304] 0 2024-09-16T09:45:39.540 INFO:tasks.workunit.client.1.smithi114.stdout:5/982: symlink d3/d24/d84/d7a/d43/d4c/db2/l149 0 2024-09-16T09:45:39.541 INFO:tasks.workunit.client.1.smithi114.stdout:5/983: getdents d3/d24/d84/d7a/d43/d4c/db2/db5/d13e 0 2024-09-16T09:45:39.542 INFO:tasks.workunit.client.1.smithi114.stdout:5/984: mknod d3/d24/d7d/c14a 0 2024-09-16T09:45:39.546 INFO:tasks.workunit.client.1.smithi114.stdout:5/985: dread d3/d24/d84/dbc/fd4 [0,4194304] 0 2024-09-16T09:45:39.546 INFO:tasks.workunit.client.1.smithi114.stdout:5/986: write d3/d24/d84/d7a/d43/d58/da0/f100 [74401,79118] 0 2024-09-16T09:45:39.547 INFO:tasks.workunit.client.1.smithi114.stdout:5/987: unlink d3/d24/d84/dbc/c131 0 2024-09-16T09:45:39.550 INFO:tasks.workunit.client.1.smithi114.stdout:8/998: dwrite d4/db/d3e/ff1 [0,4194304] 0 2024-09-16T09:45:39.550 INFO:tasks.workunit.client.1.smithi114.stdout:8/999: chown d4/d1f/cda 11 1 2024-09-16T09:45:39.557 INFO:tasks.workunit.client.1.smithi114.stdout:5/988: dread d3/d24/d84/d7a/d43/f47 [0,4194304] 0 2024-09-16T09:45:39.565 INFO:tasks.workunit.client.1.smithi114.stdout:5/989: write d3/d24/d84/d7a/d43/d4c/f10d [2164544,130270] 0 2024-09-16T09:45:39.566 INFO:tasks.workunit.client.1.smithi114.stdout:5/990: getdents d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/def 0 2024-09-16T09:45:39.580 INFO:tasks.workunit.client.1.smithi114.stdout:5/991: dwrite d3/f5 [4194304,4194304] 0 2024-09-16T09:45:39.581 INFO:tasks.workunit.client.1.smithi114.stdout:5/992: creat d3/d24/d84/dbc/f14b x:0 0 0 2024-09-16T09:45:39.581 INFO:tasks.workunit.client.1.smithi114.stdout:5/993: stat d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/dab/d9f/ldf 0 2024-09-16T09:45:39.590 INFO:tasks.workunit.client.1.smithi114.stdout:5/994: dread d3/d24/d7d/d96/f110 [0,4194304] 0 2024-09-16T09:45:39.596 INFO:tasks.workunit.client.1.smithi114.stdout:5/995: dread d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d87/ff0 [0,4194304] 0 2024-09-16T09:45:39.597 INFO:tasks.workunit.client.1.smithi114.stdout:5/996: link d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/l45 d3/d24/d84/d7a/d43/l14c 0 2024-09-16T09:45:39.598 INFO:tasks.workunit.client.1.smithi114.stdout:5/997: rename d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d3f/fe3 to d3/d1f/f14d 0 2024-09-16T09:45:39.605 INFO:tasks.workunit.client.1.smithi114.stdout:5/998: read d3/d24/d84/d7a/d43/d4c/d6d/d79/da1/d34/fe1 [49738,80222] 0 2024-09-16T09:45:39.605 INFO:tasks.workunit.client.1.smithi114.stdout:5/999: stat d3/d24/d84/d7a/l5b 0 2024-09-16T09:45:39.608 INFO:tasks.workunit.client.1.smithi114.stderr:+ rm -rf -- ./tmp.5kwPSC59Rj 2024-09-16T09:45:40.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:40 smithi111 ceph-mon[27997]: pgmap v243: 65 pgs: 65 active+clean; 1.8 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 172 MiB/s rd, 235 MiB/s wr, 453 op/s 2024-09-16T09:45:40.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:40 smithi114 ceph-mon[35635]: pgmap v243: 65 pgs: 65 active+clean; 1.8 GiB data, 5.1 GiB used, 531 GiB / 536 GiB avail; 172 MiB/s rd, 235 MiB/s wr, 453 op/s 2024-09-16T09:45:42.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:42 smithi111 ceph-mon[27997]: pgmap v244: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 211 MiB/s rd, 276 MiB/s wr, 508 op/s 2024-09-16T09:45:42.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:42 smithi114 ceph-mon[35635]: pgmap v244: 65 pgs: 65 active+clean; 2.0 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 211 MiB/s rd, 276 MiB/s wr, 508 op/s 2024-09-16T09:45:44.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:44 smithi111 ceph-mon[27997]: pgmap v245: 65 pgs: 65 active+clean; 2.1 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 241 MiB/s rd, 310 MiB/s wr, 531 op/s 2024-09-16T09:45:44.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:44 smithi114 ceph-mon[35635]: pgmap v245: 65 pgs: 65 active+clean; 2.1 GiB data, 6.8 GiB used, 530 GiB / 536 GiB avail; 241 MiB/s rd, 310 MiB/s wr, 531 op/s 2024-09-16T09:45:46.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:46 smithi111 ceph-mon[27997]: pgmap v246: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 196 MiB/s rd, 249 MiB/s wr, 443 op/s 2024-09-16T09:45:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:46 smithi114 ceph-mon[35635]: pgmap v246: 65 pgs: 65 active+clean; 1.9 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 196 MiB/s rd, 249 MiB/s wr, 443 op/s 2024-09-16T09:45:47.603 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T09:45:47.604 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-16T09:45:48.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:48 smithi111 ceph-mon[27997]: pgmap v247: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 164 MiB/s rd, 207 MiB/s wr, 349 op/s 2024-09-16T09:45:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:48 smithi114 ceph-mon[35635]: pgmap v247: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 164 MiB/s rd, 207 MiB/s wr, 349 op/s 2024-09-16T09:45:50.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:50 smithi111 ceph-mon[27997]: pgmap v248: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 92 MiB/s rd, 102 MiB/s wr, 212 op/s 2024-09-16T09:45:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:50 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:50.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:50 smithi114 ceph-mon[35635]: pgmap v248: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 92 MiB/s rd, 102 MiB/s wr, 212 op/s 2024-09-16T09:45:50.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:50 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:45:52.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:52 smithi111 ceph-mon[27997]: pgmap v249: 65 pgs: 65 active+clean; 731 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 92 MiB/s rd, 103 MiB/s wr, 261 op/s 2024-09-16T09:45:52.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:52 smithi114 ceph-mon[35635]: pgmap v249: 65 pgs: 65 active+clean; 731 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 92 MiB/s rd, 103 MiB/s wr, 261 op/s 2024-09-16T09:45:53.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 -- 172.21.15.111:0/7797542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 msgr2=0x7fa894101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:53.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 --2- 172.21.15.111:0/7797542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 0x7fa894101ec0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa888009880 tx=0x7fa88802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:53.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 -- 172.21.15.111:0/7797542 shutdown_connections 2024-09-16T09:45:53.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 --2- 172.21.15.111:0/7797542 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 0x7fa894101ec0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:53.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 --2- 172.21.15.111:0/7797542 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa894100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:53.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 -- 172.21.15.111:0/7797542 >> 172.21.15.111:0/7797542 conn(0x7fa8940fbff0 msgr2=0x7fa8940fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:53.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 -- 172.21.15.111:0/7797542 shutdown_connections 2024-09-16T09:45:53.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.875+0000 7fa89a138640 1 -- 172.21.15.111:0/7797542 wait complete. 2024-09-16T09:45:53.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa89a138640 1 Processor -- start 2024-09-16T09:45:53.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa89a138640 1 -- start start 2024-09-16T09:45:53.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa89a138640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa89406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:53.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa89a138640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 0x7fa89419c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:53.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa89a138640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa894109680 con 0x7fa894101a40 2024-09-16T09:45:53.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa89a138640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa894109500 con 0x7fa894100840 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa89406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa8937fe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa89406a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:37538/0 (socket says 172.21.15.111:37538) 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.876+0000 7fa8937fe640 1 -- 172.21.15.111:0/885558084 learned_addr learned my addr 172.21.15.111:0/885558084 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa8937fe640 1 -- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 msgr2=0x7fa89419c1f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa8937fe640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 0x7fa89419c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa8937fe640 1 -- 172.21.15.111:0/885558084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89419c7b0 con 0x7fa894100840 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa8937fe640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa89406a620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa88400e970 tx=0x7fa88400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa88400cac0 con 0x7fa894100840 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89419caa0 con 0x7fa894100840 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa88400cc60 con 0x7fa894100840 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa884003e20 con 0x7fa894100840 2024-09-16T09:45:53.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.877+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89419d030 con 0x7fa894100840 2024-09-16T09:45:53.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.878+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa894100c40 con 0x7fa894100840 2024-09-16T09:45:53.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.879+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fa884003fc0 con 0x7fa894100840 2024-09-16T09:45:53.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.879+0000 7fa890ff9640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa87c06e310 0x7fa87c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:53.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.879+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fa88408e7b0 con 0x7fa894100840 2024-09-16T09:45:53.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.879+0000 7fa892ffd640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa87c06e310 0x7fa87c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:53.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.880+0000 7fa892ffd640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa87c06e310 0x7fa87c0707d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8880096c0 tx=0x7fa888000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:53.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:53.885+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa88405c0a0 con 0x7fa894100840 2024-09-16T09:45:54.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.128+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa894062630 con 0x7fa87c06e310 2024-09-16T09:45:54.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:54 smithi111 ceph-mon[27997]: pgmap v250: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 53 MiB/s rd, 62 MiB/s wr, 286 op/s 2024-09-16T09:45:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.130+0000 7fa890ff9640 1 -- 172.21.15.111:0/885558084 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fa894062630 con 0x7fa87c06e310 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa87c06e310 msgr2=0x7fa87c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa87c06e310 0x7fa87c0707d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa8880096c0 tx=0x7fa888000bc0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 msgr2=0x7fa89406a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa89406a620 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa88400e970 tx=0x7fa88400ee30 comp rx=0 tx=0).stop 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 shutdown_connections 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fa87c06e310 0x7fa87c0707d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894101a40 0x7fa89419c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 --2- 172.21.15.111:0/885558084 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa894100840 0x7fa89406a620 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 >> 172.21.15.111:0/885558084 conn(0x7fa8940fbff0 msgr2=0x7fa894104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:54.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.132+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 shutdown_connections 2024-09-16T09:45:54.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.133+0000 7fa89a138640 1 -- 172.21.15.111:0/885558084 wait complete. 2024-09-16T09:45:54.142 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 -- 172.21.15.111:0/285296844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408101a40 msgr2=0x7fb408101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 --2- 172.21.15.111:0/285296844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408101a40 0x7fb408101ec0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009880 tx=0x7fb3fc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 -- 172.21.15.111:0/285296844 shutdown_connections 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 --2- 172.21.15.111:0/285296844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408101a40 0x7fb408101ec0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 --2- 172.21.15.111:0/285296844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb408100840 0x7fb408100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 -- 172.21.15.111:0/285296844 >> 172.21.15.111:0/285296844 conn(0x7fb4080fbff0 msgr2=0x7fb4080fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 -- 172.21.15.111:0/285296844 shutdown_connections 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 -- 172.21.15.111:0/285296844 wait complete. 2024-09-16T09:45:54.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.218+0000 7fb40dc21640 1 Processor -- start 2024-09-16T09:45:54.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb40dc21640 1 -- start start 2024-09-16T09:45:54.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb40dc21640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 0x7fb4081974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb40dc21640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb408101a40 0x7fb4081979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb40dc21640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb408109680 con 0x7fb408100840 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb40dc21640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb408109500 con 0x7fb408101a40 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb4077fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 0x7fb4081974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb4077fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 0x7fb4081974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54598/0 (socket says 172.21.15.111:54598) 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb406ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb408101a40 0x7fb4081979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb4077fe640 1 -- 172.21.15.111:0/4147646135 learned_addr learned my addr 172.21.15.111:0/4147646135 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb4077fe640 1 -- 172.21.15.111:0/4147646135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb408101a40 msgr2=0x7fb4081979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb4077fe640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb408101a40 0x7fb4081979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.219+0000 7fb4077fe640 1 -- 172.21.15.111:0/4147646135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb408198060 con 0x7fb408100840 2024-09-16T09:45:54.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.220+0000 7fb4077fe640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 0x7fb4081974a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800e940 tx=0x7fb3f800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.220+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3f800cac0 con 0x7fb408100840 2024-09-16T09:45:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.220+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40819caa0 con 0x7fb408100840 2024-09-16T09:45:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.220+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40819d000 con 0x7fb408100840 2024-09-16T09:45:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.220+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3f800cc60 con 0x7fb408100840 2024-09-16T09:45:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.221+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3f8003c70 con 0x7fb408100840 2024-09-16T09:45:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.221+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f40052c0 con 0x7fb408100840 2024-09-16T09:45:54.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.222+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7fb3f80035f0 con 0x7fb408100840 2024-09-16T09:45:54.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.223+0000 7fb404ff9640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb3f006e2b0 0x7fb3f0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.223+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7fb3f808e680 con 0x7fb408100840 2024-09-16T09:45:54.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.223+0000 7fb406ffd640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb3f006e2b0 0x7fb3f0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.224+0000 7fb406ffd640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb3f006e2b0 0x7fb3f0070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:54.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.227+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3f80541b0 con 0x7fb408100840 2024-09-16T09:45:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:54 smithi114 ceph-mon[35635]: pgmap v250: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 53 MiB/s rd, 62 MiB/s wr, 286 op/s 2024-09-16T09:45:54.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.438+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb3f4000bf0 con 0x7fb3f006e2b0 2024-09-16T09:45:54.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.441+0000 7fb404ff9640 1 -- 172.21.15.111:0/4147646135 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fb3f4000bf0 con 0x7fb3f006e2b0 2024-09-16T09:45:54.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.444+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb3f006e2b0 msgr2=0x7fb3f0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.444+0000 7fb40dc21640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb3f006e2b0 0x7fb3f0070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc0058d0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.444+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 msgr2=0x7fb4081974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.444+0000 7fb40dc21640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 0x7fb4081974a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800e940 tx=0x7fb3f800ee00 comp rx=0 tx=0).stop 2024-09-16T09:45:54.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.446+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 shutdown_connections 2024-09-16T09:45:54.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.446+0000 7fb40dc21640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7fb3f006e2b0 0x7fb3f0070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.446+0000 7fb40dc21640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb408101a40 0x7fb4081979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.446+0000 7fb40dc21640 1 --2- 172.21.15.111:0/4147646135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb408100840 0x7fb4081974a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.446+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 >> 172.21.15.111:0/4147646135 conn(0x7fb4080fbff0 msgr2=0x7fb4080fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:54.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.446+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 shutdown_connections 2024-09-16T09:45:54.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.447+0000 7fb40dc21640 1 -- 172.21.15.111:0/4147646135 wait complete. 2024-09-16T09:45:54.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 -- 172.21.15.111:0/2945670486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064100840 msgr2=0x7f1064100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2945670486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064100840 0x7f1064100c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1060009880 tx=0x7f106002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 -- 172.21.15.111:0/2945670486 shutdown_connections 2024-09-16T09:45:54.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2945670486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064101a40 0x7f1064101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2945670486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064100840 0x7f1064100c40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 -- 172.21.15.111:0/2945670486 >> 172.21.15.111:0/2945670486 conn(0x7f10640fbff0 msgr2=0x7f10640fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:54.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 -- 172.21.15.111:0/2945670486 shutdown_connections 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.580+0000 7f106c4a4640 1 -- 172.21.15.111:0/2945670486 wait complete. 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106c4a4640 1 Processor -- start 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106c4a4640 1 -- start start 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106c4a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 0x7f10641974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106c4a4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064101a40 0x7f1064197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106c4a4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1064109680 con 0x7f1064101a40 2024-09-16T09:45:54.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106c4a4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1064109500 con 0x7f1064100840 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106a240640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 0x7f10641974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106a240640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 0x7f10641974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:37566/0 (socket says 172.21.15.111:37566) 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106a240640 1 -- 172.21.15.111:0/2935771175 learned_addr learned my addr 172.21.15.111:0/2935771175 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f1069a3f640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064101a40 0x7f1064197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106a240640 1 -- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064101a40 msgr2=0x7f1064197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106a240640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064101a40 0x7f1064197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f106a240640 1 -- 172.21.15.111:0/2935771175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1064198080 con 0x7f1064100840 2024-09-16T09:45:54.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.581+0000 7f1069a3f640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064101a40 0x7f1064197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:45:54.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.582+0000 7f106a240640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 0x7f10641974c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1060009230 tx=0x7f10600045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:54.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.582+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f106003f070 con 0x7f1064100840 2024-09-16T09:45:54.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.582+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f106419ca60 con 0x7f1064100840 2024-09-16T09:45:54.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.582+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10600049d0 con 0x7f1064100840 2024-09-16T09:45:54.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.582+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1060035030 con 0x7f1064100840 2024-09-16T09:45:54.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.582+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1064102c60 con 0x7f1064100840 2024-09-16T09:45:54.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.583+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1064100c40 con 0x7f1064100840 2024-09-16T09:45:54.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.583+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f1060042070 con 0x7f1064100840 2024-09-16T09:45:54.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.584+0000 7f105b7fe640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f10500726c0 0x7f1050074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.584+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f10600aecb0 con 0x7f1064100840 2024-09-16T09:45:54.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.584+0000 7f1069a3f640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f10500726c0 0x7f1050074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.584+0000 7f1069a3f640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f10500726c0 0x7f1050074b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1064198970 tx=0x7f1054005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:54.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.589+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1060080220 con 0x7f1064100840 2024-09-16T09:45:54.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.776+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f106406a270 con 0x7f10500726c0 2024-09-16T09:45:54.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.786+0000 7f105b7fe640 1 -- 172.21.15.111:0/2935771175 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3768 (secure 0 0 0) 0x7f106406a270 con 0x7f10500726c0 2024-09-16T09:45:54.787 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:45:54.787 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (6m) 2m ago 7m 26.4M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:45:54.787 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (8m) 2m ago 8m 8166k - 19.1.1-328-gad35db06 b5388489f99e 8786fd2f4c05 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (7m) 2m ago 7m 5263k - 19.1.1-328-gad35db06 b5388489f99e 7fe7397f669d 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (7m) 2m ago 7m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (7m) 2m ago 7m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 2m ago 7m 78.2M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (2m) 2m ago 2m 16.9M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (2m) 2m ago 2m 13.6M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (2m) 2m ago 2m 14.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (2m) 2m ago 2m 14.5M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:9283,8765,8443 running (9m) 2m ago 9m 498M - 19.1.1-328-gad35db06 b5388489f99e f32e13ae383f 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (7m) 2m ago 6m 443M - 19.1.1-328-gad35db06 b5388489f99e 6d8deba4ede4 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (9m) 2m ago 9m 46.8M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (6m) 2m ago 6m 35.0M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:45:54.788 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (7m) 2m ago 7m 14.0M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (7m) 2m ago 7m 16.6M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (5m) 2m ago 5m 47.4M 3946M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (5m) 2m ago 5m 54.0M 3946M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (4m) 2m ago 4m 52.0M 3946M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (4m) 2m ago 4m 53.1M 4970M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (4m) 2m ago 4m 41.1M 4970M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (3m) 2m ago 3m 41.4M 4970M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:45:54.789 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 2m ago 7m 60.1M - 2.43.0 a07b618ecd1d ef0faa2f353d 2024-09-16T09:45:54.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f10500726c0 msgr2=0x7f1050074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f10500726c0 0x7f1050074b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1064198970 tx=0x7f1054005f90 comp rx=0 tx=0).stop 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 msgr2=0x7f10641974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 0x7f10641974c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1060009230 tx=0x7f10600045e0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 shutdown_connections 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f10500726c0 0x7f1050074b80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1064101a40 0x7f1064197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 --2- 172.21.15.111:0/2935771175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1064100840 0x7f10641974c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 >> 172.21.15.111:0/2935771175 conn(0x7f10640fbff0 msgr2=0x7f1064069b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:54.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 shutdown_connections 2024-09-16T09:45:54.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.788+0000 7f106c4a4640 1 -- 172.21.15.111:0/2935771175 wait complete. 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 -- 172.21.15.111:0/2641149505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100bc0 msgr2=0x7f9d34101020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 --2- 172.21.15.111:0/2641149505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100bc0 0x7f9d34101020 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009880 tx=0x7f9d2802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 -- 172.21.15.111:0/2641149505 shutdown_connections 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 --2- 172.21.15.111:0/2641149505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100bc0 0x7f9d34101020 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 --2- 172.21.15.111:0/2641149505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d34100280 0x7f9d34100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 -- 172.21.15.111:0/2641149505 >> 172.21.15.111:0/2641149505 conn(0x7f9d340fc010 msgr2=0x7f9d340fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 -- 172.21.15.111:0/2641149505 shutdown_connections 2024-09-16T09:45:54.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.876+0000 7f9d3b515640 1 -- 172.21.15.111:0/2641149505 wait complete. 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d3b515640 1 Processor -- start 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d3b515640 1 -- start start 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d3b515640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 0x7f9d34199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d3b515640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d34100bc0 0x7f9d34199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d3b515640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410ca20 con 0x7f9d34100280 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d3b515640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410c8a0 con 0x7f9d34100bc0 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d392b1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 0x7f9d34199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d392b1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 0x7f9d34199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54632/0 (socket says 172.21.15.111:54632) 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d392b1640 1 -- 172.21.15.111:0/289318243 learned_addr learned my addr 172.21.15.111:0/289318243 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.877+0000 7f9d38ab0640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d34100bc0 0x7f9d34199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d392b1640 1 -- 172.21.15.111:0/289318243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d34100bc0 msgr2=0x7f9d34199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d392b1640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d34100bc0 0x7f9d34199c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d392b1640 1 -- 172.21.15.111:0/289318243 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3419a2d0 con 0x7f9d34100280 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d392b1640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 0x7f9d34199710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000b420 tx=0x7f9d3000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d30011630 con 0x7f9d34100280 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d30016070 con 0x7f9d34100280 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d30010d40 con 0x7f9d34100280 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3419ed10 con 0x7f9d34100280 2024-09-16T09:45:54.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.878+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3419f240 con 0x7f9d34100280 2024-09-16T09:45:54.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.880+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d34100680 con 0x7f9d34100280 2024-09-16T09:45:54.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.880+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7f9d3001b460 con 0x7f9d34100280 2024-09-16T09:45:54.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.881+0000 7f9d267fc640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9d2006e2b0 0x7f9d20070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:54.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.881+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7f9d3008d9c0 con 0x7f9d34100280 2024-09-16T09:45:54.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.881+0000 7f9d38ab0640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9d2006e2b0 0x7f9d20070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:54.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.881+0000 7f9d38ab0640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9d2006e2b0 0x7f9d20070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000c00 tx=0x7f9d280058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:54.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:54.887+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d3005b320 con 0x7f9d34100280 2024-09-16T09:45:55.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.142+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9d3402db70 con 0x7f9d34100280 2024-09-16T09:45:55.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.143+0000 7f9d267fc640 1 -- 172.21.15.111:0/289318243 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f9d3402db70 con 0x7f9d34100280 2024-09-16T09:45:55.144 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:45:55.145 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:45:55.146 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 14 2024-09-16T09:45:55.146 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:45:55.146 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:45:55.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9d2006e2b0 msgr2=0x7f9d20070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:55.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9d2006e2b0 0x7f9d20070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000c00 tx=0x7f9d280058d0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 msgr2=0x7f9d34199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:55.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 0x7f9d34199710 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d3000b420 tx=0x7f9d3000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 shutdown_connections 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7f9d2006e2b0 0x7f9d20070770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d34100bc0 0x7f9d34199c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 --2- 172.21.15.111:0/289318243 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d34100280 0x7f9d34199710 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 >> 172.21.15.111:0/289318243 conn(0x7f9d340fc010 msgr2=0x7f9d34108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 shutdown_connections 2024-09-16T09:45:55.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.146+0000 7f9d3b515640 1 -- 172.21.15.111:0/289318243 wait complete. 2024-09-16T09:45:55.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 -- 172.21.15.111:0/4193660759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 msgr2=0x7feedc1047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 --2- 172.21.15.111:0/4193660759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1047c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7feed80098b0 tx=0x7feed802a4d0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 -- 172.21.15.111:0/4193660759 shutdown_connections 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 --2- 172.21.15.111:0/4193660759 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 0x7feedc1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 --2- 172.21.15.111:0/4193660759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1047c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 -- 172.21.15.111:0/4193660759 >> 172.21.15.111:0/4193660759 conn(0x7feedc0fbff0 msgr2=0x7feedc0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 -- 172.21.15.111:0/4193660759 shutdown_connections 2024-09-16T09:45:55.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.229+0000 7feee3959640 1 -- 172.21.15.111:0/4193660759 wait complete. 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee3959640 1 Processor -- start 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee3959640 1 -- start start 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee3959640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee3959640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 0x7feedc197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee3959640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7feedc10a7c0 con 0x7feedc1023d0 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee3959640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feedc10a640 con 0x7feedc104d00 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee16f5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee16f5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54662/0 (socket says 172.21.15.111:54662) 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee16f5640 1 -- 172.21.15.111:0/3680887101 learned_addr learned my addr 172.21.15.111:0/3680887101 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee0ef4640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 0x7feedc197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee16f5640 1 -- 172.21.15.111:0/3680887101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 msgr2=0x7feedc197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:55.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee16f5640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 0x7feedc197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee16f5640 1 -- 172.21.15.111:0/3680887101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc1980b0 con 0x7feedc1023d0 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.230+0000 7feee0ef4640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 0x7feedc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.231+0000 7feee16f5640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1974f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feed80099d0 tx=0x7feed80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.231+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feed803f070 con 0x7feedc1023d0 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.231+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc19ca90 con 0x7feedc1023d0 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.231+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feed80049d0 con 0x7feedc1023d0 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.231+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc19d020 con 0x7feedc1023d0 2024-09-16T09:45:55.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.231+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feed8035030 con 0x7feedc1023d0 2024-09-16T09:45:55.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.232+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feedc1027b0 con 0x7feedc1023d0 2024-09-16T09:45:55.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.233+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 19) ==== 92553+0+0 (secure 0 0 0) 0x7feed8042070 con 0x7feedc1023d0 2024-09-16T09:45:55.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.233+0000 7feed27fc640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7feec806e310 0x7feec80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:45:55.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.233+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5468+0+0 (secure 0 0 0) 0x7feed80aeb60 con 0x7feedc1023d0 2024-09-16T09:45:55.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.233+0000 7feee0ef4640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7feec806e310 0x7feec80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:45:55.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.234+0000 7feee0ef4640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7feec806e310 0x7feec80707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feedc1989a0 tx=0x7feecc005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:45:55.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.241+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feed80801f0 con 0x7feedc1023d0 2024-09-16T09:45:55.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:55 smithi111 ceph-mon[27997]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:55.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:55 smithi114 ceph-mon[35635]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.516+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 --> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feedc1056e0 con 0x7feec806e310 2024-09-16T09:45:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.519+0000 7feed27fc640 1 -- 172.21.15.111:0/3680887101 <== mgr.14217 v2:172.21.15.111:6800/4213406747 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7feedc1056e0 con 0x7feec806e310 2024-09-16T09:45:55.524 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:45:55.524 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:45:55.524 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:45:55.524 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "0/2 daemons upgraded", 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f image on host smithi114", 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7feec806e310 msgr2=0x7feec80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7feec806e310 0x7feec80707d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feedc1989a0 tx=0x7feecc005f90 comp rx=0 tx=0).stop 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 msgr2=0x7feedc1974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:45:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1974f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7feed80099d0 tx=0x7feed80045e0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 shutdown_connections 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:6800/4213406747,v1:172.21.15.111:6801/4213406747] conn(0x7feec806e310 0x7feec80707d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feedc104d00 0x7feedc197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 --2- 172.21.15.111:0/3680887101 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feedc1023d0 0x7feedc1974f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 >> 172.21.15.111:0/3680887101 conn(0x7feedc0fbff0 msgr2=0x7feedc0fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 shutdown_connections 2024-09-16T09:45:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:45:55.523+0000 7feee3959640 1 -- 172.21.15.111:0/3680887101 wait complete. 2024-09-16T09:45:56.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:56 smithi111 ceph-mon[27997]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:56 smithi111 ceph-mon[27997]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:56 smithi111 ceph-mon[27997]: pgmap v251: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-09-16T09:45:56.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:56 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/289318243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:45:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:56 smithi114 ceph-mon[35635]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:56 smithi114 ceph-mon[35635]: from='client.24369 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:56 smithi114 ceph-mon[35635]: pgmap v251: 65 pgs: 65 active+clean; 309 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s rd, 3.6 MiB/s wr, 267 op/s 2024-09-16T09:45:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:56 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/289318243' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:45:57.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:57 smithi111 ceph-mon[27997]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:57.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:57 smithi114 ceph-mon[35635]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:45:58.268 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:45:58 smithi114 ceph-mon[35635]: pgmap v252: 65 pgs: 65 active+clean; 311 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 321 op/s 2024-09-16T09:45:58.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:45:58 smithi111 ceph-mon[27997]: pgmap v252: 65 pgs: 65 active+clean; 311 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 321 op/s 2024-09-16T09:46:00.091 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:00 smithi114 ceph-mon[35635]: pgmap v253: 65 pgs: 65 active+clean; 311 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 294 op/s 2024-09-16T09:46:00.091 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:00.091 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:46:00.091 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:46:00.091 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:00 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:00.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:00 smithi111 ceph-mon[27997]: pgmap v253: 65 pgs: 65 active+clean; 311 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.6 MiB/s wr, 294 op/s 2024-09-16T09:46:00.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:00.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:46:00.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:46:00.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:00 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:01.240 INFO:tasks.workunit.client.0.smithi111.stdout:3/5: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:1/21: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:5/98: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:0/88: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:4/34: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:8/2: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:8/3: dwrite - no filename 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:8/4: stat - no entries 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:2/15: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:2/16: read - no filename 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/7: sync 2024-09-16T09:46:01.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/8: truncate - no filename 2024-09-16T09:46:01.242 INFO:tasks.workunit.client.0.smithi111.stdout:2/17: write - no filename 2024-09-16T09:46:01.242 INFO:tasks.workunit.client.0.smithi111.stdout:2/18: truncate - no filename 2024-09-16T09:46:01.242 INFO:tasks.workunit.client.0.smithi111.stdout:9/3: sync 2024-09-16T09:46:01.242 INFO:tasks.workunit.client.0.smithi111.stdout:7/64: sync 2024-09-16T09:46:01.242 INFO:tasks.workunit.client.0.smithi111.stdout:9/4: write d0/f1 [48016,25387] 0 2024-09-16T09:46:01.242 INFO:tasks.workunit.client.0.smithi111.stdout:5/99: unlink c16 0 2024-09-16T09:46:01.244 INFO:tasks.workunit.client.0.smithi111.stdout:0/89: truncate d0/ff 5697229 0 2024-09-16T09:46:01.245 INFO:tasks.workunit.client.0.smithi111.stdout:4/35: getdents d2 0 2024-09-16T09:46:01.245 INFO:tasks.workunit.client.0.smithi111.stdout:4/36: write d2/f5 [552589,7406] 0 2024-09-16T09:46:01.246 INFO:tasks.workunit.client.0.smithi111.stdout:1/22: creat d3/f7 x:0 0 0 2024-09-16T09:46:01.246 INFO:tasks.workunit.client.0.smithi111.stdout:9/5: dread d0/f1 [0,4194304] 0 2024-09-16T09:46:01.247 INFO:tasks.workunit.client.0.smithi111.stdout:8/5: creat f0 x:0 0 0 2024-09-16T09:46:01.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/19: mkdir d0 0 2024-09-16T09:46:01.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/20: dwrite - no filename 2024-09-16T09:46:01.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/21: dread - no filename 2024-09-16T09:46:01.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/22: dwrite - no filename 2024-09-16T09:46:01.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/23: readlink - no filename 2024-09-16T09:46:01.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/24: write - no filename 2024-09-16T09:46:01.250 INFO:tasks.workunit.client.0.smithi111.stdout:6/9: creat d0/f1 x:0 0 0 2024-09-16T09:46:01.250 INFO:tasks.workunit.client.0.smithi111.stdout:6/10: write d0/f1 [574967,114982] 0 2024-09-16T09:46:01.250 INFO:tasks.workunit.client.0.smithi111.stdout:5/100: rename d19/d20 to d19/d1b/d27 0 2024-09-16T09:46:01.252 INFO:tasks.workunit.client.0.smithi111.stdout:4/37: creat d2/f7 x:0 0 0 2024-09-16T09:46:01.253 INFO:tasks.workunit.client.0.smithi111.stdout:9/6: rmdir d0 39 2024-09-16T09:46:01.254 INFO:tasks.workunit.client.0.smithi111.stdout:9/7: chown d0 887 1 2024-09-16T09:46:01.255 INFO:tasks.workunit.client.0.smithi111.stdout:2/25: creat d0/f1 x:0 0 0 2024-09-16T09:46:01.255 INFO:tasks.workunit.client.0.smithi111.stdout:2/26: chown d0 3588361 1 2024-09-16T09:46:01.255 INFO:tasks.workunit.client.0.smithi111.stdout:2/27: readlink - no filename 2024-09-16T09:46:01.255 INFO:tasks.workunit.client.0.smithi111.stdout:2/28: chown d0/f1 63 1 2024-09-16T09:46:01.257 INFO:tasks.workunit.client.0.smithi111.stdout:7/65: truncate d1/d9/fa 116182 0 2024-09-16T09:46:01.257 INFO:tasks.workunit.client.0.smithi111.stdout:7/66: dread - d1/d9/f15 zero size 2024-09-16T09:46:01.258 INFO:tasks.workunit.client.0.smithi111.stdout:6/11: creat d0/f2 x:0 0 0 2024-09-16T09:46:01.258 INFO:tasks.workunit.client.0.smithi111.stdout:6/12: dread - d0/f2 zero size 2024-09-16T09:46:01.258 INFO:tasks.workunit.client.0.smithi111.stdout:5/101: mknod d19/d1b/d27/d25/c28 0 2024-09-16T09:46:01.260 INFO:tasks.workunit.client.0.smithi111.stdout:4/38: rename d2/f5 to d2/f8 0 2024-09-16T09:46:01.261 INFO:tasks.workunit.client.0.smithi111.stdout:1/23: symlink d3/l8 0 2024-09-16T09:46:01.262 INFO:tasks.workunit.client.0.smithi111.stdout:9/8: mknod d0/c2 0 2024-09-16T09:46:01.265 INFO:tasks.workunit.client.0.smithi111.stdout:7/67: mkdir d1/d16/d17 0 2024-09-16T09:46:01.266 INFO:tasks.workunit.client.0.smithi111.stdout:5/102: mkdir d19/d1b/d1e/d21/d29 0 2024-09-16T09:46:01.266 INFO:tasks.workunit.client.0.smithi111.stdout:5/103: truncate f12 592606 0 2024-09-16T09:46:01.268 INFO:tasks.workunit.client.0.smithi111.stdout:4/39: link d2/c3 d2/c9 0 2024-09-16T09:46:01.271 INFO:tasks.workunit.client.0.smithi111.stdout:1/24: creat d3/f9 x:0 0 0 2024-09-16T09:46:01.271 INFO:tasks.workunit.client.0.smithi111.stdout:1/25: read - d3/f9 zero size 2024-09-16T09:46:01.273 INFO:tasks.workunit.client.0.smithi111.stdout:9/9: unlink d0/f1 0 2024-09-16T09:46:01.275 INFO:tasks.workunit.client.0.smithi111.stdout:5/104: mkdir d19/d1b/d27/d25/d2a 0 2024-09-16T09:46:01.277 INFO:tasks.workunit.client.0.smithi111.stdout:4/40: symlink d2/la 0 2024-09-16T09:46:01.277 INFO:tasks.workunit.client.0.smithi111.stdout:4/41: chown c1 4 1 2024-09-16T09:46:01.277 INFO:tasks.workunit.client.0.smithi111.stdout:4/42: write d2/f8 [720017,124952] 0 2024-09-16T09:46:01.277 INFO:tasks.workunit.client.0.smithi111.stdout:1/26: creat d3/fa x:0 0 0 2024-09-16T09:46:01.278 INFO:tasks.workunit.client.0.smithi111.stdout:1/27: dread - d3/f7 zero size 2024-09-16T09:46:01.279 INFO:tasks.workunit.client.0.smithi111.stdout:9/10: symlink d0/l3 0 2024-09-16T09:46:01.281 INFO:tasks.workunit.client.0.smithi111.stdout:4/43: rename d2/f7 to d2/fb 0 2024-09-16T09:46:01.283 INFO:tasks.workunit.client.0.smithi111.stdout:1/28: rmdir d3 39 2024-09-16T09:46:01.283 INFO:tasks.workunit.client.0.smithi111.stdout:1/29: fsync f1 0 2024-09-16T09:46:01.283 INFO:tasks.workunit.client.0.smithi111.stdout:6/13: dwrite d0/f2 [0,4194304] 0 2024-09-16T09:46:01.283 INFO:tasks.workunit.client.0.smithi111.stdout:6/14: write d0/f1 [1116428,32459] 0 2024-09-16T09:46:01.284 INFO:tasks.workunit.client.0.smithi111.stdout:9/11: symlink d0/l4 0 2024-09-16T09:46:01.286 INFO:tasks.workunit.client.0.smithi111.stdout:4/44: creat d2/d6/fc x:0 0 0 2024-09-16T09:46:01.286 INFO:tasks.workunit.client.0.smithi111.stdout:4/45: read - d2/d6/fc zero size 2024-09-16T09:46:01.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/68: dwrite d1/f14 [0,4194304] 0 2024-09-16T09:46:01.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/69: chown d1/d9/cb 978363 1 2024-09-16T09:46:01.289 INFO:tasks.workunit.client.0.smithi111.stdout:6/15: rmdir d0 39 2024-09-16T09:46:01.289 INFO:tasks.workunit.client.0.smithi111.stdout:6/16: chown d0/f1 3 1 2024-09-16T09:46:01.290 INFO:tasks.workunit.client.0.smithi111.stdout:9/12: creat d0/f5 x:0 0 0 2024-09-16T09:46:01.292 INFO:tasks.workunit.client.0.smithi111.stdout:4/46: mkdir d2/d6/dd 0 2024-09-16T09:46:01.293 INFO:tasks.workunit.client.0.smithi111.stdout:5/105: dwrite fc [0,4194304] 0 2024-09-16T09:46:01.297 INFO:tasks.workunit.client.0.smithi111.stdout:1/30: mknod d3/cb 0 2024-09-16T09:46:01.297 INFO:tasks.workunit.client.0.smithi111.stdout:1/31: chown d3/f6 67 1 2024-09-16T09:46:01.299 INFO:tasks.workunit.client.0.smithi111.stdout:6/17: link d0/f1 d0/f3 0 2024-09-16T09:46:01.303 INFO:tasks.workunit.client.0.smithi111.stdout:5/106: creat d19/d1b/d27/d25/f2b x:0 0 0 2024-09-16T09:46:01.303 INFO:tasks.workunit.client.0.smithi111.stdout:5/107: readlink l9 0 2024-09-16T09:46:01.307 INFO:tasks.workunit.client.0.smithi111.stdout:1/32: symlink d3/lc 0 2024-09-16T09:46:01.309 INFO:tasks.workunit.client.0.smithi111.stdout:9/13: dwrite d0/f5 [0,4194304] 0 2024-09-16T09:46:01.317 INFO:tasks.workunit.client.0.smithi111.stdout:9/14: mkdir d0/d6 0 2024-09-16T09:46:01.317 INFO:tasks.workunit.client.0.smithi111.stdout:5/108: dwrite f12 [0,4194304] 0 2024-09-16T09:46:01.317 INFO:tasks.workunit.client.0.smithi111.stdout:5/109: truncate d19/d1b/d27/d25/f2b 985828 0 2024-09-16T09:46:01.318 INFO:tasks.workunit.client.0.smithi111.stdout:9/15: creat d0/d6/f7 x:0 0 0 2024-09-16T09:46:01.322 INFO:tasks.workunit.client.0.smithi111.stdout:5/110: symlink d19/d1b/d1e/l2c 0 2024-09-16T09:46:01.335 INFO:tasks.workunit.client.0.smithi111.stdout:9/16: write d0/f5 [2699620,124525] 0 2024-09-16T09:46:01.335 INFO:tasks.workunit.client.0.smithi111.stdout:6/18: dwrite d0/f1 [0,4194304] 0 2024-09-16T09:46:01.335 INFO:tasks.workunit.client.0.smithi111.stdout:9/17: write d0/f5 [1647277,69749] 0 2024-09-16T09:46:01.335 INFO:tasks.workunit.client.0.smithi111.stdout:9/18: write d0/d6/f7 [619384,51089] 0 2024-09-16T09:46:01.335 INFO:tasks.workunit.client.0.smithi111.stdout:9/19: readlink d0/l3 0 2024-09-16T09:46:01.336 INFO:tasks.workunit.client.0.smithi111.stdout:8/6: getdents . 0 2024-09-16T09:46:01.337 INFO:tasks.workunit.client.0.smithi111.stdout:8/7: write f0 [1041134,120931] 0 2024-09-16T09:46:01.337 INFO:tasks.workunit.client.0.smithi111.stdout:6/19: mknod d0/c4 0 2024-09-16T09:46:01.338 INFO:tasks.workunit.client.0.smithi111.stdout:9/20: mkdir d0/d6/d8 0 2024-09-16T09:46:01.340 INFO:tasks.workunit.client.0.smithi111.stdout:8/8: creat f1 x:0 0 0 2024-09-16T09:46:01.342 INFO:tasks.workunit.client.0.smithi111.stdout:5/111: dwrite f10 [4194304,4194304] 0 2024-09-16T09:46:01.344 INFO:tasks.workunit.client.0.smithi111.stdout:8/9: mknod c2 0 2024-09-16T09:46:01.344 INFO:tasks.workunit.client.0.smithi111.stdout:8/10: truncate f1 776663 0 2024-09-16T09:46:01.345 INFO:tasks.workunit.client.0.smithi111.stdout:2/29: getdents d0 0 2024-09-16T09:46:01.349 INFO:tasks.workunit.client.0.smithi111.stdout:7/70: dread d1/d9/fa [0,4194304] 0 2024-09-16T09:46:01.355 INFO:tasks.workunit.client.0.smithi111.stdout:7/71: mkdir d1/d16/d17/d18 0 2024-09-16T09:46:01.356 INFO:tasks.workunit.client.0.smithi111.stdout:6/20: dread d0/f2 [0,4194304] 0 2024-09-16T09:46:01.358 INFO:tasks.workunit.client.0.smithi111.stdout:6/21: mknod d0/c5 0 2024-09-16T09:46:01.362 INFO:tasks.workunit.client.0.smithi111.stdout:7/72: write d1/f14 [1079574,36790] 0 2024-09-16T09:46:01.365 INFO:tasks.workunit.client.0.smithi111.stdout:7/73: symlink d1/d16/d17/l19 0 2024-09-16T09:46:01.366 INFO:tasks.workunit.client.0.smithi111.stdout:6/22: dread d0/f2 [0,4194304] 0 2024-09-16T09:46:01.366 INFO:tasks.workunit.client.0.smithi111.stdout:2/30: dwrite d0/f1 [0,4194304] 0 2024-09-16T09:46:01.370 INFO:tasks.workunit.client.0.smithi111.stdout:2/31: mkdir d0/d2 0 2024-09-16T09:46:01.372 INFO:tasks.workunit.client.0.smithi111.stdout:6/23: creat d0/f6 x:0 0 0 2024-09-16T09:46:01.374 INFO:tasks.workunit.client.0.smithi111.stdout:2/32: link d0/f1 d0/d2/f3 0 2024-09-16T09:46:01.376 INFO:tasks.workunit.client.0.smithi111.stdout:7/74: dwrite d1/f13 [0,4194304] 0 2024-09-16T09:46:01.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:01 smithi111 ceph-mon[27997]: Upgrade: Updating mgr.smithi114.xvotey 2024-09-16T09:46:01.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:01 smithi111 ceph-mon[27997]: Deploying daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:46:01.382 INFO:tasks.workunit.client.0.smithi111.stdout:6/24: mknod d0/c7 0 2024-09-16T09:46:01.383 INFO:tasks.workunit.client.0.smithi111.stdout:6/25: fsync d0/f3 0 2024-09-16T09:46:01.385 INFO:tasks.workunit.client.0.smithi111.stdout:7/75: chown d1/l3 76284 1 2024-09-16T09:46:01.388 INFO:tasks.workunit.client.0.smithi111.stdout:6/26: symlink d0/l8 0 2024-09-16T09:46:01.390 INFO:tasks.workunit.client.0.smithi111.stdout:9/21: fsync d0/d6/f7 0 2024-09-16T09:46:01.390 INFO:tasks.workunit.client.0.smithi111.stdout:9/22: fsync d0/d6/f7 0 2024-09-16T09:46:01.390 INFO:tasks.workunit.client.0.smithi111.stdout:9/23: write d0/f5 [3202726,65257] 0 2024-09-16T09:46:01.390 INFO:tasks.workunit.client.0.smithi111.stdout:9/24: write d0/d6/f7 [1038334,79113] 0 2024-09-16T09:46:01.391 INFO:tasks.workunit.client.0.smithi111.stdout:9/25: mknod d0/d6/d8/c9 0 2024-09-16T09:46:01.392 INFO:tasks.workunit.client.0.smithi111.stdout:5/112: getdents d19/d1b/d1e 0 2024-09-16T09:46:01.394 INFO:tasks.workunit.client.0.smithi111.stdout:6/27: dread d0/f2 [0,4194304] 0 2024-09-16T09:46:01.394 INFO:tasks.workunit.client.0.smithi111.stdout:6/28: readlink d0/l8 0 2024-09-16T09:46:01.394 INFO:tasks.workunit.client.0.smithi111.stdout:5/113: symlink d19/d1b/d1e/d21/l2d 0 2024-09-16T09:46:01.394 INFO:tasks.workunit.client.0.smithi111.stdout:9/26: fsync d0/f5 0 2024-09-16T09:46:01.403 INFO:tasks.workunit.client.0.smithi111.stdout:9/27: dread d0/f5 [0,4194304] 0 2024-09-16T09:46:01.404 INFO:tasks.workunit.client.0.smithi111.stdout:8/11: getdents . 0 2024-09-16T09:46:01.404 INFO:tasks.workunit.client.0.smithi111.stdout:8/12: fdatasync f0 0 2024-09-16T09:46:01.405 INFO:tasks.workunit.client.0.smithi111.stdout:8/13: write f0 [950415,53875] 0 2024-09-16T09:46:01.410 INFO:tasks.workunit.client.0.smithi111.stdout:8/14: dread f0 [0,4194304] 0 2024-09-16T09:46:01.410 INFO:tasks.workunit.client.0.smithi111.stdout:8/15: write f1 [1125892,82802] 0 2024-09-16T09:46:01.411 INFO:tasks.workunit.client.0.smithi111.stdout:8/16: fsync f1 0 2024-09-16T09:46:01.413 INFO:tasks.workunit.client.0.smithi111.stdout:6/29: fsync d0/f6 0 2024-09-16T09:46:01.414 INFO:tasks.workunit.client.0.smithi111.stdout:2/33: fsync d0/f1 0 2024-09-16T09:46:01.415 INFO:tasks.workunit.client.0.smithi111.stdout:8/17: dread f1 [0,4194304] 0 2024-09-16T09:46:01.415 INFO:tasks.workunit.client.0.smithi111.stdout:6/30: rename d0/l8 to d0/l9 0 2024-09-16T09:46:01.417 INFO:tasks.workunit.client.0.smithi111.stdout:8/18: mkdir d3 0 2024-09-16T09:46:01.417 INFO:tasks.workunit.client.0.smithi111.stdout:8/19: getdents d3 0 2024-09-16T09:46:01.425 INFO:tasks.workunit.client.0.smithi111.stdout:2/34: dread d0/f1 [0,4194304] 0 2024-09-16T09:46:01.426 INFO:tasks.workunit.client.0.smithi111.stdout:2/35: rename d0/f1 to d0/f4 0 2024-09-16T09:46:01.427 INFO:tasks.workunit.client.0.smithi111.stdout:6/31: truncate d0/f3 3516965 0 2024-09-16T09:46:01.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/36: dread d0/f4 [0,4194304] 0 2024-09-16T09:46:01.433 INFO:tasks.workunit.client.0.smithi111.stdout:2/37: getdents d0/d2 0 2024-09-16T09:46:01.435 INFO:tasks.workunit.client.0.smithi111.stdout:2/38: link d0/d2/f3 d0/f5 0 2024-09-16T09:46:01.436 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:01 smithi114 ceph-mon[35635]: Upgrade: Updating mgr.smithi114.xvotey 2024-09-16T09:46:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:01 smithi114 ceph-mon[35635]: Deploying daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:46:01.443 INFO:tasks.workunit.client.0.smithi111.stdout:2/39: write d0/f4 [3384052,69770] 0 2024-09-16T09:46:01.443 INFO:tasks.workunit.client.0.smithi111.stdout:2/40: write d0/f5 [1307113,53414] 0 2024-09-16T09:46:01.446 INFO:tasks.workunit.client.0.smithi111.stdout:9/28: truncate d0/f5 3081206 0 2024-09-16T09:46:01.446 INFO:tasks.workunit.client.0.smithi111.stdout:9/29: readlink d0/l4 0 2024-09-16T09:46:01.446 INFO:tasks.workunit.client.0.smithi111.stdout:9/30: chown d0/d6/d8/c9 163882905 1 2024-09-16T09:46:01.446 INFO:tasks.workunit.client.0.smithi111.stdout:9/31: chown d0/d6/d8/c9 33333065 1 2024-09-16T09:46:01.446 INFO:tasks.workunit.client.0.smithi111.stdout:2/41: symlink d0/d2/l6 0 2024-09-16T09:46:01.446 INFO:tasks.workunit.client.0.smithi111.stdout:2/42: write d0/f5 [2638500,48765] 0 2024-09-16T09:46:01.448 INFO:tasks.workunit.client.0.smithi111.stdout:2/43: creat d0/f7 x:0 0 0 2024-09-16T09:46:01.450 INFO:tasks.workunit.client.0.smithi111.stdout:2/44: mkdir d0/d8 0 2024-09-16T09:46:01.451 INFO:tasks.workunit.client.0.smithi111.stdout:7/76: dwrite d1/d9/fe [0,4194304] 0 2024-09-16T09:46:01.451 INFO:tasks.workunit.client.0.smithi111.stdout:2/45: creat d0/f9 x:0 0 0 2024-09-16T09:46:01.454 INFO:tasks.workunit.client.0.smithi111.stdout:7/77: creat d1/f1a x:0 0 0 2024-09-16T09:46:01.456 INFO:tasks.workunit.client.0.smithi111.stdout:2/46: rename d0/d8 to d0/da 0 2024-09-16T09:46:01.456 INFO:tasks.workunit.client.0.smithi111.stdout:2/47: write d0/d2/f3 [4389531,24765] 0 2024-09-16T09:46:01.457 INFO:tasks.workunit.client.0.smithi111.stdout:2/48: write d0/f4 [4540329,68618] 0 2024-09-16T09:46:01.457 INFO:tasks.workunit.client.0.smithi111.stdout:2/49: readlink d0/d2/l6 0 2024-09-16T09:46:01.461 INFO:tasks.workunit.client.0.smithi111.stdout:2/50: creat d0/da/fb x:0 0 0 2024-09-16T09:46:01.461 INFO:tasks.workunit.client.0.smithi111.stdout:2/51: chown d0/d2 347531137 1 2024-09-16T09:46:01.462 INFO:tasks.workunit.client.0.smithi111.stdout:2/52: creat d0/fc x:0 0 0 2024-09-16T09:46:01.462 INFO:tasks.workunit.client.0.smithi111.stdout:2/53: truncate d0/f9 1026699 0 2024-09-16T09:46:01.464 INFO:tasks.workunit.client.0.smithi111.stdout:2/54: rmdir d0/d2 39 2024-09-16T09:46:01.465 INFO:tasks.workunit.client.0.smithi111.stdout:2/55: mkdir d0/dd 0 2024-09-16T09:46:01.467 INFO:tasks.workunit.client.0.smithi111.stdout:2/56: mknod d0/ce 0 2024-09-16T09:46:01.468 INFO:tasks.workunit.client.0.smithi111.stdout:7/78: dwrite d1/d9/fa [0,4194304] 0 2024-09-16T09:46:01.470 INFO:tasks.workunit.client.0.smithi111.stdout:2/57: rmdir d0/dd 0 2024-09-16T09:46:01.475 INFO:tasks.workunit.client.0.smithi111.stdout:7/79: mkdir d1/d16/d17/d18/d1b 0 2024-09-16T09:46:01.475 INFO:tasks.workunit.client.0.smithi111.stdout:7/80: stat d1/d9/cb 0 2024-09-16T09:46:01.475 INFO:tasks.workunit.client.0.smithi111.stdout:7/81: readlink d1/d16/d17/l19 0 2024-09-16T09:46:01.477 INFO:tasks.workunit.client.0.smithi111.stdout:7/82: rename d1/d9/f11 to d1/d16/f1c 0 2024-09-16T09:46:01.477 INFO:tasks.workunit.client.0.smithi111.stdout:7/83: dread - d1/d16/f1c zero size 2024-09-16T09:46:01.477 INFO:tasks.workunit.client.0.smithi111.stdout:7/84: stat d1/l3 0 2024-09-16T09:46:01.478 INFO:tasks.workunit.client.0.smithi111.stdout:7/85: fsync d1/d9/fe 0 2024-09-16T09:46:01.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/58: dread d0/d2/f3 [0,4194304] 0 2024-09-16T09:46:01.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/59: readlink d0/d2/l6 0 2024-09-16T09:46:01.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/60: readlink d0/d2/l6 0 2024-09-16T09:46:01.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/61: readlink d0/d2/l6 0 2024-09-16T09:46:01.482 INFO:tasks.workunit.client.0.smithi111.stdout:7/86: mkdir d1/d16/d17/d18/d1d 0 2024-09-16T09:46:01.486 INFO:tasks.workunit.client.0.smithi111.stdout:7/87: mknod d1/d16/d17/c1e 0 2024-09-16T09:46:01.491 INFO:tasks.workunit.client.0.smithi111.stdout:6/32: fsync d0/f1 0 2024-09-16T09:46:01.493 INFO:tasks.workunit.client.0.smithi111.stdout:6/33: rename d0/c5 to d0/ca 0 2024-09-16T09:46:01.501 INFO:tasks.workunit.client.0.smithi111.stdout:6/34: dread d0/f1 [0,4194304] 0 2024-09-16T09:46:01.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/35: stat d0/ca 0 2024-09-16T09:46:01.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/36: truncate d0/f6 105200 0 2024-09-16T09:46:01.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/37: fsync d0/f3 0 2024-09-16T09:46:01.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/38: chown d0/c7 2 1 2024-09-16T09:46:01.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/39: symlink d0/lb 0 2024-09-16T09:46:01.503 INFO:tasks.workunit.client.0.smithi111.stdout:6/40: creat d0/fc x:0 0 0 2024-09-16T09:46:01.507 INFO:tasks.workunit.client.0.smithi111.stdout:9/32: write d0/f5 [371210,37948] 0 2024-09-16T09:46:01.508 INFO:tasks.workunit.client.0.smithi111.stdout:9/33: getdents d0/d6 0 2024-09-16T09:46:01.512 INFO:tasks.workunit.client.0.smithi111.stdout:9/34: getdents d0 0 2024-09-16T09:46:01.512 INFO:tasks.workunit.client.0.smithi111.stdout:2/62: fsync d0/f9 0 2024-09-16T09:46:01.512 INFO:tasks.workunit.client.0.smithi111.stdout:2/63: write d0/f5 [3727040,130140] 0 2024-09-16T09:46:01.515 INFO:tasks.workunit.client.0.smithi111.stdout:2/64: unlink d0/f9 0 2024-09-16T09:46:01.517 INFO:tasks.workunit.client.0.smithi111.stdout:9/35: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:01.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/36: mknod d0/d6/ca 0 2024-09-16T09:46:01.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/37: write d0/f5 [717118,59813] 0 2024-09-16T09:46:01.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/38: write d0/d6/f7 [1212808,59757] 0 2024-09-16T09:46:01.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/39: write d0/f5 [3871469,117192] 0 2024-09-16T09:46:01.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/40: rename d0/d6 to d0/d6/db 22 2024-09-16T09:46:01.531 INFO:tasks.workunit.client.0.smithi111.stdout:9/41: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:01.531 INFO:tasks.workunit.client.0.smithi111.stdout:9/42: rename d0 to d0/d6/d8/dc 22 2024-09-16T09:46:01.531 INFO:tasks.workunit.client.0.smithi111.stdout:2/65: dread d0/f4 [0,4194304] 0 2024-09-16T09:46:01.532 INFO:tasks.workunit.client.0.smithi111.stdout:9/43: read d0/d6/f7 [950994,129735] 0 2024-09-16T09:46:01.534 INFO:tasks.workunit.client.0.smithi111.stdout:2/66: creat d0/ff x:0 0 0 2024-09-16T09:46:01.535 INFO:tasks.workunit.client.0.smithi111.stdout:9/44: creat d0/d6/d8/fd x:0 0 0 2024-09-16T09:46:01.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/67: creat d0/f10 x:0 0 0 2024-09-16T09:46:01.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/68: rename d0 to d0/da/d11 22 2024-09-16T09:46:01.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/69: creat d0/d2/f12 x:0 0 0 2024-09-16T09:46:01.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/70: dread - d0/f10 zero size 2024-09-16T09:46:01.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/71: chown d0/da 1085811581 1 2024-09-16T09:46:01.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/72: readlink d0/d2/l6 0 2024-09-16T09:46:01.540 INFO:tasks.workunit.client.0.smithi111.stdout:2/73: link d0/f5 d0/d2/f13 0 2024-09-16T09:46:01.557 INFO:tasks.workunit.client.0.smithi111.stdout:9/45: dwrite d0/d6/d8/fd [0,4194304] 0 2024-09-16T09:46:01.562 INFO:tasks.workunit.client.0.smithi111.stdout:9/46: mkdir d0/d6/d8/de 0 2024-09-16T09:46:01.562 INFO:tasks.workunit.client.0.smithi111.stdout:9/47: readlink d0/l4 0 2024-09-16T09:46:01.565 INFO:tasks.workunit.client.0.smithi111.stdout:9/48: link d0/d6/d8/c9 d0/d6/d8/de/cf 0 2024-09-16T09:46:01.565 INFO:tasks.workunit.client.0.smithi111.stdout:9/49: write d0/f5 [1882946,83961] 0 2024-09-16T09:46:01.566 INFO:tasks.workunit.client.0.smithi111.stdout:9/50: symlink d0/l10 0 2024-09-16T09:46:01.570 INFO:tasks.workunit.client.0.smithi111.stdout:2/74: dwrite d0/d2/f13 [0,4194304] 0 2024-09-16T09:46:01.570 INFO:tasks.workunit.client.0.smithi111.stdout:2/75: dread - d0/f10 zero size 2024-09-16T09:46:01.570 INFO:tasks.workunit.client.0.smithi111.stdout:2/76: chown d0/da/fb 30790 1 2024-09-16T09:46:01.571 INFO:tasks.workunit.client.0.smithi111.stdout:6/41: getdents d0 0 2024-09-16T09:46:01.572 INFO:tasks.workunit.client.0.smithi111.stdout:9/51: rename d0/f5 to d0/d6/d8/de/f11 0 2024-09-16T09:46:01.575 INFO:tasks.workunit.client.0.smithi111.stdout:6/42: dread d0/f1 [0,4194304] 0 2024-09-16T09:46:01.575 INFO:tasks.workunit.client.0.smithi111.stdout:2/77: rename d0/da/fb to d0/d2/f14 0 2024-09-16T09:46:01.575 INFO:tasks.workunit.client.0.smithi111.stdout:6/43: read d0/f2 [187255,67809] 0 2024-09-16T09:46:01.578 INFO:tasks.workunit.client.0.smithi111.stdout:9/52: creat d0/d6/f12 x:0 0 0 2024-09-16T09:46:01.580 INFO:tasks.workunit.client.0.smithi111.stdout:2/78: creat d0/d2/f15 x:0 0 0 2024-09-16T09:46:01.581 INFO:tasks.workunit.client.0.smithi111.stdout:9/53: symlink d0/d6/d8/de/l13 0 2024-09-16T09:46:01.593 INFO:tasks.workunit.client.0.smithi111.stdout:6/44: dwrite d0/f1 [0,4194304] 0 2024-09-16T09:46:01.604 INFO:tasks.workunit.client.0.smithi111.stdout:2/79: link d0/d2/f14 d0/f16 0 2024-09-16T09:46:01.610 INFO:tasks.workunit.client.0.smithi111.stdout:6/45: dwrite d0/f2 [4194304,4194304] 0 2024-09-16T09:46:01.610 INFO:tasks.workunit.client.0.smithi111.stdout:6/46: chown d0/ca 13330 1 2024-09-16T09:46:01.613 INFO:tasks.workunit.client.0.smithi111.stdout:9/54: truncate d0/d6/d8/de/f11 159984 0 2024-09-16T09:46:01.613 INFO:tasks.workunit.client.0.smithi111.stdout:9/55: dread - d0/d6/f12 zero size 2024-09-16T09:46:01.614 INFO:tasks.workunit.client.0.smithi111.stdout:9/56: write d0/d6/f12 [395542,97616] 0 2024-09-16T09:46:01.616 INFO:tasks.workunit.client.0.smithi111.stdout:2/80: write d0/d2/f13 [2263469,29420] 0 2024-09-16T09:46:01.616 INFO:tasks.workunit.client.0.smithi111.stdout:2/81: chown d0 1 1 2024-09-16T09:46:01.616 INFO:tasks.workunit.client.0.smithi111.stdout:2/82: dread - d0/fc zero size 2024-09-16T09:46:01.616 INFO:tasks.workunit.client.0.smithi111.stdout:9/57: rename d0/l10 to d0/d6/l14 0 2024-09-16T09:46:01.617 INFO:tasks.workunit.client.0.smithi111.stdout:2/83: creat d0/d2/f17 x:0 0 0 2024-09-16T09:46:01.618 INFO:tasks.workunit.client.0.smithi111.stdout:9/58: mkdir d0/d6/d8/d15 0 2024-09-16T09:46:01.618 INFO:tasks.workunit.client.0.smithi111.stdout:9/59: fdatasync d0/d6/f7 0 2024-09-16T09:46:01.620 INFO:tasks.workunit.client.0.smithi111.stdout:2/84: creat d0/d2/f18 x:0 0 0 2024-09-16T09:46:01.621 INFO:tasks.workunit.client.0.smithi111.stdout:6/47: write d0/f1 [710289,5484] 0 2024-09-16T09:46:01.621 INFO:tasks.workunit.client.0.smithi111.stdout:2/85: mkdir d0/da/d19 0 2024-09-16T09:46:01.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/48: creat d0/fd x:0 0 0 2024-09-16T09:46:01.625 INFO:tasks.workunit.client.0.smithi111.stdout:2/86: rmdir d0/da/d19 0 2024-09-16T09:46:01.627 INFO:tasks.workunit.client.0.smithi111.stdout:2/87: mknod d0/c1a 0 2024-09-16T09:46:01.628 INFO:tasks.workunit.client.0.smithi111.stdout:2/88: symlink d0/l1b 0 2024-09-16T09:46:01.630 INFO:tasks.workunit.client.0.smithi111.stdout:2/89: symlink d0/da/l1c 0 2024-09-16T09:46:01.637 INFO:tasks.workunit.client.0.smithi111.stdout:9/60: dwrite d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:01.640 INFO:tasks.workunit.client.0.smithi111.stdout:2/90: fsync d0/d2/f18 0 2024-09-16T09:46:01.640 INFO:tasks.workunit.client.0.smithi111.stdout:2/91: chown d0/d2/f3 577662336 1 2024-09-16T09:46:01.644 INFO:tasks.workunit.client.0.smithi111.stdout:2/92: rename d0/da/l1c to d0/da/l1d 0 2024-09-16T09:46:01.644 INFO:tasks.workunit.client.0.smithi111.stdout:6/49: getdents d0 0 2024-09-16T09:46:01.645 INFO:tasks.workunit.client.0.smithi111.stdout:6/50: dread d0/f6 [0,4194304] 0 2024-09-16T09:46:01.648 INFO:tasks.workunit.client.0.smithi111.stdout:2/93: rename d0/f5 to d0/d2/f1e 0 2024-09-16T09:46:01.651 INFO:tasks.workunit.client.0.smithi111.stdout:2/94: rename d0/d2/f3 to d0/d2/f1f 0 2024-09-16T09:46:01.656 INFO:tasks.workunit.client.0.smithi111.stdout:9/61: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:01.659 INFO:tasks.workunit.client.0.smithi111.stdout:9/62: rmdir d0/d6/d8/d15 0 2024-09-16T09:46:01.664 INFO:tasks.workunit.client.0.smithi111.stdout:9/63: mknod d0/d6/c16 0 2024-09-16T09:46:01.664 INFO:tasks.workunit.client.0.smithi111.stdout:2/95: truncate d0/d2/f1f 3638263 0 2024-09-16T09:46:01.676 INFO:tasks.workunit.client.0.smithi111.stdout:9/64: truncate d0/d6/f7 83468 0 2024-09-16T09:46:01.679 INFO:tasks.workunit.client.0.smithi111.stdout:9/65: dread d0/d6/f12 [0,4194304] 0 2024-09-16T09:46:01.694 INFO:tasks.workunit.client.0.smithi111.stdout:2/96: dwrite d0/f4 [4194304,4194304] 0 2024-09-16T09:46:01.695 INFO:tasks.workunit.client.0.smithi111.stdout:2/97: mknod d0/c20 0 2024-09-16T09:46:01.696 INFO:tasks.workunit.client.0.smithi111.stdout:2/98: chown d0/da/l1d 638485832 1 2024-09-16T09:46:01.696 INFO:tasks.workunit.client.0.smithi111.stdout:2/99: readlink d0/da/l1d 0 2024-09-16T09:46:01.696 INFO:tasks.workunit.client.0.smithi111.stdout:2/100: read - d0/d2/f18 zero size 2024-09-16T09:46:01.709 INFO:tasks.workunit.client.0.smithi111.stdout:9/66: dwrite d0/d6/f12 [0,4194304] 0 2024-09-16T09:46:01.712 INFO:tasks.workunit.client.0.smithi111.stdout:9/67: rename d0/l4 to d0/d6/l17 0 2024-09-16T09:46:01.722 INFO:tasks.workunit.client.0.smithi111.stdout:2/101: dwrite d0/f16 [0,4194304] 0 2024-09-16T09:46:01.725 INFO:tasks.workunit.client.0.smithi111.stdout:9/68: write d0/d6/d8/de/f11 [2475777,26933] 0 2024-09-16T09:46:01.725 INFO:tasks.workunit.client.0.smithi111.stdout:9/69: readlink d0/l3 0 2024-09-16T09:46:01.727 INFO:tasks.workunit.client.0.smithi111.stdout:2/102: mkdir d0/d21 0 2024-09-16T09:46:01.727 INFO:tasks.workunit.client.0.smithi111.stdout:2/103: write d0/f7 [24084,63527] 0 2024-09-16T09:46:01.728 INFO:tasks.workunit.client.0.smithi111.stdout:2/104: mkdir d0/d22 0 2024-09-16T09:46:01.730 INFO:tasks.workunit.client.0.smithi111.stdout:2/105: creat d0/d22/f23 x:0 0 0 2024-09-16T09:46:01.732 INFO:tasks.workunit.client.0.smithi111.stdout:2/106: link d0/d2/f1e d0/d22/f24 0 2024-09-16T09:46:01.732 INFO:tasks.workunit.client.0.smithi111.stdout:2/107: dread - d0/d2/f12 zero size 2024-09-16T09:46:01.733 INFO:tasks.workunit.client.0.smithi111.stdout:2/108: symlink d0/d22/l25 0 2024-09-16T09:46:01.740 INFO:tasks.workunit.client.0.smithi111.stdout:2/109: dread d0/d2/f14 [0,4194304] 0 2024-09-16T09:46:01.740 INFO:tasks.workunit.client.0.smithi111.stdout:2/110: dread - d0/fc zero size 2024-09-16T09:46:01.741 INFO:tasks.workunit.client.0.smithi111.stdout:2/111: dread - d0/d2/f12 zero size 2024-09-16T09:46:01.752 INFO:tasks.workunit.client.0.smithi111.stdout:2/112: dread d0/d22/f24 [4194304,4194304] 0 2024-09-16T09:46:01.757 INFO:tasks.workunit.client.0.smithi111.stdout:2/113: truncate d0/d2/f14 707890 0 2024-09-16T09:46:01.760 INFO:tasks.workunit.client.0.smithi111.stdout:2/114: symlink d0/d21/l26 0 2024-09-16T09:46:01.763 INFO:tasks.workunit.client.0.smithi111.stdout:2/115: unlink d0/d2/f18 0 2024-09-16T09:46:01.806 INFO:tasks.workunit.client.0.smithi111.stdout:2/116: getdents d0/d21 0 2024-09-16T09:46:01.807 INFO:tasks.workunit.client.0.smithi111.stdout:2/117: getdents d0/d22 0 2024-09-16T09:46:01.807 INFO:tasks.workunit.client.0.smithi111.stdout:2/118: chown d0/d2/f12 618431 1 2024-09-16T09:46:01.810 INFO:tasks.workunit.client.0.smithi111.stdout:2/119: creat d0/da/f27 x:0 0 0 2024-09-16T09:46:01.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/120: write d0/f4 [4916840,108775] 0 2024-09-16T09:46:01.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/121: chown d0/d22 76 1 2024-09-16T09:46:01.822 INFO:tasks.workunit.client.0.smithi111.stdout:2/122: dread d0/d2/f1e [0,4194304] 0 2024-09-16T09:46:01.822 INFO:tasks.workunit.client.0.smithi111.stdout:2/123: dread - d0/f10 zero size 2024-09-16T09:46:01.822 INFO:tasks.workunit.client.0.smithi111.stdout:2/124: fdatasync d0/d22/f24 0 2024-09-16T09:46:01.824 INFO:tasks.workunit.client.0.smithi111.stdout:2/125: unlink d0/d2/f13 0 2024-09-16T09:46:01.824 INFO:tasks.workunit.client.0.smithi111.stdout:2/126: fsync d0/fc 0 2024-09-16T09:46:01.826 INFO:tasks.workunit.client.0.smithi111.stdout:2/127: unlink d0/da/f27 0 2024-09-16T09:46:01.828 INFO:tasks.workunit.client.0.smithi111.stdout:2/128: creat d0/d2/f28 x:0 0 0 2024-09-16T09:46:01.831 INFO:tasks.workunit.client.0.smithi111.stdout:2/129: mkdir d0/d29 0 2024-09-16T09:46:01.831 INFO:tasks.workunit.client.0.smithi111.stdout:2/130: write d0/f16 [1664595,87418] 0 2024-09-16T09:46:01.831 INFO:tasks.workunit.client.0.smithi111.stdout:2/131: chown d0/d2/f12 65119 1 2024-09-16T09:46:01.833 INFO:tasks.workunit.client.0.smithi111.stdout:2/132: mknod d0/da/c2a 0 2024-09-16T09:46:01.833 INFO:tasks.workunit.client.0.smithi111.stdout:2/133: getdents d0/d21 0 2024-09-16T09:46:01.853 INFO:tasks.workunit.client.0.smithi111.stdout:2/134: dwrite d0/d2/f17 [0,4194304] 0 2024-09-16T09:46:01.858 INFO:tasks.workunit.client.0.smithi111.stdout:2/135: creat d0/d29/f2b x:0 0 0 2024-09-16T09:46:01.866 INFO:tasks.workunit.client.0.smithi111.stdout:2/136: dread d0/f16 [0,4194304] 0 2024-09-16T09:46:01.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/137: write d0/f16 [1394166,66373] 0 2024-09-16T09:46:01.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/138: fsync d0/f10 0 2024-09-16T09:46:01.919 INFO:tasks.workunit.client.0.smithi111.stdout:2/139: truncate d0/d2/f1f 1081333 0 2024-09-16T09:46:01.952 INFO:tasks.workunit.client.0.smithi111.stdout:2/140: dwrite d0/f4 [0,4194304] 0 2024-09-16T09:46:01.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/141: creat d0/d2/f2c x:0 0 0 2024-09-16T09:46:01.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/142: truncate d0/d2/f12 652834 0 2024-09-16T09:46:01.966 INFO:tasks.workunit.client.0.smithi111.stdout:2/143: dread d0/d2/f1f [0,4194304] 0 2024-09-16T09:46:01.967 INFO:tasks.workunit.client.0.smithi111.stdout:2/144: mknod d0/da/c2d 0 2024-09-16T09:46:01.967 INFO:tasks.workunit.client.0.smithi111.stdout:2/145: write d0/d2/f2c [894848,1471] 0 2024-09-16T09:46:01.970 INFO:tasks.workunit.client.0.smithi111.stdout:2/146: symlink d0/l2e 0 2024-09-16T09:46:01.974 INFO:tasks.workunit.client.0.smithi111.stdout:2/147: write d0/d2/f1e [1856967,21815] 0 2024-09-16T09:46:01.976 INFO:tasks.workunit.client.0.smithi111.stdout:2/148: rename d0/ff to d0/d21/f2f 0 2024-09-16T09:46:01.978 INFO:tasks.workunit.client.0.smithi111.stdout:2/149: symlink d0/l30 0 2024-09-16T09:46:01.978 INFO:tasks.workunit.client.0.smithi111.stdout:2/150: chown d0/d2/f17 604322105 1 2024-09-16T09:46:01.981 INFO:tasks.workunit.client.0.smithi111.stdout:2/151: creat d0/d29/f31 x:0 0 0 2024-09-16T09:46:01.981 INFO:tasks.workunit.client.0.smithi111.stdout:2/152: truncate d0/d2/f14 2689185 0 2024-09-16T09:46:01.982 INFO:tasks.workunit.client.0.smithi111.stdout:2/153: mknod d0/c32 0 2024-09-16T09:46:02.003 INFO:tasks.workunit.client.0.smithi111.stdout:2/154: truncate d0/d2/f2c 184033 0 2024-09-16T09:46:02.005 INFO:tasks.workunit.client.0.smithi111.stdout:2/155: creat d0/da/f33 x:0 0 0 2024-09-16T09:46:02.005 INFO:tasks.workunit.client.0.smithi111.stdout:2/156: write d0/f16 [981036,96042] 0 2024-09-16T09:46:02.005 INFO:tasks.workunit.client.0.smithi111.stdout:2/157: chown d0/d22/f24 0 1 2024-09-16T09:46:02.013 INFO:tasks.workunit.client.0.smithi111.stdout:2/158: truncate d0/f16 1764914 0 2024-09-16T09:46:02.020 INFO:tasks.workunit.client.0.smithi111.stdout:2/159: dread d0/f16 [0,4194304] 0 2024-09-16T09:46:02.022 INFO:tasks.workunit.client.0.smithi111.stdout:2/160: mknod d0/da/c34 0 2024-09-16T09:46:02.032 INFO:tasks.workunit.client.0.smithi111.stdout:2/161: truncate d0/d22/f24 3731164 0 2024-09-16T09:46:02.032 INFO:tasks.workunit.client.0.smithi111.stdout:2/162: write d0/f7 [976147,100276] 0 2024-09-16T09:46:02.033 INFO:tasks.workunit.client.0.smithi111.stdout:2/163: getdents d0/d21 0 2024-09-16T09:46:02.035 INFO:tasks.workunit.client.0.smithi111.stdout:2/164: symlink d0/d22/l35 0 2024-09-16T09:46:02.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:02 smithi111 ceph-mon[27997]: pgmap v254: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.2 MiB/s wr, 354 op/s 2024-09-16T09:46:02.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:02 smithi114 ceph-mon[35635]: pgmap v254: 65 pgs: 65 active+clean; 316 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.2 MiB/s wr, 354 op/s 2024-09-16T09:46:02.628 INFO:tasks.workunit.client.0.smithi111.stdout:3/6: sync 2024-09-16T09:46:02.628 INFO:tasks.workunit.client.0.smithi111.stdout:3/7: write - no filename 2024-09-16T09:46:02.630 INFO:tasks.workunit.client.0.smithi111.stdout:3/8: creat f1 x:0 0 0 2024-09-16T09:46:02.630 INFO:tasks.workunit.client.0.smithi111.stdout:3/9: write f1 [809444,27019] 0 2024-09-16T09:46:02.636 INFO:tasks.workunit.client.0.smithi111.stdout:3/10: dread f1 [0,4194304] 0 2024-09-16T09:46:02.638 INFO:tasks.workunit.client.0.smithi111.stdout:3/11: write f1 [384242,57650] 0 2024-09-16T09:46:02.638 INFO:tasks.workunit.client.0.smithi111.stdout:3/12: chown f1 36354 1 2024-09-16T09:46:02.641 INFO:tasks.workunit.client.0.smithi111.stdout:3/13: mknod c2 0 2024-09-16T09:46:02.645 INFO:tasks.workunit.client.0.smithi111.stdout:3/14: creat f3 x:0 0 0 2024-09-16T09:46:02.647 INFO:tasks.workunit.client.0.smithi111.stdout:3/15: creat f4 x:0 0 0 2024-09-16T09:46:02.650 INFO:tasks.workunit.client.0.smithi111.stdout:3/16: mkdir d5 0 2024-09-16T09:46:02.650 INFO:tasks.workunit.client.0.smithi111.stdout:3/17: dread - f3 zero size 2024-09-16T09:46:02.652 INFO:tasks.workunit.client.0.smithi111.stdout:3/18: link f3 d5/f6 0 2024-09-16T09:46:02.652 INFO:tasks.workunit.client.0.smithi111.stdout:3/19: write d5/f6 [299111,107621] 0 2024-09-16T09:46:02.658 INFO:tasks.workunit.client.0.smithi111.stdout:3/20: dread d5/f6 [0,4194304] 0 2024-09-16T09:46:02.660 INFO:tasks.workunit.client.0.smithi111.stdout:3/21: mknod d5/c7 0 2024-09-16T09:46:02.660 INFO:tasks.workunit.client.0.smithi111.stdout:3/22: read - f4 zero size 2024-09-16T09:46:02.660 INFO:tasks.workunit.client.0.smithi111.stdout:3/23: write f4 [162701,52370] 0 2024-09-16T09:46:02.662 INFO:tasks.workunit.client.0.smithi111.stdout:3/24: rmdir d5 39 2024-09-16T09:46:02.671 INFO:tasks.workunit.client.0.smithi111.stdout:3/25: dread f4 [0,4194304] 0 2024-09-16T09:46:02.672 INFO:tasks.workunit.client.0.smithi111.stdout:3/26: creat d5/f8 x:0 0 0 2024-09-16T09:46:02.672 INFO:tasks.workunit.client.0.smithi111.stdout:3/27: chown d5 6954 1 2024-09-16T09:46:02.673 INFO:tasks.workunit.client.0.smithi111.stdout:3/28: unlink d5/f6 0 2024-09-16T09:46:02.675 INFO:tasks.workunit.client.0.smithi111.stdout:3/29: rename l0 to d5/l9 0 2024-09-16T09:46:02.694 INFO:tasks.workunit.client.0.smithi111.stdout:3/30: dwrite f1 [0,4194304] 0 2024-09-16T09:46:02.712 INFO:tasks.workunit.client.0.smithi111.stdout:3/31: dwrite d5/f8 [0,4194304] 0 2024-09-16T09:46:02.712 INFO:tasks.workunit.client.0.smithi111.stdout:3/32: chown d5/l9 250 1 2024-09-16T09:46:02.712 INFO:tasks.workunit.client.0.smithi111.stdout:3/33: chown f3 726 1 2024-09-16T09:46:02.728 INFO:tasks.workunit.client.0.smithi111.stdout:3/34: mkdir d5/da 0 2024-09-16T09:46:02.729 INFO:tasks.workunit.client.0.smithi111.stdout:3/35: chown f1 2609384 1 2024-09-16T09:46:02.731 INFO:tasks.workunit.client.0.smithi111.stdout:3/36: write f3 [509531,16747] 0 2024-09-16T09:46:02.750 INFO:tasks.workunit.client.0.smithi111.stdout:3/37: dwrite f4 [0,4194304] 0 2024-09-16T09:46:02.750 INFO:tasks.workunit.client.0.smithi111.stdout:3/38: truncate f3 1019825 0 2024-09-16T09:46:02.750 INFO:tasks.workunit.client.0.smithi111.stdout:3/39: getdents d5/da 0 2024-09-16T09:46:02.751 INFO:tasks.workunit.client.0.smithi111.stdout:3/40: mkdir d5/da/db 0 2024-09-16T09:46:02.751 INFO:tasks.workunit.client.0.smithi111.stdout:3/41: chown d5/l9 58382 1 2024-09-16T09:46:02.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/42: readlink d5/l9 0 2024-09-16T09:46:02.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/43: fdatasync f1 0 2024-09-16T09:46:03.031 INFO:tasks.workunit.client.0.smithi111.stdout:3/44: fsync d5/f8 0 2024-09-16T09:46:03.033 INFO:tasks.workunit.client.0.smithi111.stdout:3/45: mkdir d5/da/db/dc 0 2024-09-16T09:46:03.038 INFO:tasks.workunit.client.0.smithi111.stdout:3/46: read d5/f8 [3470966,29924] 0 2024-09-16T09:46:03.039 INFO:tasks.workunit.client.0.smithi111.stdout:3/47: write f3 [1006798,42406] 0 2024-09-16T09:46:03.041 INFO:tasks.workunit.client.0.smithi111.stdout:3/48: symlink d5/da/db/ld 0 2024-09-16T09:46:03.057 INFO:tasks.workunit.client.0.smithi111.stdout:3/49: dwrite d5/f8 [0,4194304] 0 2024-09-16T09:46:03.096 INFO:tasks.workunit.client.0.smithi111.stdout:7/88: sync 2024-09-16T09:46:03.096 INFO:tasks.workunit.client.0.smithi111.stdout:1/33: sync 2024-09-16T09:46:03.096 INFO:tasks.workunit.client.0.smithi111.stdout:7/89: chown d1/l10 97337 1 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:2/165: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:0/90: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:5/114: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:9/70: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:0/91: readlink d0/l19 0 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:1/34: write d3/f6 [336051,9719] 0 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:9/71: chown d0/d6/d8/de/cf 31 1 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:4/47: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:8/20: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:6/51: sync 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:4/48: chown d2/f8 74 1 2024-09-16T09:46:03.097 INFO:tasks.workunit.client.0.smithi111.stdout:8/21: truncate f1 1437301 0 2024-09-16T09:46:03.098 INFO:tasks.workunit.client.0.smithi111.stdout:7/90: rmdir d1 39 2024-09-16T09:46:03.098 INFO:tasks.workunit.client.0.smithi111.stdout:7/91: fdatasync d1/f14 0 2024-09-16T09:46:03.099 INFO:tasks.workunit.client.0.smithi111.stdout:1/35: dread d3/f6 [0,4194304] 0 2024-09-16T09:46:03.100 INFO:tasks.workunit.client.0.smithi111.stdout:2/166: link d0/d2/f28 d0/f36 0 2024-09-16T09:46:03.100 INFO:tasks.workunit.client.0.smithi111.stdout:2/167: readlink d0/l1b 0 2024-09-16T09:46:03.104 INFO:tasks.workunit.client.0.smithi111.stdout:5/115: mkdir d19/d1b/d27/d2e 0 2024-09-16T09:46:03.105 INFO:tasks.workunit.client.0.smithi111.stdout:9/72: mkdir d0/d18 0 2024-09-16T09:46:03.109 INFO:tasks.workunit.client.0.smithi111.stdout:6/52: rmdir d0 39 2024-09-16T09:46:03.111 INFO:tasks.workunit.client.0.smithi111.stdout:4/49: creat d2/d6/fe x:0 0 0 2024-09-16T09:46:03.114 INFO:tasks.workunit.client.0.smithi111.stdout:0/92: dwrite d0/f18 [0,4194304] 0 2024-09-16T09:46:03.114 INFO:tasks.workunit.client.0.smithi111.stdout:0/93: write d0/f12 [944455,129029] 0 2024-09-16T09:46:03.114 INFO:tasks.workunit.client.0.smithi111.stdout:8/22: creat d3/f4 x:0 0 0 2024-09-16T09:46:03.117 INFO:tasks.workunit.client.0.smithi111.stdout:7/92: creat d1/d9/f1f x:0 0 0 2024-09-16T09:46:03.121 INFO:tasks.workunit.client.0.smithi111.stdout:2/168: symlink d0/d2/l37 0 2024-09-16T09:46:03.124 INFO:tasks.workunit.client.0.smithi111.stdout:5/116: symlink d19/d1b/d1e/d21/d29/l2f 0 2024-09-16T09:46:03.124 INFO:tasks.workunit.client.0.smithi111.stdout:5/117: fdatasync f12 0 2024-09-16T09:46:03.124 INFO:tasks.workunit.client.0.smithi111.stdout:5/118: dread - fa zero size 2024-09-16T09:46:03.125 INFO:tasks.workunit.client.0.smithi111.stdout:6/53: symlink d0/le 0 2024-09-16T09:46:03.126 INFO:tasks.workunit.client.0.smithi111.stdout:9/73: dwrite d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:03.128 INFO:tasks.workunit.client.0.smithi111.stdout:4/50: mknod d2/d6/cf 0 2024-09-16T09:46:03.130 INFO:tasks.workunit.client.0.smithi111.stdout:8/23: creat d3/f5 x:0 0 0 2024-09-16T09:46:03.133 INFO:tasks.workunit.client.0.smithi111.stdout:7/93: write d1/f13 [3396913,80948] 0 2024-09-16T09:46:03.137 INFO:tasks.workunit.client.0.smithi111.stdout:6/54: write d0/f2 [4808721,81741] 0 2024-09-16T09:46:03.137 INFO:tasks.workunit.client.0.smithi111.stdout:1/36: mkdir d3/dd 0 2024-09-16T09:46:03.141 INFO:tasks.workunit.client.0.smithi111.stdout:2/169: rename d0/da/l1d to d0/l38 0 2024-09-16T09:46:03.142 INFO:tasks.workunit.client.0.smithi111.stdout:2/170: write d0/d22/f23 [178044,102235] 0 2024-09-16T09:46:03.142 INFO:tasks.workunit.client.0.smithi111.stdout:2/171: write d0/d2/f28 [251963,111917] 0 2024-09-16T09:46:03.142 INFO:tasks.workunit.client.0.smithi111.stdout:5/119: symlink d19/d1b/d27/d25/l30 0 2024-09-16T09:46:03.146 INFO:tasks.workunit.client.0.smithi111.stdout:9/74: mknod d0/c19 0 2024-09-16T09:46:03.146 INFO:tasks.workunit.client.0.smithi111.stdout:9/75: chown d0/d6/d8/de/l13 231812283 1 2024-09-16T09:46:03.147 INFO:tasks.workunit.client.0.smithi111.stdout:9/76: write d0/d6/f12 [4775966,75570] 0 2024-09-16T09:46:03.150 INFO:tasks.workunit.client.0.smithi111.stdout:4/51: link d2/d6/cf d2/d6/c10 0 2024-09-16T09:46:03.150 INFO:tasks.workunit.client.0.smithi111.stdout:4/52: dread - d2/fb zero size 2024-09-16T09:46:03.151 INFO:tasks.workunit.client.0.smithi111.stdout:8/24: dwrite d3/f4 [0,4194304] 0 2024-09-16T09:46:03.156 INFO:tasks.workunit.client.0.smithi111.stdout:6/55: dwrite d0/f2 [8388608,4194304] 0 2024-09-16T09:46:03.158 INFO:tasks.workunit.client.0.smithi111.stdout:1/37: creat d3/dd/fe x:0 0 0 2024-09-16T09:46:03.158 INFO:tasks.workunit.client.0.smithi111.stdout:1/38: write d3/dd/fe [360775,95255] 0 2024-09-16T09:46:03.159 INFO:tasks.workunit.client.0.smithi111.stdout:2/172: creat d0/d2/f39 x:0 0 0 2024-09-16T09:46:03.165 INFO:tasks.workunit.client.0.smithi111.stdout:4/53: link d2/d6/cf d2/d6/dd/c11 0 2024-09-16T09:46:03.166 INFO:tasks.workunit.client.0.smithi111.stdout:4/54: read d2/f8 [84825,61174] 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/120: dwrite fc [4194304,4194304] 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/121: fdatasync f15 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/122: write d19/f1f [676530,11029] 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/123: fdatasync d19/d1b/f1c 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/124: stat d19/l1a 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:8/25: dwrite d3/f4 [0,4194304] 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:7/94: mkdir d1/d20 0 2024-09-16T09:46:03.172 INFO:tasks.workunit.client.0.smithi111.stdout:7/95: write d1/d16/f1c [578581,70255] 0 2024-09-16T09:46:03.184 INFO:tasks.workunit.client.0.smithi111.stdout:6/56: mkdir d0/df 0 2024-09-16T09:46:03.185 INFO:tasks.workunit.client.0.smithi111.stdout:1/39: creat d3/dd/ff x:0 0 0 2024-09-16T09:46:03.189 INFO:tasks.workunit.client.0.smithi111.stdout:4/55: creat d2/d6/dd/f12 x:0 0 0 2024-09-16T09:46:03.190 INFO:tasks.workunit.client.0.smithi111.stdout:4/56: chown d2/d6/dd/f12 1247 1 2024-09-16T09:46:03.190 INFO:tasks.workunit.client.0.smithi111.stdout:4/57: chown d2/c3 186214123 1 2024-09-16T09:46:03.193 INFO:tasks.workunit.client.0.smithi111.stdout:5/125: symlink d19/d1b/d27/d2e/l31 0 2024-09-16T09:46:03.202 INFO:tasks.workunit.client.0.smithi111.stdout:8/26: rmdir d3 39 2024-09-16T09:46:03.202 INFO:tasks.workunit.client.0.smithi111.stdout:8/27: readlink - no filename 2024-09-16T09:46:03.206 INFO:tasks.workunit.client.0.smithi111.stdout:7/96: rename d1/f13 to d1/d16/d17/d18/f21 0 2024-09-16T09:46:03.207 INFO:tasks.workunit.client.0.smithi111.stdout:5/126: dwrite d19/d1b/d27/d25/f26 [0,4194304] 0 2024-09-16T09:46:03.208 INFO:tasks.workunit.client.0.smithi111.stdout:6/57: mknod d0/c10 0 2024-09-16T09:46:03.208 INFO:tasks.workunit.client.0.smithi111.stdout:6/58: write d0/fd [742777,99835] 0 2024-09-16T09:46:03.213 INFO:tasks.workunit.client.0.smithi111.stdout:4/58: truncate d2/f8 552295 0 2024-09-16T09:46:03.215 INFO:tasks.workunit.client.0.smithi111.stdout:7/97: dread d1/d9/fa [0,4194304] 0 2024-09-16T09:46:03.217 INFO:tasks.workunit.client.0.smithi111.stdout:5/127: dread f12 [0,4194304] 0 2024-09-16T09:46:03.218 INFO:tasks.workunit.client.0.smithi111.stdout:5/128: write fa [525555,57886] 0 2024-09-16T09:46:03.218 INFO:tasks.workunit.client.0.smithi111.stdout:8/28: symlink d3/l6 0 2024-09-16T09:46:03.224 INFO:tasks.workunit.client.0.smithi111.stdout:6/59: truncate d0/f3 379542 0 2024-09-16T09:46:03.228 INFO:tasks.workunit.client.0.smithi111.stdout:1/40: mkdir d3/d10 0 2024-09-16T09:46:03.229 INFO:tasks.workunit.client.0.smithi111.stdout:5/129: mkdir d19/d1b/d1e/d21/d29/d32 0 2024-09-16T09:46:03.235 INFO:tasks.workunit.client.0.smithi111.stdout:8/29: write d3/f4 [2837344,20460] 0 2024-09-16T09:46:03.235 INFO:tasks.workunit.client.0.smithi111.stdout:6/60: mknod d0/df/c11 0 2024-09-16T09:46:03.235 INFO:tasks.workunit.client.0.smithi111.stdout:6/61: dread - d0/fc zero size 2024-09-16T09:46:03.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/59: dwrite d2/d6/dd/f12 [0,4194304] 0 2024-09-16T09:46:03.240 INFO:tasks.workunit.client.0.smithi111.stdout:7/98: dwrite d1/f14 [4194304,4194304] 0 2024-09-16T09:46:03.240 INFO:tasks.workunit.client.0.smithi111.stdout:1/41: rename d3/f5 to d3/dd/f11 0 2024-09-16T09:46:03.243 INFO:tasks.workunit.client.0.smithi111.stdout:5/130: mknod d19/d1b/d1e/d21/d29/d32/c33 0 2024-09-16T09:46:03.244 INFO:tasks.workunit.client.0.smithi111.stdout:5/131: fdatasync fc 0 2024-09-16T09:46:03.245 INFO:tasks.workunit.client.0.smithi111.stdout:6/62: creat d0/f12 x:0 0 0 2024-09-16T09:46:03.256 INFO:tasks.workunit.client.0.smithi111.stdout:7/99: symlink d1/d20/l22 0 2024-09-16T09:46:03.258 INFO:tasks.workunit.client.0.smithi111.stdout:1/42: creat d3/f12 x:0 0 0 2024-09-16T09:46:03.260 INFO:tasks.workunit.client.0.smithi111.stdout:5/132: symlink d19/d1b/d27/d25/l34 0 2024-09-16T09:46:03.261 INFO:tasks.workunit.client.0.smithi111.stdout:8/30: dwrite d3/f5 [0,4194304] 0 2024-09-16T09:46:03.261 INFO:tasks.workunit.client.0.smithi111.stdout:4/60: dwrite d2/fb [0,4194304] 0 2024-09-16T09:46:03.261 INFO:tasks.workunit.client.0.smithi111.stdout:4/61: stat d2/d6/fe 0 2024-09-16T09:46:03.262 INFO:tasks.workunit.client.0.smithi111.stdout:6/63: creat d0/f13 x:0 0 0 2024-09-16T09:46:03.262 INFO:tasks.workunit.client.0.smithi111.stdout:6/64: read - d0/f13 zero size 2024-09-16T09:46:03.267 INFO:tasks.workunit.client.0.smithi111.stdout:7/100: link d1/d16/f1c d1/d20/f23 0 2024-09-16T09:46:03.269 INFO:tasks.workunit.client.0.smithi111.stdout:1/43: creat d3/f13 x:0 0 0 2024-09-16T09:46:03.274 INFO:tasks.workunit.client.0.smithi111.stdout:5/133: unlink c17 0 2024-09-16T09:46:03.274 INFO:tasks.workunit.client.0.smithi111.stdout:5/134: rename d19/d1b/d27 to d19/d1b/d27/d25/d35 22 2024-09-16T09:46:03.281 INFO:tasks.workunit.client.0.smithi111.stdout:8/31: dwrite f1 [0,4194304] 0 2024-09-16T09:46:03.283 INFO:tasks.workunit.client.0.smithi111.stdout:4/62: symlink d2/l13 0 2024-09-16T09:46:03.287 INFO:tasks.workunit.client.0.smithi111.stdout:5/135: dread fc [4194304,4194304] 0 2024-09-16T09:46:03.291 INFO:tasks.workunit.client.0.smithi111.stdout:7/101: creat d1/d16/d17/d18/d1d/f24 x:0 0 0 2024-09-16T09:46:03.300 INFO:tasks.workunit.client.0.smithi111.stdout:7/102: dread d1/f14 [0,4194304] 0 2024-09-16T09:46:03.300 INFO:tasks.workunit.client.0.smithi111.stdout:1/44: creat d3/f14 x:0 0 0 2024-09-16T09:46:03.303 INFO:tasks.workunit.client.0.smithi111.stdout:7/103: dread d1/d9/fa [0,4194304] 0 2024-09-16T09:46:03.303 INFO:tasks.workunit.client.0.smithi111.stdout:7/104: write d1/d16/d17/d18/d1d/f24 [124553,66294] 0 2024-09-16T09:46:03.303 INFO:tasks.workunit.client.0.smithi111.stdout:7/105: read - d1/d9/f15 zero size 2024-09-16T09:46:03.304 INFO:tasks.workunit.client.0.smithi111.stdout:5/136: dwrite d19/f1f [0,4194304] 0 2024-09-16T09:46:03.305 INFO:tasks.workunit.client.0.smithi111.stdout:5/137: dread fa [0,4194304] 0 2024-09-16T09:46:03.307 INFO:tasks.workunit.client.0.smithi111.stdout:8/32: link d3/f5 d3/f7 0 2024-09-16T09:46:03.310 INFO:tasks.workunit.client.0.smithi111.stdout:4/63: link d2/d6/fc d2/d6/f14 0 2024-09-16T09:46:03.311 INFO:tasks.workunit.client.0.smithi111.stdout:5/138: dread d19/d1b/f1c [0,4194304] 0 2024-09-16T09:46:03.315 INFO:tasks.workunit.client.0.smithi111.stdout:8/33: dread f1 [0,4194304] 0 2024-09-16T09:46:03.315 INFO:tasks.workunit.client.0.smithi111.stdout:1/45: mkdir d3/d10/d15 0 2024-09-16T09:46:03.316 INFO:tasks.workunit.client.0.smithi111.stdout:1/46: readlink d3/lc 0 2024-09-16T09:46:03.319 INFO:tasks.workunit.client.0.smithi111.stdout:7/106: unlink d1/d9/cf 0 2024-09-16T09:46:03.320 INFO:tasks.workunit.client.0.smithi111.stdout:5/139: getdents d19/d1b/d1e/d21 0 2024-09-16T09:46:03.323 INFO:tasks.workunit.client.0.smithi111.stdout:7/107: dread d1/f14 [0,4194304] 0 2024-09-16T09:46:03.323 INFO:tasks.workunit.client.0.smithi111.stdout:7/108: stat d1 0 2024-09-16T09:46:03.324 INFO:tasks.workunit.client.0.smithi111.stdout:8/34: creat d3/f8 x:0 0 0 2024-09-16T09:46:03.324 INFO:tasks.workunit.client.0.smithi111.stdout:7/109: write d1/d20/f23 [296481,60221] 0 2024-09-16T09:46:03.325 INFO:tasks.workunit.client.0.smithi111.stdout:1/47: symlink d3/d10/l16 0 2024-09-16T09:46:03.328 INFO:tasks.workunit.client.0.smithi111.stdout:5/140: creat d19/d1b/d27/d25/f36 x:0 0 0 2024-09-16T09:46:03.329 INFO:tasks.workunit.client.0.smithi111.stdout:8/35: symlink d3/l9 0 2024-09-16T09:46:03.332 INFO:tasks.workunit.client.0.smithi111.stdout:7/110: rename d1/d16/d17/l19 to d1/d16/d17/d18/d1d/l25 0 2024-09-16T09:46:03.333 INFO:tasks.workunit.client.0.smithi111.stdout:1/48: creat d3/dd/f17 x:0 0 0 2024-09-16T09:46:03.338 INFO:tasks.workunit.client.0.smithi111.stdout:8/36: mkdir d3/da 0 2024-09-16T09:46:03.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/141: rename d19/f1f to d19/d1b/d27/f37 0 2024-09-16T09:46:03.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/49: creat d3/d10/f18 x:0 0 0 2024-09-16T09:46:03.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/50: dread - d3/f9 zero size 2024-09-16T09:46:03.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/51: fdatasync d3/f6 0 2024-09-16T09:46:03.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/52: chown d3/d10/f18 704861 1 2024-09-16T09:46:03.345 INFO:tasks.workunit.client.0.smithi111.stdout:8/37: mkdir d3/da/db 0 2024-09-16T09:46:03.348 INFO:tasks.workunit.client.0.smithi111.stdout:8/38: dread f1 [0,4194304] 0 2024-09-16T09:46:03.349 INFO:tasks.workunit.client.0.smithi111.stdout:8/39: chown d3/da/db 94504 1 2024-09-16T09:46:03.349 INFO:tasks.workunit.client.0.smithi111.stdout:8/40: dread - d3/f8 zero size 2024-09-16T09:46:03.349 INFO:tasks.workunit.client.0.smithi111.stdout:7/111: dwrite d1/d9/fa [0,4194304] 0 2024-09-16T09:46:03.350 INFO:tasks.workunit.client.0.smithi111.stdout:1/53: symlink d3/dd/l19 0 2024-09-16T09:46:03.358 INFO:tasks.workunit.client.0.smithi111.stdout:7/112: rmdir d1 39 2024-09-16T09:46:03.359 INFO:tasks.workunit.client.0.smithi111.stdout:8/41: write d3/f7 [2015465,95774] 0 2024-09-16T09:46:03.359 INFO:tasks.workunit.client.0.smithi111.stdout:8/42: chown d3/f5 2136 1 2024-09-16T09:46:03.360 INFO:tasks.workunit.client.0.smithi111.stdout:1/54: creat d3/f1a x:0 0 0 2024-09-16T09:46:03.363 INFO:tasks.workunit.client.0.smithi111.stdout:8/43: write f1 [3988440,71578] 0 2024-09-16T09:46:03.364 INFO:tasks.workunit.client.0.smithi111.stdout:7/113: creat d1/f26 x:0 0 0 2024-09-16T09:46:03.365 INFO:tasks.workunit.client.0.smithi111.stdout:7/114: chown d1/d9/f1f 486852797 1 2024-09-16T09:46:03.369 INFO:tasks.workunit.client.0.smithi111.stdout:3/50: truncate f3 386254 0 2024-09-16T09:46:03.377 INFO:tasks.workunit.client.0.smithi111.stdout:8/44: link f1 d3/da/db/fc 0 2024-09-16T09:46:03.378 INFO:tasks.workunit.client.0.smithi111.stdout:3/51: dread f4 [0,4194304] 0 2024-09-16T09:46:03.382 INFO:tasks.workunit.client.0.smithi111.stdout:7/115: mkdir d1/d16/d27 0 2024-09-16T09:46:03.382 INFO:tasks.workunit.client.0.smithi111.stdout:7/116: dread - d1/f26 zero size 2024-09-16T09:46:03.382 INFO:tasks.workunit.client.0.smithi111.stdout:7/117: readlink d1/l10 0 2024-09-16T09:46:03.385 INFO:tasks.workunit.client.0.smithi111.stdout:8/45: unlink d3/da/db/fc 0 2024-09-16T09:46:03.399 INFO:tasks.workunit.client.0.smithi111.stdout:8/46: dwrite f0 [0,4194304] 0 2024-09-16T09:46:03.408 INFO:tasks.workunit.client.0.smithi111.stdout:3/52: unlink f4 0 2024-09-16T09:46:03.410 INFO:tasks.workunit.client.0.smithi111.stdout:7/118: mknod d1/d20/c28 0 2024-09-16T09:46:03.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/53: write d5/f8 [1462253,39916] 0 2024-09-16T09:46:03.418 INFO:tasks.workunit.client.0.smithi111.stdout:8/47: symlink d3/da/ld 0 2024-09-16T09:46:03.419 INFO:tasks.workunit.client.0.smithi111.stdout:7/119: creat d1/d16/f29 x:0 0 0 2024-09-16T09:46:03.420 INFO:tasks.workunit.client.0.smithi111.stdout:7/120: dread - d1/d16/f29 zero size 2024-09-16T09:46:03.420 INFO:tasks.workunit.client.0.smithi111.stdout:7/121: write d1/d16/d17/d18/d1d/f24 [377075,103657] 0 2024-09-16T09:46:03.424 INFO:tasks.workunit.client.0.smithi111.stdout:3/54: rename d5/da/db/dc to d5/da/db/de 0 2024-09-16T09:46:03.424 INFO:tasks.workunit.client.0.smithi111.stdout:3/55: fsync f1 0 2024-09-16T09:46:03.428 INFO:tasks.workunit.client.0.smithi111.stdout:8/48: mkdir d3/de 0 2024-09-16T09:46:03.433 INFO:tasks.workunit.client.0.smithi111.stdout:8/49: mkdir d3/da/df 0 2024-09-16T09:46:03.438 INFO:tasks.workunit.client.0.smithi111.stdout:8/50: creat d3/f10 x:0 0 0 2024-09-16T09:46:03.528 INFO:tasks.workunit.client.0.smithi111.stdout:5/142: truncate f7 1173173 0 2024-09-16T09:46:03.532 INFO:tasks.workunit.client.0.smithi111.stdout:4/64: dwrite d2/f8 [0,4194304] 0 2024-09-16T09:46:03.533 INFO:tasks.workunit.client.0.smithi111.stdout:5/143: rename l13 to d19/d1b/d27/l38 0 2024-09-16T09:46:03.533 INFO:tasks.workunit.client.0.smithi111.stdout:5/144: write d19/d1b/d27/f24 [2767793,103641] 0 2024-09-16T09:46:03.545 INFO:tasks.workunit.client.0.smithi111.stdout:4/65: dread d2/f8 [0,4194304] 0 2024-09-16T09:46:03.545 INFO:tasks.workunit.client.0.smithi111.stdout:4/66: stat d2/fb 0 2024-09-16T09:46:03.545 INFO:tasks.workunit.client.0.smithi111.stdout:4/67: fdatasync d2/d6/dd/f12 0 2024-09-16T09:46:03.545 INFO:tasks.workunit.client.0.smithi111.stdout:5/145: read fc [163396,109300] 0 2024-09-16T09:46:03.546 INFO:tasks.workunit.client.0.smithi111.stdout:4/68: symlink d2/d6/l15 0 2024-09-16T09:46:03.548 INFO:tasks.workunit.client.0.smithi111.stdout:5/146: mkdir d19/d1b/d27/d2e/d39 0 2024-09-16T09:46:03.551 INFO:tasks.workunit.client.0.smithi111.stdout:5/147: symlink d19/d1b/d1e/d21/d29/l3a 0 2024-09-16T09:46:03.555 INFO:tasks.workunit.client.0.smithi111.stdout:5/148: creat d19/d1b/d27/f3b x:0 0 0 2024-09-16T09:46:03.726 INFO:tasks.workunit.client.0.smithi111.stdout:3/56: dread f3 [0,4194304] 0 2024-09-16T09:46:03.726 INFO:tasks.workunit.client.0.smithi111.stdout:3/57: stat f3 0 2024-09-16T09:46:03.726 INFO:tasks.workunit.client.0.smithi111.stdout:3/58: chown d5/da/db 1985078 1 2024-09-16T09:46:03.729 INFO:tasks.workunit.client.0.smithi111.stdout:3/59: creat d5/da/ff x:0 0 0 2024-09-16T09:46:03.729 INFO:tasks.workunit.client.0.smithi111.stdout:3/60: fdatasync f3 0 2024-09-16T09:46:03.732 INFO:tasks.workunit.client.0.smithi111.stdout:3/61: symlink d5/da/db/de/l10 0 2024-09-16T09:46:03.737 INFO:tasks.workunit.client.0.smithi111.stdout:3/62: creat d5/da/f11 x:0 0 0 2024-09-16T09:46:03.737 INFO:tasks.workunit.client.0.smithi111.stdout:3/63: write d5/f8 [3345945,83967] 0 2024-09-16T09:46:03.741 INFO:tasks.workunit.client.0.smithi111.stdout:3/64: mknod d5/da/db/de/c12 0 2024-09-16T09:46:03.802 INFO:tasks.workunit.client.0.smithi111.stdout:4/69: truncate d2/f8 2877810 0 2024-09-16T09:46:03.803 INFO:tasks.workunit.client.0.smithi111.stdout:4/70: creat d2/d6/dd/f16 x:0 0 0 2024-09-16T09:46:03.805 INFO:tasks.workunit.client.0.smithi111.stdout:5/149: write f7 [452858,7339] 0 2024-09-16T09:46:03.817 INFO:tasks.workunit.client.0.smithi111.stdout:5/150: dread d19/d1b/d27/f37 [0,4194304] 0 2024-09-16T09:46:03.818 INFO:tasks.workunit.client.0.smithi111.stdout:5/151: mknod d19/c3c 0 2024-09-16T09:46:03.819 INFO:tasks.workunit.client.0.smithi111.stdout:5/152: link ff d19/d1b/d27/f3d 0 2024-09-16T09:46:03.824 INFO:tasks.workunit.client.0.smithi111.stdout:4/71: dwrite d2/d6/fe [0,4194304] 0 2024-09-16T09:46:03.824 INFO:tasks.workunit.client.0.smithi111.stdout:4/72: write d2/d6/f14 [541010,56230] 0 2024-09-16T09:46:03.825 INFO:tasks.workunit.client.0.smithi111.stdout:4/73: dread - d2/d6/dd/f16 zero size 2024-09-16T09:46:03.825 INFO:tasks.workunit.client.0.smithi111.stdout:4/74: stat d2/f8 0 2024-09-16T09:46:03.827 INFO:tasks.workunit.client.0.smithi111.stdout:4/75: rmdir d2/d6/dd 39 2024-09-16T09:46:03.828 INFO:tasks.workunit.client.0.smithi111.stdout:4/76: creat d2/f17 x:0 0 0 2024-09-16T09:46:03.828 INFO:tasks.workunit.client.0.smithi111.stdout:4/77: chown d2/d6/f14 7327392 1 2024-09-16T09:46:03.830 INFO:tasks.workunit.client.0.smithi111.stdout:4/78: rename c1 to d2/d6/dd/c18 0 2024-09-16T09:46:03.839 INFO:tasks.workunit.client.0.smithi111.stdout:4/79: dread d2/d6/dd/f12 [0,4194304] 0 2024-09-16T09:46:03.969 INFO:tasks.workunit.client.0.smithi111.stdout:5/153: getdents d19 0 2024-09-16T09:46:03.974 INFO:tasks.workunit.client.0.smithi111.stdout:5/154: write d19/d1b/d27/f37 [1805951,123455] 0 2024-09-16T09:46:03.974 INFO:tasks.workunit.client.0.smithi111.stdout:5/155: read - d19/d1b/d27/d25/f36 zero size 2024-09-16T09:46:03.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/80: fsync d2/f17 0 2024-09-16T09:46:03.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/81: chown d2/d6 7 1 2024-09-16T09:46:03.988 INFO:tasks.workunit.client.0.smithi111.stdout:4/82: read d2/d6/dd/f12 [2985057,5226] 0 2024-09-16T09:46:03.989 INFO:tasks.workunit.client.0.smithi111.stdout:4/83: write d2/d6/f14 [418473,61223] 0 2024-09-16T09:46:03.991 INFO:tasks.workunit.client.0.smithi111.stdout:4/84: mknod d2/d6/c19 0 2024-09-16T09:46:03.991 INFO:tasks.workunit.client.0.smithi111.stdout:4/85: chown d2/c9 13590 1 2024-09-16T09:46:03.991 INFO:tasks.workunit.client.0.smithi111.stdout:4/86: chown d2/d6/dd/c18 2972 1 2024-09-16T09:46:03.994 INFO:tasks.workunit.client.0.smithi111.stdout:4/87: link d2/c3 d2/d6/c1a 0 2024-09-16T09:46:04.000 INFO:tasks.workunit.client.0.smithi111.stdout:3/65: truncate f3 102877 0 2024-09-16T09:46:04.000 INFO:tasks.workunit.client.0.smithi111.stdout:5/156: dwrite fc [4194304,4194304] 0 2024-09-16T09:46:04.001 INFO:tasks.workunit.client.0.smithi111.stdout:5/157: chown d19/d1b/d27/d2e/l31 64 1 2024-09-16T09:46:04.006 INFO:tasks.workunit.client.0.smithi111.stdout:5/158: rename f4 to d19/d1b/d27/f3e 0 2024-09-16T09:46:04.006 INFO:tasks.workunit.client.0.smithi111.stdout:5/159: write d19/d1b/d27/d25/f26 [1941791,53750] 0 2024-09-16T09:46:04.022 INFO:tasks.workunit.client.0.smithi111.stdout:4/88: dwrite d2/fb [0,4194304] 0 2024-09-16T09:46:04.032 INFO:tasks.workunit.client.0.smithi111.stdout:5/160: dwrite d19/d1b/d27/d25/f2b [0,4194304] 0 2024-09-16T09:46:04.038 INFO:tasks.workunit.client.0.smithi111.stdout:5/161: dread fd [0,4194304] 0 2024-09-16T09:46:04.038 INFO:tasks.workunit.client.0.smithi111.stdout:4/89: read d2/d6/fe [934069,100104] 0 2024-09-16T09:46:04.039 INFO:tasks.workunit.client.0.smithi111.stdout:4/90: write d2/d6/dd/f16 [877805,122397] 0 2024-09-16T09:46:04.039 INFO:tasks.workunit.client.0.smithi111.stdout:4/91: readlink d2/d6/l15 0 2024-09-16T09:46:04.039 INFO:tasks.workunit.client.0.smithi111.stdout:4/92: chown d2/d6/dd 30239 1 2024-09-16T09:46:04.051 INFO:tasks.workunit.client.0.smithi111.stdout:5/162: creat d19/d1b/d27/d25/f3f x:0 0 0 2024-09-16T09:46:04.053 INFO:tasks.workunit.client.0.smithi111.stdout:4/93: mkdir d2/d6/dd/d1b 0 2024-09-16T09:46:04.059 INFO:tasks.workunit.client.0.smithi111.stdout:5/163: creat d19/d1b/d1e/f40 x:0 0 0 2024-09-16T09:46:04.059 INFO:tasks.workunit.client.0.smithi111.stdout:5/164: getdents d19/d1b/d27/d25/d2a 0 2024-09-16T09:46:04.060 INFO:tasks.workunit.client.0.smithi111.stdout:4/94: mkdir d2/d6/dd/d1c 0 2024-09-16T09:46:04.060 INFO:tasks.workunit.client.0.smithi111.stdout:4/95: chown d2/d6/dd/c18 238 1 2024-09-16T09:46:04.066 INFO:tasks.workunit.client.0.smithi111.stdout:5/165: mkdir d19/d1b/d1e/d41 0 2024-09-16T09:46:04.068 INFO:tasks.workunit.client.0.smithi111.stdout:4/96: mknod d2/d6/dd/d1c/c1d 0 2024-09-16T09:46:04.073 INFO:tasks.workunit.client.0.smithi111.stdout:5/166: creat d19/d1b/d27/d2e/f42 x:0 0 0 2024-09-16T09:46:04.074 INFO:tasks.workunit.client.0.smithi111.stdout:4/97: mknod d2/d6/dd/c1e 0 2024-09-16T09:46:04.077 INFO:tasks.workunit.client.0.smithi111.stdout:5/167: creat d19/f43 x:0 0 0 2024-09-16T09:46:04.078 INFO:tasks.workunit.client.0.smithi111.stdout:4/98: creat d2/f1f x:0 0 0 2024-09-16T09:46:04.081 INFO:tasks.workunit.client.0.smithi111.stdout:4/99: creat d2/d6/f20 x:0 0 0 2024-09-16T09:46:04.087 INFO:tasks.workunit.client.0.smithi111.stdout:5/168: dread d19/d1b/d27/d25/f2b [0,4194304] 0 2024-09-16T09:46:04.087 INFO:tasks.workunit.client.0.smithi111.stdout:5/169: chown d19/d1b/d27/d2e 513573 1 2024-09-16T09:46:04.098 INFO:tasks.workunit.client.0.smithi111.stdout:4/100: dwrite d2/f1f [0,4194304] 0 2024-09-16T09:46:04.098 INFO:tasks.workunit.client.0.smithi111.stdout:4/101: write d2/f8 [3759587,24763] 0 2024-09-16T09:46:04.098 INFO:tasks.workunit.client.0.smithi111.stdout:4/102: dread - d2/f17 zero size 2024-09-16T09:46:04.104 INFO:tasks.workunit.client.0.smithi111.stdout:5/170: dwrite f18 [0,4194304] 0 2024-09-16T09:46:04.104 INFO:tasks.workunit.client.0.smithi111.stdout:4/103: rename d2/d6/c19 to d2/d6/c21 0 2024-09-16T09:46:04.106 INFO:tasks.workunit.client.0.smithi111.stdout:5/171: dread fa [0,4194304] 0 2024-09-16T09:46:04.108 INFO:tasks.workunit.client.0.smithi111.stdout:4/104: unlink d2/d6/dd/c18 0 2024-09-16T09:46:04.113 INFO:tasks.workunit.client.0.smithi111.stdout:4/105: rename d2/d6/dd/c1e to d2/d6/c22 0 2024-09-16T09:46:04.115 INFO:tasks.workunit.client.0.smithi111.stdout:4/106: dread d2/d6/f14 [0,4194304] 0 2024-09-16T09:46:04.116 INFO:tasks.workunit.client.0.smithi111.stdout:4/107: chown d2/f8 7863 1 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:0/94: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:9/77: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:8/51: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:2/173: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:6/65: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:1/55: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:2/174: chown d0/d22/f23 330306 1 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:7/122: sync 2024-09-16T09:46:04.118 INFO:tasks.workunit.client.0.smithi111.stdout:7/123: fsync d1/d16/f29 0 2024-09-16T09:46:04.119 INFO:tasks.workunit.client.0.smithi111.stdout:4/108: creat d2/d6/f23 x:0 0 0 2024-09-16T09:46:04.123 INFO:tasks.workunit.client.0.smithi111.stdout:6/66: dread d0/f2 [0,4194304] 0 2024-09-16T09:46:04.123 INFO:tasks.workunit.client.0.smithi111.stdout:0/95: mknod d0/d1d/c20 0 2024-09-16T09:46:04.123 INFO:tasks.workunit.client.0.smithi111.stdout:5/172: dwrite f15 [0,4194304] 0 2024-09-16T09:46:04.125 INFO:tasks.workunit.client.0.smithi111.stdout:8/52: creat d3/f11 x:0 0 0 2024-09-16T09:46:04.125 INFO:tasks.workunit.client.0.smithi111.stdout:8/53: rename d3/da to d3/da/db/d12 22 2024-09-16T09:46:04.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/56: creat d3/dd/f1b x:0 0 0 2024-09-16T09:46:04.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/57: write d3/dd/f11 [385759,81730] 0 2024-09-16T09:46:04.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/58: chown d3/dd 12689103 1 2024-09-16T09:46:04.128 INFO:tasks.workunit.client.0.smithi111.stdout:9/78: symlink d0/d6/l1a 0 2024-09-16T09:46:04.128 INFO:tasks.workunit.client.0.smithi111.stdout:9/79: fdatasync d0/d6/d8/de/f11 0 2024-09-16T09:46:04.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/173: write f12 [201840,11889] 0 2024-09-16T09:46:04.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/174: chown f12 31204569 1 2024-09-16T09:46:04.132 INFO:tasks.workunit.client.0.smithi111.stdout:2/175: creat d0/da/f3a x:0 0 0 2024-09-16T09:46:04.132 INFO:tasks.workunit.client.0.smithi111.stdout:2/176: write d0/fc [847704,17259] 0 2024-09-16T09:46:04.133 INFO:tasks.workunit.client.0.smithi111.stdout:8/54: dread f0 [0,4194304] 0 2024-09-16T09:46:04.135 INFO:tasks.workunit.client.0.smithi111.stdout:4/109: symlink d2/d6/dd/l24 0 2024-09-16T09:46:04.137 INFO:tasks.workunit.client.0.smithi111.stdout:6/67: mkdir d0/df/d14 0 2024-09-16T09:46:04.142 INFO:tasks.workunit.client.0.smithi111.stdout:0/96: symlink d0/d1d/l21 0 2024-09-16T09:46:04.146 INFO:tasks.workunit.client.0.smithi111.stdout:1/59: mkdir d3/d10/d1c 0 2024-09-16T09:46:04.146 INFO:tasks.workunit.client.0.smithi111.stdout:1/60: getdents d3/d10/d1c 0 2024-09-16T09:46:04.147 INFO:tasks.workunit.client.0.smithi111.stdout:9/80: symlink d0/d18/l1b 0 2024-09-16T09:46:04.147 INFO:tasks.workunit.client.0.smithi111.stdout:9/81: write d0/d6/d8/de/f11 [1693034,118711] 0 2024-09-16T09:46:04.149 INFO:tasks.workunit.client.0.smithi111.stdout:5/175: symlink d19/d1b/d1e/d21/l44 0 2024-09-16T09:46:04.151 INFO:tasks.workunit.client.0.smithi111.stdout:2/177: link d0/d2/f1f d0/da/f3b 0 2024-09-16T09:46:04.151 INFO:tasks.workunit.client.0.smithi111.stdout:2/178: truncate d0/d29/f2b 842843 0 2024-09-16T09:46:04.151 INFO:tasks.workunit.client.0.smithi111.stdout:2/179: dread - d0/da/f33 zero size 2024-09-16T09:46:04.151 INFO:tasks.workunit.client.0.smithi111.stdout:2/180: fdatasync d0/f16 0 2024-09-16T09:46:04.153 INFO:tasks.workunit.client.0.smithi111.stdout:7/124: mknod d1/c2a 0 2024-09-16T09:46:04.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/55: truncate d3/f5 4171821 0 2024-09-16T09:46:04.156 INFO:tasks.workunit.client.0.smithi111.stdout:4/110: mknod d2/d6/dd/c25 0 2024-09-16T09:46:04.159 INFO:tasks.workunit.client.0.smithi111.stdout:8/56: dread d3/f4 [0,4194304] 0 2024-09-16T09:46:04.168 INFO:tasks.workunit.client.0.smithi111.stdout:9/82: creat d0/d6/d8/f1c x:0 0 0 2024-09-16T09:46:04.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/176: mknod d19/d1b/d1e/d21/d29/d32/c45 0 2024-09-16T09:46:04.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/177: write d19/d1b/d27/f37 [2097741,64383] 0 2024-09-16T09:46:04.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/178: getdents d19/d1b/d1e/d41 0 2024-09-16T09:46:04.174 INFO:tasks.workunit.client.0.smithi111.stdout:2/181: mknod d0/d21/c3c 0 2024-09-16T09:46:04.175 INFO:tasks.workunit.client.0.smithi111.stdout:5/179: dread d19/d1b/f1c [0,4194304] 0 2024-09-16T09:46:04.175 INFO:tasks.workunit.client.0.smithi111.stdout:5/180: fdatasync d19/d1b/d1e/f40 0 2024-09-16T09:46:04.175 INFO:tasks.workunit.client.0.smithi111.stdout:5/181: chown d19/d1b/d1e/d21/d29/l3a 12797 1 2024-09-16T09:46:04.178 INFO:tasks.workunit.client.0.smithi111.stdout:7/125: creat d1/d16/d27/f2b x:0 0 0 2024-09-16T09:46:04.180 INFO:tasks.workunit.client.0.smithi111.stdout:4/111: mkdir d2/d6/dd/d26 0 2024-09-16T09:46:04.180 INFO:tasks.workunit.client.0.smithi111.stdout:4/112: read d2/d6/fe [4183646,52369] 0 2024-09-16T09:46:04.184 INFO:tasks.workunit.client.0.smithi111.stdout:8/57: getdents d3/da 0 2024-09-16T09:46:04.185 INFO:tasks.workunit.client.0.smithi111.stdout:5/182: mkdir d19/d1b/d1e/d21/d29/d32/d46 0 2024-09-16T09:46:04.189 INFO:tasks.workunit.client.0.smithi111.stdout:7/126: mknod d1/d16/d17/d18/d1b/c2c 0 2024-09-16T09:46:04.189 INFO:tasks.workunit.client.0.smithi111.stdout:7/127: stat d1/d16/d17/d18/d1d/f24 0 2024-09-16T09:46:04.191 INFO:tasks.workunit.client.0.smithi111.stdout:8/58: creat d3/f13 x:0 0 0 2024-09-16T09:46:04.191 INFO:tasks.workunit.client.0.smithi111.stdout:8/59: chown d3/f13 58705 1 2024-09-16T09:46:04.191 INFO:tasks.workunit.client.0.smithi111.stdout:8/60: dread - d3/f10 zero size 2024-09-16T09:46:04.191 INFO:tasks.workunit.client.0.smithi111.stdout:8/61: write d3/f4 [1360993,82997] 0 2024-09-16T09:46:04.192 INFO:tasks.workunit.client.0.smithi111.stdout:9/83: dwrite d0/d6/d8/f1c [0,4194304] 0 2024-09-16T09:46:04.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/183: symlink d19/l47 0 2024-09-16T09:46:04.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/184: dread - d19/d1b/d27/d25/f36 zero size 2024-09-16T09:46:04.196 INFO:tasks.workunit.client.0.smithi111.stdout:7/128: mknod d1/d16/d17/d18/d1d/c2d 0 2024-09-16T09:46:04.201 INFO:tasks.workunit.client.0.smithi111.stdout:2/182: dwrite d0/d29/f31 [0,4194304] 0 2024-09-16T09:46:04.201 INFO:tasks.workunit.client.0.smithi111.stdout:4/113: dwrite d2/d6/dd/f12 [0,4194304] 0 2024-09-16T09:46:04.203 INFO:tasks.workunit.client.0.smithi111.stdout:9/84: rmdir d0 39 2024-09-16T09:46:04.205 INFO:tasks.workunit.client.0.smithi111.stdout:7/129: symlink d1/d16/d17/d18/d1d/l2e 0 2024-09-16T09:46:04.207 INFO:tasks.workunit.client.0.smithi111.stdout:8/62: dread d3/f4 [0,4194304] 0 2024-09-16T09:46:04.208 INFO:tasks.workunit.client.0.smithi111.stdout:8/63: write d3/f10 [340492,42873] 0 2024-09-16T09:46:04.210 INFO:tasks.workunit.client.0.smithi111.stdout:8/64: fsync d3/f10 0 2024-09-16T09:46:04.212 INFO:tasks.workunit.client.0.smithi111.stdout:2/183: link d0/da/f33 d0/f3d 0 2024-09-16T09:46:04.218 INFO:tasks.workunit.client.0.smithi111.stdout:4/114: truncate d2/d6/fc 91276 0 2024-09-16T09:46:04.219 INFO:tasks.workunit.client.0.smithi111.stdout:9/85: rmdir d0/d18 39 2024-09-16T09:46:04.221 INFO:tasks.workunit.client.0.smithi111.stdout:7/130: mkdir d1/d16/d17/d18/d1d/d2f 0 2024-09-16T09:46:04.224 INFO:tasks.workunit.client.0.smithi111.stdout:2/184: symlink d0/d2/l3e 0 2024-09-16T09:46:04.224 INFO:tasks.workunit.client.0.smithi111.stdout:2/185: read d0/d2/f14 [802728,57704] 0 2024-09-16T09:46:04.226 INFO:tasks.workunit.client.0.smithi111.stdout:4/115: truncate d2/f8 2959598 0 2024-09-16T09:46:04.227 INFO:tasks.workunit.client.0.smithi111.stdout:9/86: mknod d0/d6/d8/c1d 0 2024-09-16T09:46:04.230 INFO:tasks.workunit.client.0.smithi111.stdout:4/116: link d2/d6/dd/f16 d2/d6/dd/f27 0 2024-09-16T09:46:04.231 INFO:tasks.workunit.client.0.smithi111.stdout:7/131: rename d1/d16/d17/d18/d1d/l2e to d1/l30 0 2024-09-16T09:46:04.232 INFO:tasks.workunit.client.0.smithi111.stdout:4/117: creat d2/d6/dd/f28 x:0 0 0 2024-09-16T09:46:04.233 INFO:tasks.workunit.client.0.smithi111.stdout:9/87: write d0/d6/d8/fd [769470,123321] 0 2024-09-16T09:46:04.235 INFO:tasks.workunit.client.0.smithi111.stdout:7/132: symlink d1/d20/l31 0 2024-09-16T09:46:04.235 INFO:tasks.workunit.client.0.smithi111.stdout:7/133: chown d1/f26 10545 1 2024-09-16T09:46:04.254 INFO:tasks.workunit.client.0.smithi111.stdout:2/186: dwrite d0/d21/f2f [0,4194304] 0 2024-09-16T09:46:04.254 INFO:tasks.workunit.client.0.smithi111.stdout:2/187: read d0/d2/f1e [1813779,82851] 0 2024-09-16T09:46:04.254 INFO:tasks.workunit.client.0.smithi111.stdout:2/188: chown d0/l2e 13650815 1 2024-09-16T09:46:04.257 INFO:tasks.workunit.client.0.smithi111.stdout:2/189: dread d0/f36 [0,4194304] 0 2024-09-16T09:46:04.258 INFO:tasks.workunit.client.0.smithi111.stdout:2/190: dread - d0/d2/f15 zero size 2024-09-16T09:46:04.260 INFO:tasks.workunit.client.0.smithi111.stdout:2/191: rename d0/d2/f1f to d0/da/f3f 0 2024-09-16T09:46:04.261 INFO:tasks.workunit.client.0.smithi111.stdout:2/192: creat d0/d22/f40 x:0 0 0 2024-09-16T09:46:04.263 INFO:tasks.workunit.client.0.smithi111.stdout:4/118: dwrite d2/f1f [0,4194304] 0 2024-09-16T09:46:04.263 INFO:tasks.workunit.client.0.smithi111.stdout:4/119: fdatasync d2/d6/fe 0 2024-09-16T09:46:04.263 INFO:tasks.workunit.client.0.smithi111.stdout:2/193: dread d0/d22/f23 [0,4194304] 0 2024-09-16T09:46:04.267 INFO:tasks.workunit.client.0.smithi111.stdout:2/194: truncate d0/d2/f14 1295254 0 2024-09-16T09:46:04.270 INFO:tasks.workunit.client.0.smithi111.stdout:2/195: creat d0/d2/f41 x:0 0 0 2024-09-16T09:46:04.270 INFO:tasks.workunit.client.0.smithi111.stdout:2/196: fdatasync d0/d2/f39 0 2024-09-16T09:46:04.272 INFO:tasks.workunit.client.0.smithi111.stdout:9/88: dwrite d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:04.272 INFO:tasks.workunit.client.0.smithi111.stdout:0/97: dwrite d0/ff [0,4194304] 0 2024-09-16T09:46:04.273 INFO:tasks.workunit.client.0.smithi111.stdout:2/197: truncate d0/d22/f24 1724397 0 2024-09-16T09:46:04.274 INFO:tasks.workunit.client.0.smithi111.stdout:2/198: readlink d0/l2e 0 2024-09-16T09:46:04.275 INFO:tasks.workunit.client.0.smithi111.stdout:7/134: dwrite d1/d16/d17/d18/d1d/f24 [0,4194304] 0 2024-09-16T09:46:04.275 INFO:tasks.workunit.client.0.smithi111.stdout:7/135: truncate d1/d20/f23 1262578 0 2024-09-16T09:46:04.275 INFO:tasks.workunit.client.0.smithi111.stdout:9/89: creat d0/f1e x:0 0 0 2024-09-16T09:46:04.276 INFO:tasks.workunit.client.0.smithi111.stdout:0/98: creat d0/f22 x:0 0 0 2024-09-16T09:46:04.278 INFO:tasks.workunit.client.0.smithi111.stdout:2/199: creat d0/d29/f42 x:0 0 0 2024-09-16T09:46:04.282 INFO:tasks.workunit.client.0.smithi111.stdout:2/200: dread d0/fc [0,4194304] 0 2024-09-16T09:46:04.289 INFO:tasks.workunit.client.0.smithi111.stdout:9/90: getdents d0/d6 0 2024-09-16T09:46:04.289 INFO:tasks.workunit.client.0.smithi111.stdout:9/91: dread - d0/f1e zero size 2024-09-16T09:46:04.289 INFO:tasks.workunit.client.0.smithi111.stdout:9/92: chown d0/d6/d8/c1d 13582 1 2024-09-16T09:46:04.289 INFO:tasks.workunit.client.0.smithi111.stdout:7/136: write d1/d9/fe [1384909,61903] 0 2024-09-16T09:46:04.295 INFO:tasks.workunit.client.0.smithi111.stdout:4/120: dwrite d2/f8 [0,4194304] 0 2024-09-16T09:46:04.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/93: dread d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:04.297 INFO:tasks.workunit.client.0.smithi111.stdout:4/121: dread d2/d6/fc [0,4194304] 0 2024-09-16T09:46:04.300 INFO:tasks.workunit.client.0.smithi111.stdout:9/94: rmdir d0/d6 39 2024-09-16T09:46:04.300 INFO:tasks.workunit.client.0.smithi111.stdout:9/95: truncate d0/d6/d8/f1c 4996230 0 2024-09-16T09:46:04.302 INFO:tasks.workunit.client.0.smithi111.stdout:4/122: creat d2/d6/dd/d1b/f29 x:0 0 0 2024-09-16T09:46:04.302 INFO:tasks.workunit.client.0.smithi111.stdout:4/123: chown d2/d6/c21 2890 1 2024-09-16T09:46:04.302 INFO:tasks.workunit.client.0.smithi111.stdout:9/96: mknod d0/d18/c1f 0 2024-09-16T09:46:04.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/124: rmdir d2/d6/dd/d26 0 2024-09-16T09:46:04.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/125: truncate d2/d6/dd/f28 865237 0 2024-09-16T09:46:04.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/126: chown d2/d6/fe 350 1 2024-09-16T09:46:04.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/99: dwrite d0/f22 [0,4194304] 0 2024-09-16T09:46:04.305 INFO:tasks.workunit.client.0.smithi111.stdout:2/201: dwrite d0/da/f33 [0,4194304] 0 2024-09-16T09:46:04.307 INFO:tasks.workunit.client.0.smithi111.stdout:9/97: link d0/d6/ca d0/d6/d8/de/c20 0 2024-09-16T09:46:04.313 INFO:tasks.workunit.client.0.smithi111.stdout:4/127: rename d2/d6/fc to d2/d6/dd/f2a 0 2024-09-16T09:46:04.314 INFO:tasks.workunit.client.0.smithi111.stdout:0/100: unlink d0/ff 0 2024-09-16T09:46:04.314 INFO:tasks.workunit.client.0.smithi111.stdout:0/101: write d0/f1c [1538594,29784] 0 2024-09-16T09:46:04.314 INFO:tasks.workunit.client.0.smithi111.stdout:0/102: stat d0/c16 0 2024-09-16T09:46:04.322 INFO:tasks.workunit.client.0.smithi111.stdout:9/98: mkdir d0/d21 0 2024-09-16T09:46:04.324 INFO:tasks.workunit.client.0.smithi111.stdout:4/128: creat d2/d6/dd/d1b/f2b x:0 0 0 2024-09-16T09:46:04.325 INFO:tasks.workunit.client.0.smithi111.stdout:0/103: rmdir d0/d1d 39 2024-09-16T09:46:04.327 INFO:tasks.workunit.client.0.smithi111.stdout:4/129: creat d2/d6/dd/d1c/f2c x:0 0 0 2024-09-16T09:46:04.331 INFO:tasks.workunit.client.0.smithi111.stdout:0/104: mknod d0/c23 0 2024-09-16T09:46:04.331 INFO:tasks.workunit.client.0.smithi111.stdout:0/105: write d0/f13 [1942383,1194] 0 2024-09-16T09:46:04.331 INFO:tasks.workunit.client.0.smithi111.stdout:9/99: write d0/d6/f12 [2339327,98515] 0 2024-09-16T09:46:04.337 INFO:tasks.workunit.client.0.smithi111.stdout:9/100: truncate d0/d6/d8/de/f11 1806575 0 2024-09-16T09:46:04.337 INFO:tasks.workunit.client.0.smithi111.stdout:4/130: dread d2/f1f [0,4194304] 0 2024-09-16T09:46:04.337 INFO:tasks.workunit.client.0.smithi111.stdout:4/131: write d2/d6/dd/f2a [186771,65651] 0 2024-09-16T09:46:04.339 INFO:tasks.workunit.client.0.smithi111.stdout:9/101: rmdir d0 39 2024-09-16T09:46:04.353 INFO:tasks.workunit.client.0.smithi111.stdout:2/202: dwrite d0/f3d [4194304,4194304] 0 2024-09-16T09:46:04.356 INFO:tasks.workunit.client.0.smithi111.stdout:4/132: fsync d2/d6/dd/d1b/f2b 0 2024-09-16T09:46:04.361 INFO:tasks.workunit.client.0.smithi111.stdout:0/106: link d0/f17 d0/f24 0 2024-09-16T09:46:04.371 INFO:tasks.workunit.client.0.smithi111.stdout:2/203: truncate d0/da/f33 8149523 0 2024-09-16T09:46:04.371 INFO:tasks.workunit.client.0.smithi111.stdout:2/204: chown d0/d21/l26 3 1 2024-09-16T09:46:04.372 INFO:tasks.workunit.client.0.smithi111.stdout:4/133: getdents d2 0 2024-09-16T09:46:04.372 INFO:tasks.workunit.client.0.smithi111.stdout:4/134: stat d2/d6/dd/d1c/f2c 0 2024-09-16T09:46:04.375 INFO:tasks.workunit.client.0.smithi111.stdout:2/205: rename d0/l30 to d0/da/l43 0 2024-09-16T09:46:04.377 INFO:tasks.workunit.client.0.smithi111.stdout:4/135: unlink d2/d6/f23 0 2024-09-16T09:46:04.378 INFO:tasks.workunit.client.0.smithi111.stdout:9/102: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:04.381 INFO:tasks.workunit.client.0.smithi111.stdout:2/206: mkdir d0/d2/d44 0 2024-09-16T09:46:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:04 smithi111 ceph-mon[27997]: pgmap v255: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 409 op/s 2024-09-16T09:46:04.383 INFO:tasks.workunit.client.0.smithi111.stdout:0/107: rename d0/c1a to d0/d1d/c25 0 2024-09-16T09:46:04.385 INFO:tasks.workunit.client.0.smithi111.stdout:2/207: dread d0/d22/f24 [0,4194304] 0 2024-09-16T09:46:04.387 INFO:tasks.workunit.client.0.smithi111.stdout:0/108: mkdir d0/d26 0 2024-09-16T09:46:04.388 INFO:tasks.workunit.client.0.smithi111.stdout:9/103: write d0/d6/d8/fd [2009500,29193] 0 2024-09-16T09:46:04.388 INFO:tasks.workunit.client.0.smithi111.stdout:2/208: dread d0/d22/f24 [0,4194304] 0 2024-09-16T09:46:04.390 INFO:tasks.workunit.client.0.smithi111.stdout:0/109: chown d0/cb 433 1 2024-09-16T09:46:04.391 INFO:tasks.workunit.client.0.smithi111.stdout:9/104: stat d0/d6/d8/de/c20 0 2024-09-16T09:46:04.393 INFO:tasks.workunit.client.0.smithi111.stdout:2/209: getdents d0/d29 0 2024-09-16T09:46:04.394 INFO:tasks.workunit.client.0.smithi111.stdout:2/210: read - d0/d2/f41 zero size 2024-09-16T09:46:04.395 INFO:tasks.workunit.client.0.smithi111.stdout:0/110: mknod d0/d1d/c27 0 2024-09-16T09:46:04.397 INFO:tasks.workunit.client.0.smithi111.stdout:4/136: dwrite d2/d6/dd/f27 [0,4194304] 0 2024-09-16T09:46:04.399 INFO:tasks.workunit.client.0.smithi111.stdout:9/105: mkdir d0/d21/d22 0 2024-09-16T09:46:04.400 INFO:tasks.workunit.client.0.smithi111.stdout:2/211: mkdir d0/d45 0 2024-09-16T09:46:04.410 INFO:tasks.workunit.client.0.smithi111.stdout:4/137: dwrite d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:04.410 INFO:tasks.workunit.client.0.smithi111.stdout:4/138: stat d2/d6/dd/c25 0 2024-09-16T09:46:04.414 INFO:tasks.workunit.client.0.smithi111.stdout:2/212: getdents d0/d21 0 2024-09-16T09:46:04.419 INFO:tasks.workunit.client.0.smithi111.stdout:0/111: rename d0/l19 to d0/d1d/l28 0 2024-09-16T09:46:04.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/139: creat d2/d6/dd/d1c/f2d x:0 0 0 2024-09-16T09:46:04.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/140: write d2/d6/fe [870908,111394] 0 2024-09-16T09:46:04.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/141: truncate d2/f17 1036924 0 2024-09-16T09:46:04.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/142: read d2/d6/fe [2525774,71232] 0 2024-09-16T09:46:04.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/143: truncate d2/d6/dd/d1b/f2b 141967 0 2024-09-16T09:46:04.427 INFO:tasks.workunit.client.0.smithi111.stdout:2/213: creat d0/d21/f46 x:0 0 0 2024-09-16T09:46:04.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/112: fdatasync d0/f11 0 2024-09-16T09:46:04.430 INFO:tasks.workunit.client.0.smithi111.stdout:4/144: link d2/d6/c22 d2/d6/dd/c2e 0 2024-09-16T09:46:04.432 INFO:tasks.workunit.client.0.smithi111.stdout:0/113: creat d0/d1d/f29 x:0 0 0 2024-09-16T09:46:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:04 smithi114 ceph-mon[35635]: pgmap v255: 65 pgs: 65 active+clean; 335 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 3.2 MiB/s rd, 4.4 MiB/s wr, 409 op/s 2024-09-16T09:46:04.448 INFO:tasks.workunit.client.0.smithi111.stdout:4/145: dwrite d2/fb [0,4194304] 0 2024-09-16T09:46:04.461 INFO:tasks.workunit.client.0.smithi111.stdout:0/114: dwrite d0/f24 [0,4194304] 0 2024-09-16T09:46:04.463 INFO:tasks.workunit.client.0.smithi111.stdout:4/146: dwrite d2/f8 [4194304,4194304] 0 2024-09-16T09:46:04.465 INFO:tasks.workunit.client.0.smithi111.stdout:0/115: write d0/f13 [2675055,80121] 0 2024-09-16T09:46:04.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/147: mkdir d2/d6/dd/d1c/d2f 0 2024-09-16T09:46:04.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/148: chown d2 62979390 1 2024-09-16T09:46:04.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/149: write d2/d6/fe [2200980,108935] 0 2024-09-16T09:46:04.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/150: dread - d2/d6/dd/d1b/f29 zero size 2024-09-16T09:46:04.469 INFO:tasks.workunit.client.0.smithi111.stdout:0/116: link d0/f11 d0/d26/f2a 0 2024-09-16T09:46:04.471 INFO:tasks.workunit.client.0.smithi111.stdout:0/117: creat d0/f2b x:0 0 0 2024-09-16T09:46:04.475 INFO:tasks.workunit.client.0.smithi111.stdout:0/118: truncate d0/f10 5273353 0 2024-09-16T09:46:04.484 INFO:tasks.workunit.client.0.smithi111.stdout:0/119: dread d0/f11 [0,4194304] 0 2024-09-16T09:46:04.495 INFO:tasks.workunit.client.0.smithi111.stdout:0/120: unlink d0/cc 0 2024-09-16T09:46:04.502 INFO:tasks.workunit.client.0.smithi111.stdout:0/121: creat d0/d26/f2c x:0 0 0 2024-09-16T09:46:04.533 INFO:tasks.workunit.client.0.smithi111.stdout:4/151: truncate d2/f8 6318738 0 2024-09-16T09:46:04.533 INFO:tasks.workunit.client.0.smithi111.stdout:4/152: read d2/d6/fe [2122500,85258] 0 2024-09-16T09:46:04.533 INFO:tasks.workunit.client.0.smithi111.stdout:4/153: truncate d2/d6/f14 654477 0 2024-09-16T09:46:04.786 INFO:tasks.workunit.client.0.smithi111.stdout:3/66: sync 2024-09-16T09:46:04.786 INFO:tasks.workunit.client.0.smithi111.stdout:1/61: sync 2024-09-16T09:46:04.786 INFO:tasks.workunit.client.0.smithi111.stdout:6/68: sync 2024-09-16T09:46:04.786 INFO:tasks.workunit.client.0.smithi111.stdout:5/185: sync 2024-09-16T09:46:04.786 INFO:tasks.workunit.client.0.smithi111.stdout:3/67: truncate f3 76454 0 2024-09-16T09:46:04.788 INFO:tasks.workunit.client.0.smithi111.stdout:1/62: creat d3/d10/d1c/f1d x:0 0 0 2024-09-16T09:46:04.790 INFO:tasks.workunit.client.0.smithi111.stdout:6/69: mknod d0/df/c15 0 2024-09-16T09:46:04.792 INFO:tasks.workunit.client.0.smithi111.stdout:5/186: creat d19/f48 x:0 0 0 2024-09-16T09:46:04.792 INFO:tasks.workunit.client.0.smithi111.stdout:5/187: write d19/d1b/d27/f37 [399703,94840] 0 2024-09-16T09:46:04.793 INFO:tasks.workunit.client.0.smithi111.stdout:1/63: getdents d3 0 2024-09-16T09:46:04.794 INFO:tasks.workunit.client.0.smithi111.stdout:6/70: symlink d0/df/d14/l16 0 2024-09-16T09:46:04.796 INFO:tasks.workunit.client.0.smithi111.stdout:5/188: creat d19/d1b/d27/d25/d2a/f49 x:0 0 0 2024-09-16T09:46:04.797 INFO:tasks.workunit.client.0.smithi111.stdout:5/189: write fe [240931,24612] 0 2024-09-16T09:46:04.799 INFO:tasks.workunit.client.0.smithi111.stdout:1/64: rmdir d3/d10/d15 0 2024-09-16T09:46:04.800 INFO:tasks.workunit.client.0.smithi111.stdout:1/65: read d3/f6 [202770,79397] 0 2024-09-16T09:46:04.800 INFO:tasks.workunit.client.0.smithi111.stdout:1/66: stat d3/dd/l19 0 2024-09-16T09:46:04.800 INFO:tasks.workunit.client.0.smithi111.stdout:1/67: read - d3/f7 zero size 2024-09-16T09:46:04.801 INFO:tasks.workunit.client.0.smithi111.stdout:6/71: link d0/f2 d0/f17 0 2024-09-16T09:46:04.803 INFO:tasks.workunit.client.0.smithi111.stdout:5/190: unlink d19/d1b/d1e/d21/d29/d32/c45 0 2024-09-16T09:46:04.803 INFO:tasks.workunit.client.0.smithi111.stdout:5/191: truncate f18 4581489 0 2024-09-16T09:46:04.803 INFO:tasks.workunit.client.0.smithi111.stdout:3/68: dread f3 [0,4194304] 0 2024-09-16T09:46:04.804 INFO:tasks.workunit.client.0.smithi111.stdout:1/68: mknod d3/d10/c1e 0 2024-09-16T09:46:04.805 INFO:tasks.workunit.client.0.smithi111.stdout:1/69: fsync d3/f9 0 2024-09-16T09:46:04.805 INFO:tasks.workunit.client.0.smithi111.stdout:6/72: unlink d0/c7 0 2024-09-16T09:46:04.808 INFO:tasks.workunit.client.0.smithi111.stdout:5/192: mkdir d19/d1b/d27/d2e/d4a 0 2024-09-16T09:46:04.809 INFO:tasks.workunit.client.0.smithi111.stdout:1/70: rename d3/dd/f11 to d3/dd/f1f 0 2024-09-16T09:46:04.812 INFO:tasks.workunit.client.0.smithi111.stdout:6/73: mknod d0/df/c18 0 2024-09-16T09:46:04.813 INFO:tasks.workunit.client.0.smithi111.stdout:1/71: mkdir d3/d10/d1c/d20 0 2024-09-16T09:46:04.813 INFO:tasks.workunit.client.0.smithi111.stdout:1/72: stat d3/cb 0 2024-09-16T09:46:04.813 INFO:tasks.workunit.client.0.smithi111.stdout:1/73: chown d3/lc 2559076 1 2024-09-16T09:46:04.819 INFO:tasks.workunit.client.0.smithi111.stdout:1/74: mknod d3/d10/d1c/d20/c21 0 2024-09-16T09:46:04.821 INFO:tasks.workunit.client.0.smithi111.stdout:1/75: symlink d3/d10/l22 0 2024-09-16T09:46:04.821 INFO:tasks.workunit.client.0.smithi111.stdout:3/69: dwrite d5/da/ff [0,4194304] 0 2024-09-16T09:46:04.830 INFO:tasks.workunit.client.0.smithi111.stdout:3/70: write f1 [4014847,1468] 0 2024-09-16T09:46:04.830 INFO:tasks.workunit.client.0.smithi111.stdout:3/71: write f1 [4758195,17050] 0 2024-09-16T09:46:04.830 INFO:tasks.workunit.client.0.smithi111.stdout:3/72: readlink d5/l9 0 2024-09-16T09:46:04.831 INFO:tasks.workunit.client.0.smithi111.stdout:1/76: getdents d3/dd 0 2024-09-16T09:46:04.835 INFO:tasks.workunit.client.0.smithi111.stdout:1/77: mkdir d3/d10/d23 0 2024-09-16T09:46:04.835 INFO:tasks.workunit.client.0.smithi111.stdout:1/78: fsync d3/d10/d1c/f1d 0 2024-09-16T09:46:04.837 INFO:tasks.workunit.client.0.smithi111.stdout:1/79: rmdir d3/dd 39 2024-09-16T09:46:04.837 INFO:tasks.workunit.client.0.smithi111.stdout:1/80: chown d3/dd/l19 155484 1 2024-09-16T09:46:04.839 INFO:tasks.workunit.client.0.smithi111.stdout:1/81: mkdir d3/d24 0 2024-09-16T09:46:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:1/82: write d3/dd/f17 [995192,25084] 0 2024-09-16T09:46:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:1/83: truncate d3/f6 473378 0 2024-09-16T09:46:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:1/84: dread - d3/dd/f1b zero size 2024-09-16T09:46:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:1/85: fsync d3/f14 0 2024-09-16T09:46:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:1/86: dread - d3/f1a zero size 2024-09-16T09:46:04.840 INFO:tasks.workunit.client.0.smithi111.stdout:1/87: truncate d3/dd/f17 1664343 0 2024-09-16T09:46:04.841 INFO:tasks.workunit.client.0.smithi111.stdout:1/88: creat d3/d10/d1c/f25 x:0 0 0 2024-09-16T09:46:04.841 INFO:tasks.workunit.client.0.smithi111.stdout:1/89: fsync d3/f14 0 2024-09-16T09:46:04.847 INFO:tasks.workunit.client.0.smithi111.stdout:3/73: dwrite d5/f8 [0,4194304] 0 2024-09-16T09:46:04.849 INFO:tasks.workunit.client.0.smithi111.stdout:3/74: rmdir d5 39 2024-09-16T09:46:04.859 INFO:tasks.workunit.client.0.smithi111.stdout:1/90: dwrite d3/d10/d1c/f25 [0,4194304] 0 2024-09-16T09:46:04.863 INFO:tasks.workunit.client.0.smithi111.stdout:1/91: mkdir d3/d26 0 2024-09-16T09:46:04.864 INFO:tasks.workunit.client.0.smithi111.stdout:1/92: creat d3/f27 x:0 0 0 2024-09-16T09:46:04.866 INFO:tasks.workunit.client.0.smithi111.stdout:1/93: mkdir d3/dd/d28 0 2024-09-16T09:46:04.866 INFO:tasks.workunit.client.0.smithi111.stdout:1/94: chown d3/d10/d1c/f25 56944518 1 2024-09-16T09:46:04.867 INFO:tasks.workunit.client.0.smithi111.stdout:3/75: dwrite d5/da/f11 [0,4194304] 0 2024-09-16T09:46:04.869 INFO:tasks.workunit.client.0.smithi111.stdout:1/95: mkdir d3/d24/d29 0 2024-09-16T09:46:04.875 INFO:tasks.workunit.client.0.smithi111.stdout:3/76: write d5/da/f11 [2653712,823] 0 2024-09-16T09:46:04.875 INFO:tasks.workunit.client.0.smithi111.stdout:3/77: readlink d5/l9 0 2024-09-16T09:46:04.876 INFO:tasks.workunit.client.0.smithi111.stdout:1/96: creat d3/dd/f2a x:0 0 0 2024-09-16T09:46:04.878 INFO:tasks.workunit.client.0.smithi111.stdout:3/78: rename d5/da/ff to d5/f13 0 2024-09-16T09:46:04.879 INFO:tasks.workunit.client.0.smithi111.stdout:1/97: creat d3/d10/d23/f2b x:0 0 0 2024-09-16T09:46:04.879 INFO:tasks.workunit.client.0.smithi111.stdout:1/98: getdents d3/d26 0 2024-09-16T09:46:04.879 INFO:tasks.workunit.client.0.smithi111.stdout:1/99: stat d3/d10 0 2024-09-16T09:46:04.879 INFO:tasks.workunit.client.0.smithi111.stdout:1/100: chown d3/dd/f2a 67486570 1 2024-09-16T09:46:04.880 INFO:tasks.workunit.client.0.smithi111.stdout:3/79: creat d5/da/db/f14 x:0 0 0 2024-09-16T09:46:04.881 INFO:tasks.workunit.client.0.smithi111.stdout:1/101: unlink f1 0 2024-09-16T09:46:04.883 INFO:tasks.workunit.client.0.smithi111.stdout:3/80: link d5/da/db/f14 d5/da/db/de/f15 0 2024-09-16T09:46:04.898 INFO:tasks.workunit.client.0.smithi111.stdout:2/214: sync 2024-09-16T09:46:04.898 INFO:tasks.workunit.client.0.smithi111.stdout:9/106: sync 2024-09-16T09:46:04.898 INFO:tasks.workunit.client.0.smithi111.stdout:8/65: sync 2024-09-16T09:46:04.898 INFO:tasks.workunit.client.0.smithi111.stdout:7/137: sync 2024-09-16T09:46:04.899 INFO:tasks.workunit.client.0.smithi111.stdout:2/215: stat d0/f3d 0 2024-09-16T09:46:04.899 INFO:tasks.workunit.client.0.smithi111.stdout:3/81: dwrite f3 [0,4194304] 0 2024-09-16T09:46:04.900 INFO:tasks.workunit.client.0.smithi111.stdout:7/138: creat d1/f32 x:0 0 0 2024-09-16T09:46:04.900 INFO:tasks.workunit.client.0.smithi111.stdout:7/139: chown d1/d16/d17/d18/d1b/c2c 155 1 2024-09-16T09:46:04.900 INFO:tasks.workunit.client.0.smithi111.stdout:7/140: chown d1/d16/d17/d18/d1d 12 1 2024-09-16T09:46:04.901 INFO:tasks.workunit.client.0.smithi111.stdout:7/141: fdatasync d1/d16/d17/d18/f21 0 2024-09-16T09:46:04.902 INFO:tasks.workunit.client.0.smithi111.stdout:2/216: symlink d0/d22/l47 0 2024-09-16T09:46:04.905 INFO:tasks.workunit.client.0.smithi111.stdout:3/82: rmdir d5/da 39 2024-09-16T09:46:04.909 INFO:tasks.workunit.client.0.smithi111.stdout:7/142: symlink d1/d16/d17/d18/d1d/d2f/l33 0 2024-09-16T09:46:04.912 INFO:tasks.workunit.client.0.smithi111.stdout:2/217: unlink d0/d2/f12 0 2024-09-16T09:46:04.914 INFO:tasks.workunit.client.0.smithi111.stdout:3/83: getdents d5/da 0 2024-09-16T09:46:04.914 INFO:tasks.workunit.client.0.smithi111.stdout:3/84: write d5/da/f11 [4913793,73578] 0 2024-09-16T09:46:04.918 INFO:tasks.workunit.client.0.smithi111.stdout:9/107: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:04.918 INFO:tasks.workunit.client.0.smithi111.stdout:7/143: creat d1/d9/f34 x:0 0 0 2024-09-16T09:46:04.919 INFO:tasks.workunit.client.0.smithi111.stdout:8/66: dwrite f0 [0,4194304] 0 2024-09-16T09:46:04.919 INFO:tasks.workunit.client.0.smithi111.stdout:3/85: creat d5/da/f16 x:0 0 0 2024-09-16T09:46:04.921 INFO:tasks.workunit.client.0.smithi111.stdout:9/108: mknod d0/d6/d8/de/c23 0 2024-09-16T09:46:04.924 INFO:tasks.workunit.client.0.smithi111.stdout:7/144: creat d1/d9/f35 x:0 0 0 2024-09-16T09:46:04.924 INFO:tasks.workunit.client.0.smithi111.stdout:7/145: chown d1/cc 1 1 2024-09-16T09:46:04.925 INFO:tasks.workunit.client.0.smithi111.stdout:8/67: link d3/f13 d3/de/f14 0 2024-09-16T09:46:04.925 INFO:tasks.workunit.client.0.smithi111.stdout:8/68: readlink d3/l9 0 2024-09-16T09:46:04.926 INFO:tasks.workunit.client.0.smithi111.stdout:3/86: stat d5/da/db/de 0 2024-09-16T09:46:04.926 INFO:tasks.workunit.client.0.smithi111.stdout:3/87: chown d5/da/db 71221455 1 2024-09-16T09:46:04.926 INFO:tasks.workunit.client.0.smithi111.stdout:3/88: dread - d5/da/f16 zero size 2024-09-16T09:46:04.927 INFO:tasks.workunit.client.0.smithi111.stdout:9/109: unlink d0/d6/f12 0 2024-09-16T09:46:04.929 INFO:tasks.workunit.client.0.smithi111.stdout:8/69: getdents d3 0 2024-09-16T09:46:04.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/89: mknod d5/da/db/de/c17 0 2024-09-16T09:46:04.930 INFO:tasks.workunit.client.0.smithi111.stdout:9/110: stat d0/d6/d8/c9 0 2024-09-16T09:46:04.931 INFO:tasks.workunit.client.0.smithi111.stdout:7/146: rename d1/l3 to d1/l36 0 2024-09-16T09:46:04.932 INFO:tasks.workunit.client.0.smithi111.stdout:7/147: write d1/f32 [678640,30684] 0 2024-09-16T09:46:04.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/70: mknod d3/de/c15 0 2024-09-16T09:46:04.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/71: write d3/f8 [503718,58976] 0 2024-09-16T09:46:04.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/72: chown d3/f7 7 1 2024-09-16T09:46:04.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/73: dread - d3/de/f14 zero size 2024-09-16T09:46:04.933 INFO:tasks.workunit.client.0.smithi111.stdout:8/74: write d3/f7 [401103,98722] 0 2024-09-16T09:46:04.933 INFO:tasks.workunit.client.0.smithi111.stdout:3/90: getdents d5 0 2024-09-16T09:46:04.934 INFO:tasks.workunit.client.0.smithi111.stdout:8/75: mknod d3/da/db/c16 0 2024-09-16T09:46:04.935 INFO:tasks.workunit.client.0.smithi111.stdout:8/76: dread - d3/f13 zero size 2024-09-16T09:46:04.936 INFO:tasks.workunit.client.0.smithi111.stdout:3/91: unlink d5/da/f16 0 2024-09-16T09:46:04.938 INFO:tasks.workunit.client.0.smithi111.stdout:8/77: rename d3/f5 to d3/da/df/f17 0 2024-09-16T09:46:04.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/92: mkdir d5/d18 0 2024-09-16T09:46:04.940 INFO:tasks.workunit.client.0.smithi111.stdout:8/78: mkdir d3/da/df/d18 0 2024-09-16T09:46:04.941 INFO:tasks.workunit.client.0.smithi111.stdout:3/93: write d5/da/f11 [3058108,8548] 0 2024-09-16T09:46:04.942 INFO:tasks.workunit.client.0.smithi111.stdout:8/79: creat d3/f19 x:0 0 0 2024-09-16T09:46:04.942 INFO:tasks.workunit.client.0.smithi111.stdout:8/80: truncate d3/f10 635614 0 2024-09-16T09:46:04.944 INFO:tasks.workunit.client.0.smithi111.stdout:3/94: mknod d5/da/db/de/c19 0 2024-09-16T09:46:04.944 INFO:tasks.workunit.client.0.smithi111.stdout:3/95: chown f3 28860484 1 2024-09-16T09:46:04.951 INFO:tasks.workunit.client.0.smithi111.stdout:7/148: dwrite d1/d9/f34 [0,4194304] 0 2024-09-16T09:46:04.951 INFO:tasks.workunit.client.0.smithi111.stdout:7/149: truncate d1/d16/d27/f2b 915605 0 2024-09-16T09:46:04.951 INFO:tasks.workunit.client.0.smithi111.stdout:7/150: chown d1 1 1 2024-09-16T09:46:04.954 INFO:tasks.workunit.client.0.smithi111.stdout:7/151: symlink d1/d16/d17/d18/d1b/l37 0 2024-09-16T09:46:04.954 INFO:tasks.workunit.client.0.smithi111.stdout:7/152: chown d1/l30 204690 1 2024-09-16T09:46:04.954 INFO:tasks.workunit.client.0.smithi111.stdout:7/153: stat d1/d9 0 2024-09-16T09:46:04.955 INFO:tasks.workunit.client.0.smithi111.stdout:3/96: write f3 [504972,63196] 0 2024-09-16T09:46:04.956 INFO:tasks.workunit.client.0.smithi111.stdout:3/97: stat d5/da/db/f14 0 2024-09-16T09:46:04.956 INFO:tasks.workunit.client.0.smithi111.stdout:3/98: chown d5/da/f11 37962 1 2024-09-16T09:46:04.959 INFO:tasks.workunit.client.0.smithi111.stdout:3/99: creat d5/f1a x:0 0 0 2024-09-16T09:46:04.961 INFO:tasks.workunit.client.0.smithi111.stdout:3/100: rename d5/da/db/ld to d5/d18/l1b 0 2024-09-16T09:46:04.965 INFO:tasks.workunit.client.0.smithi111.stdout:7/154: read d1/d9/f34 [1213010,64267] 0 2024-09-16T09:46:04.966 INFO:tasks.workunit.client.0.smithi111.stdout:3/101: mknod d5/c1c 0 2024-09-16T09:46:04.966 INFO:tasks.workunit.client.0.smithi111.stdout:7/155: write d1/d16/d27/f2b [1412674,40840] 0 2024-09-16T09:46:04.966 INFO:tasks.workunit.client.0.smithi111.stdout:3/102: write f3 [3230937,74080] 0 2024-09-16T09:46:04.966 INFO:tasks.workunit.client.0.smithi111.stdout:7/156: symlink d1/d9/l38 0 2024-09-16T09:46:04.975 INFO:tasks.workunit.client.0.smithi111.stdout:3/103: dread d5/f13 [0,4194304] 0 2024-09-16T09:46:04.979 INFO:tasks.workunit.client.0.smithi111.stdout:7/157: write d1/f14 [6832721,53227] 0 2024-09-16T09:46:04.979 INFO:tasks.workunit.client.0.smithi111.stdout:7/158: truncate d1/f1a 623726 0 2024-09-16T09:46:04.999 INFO:tasks.workunit.client.0.smithi111.stdout:3/104: dwrite d5/f13 [0,4194304] 0 2024-09-16T09:46:05.002 INFO:tasks.workunit.client.0.smithi111.stdout:7/159: dwrite d1/f26 [0,4194304] 0 2024-09-16T09:46:05.009 INFO:tasks.workunit.client.0.smithi111.stdout:3/105: dread f1 [0,4194304] 0 2024-09-16T09:46:05.012 INFO:tasks.workunit.client.0.smithi111.stdout:3/106: link d5/da/db/de/c19 d5/d18/c1d 0 2024-09-16T09:46:05.012 INFO:tasks.workunit.client.0.smithi111.stdout:3/107: fsync d5/da/f11 0 2024-09-16T09:46:05.014 INFO:tasks.workunit.client.0.smithi111.stdout:3/108: symlink d5/da/db/de/l1e 0 2024-09-16T09:46:05.016 INFO:tasks.workunit.client.0.smithi111.stdout:7/160: dwrite d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:05.017 INFO:tasks.workunit.client.0.smithi111.stdout:3/109: mkdir d5/da/db/de/d1f 0 2024-09-16T09:46:05.022 INFO:tasks.workunit.client.0.smithi111.stdout:7/161: rename d1/cc to d1/d16/d17/d18/d1d/d2f/c39 0 2024-09-16T09:46:05.022 INFO:tasks.workunit.client.0.smithi111.stdout:7/162: fdatasync d1/d16/f1c 0 2024-09-16T09:46:05.041 INFO:tasks.workunit.client.0.smithi111.stdout:3/110: dwrite f1 [0,4194304] 0 2024-09-16T09:46:05.041 INFO:tasks.workunit.client.0.smithi111.stdout:7/163: dwrite d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:05.042 INFO:tasks.workunit.client.0.smithi111.stdout:7/164: truncate d1/d9/f34 1993937 0 2024-09-16T09:46:05.067 INFO:tasks.workunit.client.0.smithi111.stdout:3/111: dwrite d5/da/db/de/f15 [0,4194304] 0 2024-09-16T09:46:05.078 INFO:tasks.workunit.client.0.smithi111.stdout:7/165: dwrite d1/d9/f34 [0,4194304] 0 2024-09-16T09:46:05.078 INFO:tasks.workunit.client.0.smithi111.stdout:3/112: dread d5/f13 [0,4194304] 0 2024-09-16T09:46:05.081 INFO:tasks.workunit.client.0.smithi111.stdout:3/113: symlink d5/d18/l20 0 2024-09-16T09:46:05.081 INFO:tasks.workunit.client.0.smithi111.stdout:5/193: sync 2024-09-16T09:46:05.081 INFO:tasks.workunit.client.0.smithi111.stdout:4/154: sync 2024-09-16T09:46:05.081 INFO:tasks.workunit.client.0.smithi111.stdout:0/122: sync 2024-09-16T09:46:05.084 INFO:tasks.workunit.client.0.smithi111.stdout:0/123: creat d0/d1d/f2d x:0 0 0 2024-09-16T09:46:05.088 INFO:tasks.workunit.client.0.smithi111.stdout:3/114: dread d5/da/db/de/f15 [0,4194304] 0 2024-09-16T09:46:05.092 INFO:tasks.workunit.client.0.smithi111.stdout:3/115: mknod d5/da/c21 0 2024-09-16T09:46:05.094 INFO:tasks.workunit.client.0.smithi111.stdout:0/124: write d0/f18 [3091775,127954] 0 2024-09-16T09:46:05.094 INFO:tasks.workunit.client.0.smithi111.stdout:0/125: chown d0/f24 21888196 1 2024-09-16T09:46:05.095 INFO:tasks.workunit.client.0.smithi111.stdout:3/116: creat d5/f22 x:0 0 0 2024-09-16T09:46:05.095 INFO:tasks.workunit.client.0.smithi111.stdout:0/126: write d0/f12 [1299205,92044] 0 2024-09-16T09:46:05.096 INFO:tasks.workunit.client.0.smithi111.stdout:0/127: symlink d0/d26/l2e 0 2024-09-16T09:46:05.104 INFO:tasks.workunit.client.0.smithi111.stdout:5/194: dwrite d19/d1b/d27/d25/f3f [0,4194304] 0 2024-09-16T09:46:05.105 INFO:tasks.workunit.client.0.smithi111.stdout:4/155: dwrite d2/d6/dd/f28 [0,4194304] 0 2024-09-16T09:46:05.107 INFO:tasks.workunit.client.0.smithi111.stdout:3/117: write d5/f8 [1619079,18782] 0 2024-09-16T09:46:05.109 INFO:tasks.workunit.client.0.smithi111.stdout:5/195: mkdir d19/d1b/d27/d2e/d4a/d4b 0 2024-09-16T09:46:05.111 INFO:tasks.workunit.client.0.smithi111.stdout:3/118: symlink d5/l23 0 2024-09-16T09:46:05.111 INFO:tasks.workunit.client.0.smithi111.stdout:3/119: write f3 [3978765,95053] 0 2024-09-16T09:46:05.112 INFO:tasks.workunit.client.0.smithi111.stdout:5/196: creat d19/d1b/d27/d2e/d4a/f4c x:0 0 0 2024-09-16T09:46:05.112 INFO:tasks.workunit.client.0.smithi111.stdout:0/128: dwrite d0/d1d/f2d [0,4194304] 0 2024-09-16T09:46:05.113 INFO:tasks.workunit.client.0.smithi111.stdout:3/120: creat d5/d18/f24 x:0 0 0 2024-09-16T09:46:05.113 INFO:tasks.workunit.client.0.smithi111.stdout:3/121: fdatasync d5/f1a 0 2024-09-16T09:46:05.113 INFO:tasks.workunit.client.0.smithi111.stdout:3/122: stat d5/da/db/de/l1e 0 2024-09-16T09:46:05.117 INFO:tasks.workunit.client.0.smithi111.stdout:0/129: truncate d0/f1c 2164534 0 2024-09-16T09:46:05.118 INFO:tasks.workunit.client.0.smithi111.stdout:3/123: write d5/f13 [4017901,16501] 0 2024-09-16T09:46:05.122 INFO:tasks.workunit.client.0.smithi111.stdout:0/130: creat d0/d1d/f2f x:0 0 0 2024-09-16T09:46:05.122 INFO:tasks.workunit.client.0.smithi111.stdout:4/156: dwrite d2/d6/dd/f12 [0,4194304] 0 2024-09-16T09:46:05.123 INFO:tasks.workunit.client.0.smithi111.stdout:3/124: rmdir d5/da/db/de/d1f 0 2024-09-16T09:46:05.125 INFO:tasks.workunit.client.0.smithi111.stdout:0/131: creat d0/d1d/f30 x:0 0 0 2024-09-16T09:46:05.126 INFO:tasks.workunit.client.0.smithi111.stdout:3/125: rmdir d5/da/db/de 39 2024-09-16T09:46:05.126 INFO:tasks.workunit.client.0.smithi111.stdout:3/126: chown f1 61 1 2024-09-16T09:46:05.128 INFO:tasks.workunit.client.0.smithi111.stdout:0/132: creat d0/f31 x:0 0 0 2024-09-16T09:46:05.128 INFO:tasks.workunit.client.0.smithi111.stdout:0/133: write d0/d1d/f30 [414775,18221] 0 2024-09-16T09:46:05.128 INFO:tasks.workunit.client.0.smithi111.stdout:3/127: mknod d5/da/db/c25 0 2024-09-16T09:46:05.133 INFO:tasks.workunit.client.0.smithi111.stdout:4/157: write d2/d6/dd/f27 [3152402,58620] 0 2024-09-16T09:46:05.135 INFO:tasks.workunit.client.0.smithi111.stdout:4/158: mkdir d2/d30 0 2024-09-16T09:46:05.136 INFO:tasks.workunit.client.0.smithi111.stdout:3/128: write d5/da/db/de/f15 [3702315,22383] 0 2024-09-16T09:46:05.137 INFO:tasks.workunit.client.0.smithi111.stdout:4/159: symlink d2/d6/l31 0 2024-09-16T09:46:05.139 INFO:tasks.workunit.client.0.smithi111.stdout:3/129: mknod d5/c26 0 2024-09-16T09:46:05.139 INFO:tasks.workunit.client.0.smithi111.stdout:3/130: write f1 [5613236,52263] 0 2024-09-16T09:46:05.140 INFO:tasks.workunit.client.0.smithi111.stdout:4/160: creat d2/f32 x:0 0 0 2024-09-16T09:46:05.141 INFO:tasks.workunit.client.0.smithi111.stdout:5/197: write f14 [814620,106712] 0 2024-09-16T09:46:05.141 INFO:tasks.workunit.client.0.smithi111.stdout:5/198: chown f15 4 1 2024-09-16T09:46:05.145 INFO:tasks.workunit.client.0.smithi111.stdout:3/131: creat d5/da/db/de/f27 x:0 0 0 2024-09-16T09:46:05.145 INFO:tasks.workunit.client.0.smithi111.stdout:3/132: chown d5/da/db/de/c17 45109 1 2024-09-16T09:46:05.145 INFO:tasks.workunit.client.0.smithi111.stdout:4/161: unlink d2/d6/dd/d1c/f2d 0 2024-09-16T09:46:05.146 INFO:tasks.workunit.client.0.smithi111.stdout:3/133: creat d5/da/db/de/f28 x:0 0 0 2024-09-16T09:46:05.147 INFO:tasks.workunit.client.0.smithi111.stdout:4/162: unlink d2/d6/dd/f12 0 2024-09-16T09:46:05.149 INFO:tasks.workunit.client.0.smithi111.stdout:0/134: dwrite d0/f22 [4194304,4194304] 0 2024-09-16T09:46:05.149 INFO:tasks.workunit.client.0.smithi111.stdout:4/163: mknod d2/d6/dd/d1b/c33 0 2024-09-16T09:46:05.153 INFO:tasks.workunit.client.0.smithi111.stdout:0/135: creat d0/f32 x:0 0 0 2024-09-16T09:46:05.155 INFO:tasks.workunit.client.0.smithi111.stdout:5/199: write d19/f1d [3891976,27382] 0 2024-09-16T09:46:05.157 INFO:tasks.workunit.client.0.smithi111.stdout:0/136: rename d0/c16 to d0/d26/c33 0 2024-09-16T09:46:05.157 INFO:tasks.workunit.client.0.smithi111.stdout:0/137: chown d0/d1d/c20 23 1 2024-09-16T09:46:05.160 INFO:tasks.workunit.client.0.smithi111.stdout:4/164: dread d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:05.161 INFO:tasks.workunit.client.0.smithi111.stdout:0/138: mknod d0/c34 0 2024-09-16T09:46:05.164 INFO:tasks.workunit.client.0.smithi111.stdout:4/165: dread d2/d6/dd/f2a [0,4194304] 0 2024-09-16T09:46:05.164 INFO:tasks.workunit.client.0.smithi111.stdout:0/139: mkdir d0/d26/d35 0 2024-09-16T09:46:05.165 INFO:tasks.workunit.client.0.smithi111.stdout:3/134: dwrite d5/d18/f24 [0,4194304] 0 2024-09-16T09:46:05.165 INFO:tasks.workunit.client.0.smithi111.stdout:3/135: write d5/f8 [241997,53463] 0 2024-09-16T09:46:05.165 INFO:tasks.workunit.client.0.smithi111.stdout:3/136: truncate f1 6140971 0 2024-09-16T09:46:05.165 INFO:tasks.workunit.client.0.smithi111.stdout:3/137: truncate d5/f8 4323362 0 2024-09-16T09:46:05.167 INFO:tasks.workunit.client.0.smithi111.stdout:0/140: fsync d0/f12 0 2024-09-16T09:46:05.169 INFO:tasks.workunit.client.0.smithi111.stdout:5/200: dread d19/d1b/d27/d25/f26 [0,4194304] 0 2024-09-16T09:46:05.171 INFO:tasks.workunit.client.0.smithi111.stdout:3/138: creat d5/d18/f29 x:0 0 0 2024-09-16T09:46:05.176 INFO:tasks.workunit.client.0.smithi111.stdout:4/166: dread d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:05.177 INFO:tasks.workunit.client.0.smithi111.stdout:4/167: write d2/d6/dd/d1b/f2b [621024,21356] 0 2024-09-16T09:46:05.177 INFO:tasks.workunit.client.0.smithi111.stdout:4/168: stat d2/d6/dd/d1c 0 2024-09-16T09:46:05.178 INFO:tasks.workunit.client.0.smithi111.stdout:5/201: rename d19/d1b/d27/f3e to d19/d1b/f4d 0 2024-09-16T09:46:05.180 INFO:tasks.workunit.client.0.smithi111.stdout:3/139: creat d5/d18/f2a x:0 0 0 2024-09-16T09:46:05.180 INFO:tasks.workunit.client.0.smithi111.stdout:3/140: write d5/d18/f29 [556487,39516] 0 2024-09-16T09:46:05.180 INFO:tasks.workunit.client.0.smithi111.stdout:3/141: truncate d5/d18/f2a 655926 0 2024-09-16T09:46:05.181 INFO:tasks.workunit.client.0.smithi111.stdout:3/142: chown d5/da/db/de/l10 1726390 1 2024-09-16T09:46:05.181 INFO:tasks.workunit.client.0.smithi111.stdout:3/143: chown d5/f13 145 1 2024-09-16T09:46:05.181 INFO:tasks.workunit.client.0.smithi111.stdout:3/144: dread - d5/f22 zero size 2024-09-16T09:46:05.181 INFO:tasks.workunit.client.0.smithi111.stdout:3/145: write d5/f13 [4283909,28236] 0 2024-09-16T09:46:05.181 INFO:tasks.workunit.client.0.smithi111.stdout:3/146: stat d5/d18/f29 0 2024-09-16T09:46:05.181 INFO:tasks.workunit.client.0.smithi111.stdout:3/147: chown d5/da/db/de/f15 6548739 1 2024-09-16T09:46:05.189 INFO:tasks.workunit.client.0.smithi111.stdout:4/169: truncate d2/d6/f14 505782 0 2024-09-16T09:46:05.199 INFO:tasks.workunit.client.0.smithi111.stdout:5/202: rename f18 to d19/d1b/d27/d2e/d39/f4e 0 2024-09-16T09:46:05.199 INFO:tasks.workunit.client.0.smithi111.stdout:5/203: write d19/d1b/d27/d25/f26 [4867932,20988] 0 2024-09-16T09:46:05.200 INFO:tasks.workunit.client.0.smithi111.stdout:0/141: read d0/f17 [1361980,93173] 0 2024-09-16T09:46:05.201 INFO:tasks.workunit.client.0.smithi111.stdout:3/148: rename d5/da/db/c25 to d5/da/db/de/c2b 0 2024-09-16T09:46:05.201 INFO:tasks.workunit.client.0.smithi111.stdout:3/149: fsync d5/da/db/f14 0 2024-09-16T09:46:05.201 INFO:tasks.workunit.client.0.smithi111.stdout:3/150: write d5/da/f11 [262740,130260] 0 2024-09-16T09:46:05.203 INFO:tasks.workunit.client.0.smithi111.stdout:5/204: symlink d19/d1b/d1e/d41/l4f 0 2024-09-16T09:46:05.204 INFO:tasks.workunit.client.0.smithi111.stdout:0/142: truncate d0/f24 2852452 0 2024-09-16T09:46:05.204 INFO:tasks.workunit.client.0.smithi111.stdout:0/143: truncate d0/f32 380373 0 2024-09-16T09:46:05.207 INFO:tasks.workunit.client.0.smithi111.stdout:3/151: rmdir d5/da/db/de 39 2024-09-16T09:46:05.207 INFO:tasks.workunit.client.0.smithi111.stdout:3/152: read - d5/f1a zero size 2024-09-16T09:46:05.207 INFO:tasks.workunit.client.0.smithi111.stdout:3/153: stat d5/f1a 0 2024-09-16T09:46:05.208 INFO:tasks.workunit.client.0.smithi111.stdout:5/205: rename d19/d1b/d27/d25/d2a/f49 to d19/d1b/d1e/f50 0 2024-09-16T09:46:05.209 INFO:tasks.workunit.client.0.smithi111.stdout:0/144: rmdir d0 39 2024-09-16T09:46:05.210 INFO:tasks.workunit.client.0.smithi111.stdout:3/154: symlink d5/l2c 0 2024-09-16T09:46:05.213 INFO:tasks.workunit.client.0.smithi111.stdout:5/206: rmdir d19/d1b/d27 39 2024-09-16T09:46:05.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/145: dread d0/f15 [0,4194304] 0 2024-09-16T09:46:05.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/146: readlink d0/d26/l2e 0 2024-09-16T09:46:05.216 INFO:tasks.workunit.client.0.smithi111.stdout:0/147: chown d0/d1d/l21 12850183 1 2024-09-16T09:46:05.216 INFO:tasks.workunit.client.0.smithi111.stdout:3/155: creat d5/da/db/f2d x:0 0 0 2024-09-16T09:46:05.219 INFO:tasks.workunit.client.0.smithi111.stdout:4/170: dwrite d2/d6/f14 [0,4194304] 0 2024-09-16T09:46:05.220 INFO:tasks.workunit.client.0.smithi111.stdout:5/207: creat d19/d1b/d1e/d21/d29/d32/f51 x:0 0 0 2024-09-16T09:46:05.222 INFO:tasks.workunit.client.0.smithi111.stdout:0/148: mkdir d0/d26/d36 0 2024-09-16T09:46:05.224 INFO:tasks.workunit.client.0.smithi111.stdout:3/156: rmdir d5 39 2024-09-16T09:46:05.225 INFO:tasks.workunit.client.0.smithi111.stdout:3/157: fsync d5/f8 0 2024-09-16T09:46:05.228 INFO:tasks.workunit.client.0.smithi111.stdout:0/149: symlink d0/d26/d36/l37 0 2024-09-16T09:46:05.229 INFO:tasks.workunit.client.0.smithi111.stdout:3/158: creat d5/d18/f2e x:0 0 0 2024-09-16T09:46:05.229 INFO:tasks.workunit.client.0.smithi111.stdout:0/150: chown d0/l5 334 1 2024-09-16T09:46:05.230 INFO:tasks.workunit.client.0.smithi111.stdout:5/208: read fc [7119318,99390] 0 2024-09-16T09:46:05.230 INFO:tasks.workunit.client.0.smithi111.stdout:3/159: symlink d5/l2f 0 2024-09-16T09:46:05.232 INFO:tasks.workunit.client.0.smithi111.stdout:0/151: creat d0/f38 x:0 0 0 2024-09-16T09:46:05.233 INFO:tasks.workunit.client.0.smithi111.stdout:5/209: rename f14 to d19/d1b/d27/d2e/f52 0 2024-09-16T09:46:05.235 INFO:tasks.workunit.client.0.smithi111.stdout:4/171: dwrite d2/f1f [0,4194304] 0 2024-09-16T09:46:05.235 INFO:tasks.workunit.client.0.smithi111.stdout:4/172: write d2/f17 [1831036,41356] 0 2024-09-16T09:46:05.236 INFO:tasks.workunit.client.0.smithi111.stdout:3/160: rename d5/da/db/de/l10 to d5/da/db/l30 0 2024-09-16T09:46:05.237 INFO:tasks.workunit.client.0.smithi111.stdout:5/210: creat d19/d1b/d27/d2e/f53 x:0 0 0 2024-09-16T09:46:05.237 INFO:tasks.workunit.client.0.smithi111.stdout:5/211: write f7 [5698507,19269] 0 2024-09-16T09:46:05.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/173: dread d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:05.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/174: chown d2/f17 2 1 2024-09-16T09:46:05.242 INFO:tasks.workunit.client.0.smithi111.stdout:0/152: dread d0/fd [0,4194304] 0 2024-09-16T09:46:05.245 INFO:tasks.workunit.client.0.smithi111.stdout:3/161: mknod d5/da/db/c31 0 2024-09-16T09:46:05.247 INFO:tasks.workunit.client.0.smithi111.stdout:5/212: mkdir d19/d1b/d27/d2e/d39/d54 0 2024-09-16T09:46:05.248 INFO:tasks.workunit.client.0.smithi111.stdout:4/175: mknod d2/c34 0 2024-09-16T09:46:05.248 INFO:tasks.workunit.client.0.smithi111.stdout:4/176: chown d2/d6/dd/d1c/f2c 534 1 2024-09-16T09:46:05.251 INFO:tasks.workunit.client.0.smithi111.stdout:3/162: mknod d5/da/db/c32 0 2024-09-16T09:46:05.251 INFO:tasks.workunit.client.0.smithi111.stdout:3/163: write d5/da/db/de/f27 [871910,81837] 0 2024-09-16T09:46:05.251 INFO:tasks.workunit.client.0.smithi111.stdout:3/164: read - d5/d18/f2e zero size 2024-09-16T09:46:05.251 INFO:tasks.workunit.client.0.smithi111.stdout:3/165: truncate d5/d18/f2e 37359 0 2024-09-16T09:46:05.252 INFO:tasks.workunit.client.0.smithi111.stdout:5/213: rename d19/d1b/f1c to d19/d1b/d1e/f55 0 2024-09-16T09:46:05.252 INFO:tasks.workunit.client.0.smithi111.stdout:5/214: write fc [7847355,33766] 0 2024-09-16T09:46:05.252 INFO:tasks.workunit.client.0.smithi111.stdout:5/215: fdatasync d19/d1b/d27/f3b 0 2024-09-16T09:46:05.255 INFO:tasks.workunit.client.0.smithi111.stdout:4/177: mknod d2/d30/c35 0 2024-09-16T09:46:05.256 INFO:tasks.workunit.client.0.smithi111.stdout:3/166: truncate f1 2148164 0 2024-09-16T09:46:05.256 INFO:tasks.workunit.client.0.smithi111.stdout:3/167: truncate d5/d18/f2a 981902 0 2024-09-16T09:46:05.261 INFO:tasks.workunit.client.0.smithi111.stdout:4/178: truncate d2/d6/dd/f2a 1046093 0 2024-09-16T09:46:05.261 INFO:tasks.workunit.client.0.smithi111.stdout:4/179: chown d2/d6 12085 1 2024-09-16T09:46:05.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/168: rename d5/da/db/l30 to d5/l33 0 2024-09-16T09:46:05.266 INFO:tasks.workunit.client.0.smithi111.stdout:3/169: mknod d5/da/db/c34 0 2024-09-16T09:46:05.266 INFO:tasks.workunit.client.0.smithi111.stdout:3/170: chown f1 54285 1 2024-09-16T09:46:05.266 INFO:tasks.workunit.client.0.smithi111.stdout:5/216: read f10 [4590465,18508] 0 2024-09-16T09:46:05.268 INFO:tasks.workunit.client.0.smithi111.stdout:3/171: mkdir d5/da/db/d35 0 2024-09-16T09:46:05.272 INFO:tasks.workunit.client.0.smithi111.stdout:0/153: dwrite d0/f12 [0,4194304] 0 2024-09-16T09:46:05.275 INFO:tasks.workunit.client.0.smithi111.stdout:0/154: mknod d0/d26/c39 0 2024-09-16T09:46:05.277 INFO:tasks.workunit.client.0.smithi111.stdout:5/217: write f15 [2019392,127109] 0 2024-09-16T09:46:05.278 INFO:tasks.workunit.client.0.smithi111.stdout:0/155: dread d0/f17 [0,4194304] 0 2024-09-16T09:46:05.278 INFO:tasks.workunit.client.0.smithi111.stdout:0/156: write d0/f24 [360777,73181] 0 2024-09-16T09:46:05.282 INFO:tasks.workunit.client.0.smithi111.stdout:0/157: mkdir d0/d26/d36/d3a 0 2024-09-16T09:46:05.282 INFO:tasks.workunit.client.0.smithi111.stdout:0/158: fsync d0/f22 0 2024-09-16T09:46:05.282 INFO:tasks.workunit.client.0.smithi111.stdout:0/159: dread - d0/d1d/f29 zero size 2024-09-16T09:46:05.282 INFO:tasks.workunit.client.0.smithi111.stdout:0/160: readlink d0/l5 0 2024-09-16T09:46:05.285 INFO:tasks.workunit.client.0.smithi111.stdout:0/161: mknod d0/c3b 0 2024-09-16T09:46:05.285 INFO:tasks.workunit.client.0.smithi111.stdout:4/180: dwrite d2/d6/dd/f27 [0,4194304] 0 2024-09-16T09:46:05.288 INFO:tasks.workunit.client.0.smithi111.stdout:4/181: creat d2/d6/dd/d1c/d2f/f36 x:0 0 0 2024-09-16T09:46:05.290 INFO:tasks.workunit.client.0.smithi111.stdout:4/182: rename d2/d6/dd/d1b/c33 to d2/d30/c37 0 2024-09-16T09:46:05.290 INFO:tasks.workunit.client.0.smithi111.stdout:4/183: readlink d2/d6/l15 0 2024-09-16T09:46:05.296 INFO:tasks.workunit.client.0.smithi111.stdout:0/162: getdents d0/d26 0 2024-09-16T09:46:05.297 INFO:tasks.workunit.client.0.smithi111.stdout:5/218: dwrite d19/d1b/d1e/f40 [0,4194304] 0 2024-09-16T09:46:05.297 INFO:tasks.workunit.client.0.smithi111.stdout:5/219: write d19/f1d [330007,57692] 0 2024-09-16T09:46:05.297 INFO:tasks.workunit.client.0.smithi111.stdout:5/220: read d19/d1b/d27/f37 [806814,78301] 0 2024-09-16T09:46:05.298 INFO:tasks.workunit.client.0.smithi111.stdout:5/221: write f15 [3782052,127623] 0 2024-09-16T09:46:05.298 INFO:tasks.workunit.client.0.smithi111.stdout:0/163: link d0/f17 d0/d1d/f3c 0 2024-09-16T09:46:05.298 INFO:tasks.workunit.client.0.smithi111.stdout:0/164: chown d0/d1d/l21 178 1 2024-09-16T09:46:05.298 INFO:tasks.workunit.client.0.smithi111.stdout:0/165: write d0/d1d/f2f [567507,64729] 0 2024-09-16T09:46:05.298 INFO:tasks.workunit.client.0.smithi111.stdout:0/166: fsync d0/f15 0 2024-09-16T09:46:05.300 INFO:tasks.workunit.client.0.smithi111.stdout:5/222: creat d19/d1b/d1e/d21/d29/f56 x:0 0 0 2024-09-16T09:46:05.302 INFO:tasks.workunit.client.0.smithi111.stdout:0/167: mkdir d0/d26/d36/d3a/d3d 0 2024-09-16T09:46:05.303 INFO:tasks.workunit.client.0.smithi111.stdout:5/223: mknod d19/d1b/d27/d2e/d39/d54/c57 0 2024-09-16T09:46:05.304 INFO:tasks.workunit.client.0.smithi111.stdout:5/224: mknod d19/d1b/d27/d2e/d4a/c58 0 2024-09-16T09:46:05.305 INFO:tasks.workunit.client.0.smithi111.stdout:5/225: rmdir d19 39 2024-09-16T09:46:05.306 INFO:tasks.workunit.client.0.smithi111.stdout:4/184: dwrite d2/d6/dd/d1c/d2f/f36 [0,4194304] 0 2024-09-16T09:46:05.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/226: creat d19/d1b/d1e/f59 x:0 0 0 2024-09-16T09:46:05.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/227: write d19/d1b/d1e/f59 [141209,69763] 0 2024-09-16T09:46:05.312 INFO:tasks.workunit.client.0.smithi111.stdout:5/228: mknod d19/d1b/d1e/d21/d29/d32/d46/c5a 0 2024-09-16T09:46:05.312 INFO:tasks.workunit.client.0.smithi111.stdout:5/229: dread - d19/d1b/d27/d2e/f42 zero size 2024-09-16T09:46:05.321 INFO:tasks.workunit.client.0.smithi111.stdout:4/185: dread d2/fb [0,4194304] 0 2024-09-16T09:46:05.326 INFO:tasks.workunit.client.0.smithi111.stdout:1/102: sync 2024-09-16T09:46:05.326 INFO:tasks.workunit.client.0.smithi111.stdout:6/74: sync 2024-09-16T09:46:05.326 INFO:tasks.workunit.client.0.smithi111.stdout:6/75: read d0/f2 [8254862,19547] 0 2024-09-16T09:46:05.328 INFO:tasks.workunit.client.0.smithi111.stdout:6/76: unlink d0/df/d14/l16 0 2024-09-16T09:46:05.334 INFO:tasks.workunit.client.0.smithi111.stdout:5/230: dwrite d19/d1b/d27/f3b [0,4194304] 0 2024-09-16T09:46:05.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/231: creat d19/d1b/d1e/d21/d29/d32/d46/f5b x:0 0 0 2024-09-16T09:46:05.340 INFO:tasks.workunit.client.0.smithi111.stdout:5/232: symlink d19/d1b/d27/d2e/d39/d54/l5c 0 2024-09-16T09:46:05.342 INFO:tasks.workunit.client.0.smithi111.stdout:5/233: mknod d19/d1b/d27/c5d 0 2024-09-16T09:46:05.342 INFO:tasks.workunit.client.0.smithi111.stdout:5/234: fdatasync fc 0 2024-09-16T09:46:05.342 INFO:tasks.workunit.client.0.smithi111.stdout:5/235: stat d19/d1b/d1e/d21/d29/d32/d46 0 2024-09-16T09:46:05.345 INFO:tasks.workunit.client.0.smithi111.stdout:5/236: write f7 [899200,55093] 0 2024-09-16T09:46:05.345 INFO:tasks.workunit.client.0.smithi111.stdout:5/237: creat d19/d1b/d1e/d21/f5e x:0 0 0 2024-09-16T09:46:05.346 INFO:tasks.workunit.client.0.smithi111.stdout:4/186: dwrite d2/f32 [0,4194304] 0 2024-09-16T09:46:05.349 INFO:tasks.workunit.client.0.smithi111.stdout:4/187: mkdir d2/d6/dd/d1b/d38 0 2024-09-16T09:46:05.349 INFO:tasks.workunit.client.0.smithi111.stdout:4/188: fsync d2/d6/f20 0 2024-09-16T09:46:05.357 INFO:tasks.workunit.client.0.smithi111.stdout:1/103: dwrite d3/f9 [0,4194304] 0 2024-09-16T09:46:05.359 INFO:tasks.workunit.client.0.smithi111.stdout:6/77: dwrite d0/fd [0,4194304] 0 2024-09-16T09:46:05.360 INFO:tasks.workunit.client.0.smithi111.stdout:1/104: mknod d3/dd/c2c 0 2024-09-16T09:46:05.360 INFO:tasks.workunit.client.0.smithi111.stdout:1/105: chown d3/d10/d23 11 1 2024-09-16T09:46:05.362 INFO:tasks.workunit.client.0.smithi111.stdout:5/238: dread d19/d1b/d27/d25/f3f [0,4194304] 0 2024-09-16T09:46:05.364 INFO:tasks.workunit.client.0.smithi111.stdout:6/78: link d0/f1 d0/f19 0 2024-09-16T09:46:05.364 INFO:tasks.workunit.client.0.smithi111.stdout:4/189: dwrite d2/f17 [0,4194304] 0 2024-09-16T09:46:05.365 INFO:tasks.workunit.client.0.smithi111.stdout:6/79: dread d0/f1 [0,4194304] 0 2024-09-16T09:46:05.365 INFO:tasks.workunit.client.0.smithi111.stdout:5/239: creat d19/d1b/d27/d2e/d4a/d4b/f5f x:0 0 0 2024-09-16T09:46:05.365 INFO:tasks.workunit.client.0.smithi111.stdout:5/240: read fc [2552318,48143] 0 2024-09-16T09:46:05.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/190: mknod d2/d6/dd/d1b/d38/c39 0 2024-09-16T09:46:05.370 INFO:tasks.workunit.client.0.smithi111.stdout:6/80: rename d0/f6 to d0/f1a 0 2024-09-16T09:46:05.371 INFO:tasks.workunit.client.0.smithi111.stdout:5/241: mkdir d19/d1b/d27/d2e/d39/d54/d60 0 2024-09-16T09:46:05.374 INFO:tasks.workunit.client.0.smithi111.stdout:6/81: creat d0/df/d14/f1b x:0 0 0 2024-09-16T09:46:05.374 INFO:tasks.workunit.client.0.smithi111.stdout:6/82: chown d0/df/c11 1216 1 2024-09-16T09:46:05.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/242: rename d19/d1b/d27/f24 to d19/d1b/d1e/d21/d29/d32/f61 0 2024-09-16T09:46:05.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/243: write f10 [7252052,42122] 0 2024-09-16T09:46:05.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/244: dread - d19/d1b/d27/d2e/f42 zero size 2024-09-16T09:46:05.377 INFO:tasks.workunit.client.0.smithi111.stdout:5/245: readlink d19/d1b/d1e/d21/d29/l2f 0 2024-09-16T09:46:05.378 INFO:tasks.workunit.client.0.smithi111.stdout:5/246: write d19/d1b/d27/d2e/d4a/f4c [908540,117758] 0 2024-09-16T09:46:05.378 INFO:tasks.workunit.client.0.smithi111.stdout:1/106: dwrite d3/f27 [0,4194304] 0 2024-09-16T09:46:05.379 INFO:tasks.workunit.client.0.smithi111.stdout:6/83: mknod d0/df/d14/c1c 0 2024-09-16T09:46:05.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/247: rename d19/f1d to d19/d1b/d27/d2e/d39/f62 0 2024-09-16T09:46:05.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:05 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:05.384 INFO:tasks.workunit.client.0.smithi111.stdout:4/191: truncate d2/f17 2469729 0 2024-09-16T09:46:05.386 INFO:tasks.workunit.client.0.smithi111.stdout:5/248: dread fc [4194304,4194304] 0 2024-09-16T09:46:05.387 INFO:tasks.workunit.client.0.smithi111.stdout:1/107: creat d3/d26/f2d x:0 0 0 2024-09-16T09:46:05.387 INFO:tasks.workunit.client.0.smithi111.stdout:1/108: truncate d3/d10/d23/f2b 323347 0 2024-09-16T09:46:05.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/84: truncate d0/f1 55886 0 2024-09-16T09:46:05.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/85: truncate d0/df/d14/f1b 638656 0 2024-09-16T09:46:05.391 INFO:tasks.workunit.client.0.smithi111.stdout:5/249: link d19/d1b/d27/d25/f26 d19/d1b/d27/d25/f63 0 2024-09-16T09:46:05.395 INFO:tasks.workunit.client.0.smithi111.stdout:6/86: getdents d0/df/d14 0 2024-09-16T09:46:05.396 INFO:tasks.workunit.client.0.smithi111.stdout:5/250: creat d19/d1b/d27/d2e/d39/d54/d60/f64 x:0 0 0 2024-09-16T09:46:05.397 INFO:tasks.workunit.client.0.smithi111.stdout:5/251: chown d19/d1b/f4d 17695737 1 2024-09-16T09:46:05.397 INFO:tasks.workunit.client.0.smithi111.stdout:5/252: fsync d19/f48 0 2024-09-16T09:46:05.398 INFO:tasks.workunit.client.0.smithi111.stdout:5/253: read d19/d1b/d1e/f55 [897235,72678] 0 2024-09-16T09:46:05.401 INFO:tasks.workunit.client.0.smithi111.stdout:6/87: symlink d0/l1d 0 2024-09-16T09:46:05.403 INFO:tasks.workunit.client.0.smithi111.stdout:5/254: rename d19/l1a to d19/d1b/d27/d25/d2a/l65 0 2024-09-16T09:46:05.407 INFO:tasks.workunit.client.0.smithi111.stdout:6/88: creat d0/df/f1e x:0 0 0 2024-09-16T09:46:05.409 INFO:tasks.workunit.client.0.smithi111.stdout:5/255: unlink d19/d1b/d1e/d21/l2d 0 2024-09-16T09:46:05.411 INFO:tasks.workunit.client.0.smithi111.stdout:1/109: dwrite d3/dd/f17 [0,4194304] 0 2024-09-16T09:46:05.411 INFO:tasks.workunit.client.0.smithi111.stdout:1/110: readlink d3/d10/l16 0 2024-09-16T09:46:05.412 INFO:tasks.workunit.client.0.smithi111.stdout:4/192: dwrite d2/d6/dd/f2a [0,4194304] 0 2024-09-16T09:46:05.412 INFO:tasks.workunit.client.0.smithi111.stdout:6/89: dread d0/f2 [0,4194304] 0 2024-09-16T09:46:05.413 INFO:tasks.workunit.client.0.smithi111.stdout:4/193: dread - d2/d6/dd/d1c/f2c zero size 2024-09-16T09:46:05.422 INFO:tasks.workunit.client.0.smithi111.stdout:5/256: creat d19/d1b/d27/d25/f66 x:0 0 0 2024-09-16T09:46:05.422 INFO:tasks.workunit.client.0.smithi111.stdout:5/257: truncate d19/d1b/d27/d25/f2b 4497935 0 2024-09-16T09:46:05.428 INFO:tasks.workunit.client.0.smithi111.stdout:1/111: creat d3/dd/f2e x:0 0 0 2024-09-16T09:46:05.428 INFO:tasks.workunit.client.0.smithi111.stdout:1/112: readlink d3/d10/l22 0 2024-09-16T09:46:05.428 INFO:tasks.workunit.client.0.smithi111.stdout:1/113: fdatasync d3/dd/fe 0 2024-09-16T09:46:05.436 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:05 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:05.442 INFO:tasks.workunit.client.0.smithi111.stdout:6/90: rename d0/f2 to d0/df/d14/f1f 0 2024-09-16T09:46:05.442 INFO:tasks.workunit.client.0.smithi111.stdout:6/91: truncate d0/f13 812734 0 2024-09-16T09:46:05.443 INFO:tasks.workunit.client.0.smithi111.stdout:1/114: dwrite d3/f9 [0,4194304] 0 2024-09-16T09:46:05.445 INFO:tasks.workunit.client.0.smithi111.stdout:4/194: rename d2/c4 to d2/d6/dd/c3a 0 2024-09-16T09:46:05.446 INFO:tasks.workunit.client.0.smithi111.stdout:4/195: fsync d2/fb 0 2024-09-16T09:46:05.446 INFO:tasks.workunit.client.0.smithi111.stdout:4/196: fsync d2/d6/dd/f28 0 2024-09-16T09:46:05.446 INFO:tasks.workunit.client.0.smithi111.stdout:4/197: fdatasync d2/f17 0 2024-09-16T09:46:05.446 INFO:tasks.workunit.client.0.smithi111.stdout:4/198: fdatasync d2/f17 0 2024-09-16T09:46:05.446 INFO:tasks.workunit.client.0.smithi111.stdout:6/92: truncate d0/df/d14/f1f 12515090 0 2024-09-16T09:46:05.449 INFO:tasks.workunit.client.0.smithi111.stdout:1/115: mknod d3/d10/d23/c2f 0 2024-09-16T09:46:05.451 INFO:tasks.workunit.client.0.smithi111.stdout:5/258: rename d19/d1b/d27/d2e/d4a/c58 to d19/d1b/d1e/d41/c67 0 2024-09-16T09:46:05.453 INFO:tasks.workunit.client.0.smithi111.stdout:4/199: mkdir d2/d6/dd/d1b/d38/d3b 0 2024-09-16T09:46:05.453 INFO:tasks.workunit.client.0.smithi111.stdout:4/200: fdatasync d2/d6/f14 0 2024-09-16T09:46:05.455 INFO:tasks.workunit.client.0.smithi111.stdout:5/259: creat d19/d1b/d27/d2e/f68 x:0 0 0 2024-09-16T09:46:05.458 INFO:tasks.workunit.client.0.smithi111.stdout:5/260: creat d19/d1b/d27/d25/d2a/f69 x:0 0 0 2024-09-16T09:46:05.461 INFO:tasks.workunit.client.0.smithi111.stdout:5/261: mknod d19/d1b/c6a 0 2024-09-16T09:46:05.464 INFO:tasks.workunit.client.0.smithi111.stdout:5/262: creat d19/f6b x:0 0 0 2024-09-16T09:46:05.464 INFO:tasks.workunit.client.0.smithi111.stdout:5/263: truncate d19/d1b/d27/d25/f36 998659 0 2024-09-16T09:46:05.466 INFO:tasks.workunit.client.0.smithi111.stdout:5/264: mkdir d19/d1b/d27/d2e/d39/d6c 0 2024-09-16T09:46:05.466 INFO:tasks.workunit.client.0.smithi111.stdout:5/265: write d19/d1b/d27/d2e/f42 [111442,68036] 0 2024-09-16T09:46:05.471 INFO:tasks.workunit.client.0.smithi111.stdout:5/266: dread d19/d1b/d27/d25/f3f [0,4194304] 0 2024-09-16T09:46:05.511 INFO:tasks.workunit.client.0.smithi111.stdout:2/218: sync 2024-09-16T09:46:05.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/267: rename ff to d19/d1b/d27/d2e/f6d 0 2024-09-16T09:46:05.516 INFO:tasks.workunit.client.0.smithi111.stdout:5/268: fsync d19/d1b/d1e/d21/d29/d32/d46/f5b 0 2024-09-16T09:46:05.517 INFO:tasks.workunit.client.0.smithi111.stdout:2/219: creat d0/da/f48 x:0 0 0 2024-09-16T09:46:05.517 INFO:tasks.workunit.client.0.smithi111.stdout:4/201: getdents d2 0 2024-09-16T09:46:05.522 INFO:tasks.workunit.client.0.smithi111.stdout:4/202: dread d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:05.522 INFO:tasks.workunit.client.0.smithi111.stdout:4/203: chown d2/d30/c35 1 1 2024-09-16T09:46:05.533 INFO:tasks.workunit.client.0.smithi111.stdout:2/220: dwrite d0/d22/f24 [0,4194304] 0 2024-09-16T09:46:05.534 INFO:tasks.workunit.client.0.smithi111.stdout:2/221: truncate d0/d22/f23 429162 0 2024-09-16T09:46:05.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/222: dread d0/f7 [0,4194304] 0 2024-09-16T09:46:05.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/223: write d0/d22/f40 [319621,126281] 0 2024-09-16T09:46:05.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/224: chown d0/d2 0 1 2024-09-16T09:46:05.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/225: stat d0/d21/f46 0 2024-09-16T09:46:05.538 INFO:tasks.workunit.client.0.smithi111.stdout:2/226: fsync d0/d2/f39 0 2024-09-16T09:46:05.606 INFO:tasks.workunit.client.0.smithi111.stdout:5/269: symlink d19/d1b/d1e/d21/d29/d32/d46/l6e 0 2024-09-16T09:46:05.607 INFO:tasks.workunit.client.0.smithi111.stdout:4/204: creat d2/d6/f3c x:0 0 0 2024-09-16T09:46:05.608 INFO:tasks.workunit.client.0.smithi111.stdout:2/227: symlink d0/l49 0 2024-09-16T09:46:05.611 INFO:tasks.workunit.client.0.smithi111.stdout:6/93: read d0/f17 [1939070,87878] 0 2024-09-16T09:46:05.617 INFO:tasks.workunit.client.0.smithi111.stdout:5/270: creat d19/d1b/d1e/d41/f6f x:0 0 0 2024-09-16T09:46:05.619 INFO:tasks.workunit.client.0.smithi111.stdout:4/205: mknod d2/d6/dd/d1b/d38/c3d 0 2024-09-16T09:46:05.620 INFO:tasks.workunit.client.0.smithi111.stdout:6/94: mkdir d0/df/d14/d20 0 2024-09-16T09:46:05.620 INFO:tasks.workunit.client.0.smithi111.stdout:6/95: chown d0/df/d14/d20 3 1 2024-09-16T09:46:05.622 INFO:tasks.workunit.client.0.smithi111.stdout:5/271: unlink d19/d1b/d27/c5d 0 2024-09-16T09:46:05.623 INFO:tasks.workunit.client.0.smithi111.stdout:4/206: symlink d2/d6/dd/d1b/l3e 0 2024-09-16T09:46:05.625 INFO:tasks.workunit.client.0.smithi111.stdout:2/228: dwrite d0/da/f3f [0,4194304] 0 2024-09-16T09:46:05.625 INFO:tasks.workunit.client.0.smithi111.stdout:2/229: write d0/d2/f14 [347096,16035] 0 2024-09-16T09:46:05.626 INFO:tasks.workunit.client.0.smithi111.stdout:6/96: rename d0/f3 to d0/df/d14/f21 0 2024-09-16T09:46:05.628 INFO:tasks.workunit.client.0.smithi111.stdout:5/272: rename d19/d1b/d1e/d41/c67 to d19/d1b/c70 0 2024-09-16T09:46:05.630 INFO:tasks.workunit.client.0.smithi111.stdout:6/97: mknod d0/df/c22 0 2024-09-16T09:46:05.632 INFO:tasks.workunit.client.0.smithi111.stdout:2/230: dread d0/f16 [0,4194304] 0 2024-09-16T09:46:05.632 INFO:tasks.workunit.client.0.smithi111.stdout:2/231: chown d0/da/f3a 23840841 1 2024-09-16T09:46:05.634 INFO:tasks.workunit.client.0.smithi111.stdout:5/273: dread d19/d1b/d27/d25/f63 [0,4194304] 0 2024-09-16T09:46:05.635 INFO:tasks.workunit.client.0.smithi111.stdout:5/274: fsync d19/d1b/d27/d2e/d39/f4e 0 2024-09-16T09:46:05.635 INFO:tasks.workunit.client.0.smithi111.stdout:5/275: truncate fe 1707361 0 2024-09-16T09:46:05.636 INFO:tasks.workunit.client.0.smithi111.stdout:4/207: dread d2/f8 [0,4194304] 0 2024-09-16T09:46:05.637 INFO:tasks.workunit.client.0.smithi111.stdout:4/208: dread - d2/d6/f3c zero size 2024-09-16T09:46:05.638 INFO:tasks.workunit.client.0.smithi111.stdout:5/276: dread d19/d1b/d1e/d21/d29/d32/f61 [0,4194304] 0 2024-09-16T09:46:05.638 INFO:tasks.workunit.client.0.smithi111.stdout:5/277: truncate d19/d1b/d27/f3d 1898936 0 2024-09-16T09:46:05.640 INFO:tasks.workunit.client.0.smithi111.stdout:5/278: creat d19/d1b/d27/d25/d2a/f71 x:0 0 0 2024-09-16T09:46:05.644 INFO:tasks.workunit.client.0.smithi111.stdout:5/279: truncate d19/d1b/d27/d25/f26 5226143 0 2024-09-16T09:46:05.647 INFO:tasks.workunit.client.0.smithi111.stdout:5/280: mknod d19/d1b/d27/d2e/d39/d54/d60/c72 0 2024-09-16T09:46:05.657 INFO:tasks.workunit.client.0.smithi111.stdout:6/98: dwrite d0/fc [0,4194304] 0 2024-09-16T09:46:05.662 INFO:tasks.workunit.client.0.smithi111.stdout:6/99: mkdir d0/df/d14/d20/d23 0 2024-09-16T09:46:05.665 INFO:tasks.workunit.client.0.smithi111.stdout:6/100: symlink d0/df/d14/d20/l24 0 2024-09-16T09:46:05.665 INFO:tasks.workunit.client.0.smithi111.stdout:6/101: chown d0/fd 31920 1 2024-09-16T09:46:05.671 INFO:tasks.workunit.client.0.smithi111.stdout:5/281: truncate d19/d1b/d27/d2e/f42 142025 0 2024-09-16T09:46:05.673 INFO:tasks.workunit.client.0.smithi111.stdout:5/282: mknod d19/d1b/d1e/d21/d29/c73 0 2024-09-16T09:46:05.673 INFO:tasks.workunit.client.0.smithi111.stdout:5/283: write d19/d1b/d1e/d21/d29/d32/d46/f5b [697413,88963] 0 2024-09-16T09:46:05.683 INFO:tasks.workunit.client.0.smithi111.stdout:4/209: dwrite d2/d6/dd/f27 [0,4194304] 0 2024-09-16T09:46:05.684 INFO:tasks.workunit.client.0.smithi111.stdout:2/232: dwrite d0/da/f48 [0,4194304] 0 2024-09-16T09:46:05.686 INFO:tasks.workunit.client.0.smithi111.stdout:2/233: symlink d0/d45/l4a 0 2024-09-16T09:46:05.687 INFO:tasks.workunit.client.0.smithi111.stdout:9/111: sync 2024-09-16T09:46:05.690 INFO:tasks.workunit.client.0.smithi111.stdout:2/234: creat d0/d2/d44/f4b x:0 0 0 2024-09-16T09:46:05.691 INFO:tasks.workunit.client.0.smithi111.stdout:9/112: rmdir d0/d6/d8 39 2024-09-16T09:46:05.691 INFO:tasks.workunit.client.0.smithi111.stdout:6/102: dwrite d0/f1 [0,4194304] 0 2024-09-16T09:46:05.692 INFO:tasks.workunit.client.0.smithi111.stdout:2/235: link d0/d45/l4a d0/d45/l4c 0 2024-09-16T09:46:05.694 INFO:tasks.workunit.client.0.smithi111.stdout:9/113: unlink d0/l3 0 2024-09-16T09:46:05.694 INFO:tasks.workunit.client.0.smithi111.stdout:9/114: chown d0/d6/ca 1 1 2024-09-16T09:46:05.694 INFO:tasks.workunit.client.0.smithi111.stdout:9/115: fsync d0/d6/d8/f1c 0 2024-09-16T09:46:05.694 INFO:tasks.workunit.client.0.smithi111.stdout:9/116: chown d0/d6/d8/de/c20 316662532 1 2024-09-16T09:46:05.695 INFO:tasks.workunit.client.0.smithi111.stdout:6/103: creat d0/df/f25 x:0 0 0 2024-09-16T09:46:05.702 INFO:tasks.workunit.client.0.smithi111.stdout:4/210: dwrite d2/f8 [4194304,4194304] 0 2024-09-16T09:46:05.702 INFO:tasks.workunit.client.0.smithi111.stdout:4/211: dread - d2/d6/dd/d1c/f2c zero size 2024-09-16T09:46:05.704 INFO:tasks.workunit.client.0.smithi111.stdout:4/212: rmdir d2/d6/dd/d1b 39 2024-09-16T09:46:05.705 INFO:tasks.workunit.client.0.smithi111.stdout:2/236: write d0/f3d [3170666,87398] 0 2024-09-16T09:46:05.705 INFO:tasks.workunit.client.0.smithi111.stdout:2/237: truncate d0/d2/d44/f4b 12743 0 2024-09-16T09:46:05.705 INFO:tasks.workunit.client.0.smithi111.stdout:2/238: fdatasync d0/d21/f46 0 2024-09-16T09:46:05.706 INFO:tasks.workunit.client.0.smithi111.stdout:2/239: mknod d0/d22/c4d 0 2024-09-16T09:46:05.707 INFO:tasks.workunit.client.0.smithi111.stdout:2/240: write d0/d2/f41 [21092,119783] 0 2024-09-16T09:46:05.708 INFO:tasks.workunit.client.0.smithi111.stdout:9/117: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:05.710 INFO:tasks.workunit.client.0.smithi111.stdout:9/118: mknod d0/c24 0 2024-09-16T09:46:05.711 INFO:tasks.workunit.client.0.smithi111.stdout:6/104: dread d0/fc [0,4194304] 0 2024-09-16T09:46:05.711 INFO:tasks.workunit.client.0.smithi111.stdout:6/105: write d0/fd [5197611,106041] 0 2024-09-16T09:46:05.713 INFO:tasks.workunit.client.0.smithi111.stdout:6/106: truncate d0/fc 2680364 0 2024-09-16T09:46:05.732 INFO:tasks.workunit.client.0.smithi111.stdout:4/213: dwrite d2/f32 [0,4194304] 0 2024-09-16T09:46:05.732 INFO:tasks.workunit.client.0.smithi111.stdout:9/119: dwrite d0/d6/d8/fd [0,4194304] 0 2024-09-16T09:46:05.732 INFO:tasks.workunit.client.0.smithi111.stdout:9/120: chown d0/d6 512382 1 2024-09-16T09:46:05.742 INFO:tasks.workunit.client.0.smithi111.stdout:9/121: write d0/d6/d8/de/f11 [1212796,16862] 0 2024-09-16T09:46:05.770 INFO:tasks.workunit.client.0.smithi111.stdout:6/107: creat d0/df/f26 x:0 0 0 2024-09-16T09:46:05.771 INFO:tasks.workunit.client.0.smithi111.stdout:4/214: creat d2/d6/f3f x:0 0 0 2024-09-16T09:46:05.780 INFO:tasks.workunit.client.0.smithi111.stdout:6/108: dread d0/f19 [0,4194304] 0 2024-09-16T09:46:05.783 INFO:tasks.workunit.client.0.smithi111.stdout:4/215: rename d2/d6/dd/f27 to d2/d6/dd/f40 0 2024-09-16T09:46:05.783 INFO:tasks.workunit.client.0.smithi111.stdout:4/216: write d2/d6/dd/f40 [4335030,123891] 0 2024-09-16T09:46:05.783 INFO:tasks.workunit.client.0.smithi111.stdout:4/217: stat d2/d6/dd/f16 0 2024-09-16T09:46:05.784 INFO:tasks.workunit.client.0.smithi111.stdout:4/218: read d2/d6/dd/d1b/f2b [306364,56410] 0 2024-09-16T09:46:05.787 INFO:tasks.workunit.client.0.smithi111.stdout:6/109: read d0/f19 [1384477,8486] 0 2024-09-16T09:46:05.787 INFO:tasks.workunit.client.0.smithi111.stdout:6/110: write d0/f1 [104085,81068] 0 2024-09-16T09:46:05.790 INFO:tasks.workunit.client.0.smithi111.stdout:6/111: rename d0/le to d0/df/d14/d20/l27 0 2024-09-16T09:46:05.796 INFO:tasks.workunit.client.0.smithi111.stdout:6/112: unlink d0/f1 0 2024-09-16T09:46:05.797 INFO:tasks.workunit.client.0.smithi111.stdout:6/113: symlink d0/df/d14/d20/d23/l28 0 2024-09-16T09:46:05.797 INFO:tasks.workunit.client.0.smithi111.stdout:6/114: chown d0 3590456 1 2024-09-16T09:46:05.807 INFO:tasks.workunit.client.0.smithi111.stdout:5/284: dwrite d19/d1b/d27/d2e/f42 [0,4194304] 0 2024-09-16T09:46:05.807 INFO:tasks.workunit.client.0.smithi111.stdout:5/285: truncate d19/d1b/d1e/f59 291959 0 2024-09-16T09:46:05.807 INFO:tasks.workunit.client.0.smithi111.stdout:4/219: dwrite d2/d6/dd/d1c/f2c [0,4194304] 0 2024-09-16T09:46:05.812 INFO:tasks.workunit.client.0.smithi111.stdout:5/286: getdents d19/d1b 0 2024-09-16T09:46:05.834 INFO:tasks.workunit.client.0.smithi111.stdout:5/287: dwrite fa [0,4194304] 0 2024-09-16T09:46:05.864 INFO:tasks.workunit.client.0.smithi111.stdout:0/168: sync 2024-09-16T09:46:05.864 INFO:tasks.workunit.client.0.smithi111.stdout:7/166: sync 2024-09-16T09:46:05.864 INFO:tasks.workunit.client.0.smithi111.stdout:1/116: sync 2024-09-16T09:46:05.865 INFO:tasks.workunit.client.0.smithi111.stdout:8/81: sync 2024-09-16T09:46:05.865 INFO:tasks.workunit.client.0.smithi111.stdout:3/172: sync 2024-09-16T09:46:05.865 INFO:tasks.workunit.client.0.smithi111.stdout:3/173: chown d5/c7 103 1 2024-09-16T09:46:05.865 INFO:tasks.workunit.client.0.smithi111.stdout:3/174: chown d5/d18/f24 14395181 1 2024-09-16T09:46:05.867 INFO:tasks.workunit.client.0.smithi111.stdout:0/169: symlink d0/d26/d36/d3a/d3d/l3e 0 2024-09-16T09:46:05.868 INFO:tasks.workunit.client.0.smithi111.stdout:7/167: mknod d1/d16/d17/d18/c3a 0 2024-09-16T09:46:05.868 INFO:tasks.workunit.client.0.smithi111.stdout:7/168: write d1/d9/f15 [685221,75337] 0 2024-09-16T09:46:05.869 INFO:tasks.workunit.client.0.smithi111.stdout:7/169: chown d1/d9/cd 81 1 2024-09-16T09:46:05.870 INFO:tasks.workunit.client.0.smithi111.stdout:1/117: link d3/d10/c1e d3/d26/c30 0 2024-09-16T09:46:05.870 INFO:tasks.workunit.client.0.smithi111.stdout:1/118: readlink d3/lc 0 2024-09-16T09:46:05.870 INFO:tasks.workunit.client.0.smithi111.stdout:1/119: write d3/f13 [1013115,72738] 0 2024-09-16T09:46:05.872 INFO:tasks.workunit.client.0.smithi111.stdout:8/82: link d3/f19 d3/f1a 0 2024-09-16T09:46:05.874 INFO:tasks.workunit.client.0.smithi111.stdout:3/175: creat d5/d18/f36 x:0 0 0 2024-09-16T09:46:05.874 INFO:tasks.workunit.client.0.smithi111.stdout:3/176: readlink d5/da/db/de/l1e 0 2024-09-16T09:46:05.874 INFO:tasks.workunit.client.0.smithi111.stdout:3/177: write d5/da/db/f14 [4804779,54926] 0 2024-09-16T09:46:05.875 INFO:tasks.workunit.client.0.smithi111.stdout:0/170: unlink d0/f10 0 2024-09-16T09:46:05.876 INFO:tasks.workunit.client.0.smithi111.stdout:7/170: dread d1/d16/d27/f2b [0,4194304] 0 2024-09-16T09:46:05.876 INFO:tasks.workunit.client.0.smithi111.stdout:9/122: truncate d0/d6/d8/de/f11 1064343 0 2024-09-16T09:46:05.877 INFO:tasks.workunit.client.0.smithi111.stdout:1/120: creat d3/d10/d1c/f31 x:0 0 0 2024-09-16T09:46:05.878 INFO:tasks.workunit.client.0.smithi111.stdout:3/178: getdents d5/da/db 0 2024-09-16T09:46:05.880 INFO:tasks.workunit.client.0.smithi111.stdout:0/171: symlink d0/d26/l3f 0 2024-09-16T09:46:05.880 INFO:tasks.workunit.client.0.smithi111.stdout:0/172: truncate d0/f31 311822 0 2024-09-16T09:46:05.880 INFO:tasks.workunit.client.0.smithi111.stdout:1/121: mknod d3/c32 0 2024-09-16T09:46:05.882 INFO:tasks.workunit.client.0.smithi111.stdout:3/179: unlink f1 0 2024-09-16T09:46:05.882 INFO:tasks.workunit.client.0.smithi111.stdout:3/180: fsync d5/da/db/f2d 0 2024-09-16T09:46:05.883 INFO:tasks.workunit.client.0.smithi111.stdout:8/83: dread d3/f7 [0,4194304] 0 2024-09-16T09:46:05.887 INFO:tasks.workunit.client.0.smithi111.stdout:1/122: creat d3/d10/d1c/f33 x:0 0 0 2024-09-16T09:46:05.888 INFO:tasks.workunit.client.0.smithi111.stdout:3/181: dread d5/f8 [0,4194304] 0 2024-09-16T09:46:05.889 INFO:tasks.workunit.client.0.smithi111.stdout:3/182: readlink d5/d18/l1b 0 2024-09-16T09:46:05.890 INFO:tasks.workunit.client.0.smithi111.stdout:8/84: rename d3/da/df/d18 to d3/da/df/d1b 0 2024-09-16T09:46:05.891 INFO:tasks.workunit.client.0.smithi111.stdout:0/173: symlink d0/l40 0 2024-09-16T09:46:05.896 INFO:tasks.workunit.client.0.smithi111.stdout:1/123: dread d3/f6 [0,4194304] 0 2024-09-16T09:46:05.896 INFO:tasks.workunit.client.0.smithi111.stdout:1/124: write d3/dd/fe [617477,122017] 0 2024-09-16T09:46:05.896 INFO:tasks.workunit.client.0.smithi111.stdout:1/125: read - d3/f12 zero size 2024-09-16T09:46:05.901 INFO:tasks.workunit.client.0.smithi111.stdout:1/126: dread d3/f13 [0,4194304] 0 2024-09-16T09:46:05.901 INFO:tasks.workunit.client.0.smithi111.stdout:1/127: stat d3/d26/f2d 0 2024-09-16T09:46:05.901 INFO:tasks.workunit.client.0.smithi111.stdout:1/128: write d3/f14 [463513,130459] 0 2024-09-16T09:46:05.902 INFO:tasks.workunit.client.0.smithi111.stdout:1/129: write d3/d10/f18 [1007334,110334] 0 2024-09-16T09:46:05.902 INFO:tasks.workunit.client.0.smithi111.stdout:3/183: write d5/d18/f24 [2290137,119506] 0 2024-09-16T09:46:05.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/85: truncate d3/f4 1584393 0 2024-09-16T09:46:05.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/86: write d3/f8 [541839,101453] 0 2024-09-16T09:46:05.908 INFO:tasks.workunit.client.0.smithi111.stdout:3/184: symlink d5/da/db/de/l37 0 2024-09-16T09:46:05.911 INFO:tasks.workunit.client.0.smithi111.stdout:3/185: mknod d5/d18/c38 0 2024-09-16T09:46:05.911 INFO:tasks.workunit.client.0.smithi111.stdout:3/186: stat d5/da/db 0 2024-09-16T09:46:05.911 INFO:tasks.workunit.client.0.smithi111.stdout:3/187: write d5/d18/f24 [50817,15397] 0 2024-09-16T09:46:05.911 INFO:tasks.workunit.client.0.smithi111.stdout:3/188: read d5/d18/f24 [2262355,71240] 0 2024-09-16T09:46:05.912 INFO:tasks.workunit.client.0.smithi111.stdout:1/130: dread d3/dd/f17 [0,4194304] 0 2024-09-16T09:46:05.918 INFO:tasks.workunit.client.0.smithi111.stdout:1/131: write d3/dd/f17 [1128539,29908] 0 2024-09-16T09:46:05.919 INFO:tasks.workunit.client.0.smithi111.stdout:9/123: dwrite d0/f1e [0,4194304] 0 2024-09-16T09:46:05.919 INFO:tasks.workunit.client.0.smithi111.stdout:0/174: dwrite d0/f18 [4194304,4194304] 0 2024-09-16T09:46:05.920 INFO:tasks.workunit.client.0.smithi111.stdout:7/171: dwrite d1/d16/d17/d18/d1d/f24 [0,4194304] 0 2024-09-16T09:46:05.920 INFO:tasks.workunit.client.0.smithi111.stdout:7/172: readlink d1/l10 0 2024-09-16T09:46:05.921 INFO:tasks.workunit.client.0.smithi111.stdout:3/189: dread f3 [0,4194304] 0 2024-09-16T09:46:05.922 INFO:tasks.workunit.client.0.smithi111.stdout:9/124: write d0/d6/d8/f1c [758329,33826] 0 2024-09-16T09:46:05.926 INFO:tasks.workunit.client.0.smithi111.stdout:1/132: unlink d3/d10/d1c/d20/c21 0 2024-09-16T09:46:05.926 INFO:tasks.workunit.client.0.smithi111.stdout:1/133: chown d3/f12 4204 1 2024-09-16T09:46:05.926 INFO:tasks.workunit.client.0.smithi111.stdout:1/134: chown d3/d10/c1e 235771 1 2024-09-16T09:46:05.931 INFO:tasks.workunit.client.0.smithi111.stdout:0/175: chown d0/l1b 69 1 2024-09-16T09:46:05.931 INFO:tasks.workunit.client.0.smithi111.stdout:0/176: dread - d0/f38 zero size 2024-09-16T09:46:05.938 INFO:tasks.workunit.client.0.smithi111.stdout:7/173: symlink d1/d16/d17/d18/d1b/l3b 0 2024-09-16T09:46:05.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/190: creat d5/da/db/d35/f39 x:0 0 0 2024-09-16T09:46:05.943 INFO:tasks.workunit.client.0.smithi111.stdout:9/125: rename d0/c19 to d0/d21/d22/c25 0 2024-09-16T09:46:05.945 INFO:tasks.workunit.client.0.smithi111.stdout:1/135: unlink d3/dd/f1f 0 2024-09-16T09:46:05.947 INFO:tasks.workunit.client.0.smithi111.stdout:8/87: rmdir d3/da/df/d1b 0 2024-09-16T09:46:05.963 INFO:tasks.workunit.client.0.smithi111.stdout:0/177: creat d0/d26/d36/f41 x:0 0 0 2024-09-16T09:46:05.964 INFO:tasks.workunit.client.0.smithi111.stdout:3/191: mkdir d5/da/db/d3a 0 2024-09-16T09:46:05.964 INFO:tasks.workunit.client.0.smithi111.stdout:3/192: read d5/da/db/de/f15 [1177962,34469] 0 2024-09-16T09:46:05.971 INFO:tasks.workunit.client.0.smithi111.stdout:9/126: rename d0/d6/d8/fd to d0/d6/d8/f26 0 2024-09-16T09:46:05.973 INFO:tasks.workunit.client.0.smithi111.stdout:1/136: creat d3/d26/f34 x:0 0 0 2024-09-16T09:46:05.973 INFO:tasks.workunit.client.0.smithi111.stdout:1/137: read - d3/d26/f34 zero size 2024-09-16T09:46:05.975 INFO:tasks.workunit.client.0.smithi111.stdout:8/88: mknod d3/da/df/c1c 0 2024-09-16T09:46:05.975 INFO:tasks.workunit.client.0.smithi111.stdout:8/89: chown d3/f7 57 1 2024-09-16T09:46:05.975 INFO:tasks.workunit.client.0.smithi111.stdout:8/90: readlink d3/l6 0 2024-09-16T09:46:05.975 INFO:tasks.workunit.client.0.smithi111.stdout:8/91: chown d3/f8 123991 1 2024-09-16T09:46:05.975 INFO:tasks.workunit.client.0.smithi111.stdout:8/92: chown d3/da/df/c1c 4989873 1 2024-09-16T09:46:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/93: fsync d3/f10 0 2024-09-16T09:46:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/94: read - d3/f19 zero size 2024-09-16T09:46:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/95: stat d3/f4 0 2024-09-16T09:46:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/96: chown d3/f7 5876084 1 2024-09-16T09:46:05.976 INFO:tasks.workunit.client.0.smithi111.stdout:8/97: stat c2 0 2024-09-16T09:46:05.977 INFO:tasks.workunit.client.0.smithi111.stdout:8/98: dread d3/f8 [0,4194304] 0 2024-09-16T09:46:05.977 INFO:tasks.workunit.client.0.smithi111.stdout:8/99: write d3/de/f14 [544707,20441] 0 2024-09-16T09:46:05.978 INFO:tasks.workunit.client.0.smithi111.stdout:8/100: fdatasync d3/f7 0 2024-09-16T09:46:05.978 INFO:tasks.workunit.client.0.smithi111.stdout:8/101: chown d3/f4 33044 1 2024-09-16T09:46:05.978 INFO:tasks.workunit.client.0.smithi111.stdout:8/102: chown d3/f13 46412232 1 2024-09-16T09:46:05.978 INFO:tasks.workunit.client.0.smithi111.stdout:0/178: creat d0/f42 x:0 0 0 2024-09-16T09:46:05.978 INFO:tasks.workunit.client.0.smithi111.stdout:8/103: write d3/f8 [219407,8189] 0 2024-09-16T09:46:05.979 INFO:tasks.workunit.client.0.smithi111.stdout:3/193: getdents d5 0 2024-09-16T09:46:05.982 INFO:tasks.workunit.client.0.smithi111.stdout:9/127: mknod d0/d6/c27 0 2024-09-16T09:46:05.984 INFO:tasks.workunit.client.0.smithi111.stdout:1/138: unlink d3/c32 0 2024-09-16T09:46:05.984 INFO:tasks.workunit.client.0.smithi111.stdout:1/139: write d3/f13 [2118485,59403] 0 2024-09-16T09:46:05.985 INFO:tasks.workunit.client.0.smithi111.stdout:1/140: write d3/dd/fe [109187,120797] 0 2024-09-16T09:46:05.987 INFO:tasks.workunit.client.0.smithi111.stdout:1/141: fdatasync d3/f13 0 2024-09-16T09:46:05.987 INFO:tasks.workunit.client.0.smithi111.stdout:1/142: chown d3/f7 2833 1 2024-09-16T09:46:05.987 INFO:tasks.workunit.client.0.smithi111.stdout:0/179: creat d0/d26/d36/f43 x:0 0 0 2024-09-16T09:46:05.992 INFO:tasks.workunit.client.0.smithi111.stdout:8/104: rmdir d3 39 2024-09-16T09:46:05.997 INFO:tasks.workunit.client.0.smithi111.stdout:9/128: rename d0/c24 to d0/c28 0 2024-09-16T09:46:06.002 INFO:tasks.workunit.client.0.smithi111.stdout:9/129: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:06.002 INFO:tasks.workunit.client.0.smithi111.stdout:8/105: unlink d3/f4 0 2024-09-16T09:46:06.003 INFO:tasks.workunit.client.0.smithi111.stdout:8/106: readlink d3/l9 0 2024-09-16T09:46:06.003 INFO:tasks.workunit.client.0.smithi111.stdout:8/107: write d3/f8 [407401,121638] 0 2024-09-16T09:46:06.005 INFO:tasks.workunit.client.0.smithi111.stdout:8/108: creat d3/da/df/f1d x:0 0 0 2024-09-16T09:46:06.005 INFO:tasks.workunit.client.0.smithi111.stdout:8/109: write d3/da/df/f17 [3488976,5215] 0 2024-09-16T09:46:06.006 INFO:tasks.workunit.client.0.smithi111.stdout:8/110: dread - d3/da/df/f1d zero size 2024-09-16T09:46:06.008 INFO:tasks.workunit.client.0.smithi111.stdout:1/143: dwrite d3/d10/f18 [0,4194304] 0 2024-09-16T09:46:06.013 INFO:tasks.workunit.client.0.smithi111.stdout:1/144: creat d3/dd/f35 x:0 0 0 2024-09-16T09:46:06.015 INFO:tasks.workunit.client.0.smithi111.stdout:1/145: mkdir d3/dd/d28/d36 0 2024-09-16T09:46:06.017 INFO:tasks.workunit.client.0.smithi111.stdout:1/146: link d3/f6 d3/d24/d29/f37 0 2024-09-16T09:46:06.026 INFO:tasks.workunit.client.0.smithi111.stdout:1/147: write d3/d10/f18 [3787365,95543] 0 2024-09-16T09:46:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:2/241: sync 2024-09-16T09:46:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/220: sync 2024-09-16T09:46:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:6/115: sync 2024-09-16T09:46:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:5/288: sync 2024-09-16T09:46:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/221: fdatasync d2/d6/dd/f28 0 2024-09-16T09:46:06.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/222: chown d2/f8 32695 1 2024-09-16T09:46:06.028 INFO:tasks.workunit.client.0.smithi111.stdout:4/223: truncate d2/d6/f3c 768175 0 2024-09-16T09:46:06.028 INFO:tasks.workunit.client.0.smithi111.stdout:1/148: rename d3/d10/d23/c2f to d3/c38 0 2024-09-16T09:46:06.028 INFO:tasks.workunit.client.0.smithi111.stdout:6/116: write d0/f19 [3633595,51807] 0 2024-09-16T09:46:06.028 INFO:tasks.workunit.client.0.smithi111.stdout:5/289: truncate f12 4070826 0 2024-09-16T09:46:06.030 INFO:tasks.workunit.client.0.smithi111.stdout:6/117: dread - d0/f12 zero size 2024-09-16T09:46:06.031 INFO:tasks.workunit.client.0.smithi111.stdout:6/118: write d0/f17 [13224169,36673] 0 2024-09-16T09:46:06.033 INFO:tasks.workunit.client.0.smithi111.stdout:6/119: symlink d0/df/d14/l29 0 2024-09-16T09:46:06.033 INFO:tasks.workunit.client.0.smithi111.stdout:6/120: stat d0/df/d14/d20/d23/l28 0 2024-09-16T09:46:06.042 INFO:tasks.workunit.client.0.smithi111.stdout:1/149: dwrite d3/d26/f2d [0,4194304] 0 2024-09-16T09:46:06.042 INFO:tasks.workunit.client.0.smithi111.stdout:1/150: truncate d3/dd/f35 87378 0 2024-09-16T09:46:06.044 INFO:tasks.workunit.client.0.smithi111.stdout:1/151: rename d3/f13 to d3/d24/d29/f39 0 2024-09-16T09:46:06.045 INFO:tasks.workunit.client.0.smithi111.stdout:4/224: dread d2/fb [0,4194304] 0 2024-09-16T09:46:06.045 INFO:tasks.workunit.client.0.smithi111.stdout:4/225: rename d2/d6/dd to d2/d6/dd/d1c/d2f/d41 22 2024-09-16T09:46:06.048 INFO:tasks.workunit.client.0.smithi111.stdout:8/111: fsync d3/f7 0 2024-09-16T09:46:06.048 INFO:tasks.workunit.client.0.smithi111.stdout:8/112: chown d3/f19 1644 1 2024-09-16T09:46:06.048 INFO:tasks.workunit.client.0.smithi111.stdout:8/113: chown d3/l9 3641 1 2024-09-16T09:46:06.049 INFO:tasks.workunit.client.0.smithi111.stdout:8/114: mkdir d3/de/d1e 0 2024-09-16T09:46:06.050 INFO:tasks.workunit.client.0.smithi111.stdout:0/180: dwrite d0/f17 [0,4194304] 0 2024-09-16T09:46:06.051 INFO:tasks.workunit.client.0.smithi111.stdout:8/115: mknod d3/de/d1e/c1f 0 2024-09-16T09:46:06.053 INFO:tasks.workunit.client.0.smithi111.stdout:4/226: write d2/d6/dd/f16 [2105206,67143] 0 2024-09-16T09:46:06.054 INFO:tasks.workunit.client.0.smithi111.stdout:0/181: creat d0/f44 x:0 0 0 2024-09-16T09:46:06.054 INFO:tasks.workunit.client.0.smithi111.stdout:9/130: write d0/f1e [3006111,15431] 0 2024-09-16T09:46:06.054 INFO:tasks.workunit.client.0.smithi111.stdout:2/242: read d0/f7 [324938,126670] 0 2024-09-16T09:46:06.055 INFO:tasks.workunit.client.0.smithi111.stdout:4/227: truncate d2/d6/f20 2049224 0 2024-09-16T09:46:06.058 INFO:tasks.workunit.client.0.smithi111.stdout:2/243: mkdir d0/da/d4e 0 2024-09-16T09:46:06.062 INFO:tasks.workunit.client.0.smithi111.stdout:6/121: dwrite d0/f1a [0,4194304] 0 2024-09-16T09:46:06.063 INFO:tasks.workunit.client.0.smithi111.stdout:6/122: read d0/df/d14/f21 [2824609,44206] 0 2024-09-16T09:46:06.063 INFO:tasks.workunit.client.0.smithi111.stdout:6/123: write d0/f12 [41201,77079] 0 2024-09-16T09:46:06.063 INFO:tasks.workunit.client.0.smithi111.stdout:6/124: write d0/df/f25 [993563,28804] 0 2024-09-16T09:46:06.063 INFO:tasks.workunit.client.0.smithi111.stdout:2/244: link d0/f4 d0/d21/f4f 0 2024-09-16T09:46:06.064 INFO:tasks.workunit.client.0.smithi111.stdout:4/228: write d2/fb [3635620,30752] 0 2024-09-16T09:46:06.064 INFO:tasks.workunit.client.0.smithi111.stdout:4/229: chown d2/f1f 3 1 2024-09-16T09:46:06.064 INFO:tasks.workunit.client.0.smithi111.stdout:4/230: readlink d2/d6/l15 0 2024-09-16T09:46:06.065 INFO:tasks.workunit.client.0.smithi111.stdout:4/231: dread d2/d6/f3c [0,4194304] 0 2024-09-16T09:46:06.067 INFO:tasks.workunit.client.0.smithi111.stdout:6/125: mknod d0/df/c2a 0 2024-09-16T09:46:06.067 INFO:tasks.workunit.client.0.smithi111.stdout:9/131: dread d0/d6/d8/f1c [0,4194304] 0 2024-09-16T09:46:06.068 INFO:tasks.workunit.client.0.smithi111.stdout:2/245: creat d0/da/d4e/f50 x:0 0 0 2024-09-16T09:46:06.071 INFO:tasks.workunit.client.0.smithi111.stdout:6/126: creat d0/df/d14/d20/d23/f2b x:0 0 0 2024-09-16T09:46:06.074 INFO:tasks.workunit.client.0.smithi111.stdout:9/132: rmdir d0/d6 39 2024-09-16T09:46:06.074 INFO:tasks.workunit.client.0.smithi111.stdout:0/182: dwrite d0/f13 [0,4194304] 0 2024-09-16T09:46:06.074 INFO:tasks.workunit.client.0.smithi111.stdout:8/116: dwrite d3/f11 [0,4194304] 0 2024-09-16T09:46:06.074 INFO:tasks.workunit.client.0.smithi111.stdout:1/152: fsync d3/f6 0 2024-09-16T09:46:06.081 INFO:tasks.workunit.client.0.smithi111.stdout:6/127: dread d0/f12 [0,4194304] 0 2024-09-16T09:46:06.083 INFO:tasks.workunit.client.0.smithi111.stdout:1/153: symlink d3/d26/l3a 0 2024-09-16T09:46:06.091 INFO:tasks.workunit.client.0.smithi111.stdout:6/128: rename d0/c4 to d0/df/d14/d20/c2c 0 2024-09-16T09:46:06.095 INFO:tasks.workunit.client.0.smithi111.stdout:0/183: dwrite d0/f22 [0,4194304] 0 2024-09-16T09:46:06.096 INFO:tasks.workunit.client.0.smithi111.stdout:6/129: unlink d0/df/f26 0 2024-09-16T09:46:06.097 INFO:tasks.workunit.client.0.smithi111.stdout:6/130: chown d0/df/d14/d20/l27 88539152 1 2024-09-16T09:46:06.101 INFO:tasks.workunit.client.0.smithi111.stdout:6/131: rmdir d0/df/d14 39 2024-09-16T09:46:06.101 INFO:tasks.workunit.client.0.smithi111.stdout:6/132: fdatasync d0/df/d14/f21 0 2024-09-16T09:46:06.103 INFO:tasks.workunit.client.0.smithi111.stdout:0/184: dread d0/f11 [0,4194304] 0 2024-09-16T09:46:06.105 INFO:tasks.workunit.client.0.smithi111.stdout:0/185: getdents d0 0 2024-09-16T09:46:06.105 INFO:tasks.workunit.client.0.smithi111.stdout:0/186: chown d0/fd 213759 1 2024-09-16T09:46:06.106 INFO:tasks.workunit.client.0.smithi111.stdout:4/232: truncate d2/fb 1897749 0 2024-09-16T09:46:06.110 INFO:tasks.workunit.client.0.smithi111.stdout:2/246: dwrite d0/d2/f15 [0,4194304] 0 2024-09-16T09:46:06.113 INFO:tasks.workunit.client.0.smithi111.stdout:2/247: rename d0/da/d4e/f50 to d0/d2/f51 0 2024-09-16T09:46:06.113 INFO:tasks.workunit.client.0.smithi111.stdout:2/248: chown d0/l38 1627 1 2024-09-16T09:46:06.114 INFO:tasks.workunit.client.0.smithi111.stdout:2/249: mknod d0/d2/c52 0 2024-09-16T09:46:06.115 INFO:tasks.workunit.client.0.smithi111.stdout:0/187: read d0/d26/f2a [373517,54191] 0 2024-09-16T09:46:06.115 INFO:tasks.workunit.client.0.smithi111.stdout:0/188: dread - d0/d26/d36/f43 zero size 2024-09-16T09:46:06.115 INFO:tasks.workunit.client.0.smithi111.stdout:6/133: read d0/f17 [10955352,57812] 0 2024-09-16T09:46:06.115 INFO:tasks.workunit.client.0.smithi111.stdout:2/250: creat d0/f53 x:0 0 0 2024-09-16T09:46:06.116 INFO:tasks.workunit.client.0.smithi111.stdout:0/189: creat d0/d26/f45 x:0 0 0 2024-09-16T09:46:06.117 INFO:tasks.workunit.client.0.smithi111.stdout:2/251: symlink d0/d21/l54 0 2024-09-16T09:46:06.118 INFO:tasks.workunit.client.0.smithi111.stdout:2/252: creat d0/f55 x:0 0 0 2024-09-16T09:46:06.119 INFO:tasks.workunit.client.0.smithi111.stdout:2/253: mknod d0/d2/d44/c56 0 2024-09-16T09:46:06.119 INFO:tasks.workunit.client.0.smithi111.stdout:2/254: creat d0/da/f57 x:0 0 0 2024-09-16T09:46:06.121 INFO:tasks.workunit.client.0.smithi111.stdout:2/255: creat d0/d22/f58 x:0 0 0 2024-09-16T09:46:06.122 INFO:tasks.workunit.client.0.smithi111.stdout:0/190: dread d0/f11 [0,4194304] 0 2024-09-16T09:46:06.122 INFO:tasks.workunit.client.0.smithi111.stdout:0/191: write d0/d1d/f30 [1400156,52161] 0 2024-09-16T09:46:06.122 INFO:tasks.workunit.client.0.smithi111.stdout:2/256: mkdir d0/d2/d59 0 2024-09-16T09:46:06.123 INFO:tasks.workunit.client.0.smithi111.stdout:0/192: rename d0/d1d/f2f to d0/d26/d36/d3a/d3d/f46 0 2024-09-16T09:46:06.124 INFO:tasks.workunit.client.0.smithi111.stdout:2/257: mkdir d0/d2/d5a 0 2024-09-16T09:46:06.125 INFO:tasks.workunit.client.0.smithi111.stdout:0/193: symlink d0/d26/d36/d3a/l47 0 2024-09-16T09:46:06.125 INFO:tasks.workunit.client.0.smithi111.stdout:0/194: write d0/f18 [3459995,53310] 0 2024-09-16T09:46:06.125 INFO:tasks.workunit.client.0.smithi111.stdout:0/195: fsync d0/f15 0 2024-09-16T09:46:06.126 INFO:tasks.workunit.client.0.smithi111.stdout:0/196: fsync d0/f38 0 2024-09-16T09:46:06.126 INFO:tasks.workunit.client.0.smithi111.stdout:0/197: dread - d0/d26/f45 zero size 2024-09-16T09:46:06.127 INFO:tasks.workunit.client.0.smithi111.stdout:2/258: rename d0/f16 to d0/da/f5b 0 2024-09-16T09:46:06.127 INFO:tasks.workunit.client.0.smithi111.stdout:2/259: chown d0/da/f3b 2 1 2024-09-16T09:46:06.127 INFO:tasks.workunit.client.0.smithi111.stdout:2/260: truncate d0/d2/f17 4893887 0 2024-09-16T09:46:06.129 INFO:tasks.workunit.client.0.smithi111.stdout:0/198: creat d0/d26/d36/d3a/d3d/f48 x:0 0 0 2024-09-16T09:46:06.130 INFO:tasks.workunit.client.0.smithi111.stdout:0/199: mknod d0/d26/c49 0 2024-09-16T09:46:06.130 INFO:tasks.workunit.client.0.smithi111.stdout:0/200: read - d0/d26/d36/f43 zero size 2024-09-16T09:46:06.130 INFO:tasks.workunit.client.0.smithi111.stdout:0/201: fsync d0/f42 0 2024-09-16T09:46:06.135 INFO:tasks.workunit.client.0.smithi111.stdout:1/154: dwrite d3/d24/d29/f39 [0,4194304] 0 2024-09-16T09:46:06.137 INFO:tasks.workunit.client.0.smithi111.stdout:1/155: creat d3/dd/d28/d36/f3b x:0 0 0 2024-09-16T09:46:06.137 INFO:tasks.workunit.client.0.smithi111.stdout:1/156: chown d3/d10/d1c/f25 1834 1 2024-09-16T09:46:06.137 INFO:tasks.workunit.client.0.smithi111.stdout:1/157: write d3/dd/f2e [821270,90002] 0 2024-09-16T09:46:06.138 INFO:tasks.workunit.client.0.smithi111.stdout:1/158: getdents d3 0 2024-09-16T09:46:06.138 INFO:tasks.workunit.client.0.smithi111.stdout:5/290: dwrite d19/d1b/d27/f3d [0,4194304] 0 2024-09-16T09:46:06.139 INFO:tasks.workunit.client.0.smithi111.stdout:0/202: read d0/f22 [2695628,58982] 0 2024-09-16T09:46:06.141 INFO:tasks.workunit.client.0.smithi111.stdout:6/134: dwrite d0/f12 [0,4194304] 0 2024-09-16T09:46:06.141 INFO:tasks.workunit.client.0.smithi111.stdout:9/133: dwrite d0/f1e [4194304,4194304] 0 2024-09-16T09:46:06.141 INFO:tasks.workunit.client.0.smithi111.stdout:9/134: readlink d0/d6/l14 0 2024-09-16T09:46:06.145 INFO:tasks.workunit.client.0.smithi111.stdout:2/261: dwrite d0/d29/f31 [0,4194304] 0 2024-09-16T09:46:06.145 INFO:tasks.workunit.client.0.smithi111.stdout:2/262: stat d0/d2/f2c 0 2024-09-16T09:46:06.145 INFO:tasks.workunit.client.0.smithi111.stdout:2/263: write d0/da/f3a [831743,60271] 0 2024-09-16T09:46:06.146 INFO:tasks.workunit.client.0.smithi111.stdout:5/291: creat d19/d1b/d1e/d21/d29/d32/f74 x:0 0 0 2024-09-16T09:46:06.146 INFO:tasks.workunit.client.0.smithi111.stdout:5/292: chown d19/d1b/d1e/d21/d29/d32/f51 791 1 2024-09-16T09:46:06.146 INFO:tasks.workunit.client.0.smithi111.stdout:5/293: getdents d19/d1b 0 2024-09-16T09:46:06.166 INFO:tasks.workunit.client.0.smithi111.stdout:0/203: dwrite d0/f18 [4194304,4194304] 0 2024-09-16T09:46:06.169 INFO:tasks.workunit.client.0.smithi111.stdout:6/135: creat d0/df/f2d x:0 0 0 2024-09-16T09:46:06.171 INFO:tasks.workunit.client.0.smithi111.stdout:2/264: mkdir d0/d45/d5c 0 2024-09-16T09:46:06.175 INFO:tasks.workunit.client.0.smithi111.stdout:1/159: rename d3/dd to d3/d24/d3c 0 2024-09-16T09:46:06.175 INFO:tasks.workunit.client.0.smithi111.stdout:9/135: rename d0/d6 to d0/d6/d8/d29 22 2024-09-16T09:46:06.177 INFO:tasks.workunit.client.0.smithi111.stdout:0/204: mkdir d0/d26/d36/d4a 0 2024-09-16T09:46:06.177 INFO:tasks.workunit.client.0.smithi111.stdout:0/205: chown d0/d26/d36/d3a/d3d/l3e 3 1 2024-09-16T09:46:06.181 INFO:tasks.workunit.client.0.smithi111.stdout:2/265: mkdir d0/d5d 0 2024-09-16T09:46:06.181 INFO:tasks.workunit.client.0.smithi111.stdout:6/136: dread d0/fc [0,4194304] 0 2024-09-16T09:46:06.185 INFO:tasks.workunit.client.0.smithi111.stdout:9/136: creat d0/f2a x:0 0 0 2024-09-16T09:46:06.193 INFO:tasks.workunit.client.0.smithi111.stdout:0/206: dwrite d0/f15 [0,4194304] 0 2024-09-16T09:46:06.210 INFO:tasks.workunit.client.0.smithi111.stdout:0/207: dwrite d0/d26/f45 [0,4194304] 0 2024-09-16T09:46:06.217 INFO:tasks.workunit.client.0.smithi111.stdout:0/208: dread d0/f13 [0,4194304] 0 2024-09-16T09:46:06.224 INFO:tasks.workunit.client.0.smithi111.stdout:6/137: creat d0/df/d14/d20/d23/f2e x:0 0 0 2024-09-16T09:46:06.226 INFO:tasks.workunit.client.0.smithi111.stdout:1/160: mkdir d3/d24/d3c/d28/d36/d3d 0 2024-09-16T09:46:06.229 INFO:tasks.workunit.client.0.smithi111.stdout:4/233: truncate d2/d6/f20 1346874 0 2024-09-16T09:46:06.236 INFO:tasks.workunit.client.0.smithi111.stdout:0/209: mkdir d0/d26/d4b 0 2024-09-16T09:46:06.237 INFO:tasks.workunit.client.0.smithi111.stdout:0/210: write d0/f44 [366125,43979] 0 2024-09-16T09:46:06.243 INFO:tasks.workunit.client.0.smithi111.stdout:6/138: unlink d0/df/f1e 0 2024-09-16T09:46:06.243 INFO:tasks.workunit.client.0.smithi111.stdout:1/161: chown d3/f12 71659 1 2024-09-16T09:46:06.249 INFO:tasks.workunit.client.0.smithi111.stdout:4/234: creat d2/f42 x:0 0 0 2024-09-16T09:46:06.249 INFO:tasks.workunit.client.0.smithi111.stdout:4/235: chown d2/d30 60581331 1 2024-09-16T09:46:06.250 INFO:tasks.workunit.client.0.smithi111.stdout:1/162: creat d3/f3e x:0 0 0 2024-09-16T09:46:06.250 INFO:tasks.workunit.client.0.smithi111.stdout:1/163: dread - d3/d24/d3c/f2a zero size 2024-09-16T09:46:06.251 INFO:tasks.workunit.client.0.smithi111.stdout:0/211: dwrite d0/d26/d36/d3a/d3d/f48 [0,4194304] 0 2024-09-16T09:46:06.252 INFO:tasks.workunit.client.0.smithi111.stdout:4/236: creat d2/d6/dd/d1c/f43 x:0 0 0 2024-09-16T09:46:06.259 INFO:tasks.workunit.client.0.smithi111.stdout:6/139: dwrite d0/f17 [4194304,4194304] 0 2024-09-16T09:46:06.259 INFO:tasks.workunit.client.0.smithi111.stdout:6/140: fdatasync d0/df/f25 0 2024-09-16T09:46:06.259 INFO:tasks.workunit.client.0.smithi111.stdout:4/237: mkdir d2/d30/d44 0 2024-09-16T09:46:06.263 INFO:tasks.workunit.client.0.smithi111.stdout:4/238: creat d2/d6/f45 x:0 0 0 2024-09-16T09:46:06.264 INFO:tasks.workunit.client.0.smithi111.stdout:0/212: read d0/d1d/f3c [2298955,89253] 0 2024-09-16T09:46:06.264 INFO:tasks.workunit.client.0.smithi111.stdout:0/213: chown d0/d26/d4b 11 1 2024-09-16T09:46:06.264 INFO:tasks.workunit.client.0.smithi111.stdout:0/214: chown d0/l1b 5 1 2024-09-16T09:46:06.265 INFO:tasks.workunit.client.0.smithi111.stdout:4/239: creat d2/d6/dd/d1c/d2f/f46 x:0 0 0 2024-09-16T09:46:06.269 INFO:tasks.workunit.client.0.smithi111.stdout:0/215: link d0/f12 d0/d26/d4b/f4c 0 2024-09-16T09:46:06.270 INFO:tasks.workunit.client.0.smithi111.stdout:4/240: truncate d2/d6/dd/d1c/f2c 2885940 0 2024-09-16T09:46:06.271 INFO:tasks.workunit.client.0.smithi111.stdout:9/137: truncate d0/f1e 8290727 0 2024-09-16T09:46:06.274 INFO:tasks.workunit.client.0.smithi111.stdout:1/164: dwrite d3/d24/d3c/f35 [0,4194304] 0 2024-09-16T09:46:06.274 INFO:tasks.workunit.client.0.smithi111.stdout:4/241: getdents d2/d6/dd 0 2024-09-16T09:46:06.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/141: dwrite d0/df/d14/d20/d23/f2e [0,4194304] 0 2024-09-16T09:46:06.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/142: write d0/df/d14/f1b [1043172,62379] 0 2024-09-16T09:46:06.278 INFO:tasks.workunit.client.0.smithi111.stdout:9/138: mknod d0/d21/c2b 0 2024-09-16T09:46:06.290 INFO:tasks.workunit.client.0.smithi111.stdout:4/242: write d2/f1f [3394214,123595] 0 2024-09-16T09:46:06.290 INFO:tasks.workunit.client.0.smithi111.stdout:4/243: write d2/d6/f20 [1533350,71452] 0 2024-09-16T09:46:06.291 INFO:tasks.workunit.client.0.smithi111.stdout:6/143: symlink d0/df/l2f 0 2024-09-16T09:46:06.294 INFO:tasks.workunit.client.0.smithi111.stdout:4/244: creat d2/d30/d44/f47 x:0 0 0 2024-09-16T09:46:06.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/139: write d0/f1e [3368116,128883] 0 2024-09-16T09:46:06.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/140: fdatasync d0/d6/f7 0 2024-09-16T09:46:06.297 INFO:tasks.workunit.client.0.smithi111.stdout:6/144: mknod d0/df/d14/c30 0 2024-09-16T09:46:06.299 INFO:tasks.workunit.client.0.smithi111.stdout:9/141: symlink d0/d21/l2c 0 2024-09-16T09:46:06.301 INFO:tasks.workunit.client.0.smithi111.stdout:6/145: unlink d0/df/f25 0 2024-09-16T09:46:06.301 INFO:tasks.workunit.client.0.smithi111.stdout:6/146: dread - d0/df/f2d zero size 2024-09-16T09:46:06.301 INFO:tasks.workunit.client.0.smithi111.stdout:9/142: mknod d0/c2d 0 2024-09-16T09:46:06.302 INFO:tasks.workunit.client.0.smithi111.stdout:6/147: creat d0/df/d14/f31 x:0 0 0 2024-09-16T09:46:06.302 INFO:tasks.workunit.client.0.smithi111.stdout:6/148: fsync d0/df/d14/f21 0 2024-09-16T09:46:06.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/143: link d0/c2d d0/d21/d22/c2e 0 2024-09-16T09:46:06.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/144: dread - d0/f2a zero size 2024-09-16T09:46:06.306 INFO:tasks.workunit.client.0.smithi111.stdout:9/145: creat d0/d6/d8/de/f2f x:0 0 0 2024-09-16T09:46:06.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/146: mkdir d0/d6/d30 0 2024-09-16T09:46:06.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/147: truncate d0/f2a 675906 0 2024-09-16T09:46:06.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/148: chown d0/d18/c1f 0 1 2024-09-16T09:46:06.327 INFO:tasks.workunit.client.0.smithi111.stdout:0/216: dwrite d0/f22 [8388608,4194304] 0 2024-09-16T09:46:06.328 INFO:tasks.workunit.client.0.smithi111.stdout:1/165: dwrite d3/d26/f2d [0,4194304] 0 2024-09-16T09:46:06.330 INFO:tasks.workunit.client.0.smithi111.stdout:0/217: creat d0/d26/d36/d4a/f4d x:0 0 0 2024-09-16T09:46:06.338 INFO:tasks.workunit.client.0.smithi111.stdout:1/166: mkdir d3/d24/d3f 0 2024-09-16T09:46:06.338 INFO:tasks.workunit.client.0.smithi111.stdout:1/167: fsync d3/d24/d3c/f2e 0 2024-09-16T09:46:06.340 INFO:tasks.workunit.client.0.smithi111.stdout:1/168: dread - d3/fa zero size 2024-09-16T09:46:06.343 INFO:tasks.workunit.client.0.smithi111.stdout:1/169: rename d3/d10/l16 to d3/l40 0 2024-09-16T09:46:06.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/149: dwrite d0/f17 [4194304,4194304] 0 2024-09-16T09:46:06.352 INFO:tasks.workunit.client.0.smithi111.stdout:9/149: truncate d0/f1e 7956153 0 2024-09-16T09:46:06.352 INFO:tasks.workunit.client.0.smithi111.stdout:9/150: dread - d0/d6/d8/de/f2f zero size 2024-09-16T09:46:06.353 INFO:tasks.workunit.client.0.smithi111.stdout:4/245: dwrite d2/d6/fe [0,4194304] 0 2024-09-16T09:46:06.353 INFO:tasks.workunit.client.0.smithi111.stdout:4/246: stat d2/d6/dd/d1c/d2f/f46 0 2024-09-16T09:46:06.356 INFO:tasks.workunit.client.0.smithi111.stdout:4/247: creat d2/d6/f48 x:0 0 0 2024-09-16T09:46:06.358 INFO:tasks.workunit.client.0.smithi111.stdout:4/248: mknod d2/d6/dd/d1c/c49 0 2024-09-16T09:46:06.359 INFO:tasks.workunit.client.0.smithi111.stdout:4/249: rename d2/d6/f45 to d2/d30/f4a 0 2024-09-16T09:46:06.360 INFO:tasks.workunit.client.0.smithi111.stdout:0/218: dwrite d0/d26/d36/f43 [0,4194304] 0 2024-09-16T09:46:06.360 INFO:tasks.workunit.client.0.smithi111.stdout:4/250: mknod d2/c4b 0 2024-09-16T09:46:06.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/170: dwrite d3/d24/d3c/f35 [4194304,4194304] 0 2024-09-16T09:46:06.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/171: write d3/d24/d3c/ff [632864,47779] 0 2024-09-16T09:46:06.367 INFO:tasks.workunit.client.0.smithi111.stdout:0/219: symlink d0/d1d/l4e 0 2024-09-16T09:46:06.370 INFO:tasks.workunit.client.0.smithi111.stdout:4/251: creat d2/d6/dd/d1b/f4c x:0 0 0 2024-09-16T09:46:06.373 INFO:tasks.workunit.client.0.smithi111.stdout:4/252: creat d2/d6/dd/d1c/d2f/f4d x:0 0 0 2024-09-16T09:46:06.376 INFO:tasks.workunit.client.0.smithi111.stdout:6/150: dwrite d0/fd [0,4194304] 0 2024-09-16T09:46:06.380 INFO:tasks.workunit.client.0.smithi111.stdout:1/172: dwrite d3/d10/f18 [0,4194304] 0 2024-09-16T09:46:06.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:06 smithi111 ceph-mon[27997]: pgmap v256: 65 pgs: 65 active+clean; 369 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7.3 MiB/s rd, 9.7 MiB/s wr, 380 op/s 2024-09-16T09:46:06.382 INFO:tasks.workunit.client.0.smithi111.stdout:6/151: dread d0/fc [0,4194304] 0 2024-09-16T09:46:06.383 INFO:tasks.workunit.client.0.smithi111.stdout:1/173: unlink d3/d24/d3c/f2e 0 2024-09-16T09:46:06.383 INFO:tasks.workunit.client.0.smithi111.stdout:8/117: sync 2024-09-16T09:46:06.384 INFO:tasks.workunit.client.0.smithi111.stdout:3/194: sync 2024-09-16T09:46:06.384 INFO:tasks.workunit.client.0.smithi111.stdout:7/174: sync 2024-09-16T09:46:06.384 INFO:tasks.workunit.client.0.smithi111.stdout:5/294: sync 2024-09-16T09:46:06.384 INFO:tasks.workunit.client.0.smithi111.stdout:5/295: fdatasync d19/d1b/d27/d2e/f68 0 2024-09-16T09:46:06.384 INFO:tasks.workunit.client.0.smithi111.stdout:8/118: fsync d3/f11 0 2024-09-16T09:46:06.384 INFO:tasks.workunit.client.0.smithi111.stdout:5/296: chown d19/d1b/d1e/d21/d29/d32/d46 3445783 1 2024-09-16T09:46:06.386 INFO:tasks.workunit.client.0.smithi111.stdout:6/152: mkdir d0/df/d14/d20/d23/d32 0 2024-09-16T09:46:06.388 INFO:tasks.workunit.client.0.smithi111.stdout:1/174: rmdir d3 39 2024-09-16T09:46:06.388 INFO:tasks.workunit.client.0.smithi111.stdout:7/175: dread d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:06.388 INFO:tasks.workunit.client.0.smithi111.stdout:7/176: stat d1/d9/l38 0 2024-09-16T09:46:06.391 INFO:tasks.workunit.client.0.smithi111.stdout:3/195: symlink d5/da/db/de/l3b 0 2024-09-16T09:46:06.391 INFO:tasks.workunit.client.0.smithi111.stdout:3/196: stat d5/da/db/de/c17 0 2024-09-16T09:46:06.391 INFO:tasks.workunit.client.0.smithi111.stdout:2/266: sync 2024-09-16T09:46:06.391 INFO:tasks.workunit.client.0.smithi111.stdout:2/267: chown d0/d2/f17 0 1 2024-09-16T09:46:06.392 INFO:tasks.workunit.client.0.smithi111.stdout:5/297: creat d19/d1b/d27/d25/f75 x:0 0 0 2024-09-16T09:46:06.394 INFO:tasks.workunit.client.0.smithi111.stdout:0/220: dwrite d0/f13 [4194304,4194304] 0 2024-09-16T09:46:06.394 INFO:tasks.workunit.client.0.smithi111.stdout:0/221: readlink d0/d26/d36/d3a/d3d/l3e 0 2024-09-16T09:46:06.395 INFO:tasks.workunit.client.0.smithi111.stdout:1/175: mknod d3/d24/d3c/d28/d36/d3d/c41 0 2024-09-16T09:46:06.397 INFO:tasks.workunit.client.0.smithi111.stdout:4/253: dwrite d2/d6/dd/f2a [4194304,4194304] 0 2024-09-16T09:46:06.399 INFO:tasks.workunit.client.0.smithi111.stdout:2/268: creat d0/d2/d44/f5e x:0 0 0 2024-09-16T09:46:06.400 INFO:tasks.workunit.client.0.smithi111.stdout:2/269: truncate d0/d22/f58 68551 0 2024-09-16T09:46:06.400 INFO:tasks.workunit.client.0.smithi111.stdout:2/270: read - d0/d2/d44/f5e zero size 2024-09-16T09:46:06.401 INFO:tasks.workunit.client.0.smithi111.stdout:7/177: write d1/d9/fa [3733347,77436] 0 2024-09-16T09:46:06.402 INFO:tasks.workunit.client.0.smithi111.stdout:0/222: mkdir d0/d26/d36/d4a/d4f 0 2024-09-16T09:46:06.402 INFO:tasks.workunit.client.0.smithi111.stdout:0/223: chown d0/f17 19755444 1 2024-09-16T09:46:06.405 INFO:tasks.workunit.client.0.smithi111.stdout:9/151: read d0/f1e [5018388,85905] 0 2024-09-16T09:46:06.406 INFO:tasks.workunit.client.0.smithi111.stdout:1/176: mknod d3/d10/d23/c42 0 2024-09-16T09:46:06.407 INFO:tasks.workunit.client.0.smithi111.stdout:1/177: dread - d3/d24/d3c/d28/d36/f3b zero size 2024-09-16T09:46:06.407 INFO:tasks.workunit.client.0.smithi111.stdout:1/178: chown d3/d24/d3f 21254 1 2024-09-16T09:46:06.411 INFO:tasks.workunit.client.0.smithi111.stdout:4/254: getdents d2/d30/d44 0 2024-09-16T09:46:06.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/197: mknod d5/da/c3c 0 2024-09-16T09:46:06.416 INFO:tasks.workunit.client.0.smithi111.stdout:0/224: write d0/f18 [8293447,54237] 0 2024-09-16T09:46:06.418 INFO:tasks.workunit.client.0.smithi111.stdout:2/271: getdents d0/d2 0 2024-09-16T09:46:06.419 INFO:tasks.workunit.client.0.smithi111.stdout:4/255: dread d2/d6/dd/d1c/f2c [0,4194304] 0 2024-09-16T09:46:06.424 INFO:tasks.workunit.client.0.smithi111.stdout:7/178: creat d1/d9/f3c x:0 0 0 2024-09-16T09:46:06.424 INFO:tasks.workunit.client.0.smithi111.stdout:6/153: dwrite d0/f13 [0,4194304] 0 2024-09-16T09:46:06.425 INFO:tasks.workunit.client.0.smithi111.stdout:5/298: dwrite d19/f48 [0,4194304] 0 2024-09-16T09:46:06.426 INFO:tasks.workunit.client.0.smithi111.stdout:5/299: write d19/d1b/d1e/d21/d29/d32/d46/f5b [1730520,60401] 0 2024-09-16T09:46:06.426 INFO:tasks.workunit.client.0.smithi111.stdout:5/300: dread - d19/d1b/d27/d2e/f53 zero size 2024-09-16T09:46:06.426 INFO:tasks.workunit.client.0.smithi111.stdout:5/301: readlink l9 0 2024-09-16T09:46:06.428 INFO:tasks.workunit.client.0.smithi111.stdout:1/179: dread - d3/f1a zero size 2024-09-16T09:46:06.429 INFO:tasks.workunit.client.0.smithi111.stdout:9/152: dwrite d0/d6/d8/f1c [4194304,4194304] 0 2024-09-16T09:46:06.430 INFO:tasks.workunit.client.0.smithi111.stdout:3/198: mknod d5/da/db/c3d 0 2024-09-16T09:46:06.432 INFO:tasks.workunit.client.0.smithi111.stdout:0/225: symlink d0/d26/d36/d4a/l50 0 2024-09-16T09:46:06.433 INFO:tasks.workunit.client.0.smithi111.stdout:2/272: creat d0/da/f5f x:0 0 0 2024-09-16T09:46:06.433 INFO:tasks.workunit.client.0.smithi111.stdout:2/273: read d0/d2/f2c [139724,11194] 0 2024-09-16T09:46:06.434 INFO:tasks.workunit.client.0.smithi111.stdout:2/274: chown d0/d2/l3e 2415800 1 2024-09-16T09:46:06.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:06 smithi114 ceph-mon[35635]: pgmap v256: 65 pgs: 65 active+clean; 369 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 7.3 MiB/s rd, 9.7 MiB/s wr, 380 op/s 2024-09-16T09:46:06.438 INFO:tasks.workunit.client.0.smithi111.stdout:4/256: mkdir d2/d6/dd/d1c/d2f/d4e 0 2024-09-16T09:46:06.440 INFO:tasks.workunit.client.0.smithi111.stdout:7/179: rename d1/d20/l31 to d1/d9/l3d 0 2024-09-16T09:46:06.441 INFO:tasks.workunit.client.0.smithi111.stdout:2/275: write d0/f3d [4751563,57616] 0 2024-09-16T09:46:06.446 INFO:tasks.workunit.client.0.smithi111.stdout:9/153: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:06.447 INFO:tasks.workunit.client.0.smithi111.stdout:6/154: rmdir d0/df/d14/d20 39 2024-09-16T09:46:06.451 INFO:tasks.workunit.client.0.smithi111.stdout:1/180: symlink d3/d10/l43 0 2024-09-16T09:46:06.451 INFO:tasks.workunit.client.0.smithi111.stdout:1/181: fsync d3/d24/d3c/f17 0 2024-09-16T09:46:06.455 INFO:tasks.workunit.client.0.smithi111.stdout:9/154: write d0/d6/d8/f26 [4145420,21318] 0 2024-09-16T09:46:06.461 INFO:tasks.workunit.client.0.smithi111.stdout:7/180: truncate d1/d16/d17/d18/d1d/f24 3519742 0 2024-09-16T09:46:06.461 INFO:tasks.workunit.client.0.smithi111.stdout:7/181: fsync d1/d16/f29 0 2024-09-16T09:46:06.462 INFO:tasks.workunit.client.0.smithi111.stdout:2/276: mknod d0/d2/d59/c60 0 2024-09-16T09:46:06.462 INFO:tasks.workunit.client.0.smithi111.stdout:2/277: chown d0/da/d4e 152 1 2024-09-16T09:46:06.464 INFO:tasks.workunit.client.0.smithi111.stdout:6/155: truncate d0/df/d14/f21 1934466 0 2024-09-16T09:46:06.468 INFO:tasks.workunit.client.0.smithi111.stdout:1/182: mknod d3/d24/d3f/c44 0 2024-09-16T09:46:06.470 INFO:tasks.workunit.client.0.smithi111.stdout:2/278: dread d0/d22/f24 [0,4194304] 0 2024-09-16T09:46:06.472 INFO:tasks.workunit.client.0.smithi111.stdout:6/156: write d0/df/d14/d20/d23/f2e [625813,47889] 0 2024-09-16T09:46:06.473 INFO:tasks.workunit.client.0.smithi111.stdout:9/155: creat d0/d6/d30/f31 x:0 0 0 2024-09-16T09:46:06.477 INFO:tasks.workunit.client.0.smithi111.stdout:6/157: dread d0/f17 [0,4194304] 0 2024-09-16T09:46:06.499 INFO:tasks.workunit.client.0.smithi111.stdout:2/279: dwrite d0/d29/f31 [4194304,4194304] 0 2024-09-16T09:46:06.499 INFO:tasks.workunit.client.0.smithi111.stdout:2/280: write d0/fc [1639938,55422] 0 2024-09-16T09:46:06.500 INFO:tasks.workunit.client.0.smithi111.stdout:2/281: dread d0/d22/f58 [0,4194304] 0 2024-09-16T09:46:06.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/158: dwrite d0/df/d14/f1f [4194304,4194304] 0 2024-09-16T09:46:06.502 INFO:tasks.workunit.client.0.smithi111.stdout:6/159: truncate d0/df/d14/f1b 2020788 0 2024-09-16T09:46:06.503 INFO:tasks.workunit.client.0.smithi111.stdout:6/160: write d0/df/d14/f1b [1455752,101174] 0 2024-09-16T09:46:06.503 INFO:tasks.workunit.client.0.smithi111.stdout:6/161: readlink d0/df/d14/l29 0 2024-09-16T09:46:06.506 INFO:tasks.workunit.client.0.smithi111.stdout:2/282: mkdir d0/d2/d61 0 2024-09-16T09:46:06.508 INFO:tasks.workunit.client.0.smithi111.stdout:6/162: unlink d0/fc 0 2024-09-16T09:46:06.509 INFO:tasks.workunit.client.0.smithi111.stdout:1/183: dwrite d3/f7 [0,4194304] 0 2024-09-16T09:46:06.509 INFO:tasks.workunit.client.0.smithi111.stdout:1/184: dread - d3/d10/d1c/f1d zero size 2024-09-16T09:46:06.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/283: rmdir d0/d29 39 2024-09-16T09:46:06.510 INFO:tasks.workunit.client.0.smithi111.stdout:6/163: mkdir d0/df/d14/d20/d23/d33 0 2024-09-16T09:46:06.512 INFO:tasks.workunit.client.0.smithi111.stdout:1/185: mknod d3/d10/c45 0 2024-09-16T09:46:06.513 INFO:tasks.workunit.client.0.smithi111.stdout:2/284: creat d0/d2/d5a/f62 x:0 0 0 2024-09-16T09:46:06.513 INFO:tasks.workunit.client.0.smithi111.stdout:2/285: read - d0/da/f5f zero size 2024-09-16T09:46:06.513 INFO:tasks.workunit.client.0.smithi111.stdout:2/286: chown d0/d2/d61 9 1 2024-09-16T09:46:06.515 INFO:tasks.workunit.client.0.smithi111.stdout:6/164: unlink d0/df/d14/d20/c2c 0 2024-09-16T09:46:06.515 INFO:tasks.workunit.client.0.smithi111.stdout:0/226: truncate d0/f13 904500 0 2024-09-16T09:46:06.516 INFO:tasks.workunit.client.0.smithi111.stdout:0/227: dread - d0/d26/d36/f41 zero size 2024-09-16T09:46:06.516 INFO:tasks.workunit.client.0.smithi111.stdout:2/287: mkdir d0/d5d/d63 0 2024-09-16T09:46:06.516 INFO:tasks.workunit.client.0.smithi111.stdout:2/288: readlink d0/da/l43 0 2024-09-16T09:46:06.518 INFO:tasks.workunit.client.0.smithi111.stdout:6/165: rename d0/df/d14/d20/d23/f2b to d0/df/d14/d20/d23/d33/f34 0 2024-09-16T09:46:06.519 INFO:tasks.workunit.client.0.smithi111.stdout:2/289: getdents d0/d45 0 2024-09-16T09:46:06.521 INFO:tasks.workunit.client.0.smithi111.stdout:6/166: mknod d0/df/d14/c35 0 2024-09-16T09:46:06.521 INFO:tasks.workunit.client.0.smithi111.stdout:0/228: mknod d0/c51 0 2024-09-16T09:46:06.523 INFO:tasks.workunit.client.0.smithi111.stdout:2/290: link d0/da/c2d d0/d2/d5a/c64 0 2024-09-16T09:46:06.525 INFO:tasks.workunit.client.0.smithi111.stdout:6/167: link d0/f13 d0/df/d14/d20/d23/d33/f36 0 2024-09-16T09:46:06.526 INFO:tasks.workunit.client.0.smithi111.stdout:0/229: creat d0/d26/d36/d4a/d4f/f52 x:0 0 0 2024-09-16T09:46:06.527 INFO:tasks.workunit.client.0.smithi111.stdout:2/291: creat d0/d45/f65 x:0 0 0 2024-09-16T09:46:06.528 INFO:tasks.workunit.client.0.smithi111.stdout:6/168: creat d0/df/d14/f37 x:0 0 0 2024-09-16T09:46:06.528 INFO:tasks.workunit.client.0.smithi111.stdout:6/169: chown d0/df/d14/f31 895 1 2024-09-16T09:46:06.529 INFO:tasks.workunit.client.0.smithi111.stdout:2/292: dread d0/d22/f40 [0,4194304] 0 2024-09-16T09:46:06.530 INFO:tasks.workunit.client.0.smithi111.stdout:0/230: creat d0/d26/d36/d3a/d3d/f53 x:0 0 0 2024-09-16T09:46:06.532 INFO:tasks.workunit.client.0.smithi111.stdout:2/293: getdents d0/d21 0 2024-09-16T09:46:06.532 INFO:tasks.workunit.client.0.smithi111.stdout:2/294: write d0/d2/d5a/f62 [335064,76325] 0 2024-09-16T09:46:06.532 INFO:tasks.workunit.client.0.smithi111.stdout:0/231: mkdir d0/d26/d36/d54 0 2024-09-16T09:46:06.533 INFO:tasks.workunit.client.0.smithi111.stdout:1/186: dwrite d3/d24/d29/f37 [0,4194304] 0 2024-09-16T09:46:06.536 INFO:tasks.workunit.client.0.smithi111.stdout:0/232: creat d0/f55 x:0 0 0 2024-09-16T09:46:06.540 INFO:tasks.workunit.client.0.smithi111.stdout:1/187: rename d3/l40 to d3/d26/l46 0 2024-09-16T09:46:06.540 INFO:tasks.workunit.client.0.smithi111.stdout:6/170: write d0/fd [3898544,62198] 0 2024-09-16T09:46:06.540 INFO:tasks.workunit.client.0.smithi111.stdout:6/171: stat d0/df/d14 0 2024-09-16T09:46:06.541 INFO:tasks.workunit.client.0.smithi111.stdout:2/295: link d0/d2/d5a/f62 d0/d2/d5a/f66 0 2024-09-16T09:46:06.546 INFO:tasks.workunit.client.0.smithi111.stdout:0/233: rename d0/d26/f45 to d0/d26/d36/d54/f56 0 2024-09-16T09:46:06.551 INFO:tasks.workunit.client.0.smithi111.stdout:6/172: symlink d0/df/d14/d20/l38 0 2024-09-16T09:46:06.551 INFO:tasks.workunit.client.0.smithi111.stdout:6/173: fdatasync d0/df/f2d 0 2024-09-16T09:46:06.555 INFO:tasks.workunit.client.0.smithi111.stdout:0/234: rename d0/c7 to d0/d26/d36/d4a/c57 0 2024-09-16T09:46:06.558 INFO:tasks.workunit.client.0.smithi111.stdout:0/235: truncate d0/f18 6605280 0 2024-09-16T09:46:06.561 INFO:tasks.workunit.client.0.smithi111.stdout:2/296: dwrite d0/d2/f28 [0,4194304] 0 2024-09-16T09:46:06.562 INFO:tasks.workunit.client.0.smithi111.stdout:0/236: mkdir d0/d1d/d58 0 2024-09-16T09:46:06.566 INFO:tasks.workunit.client.0.smithi111.stdout:6/174: dread d0/f1a [0,4194304] 0 2024-09-16T09:46:06.566 INFO:tasks.workunit.client.0.smithi111.stdout:1/188: dwrite d3/fa [0,4194304] 0 2024-09-16T09:46:06.566 INFO:tasks.workunit.client.0.smithi111.stdout:6/175: truncate d0/df/d14/f1b 2179025 0 2024-09-16T09:46:06.566 INFO:tasks.workunit.client.0.smithi111.stdout:1/189: write d3/d10/d1c/f25 [4869607,91180] 0 2024-09-16T09:46:06.569 INFO:tasks.workunit.client.0.smithi111.stdout:0/237: mkdir d0/d26/d36/d3a/d3d/d59 0 2024-09-16T09:46:06.569 INFO:tasks.workunit.client.0.smithi111.stdout:0/238: chown d0/d26/d36/d4a/d4f/f52 6 1 2024-09-16T09:46:06.581 INFO:tasks.workunit.client.0.smithi111.stdout:6/176: symlink d0/df/d14/d20/l39 0 2024-09-16T09:46:06.584 INFO:tasks.workunit.client.0.smithi111.stdout:2/297: dwrite d0/d22/f23 [0,4194304] 0 2024-09-16T09:46:06.586 INFO:tasks.workunit.client.0.smithi111.stdout:1/190: getdents d3 0 2024-09-16T09:46:06.588 INFO:tasks.workunit.client.0.smithi111.stdout:6/177: creat d0/f3a x:0 0 0 2024-09-16T09:46:06.596 INFO:tasks.workunit.client.0.smithi111.stdout:0/239: dwrite d0/d26/d36/f41 [0,4194304] 0 2024-09-16T09:46:06.596 INFO:tasks.workunit.client.0.smithi111.stdout:2/298: rename d0/d5d to d0/d45/d5c/d67 0 2024-09-16T09:46:06.597 INFO:tasks.workunit.client.0.smithi111.stdout:1/191: unlink d3/l8 0 2024-09-16T09:46:06.603 INFO:tasks.workunit.client.0.smithi111.stdout:6/178: dwrite d0/df/d14/f1b [0,4194304] 0 2024-09-16T09:46:06.604 INFO:tasks.workunit.client.0.smithi111.stdout:0/240: unlink d0/f24 0 2024-09-16T09:46:06.606 INFO:tasks.workunit.client.0.smithi111.stdout:2/299: rename d0/f10 to d0/d2/d5a/f68 0 2024-09-16T09:46:06.613 INFO:tasks.workunit.client.0.smithi111.stdout:6/179: rmdir d0/df/d14/d20 39 2024-09-16T09:46:06.613 INFO:tasks.workunit.client.0.smithi111.stdout:6/180: truncate d0/df/f2d 165950 0 2024-09-16T09:46:06.616 INFO:tasks.workunit.client.0.smithi111.stdout:0/241: link d0/d26/c49 d0/d26/c5a 0 2024-09-16T09:46:06.617 INFO:tasks.workunit.client.0.smithi111.stdout:2/300: unlink d0/d2/c52 0 2024-09-16T09:46:06.621 INFO:tasks.workunit.client.0.smithi111.stdout:6/181: creat d0/df/d14/d20/d23/f3b x:0 0 0 2024-09-16T09:46:06.621 INFO:tasks.workunit.client.0.smithi111.stdout:6/182: write d0/df/d14/d20/d23/f3b [409003,5060] 0 2024-09-16T09:46:06.621 INFO:tasks.workunit.client.0.smithi111.stdout:6/183: truncate d0/df/d14/d20/d23/f3b 1042743 0 2024-09-16T09:46:06.625 INFO:tasks.workunit.client.0.smithi111.stdout:0/242: unlink d0/f2b 0 2024-09-16T09:46:06.625 INFO:tasks.workunit.client.0.smithi111.stdout:0/243: write d0/f32 [602022,1944] 0 2024-09-16T09:46:06.626 INFO:tasks.workunit.client.0.smithi111.stdout:0/244: read d0/d1d/f30 [326018,977] 0 2024-09-16T09:46:06.626 INFO:tasks.workunit.client.0.smithi111.stdout:0/245: write d0/f11 [4208297,102606] 0 2024-09-16T09:46:06.628 INFO:tasks.workunit.client.0.smithi111.stdout:2/301: truncate d0/d2/d5a/f66 278467 0 2024-09-16T09:46:06.632 INFO:tasks.workunit.client.0.smithi111.stdout:1/192: rename d3/d10/d1c/d20 to d3/d24/d3c/d28/d36/d3d/d47 0 2024-09-16T09:46:06.636 INFO:tasks.workunit.client.0.smithi111.stdout:1/193: stat d3/f1a 0 2024-09-16T09:46:06.639 INFO:tasks.workunit.client.0.smithi111.stdout:1/194: creat d3/d24/d3c/f48 x:0 0 0 2024-09-16T09:46:06.640 INFO:tasks.workunit.client.0.smithi111.stdout:6/184: dwrite d0/df/d14/d20/d23/f2e [0,4194304] 0 2024-09-16T09:46:06.642 INFO:tasks.workunit.client.0.smithi111.stdout:1/195: symlink d3/d24/d29/l49 0 2024-09-16T09:46:06.642 INFO:tasks.workunit.client.0.smithi111.stdout:1/196: stat d3/d24/d3c/d28/d36/d3d/c41 0 2024-09-16T09:46:06.645 INFO:tasks.workunit.client.0.smithi111.stdout:6/185: dread d0/f1a [0,4194304] 0 2024-09-16T09:46:06.650 INFO:tasks.workunit.client.0.smithi111.stdout:0/246: dwrite d0/f12 [4194304,4194304] 0 2024-09-16T09:46:06.650 INFO:tasks.workunit.client.0.smithi111.stdout:2/302: dwrite d0/d2/f1e [0,4194304] 0 2024-09-16T09:46:06.652 INFO:tasks.workunit.client.0.smithi111.stdout:0/247: write d0/d1d/f3c [4062881,65382] 0 2024-09-16T09:46:06.653 INFO:tasks.workunit.client.0.smithi111.stdout:6/186: dread d0/df/d14/d20/d23/f3b [0,4194304] 0 2024-09-16T09:46:06.655 INFO:tasks.workunit.client.0.smithi111.stdout:2/303: rename d0/d2/l3e to d0/d45/d5c/d67/d63/l69 0 2024-09-16T09:46:06.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/304: write d0/da/f5f [95646,42102] 0 2024-09-16T09:46:06.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/305: chown d0/d22/f24 2 1 2024-09-16T09:46:06.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/306: write d0/d45/f65 [823261,28451] 0 2024-09-16T09:46:06.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/307: chown d0/d2/f51 30316001 1 2024-09-16T09:46:06.656 INFO:tasks.workunit.client.0.smithi111.stdout:0/248: symlink d0/d26/d4b/l5b 0 2024-09-16T09:46:06.657 INFO:tasks.workunit.client.0.smithi111.stdout:6/187: symlink d0/df/d14/d20/d23/d32/l3c 0 2024-09-16T09:46:06.659 INFO:tasks.workunit.client.0.smithi111.stdout:2/308: rename d0/da/f5b to d0/d2/f6a 0 2024-09-16T09:46:06.661 INFO:tasks.workunit.client.0.smithi111.stdout:0/249: unlink d0/d1d/c27 0 2024-09-16T09:46:06.661 INFO:tasks.workunit.client.0.smithi111.stdout:0/250: write d0/f31 [161815,17732] 0 2024-09-16T09:46:06.662 INFO:tasks.workunit.client.0.smithi111.stdout:0/251: chown d0/ce 3482494 1 2024-09-16T09:46:06.663 INFO:tasks.workunit.client.0.smithi111.stdout:2/309: creat d0/d45/d5c/f6b x:0 0 0 2024-09-16T09:46:06.663 INFO:tasks.workunit.client.0.smithi111.stdout:2/310: chown d0/d45/l4c 100 1 2024-09-16T09:46:06.663 INFO:tasks.workunit.client.0.smithi111.stdout:1/197: dwrite d3/f6 [0,4194304] 0 2024-09-16T09:46:06.664 INFO:tasks.workunit.client.0.smithi111.stdout:0/252: symlink d0/d26/d36/d4a/d4f/l5c 0 2024-09-16T09:46:06.666 INFO:tasks.workunit.client.0.smithi111.stdout:6/188: symlink d0/l3d 0 2024-09-16T09:46:06.667 INFO:tasks.workunit.client.0.smithi111.stdout:2/311: creat d0/d29/f6c x:0 0 0 2024-09-16T09:46:06.668 INFO:tasks.workunit.client.0.smithi111.stdout:2/312: fdatasync d0/f36 0 2024-09-16T09:46:06.668 INFO:tasks.workunit.client.0.smithi111.stdout:2/313: readlink d0/d2/l37 0 2024-09-16T09:46:06.668 INFO:tasks.workunit.client.0.smithi111.stdout:2/314: dread d0/d2/d5a/f66 [0,4194304] 0 2024-09-16T09:46:06.671 INFO:tasks.workunit.client.0.smithi111.stdout:6/189: dread d0/df/d14/f21 [0,4194304] 0 2024-09-16T09:46:06.671 INFO:tasks.workunit.client.0.smithi111.stdout:6/190: stat d0/df/d14/d20/d23 0 2024-09-16T09:46:06.672 INFO:tasks.workunit.client.0.smithi111.stdout:1/198: fdatasync d3/d26/f34 0 2024-09-16T09:46:06.672 INFO:tasks.workunit.client.0.smithi111.stdout:1/199: readlink d3/d10/l22 0 2024-09-16T09:46:06.672 INFO:tasks.workunit.client.0.smithi111.stdout:1/200: truncate d3/d10/d1c/f1d 440628 0 2024-09-16T09:46:06.673 INFO:tasks.workunit.client.0.smithi111.stdout:0/253: symlink d0/d26/d4b/l5d 0 2024-09-16T09:46:06.682 INFO:tasks.workunit.client.0.smithi111.stdout:0/254: mkdir d0/d26/d36/d4a/d5e 0 2024-09-16T09:46:06.688 INFO:tasks.workunit.client.0.smithi111.stdout:0/255: mknod d0/c5f 0 2024-09-16T09:46:06.690 INFO:tasks.workunit.client.0.smithi111.stdout:0/256: rename d0/d1d/c25 to d0/d26/d36/d54/c60 0 2024-09-16T09:46:06.692 INFO:tasks.workunit.client.0.smithi111.stdout:0/257: truncate d0/f44 101356 0 2024-09-16T09:46:06.693 INFO:tasks.workunit.client.0.smithi111.stdout:6/191: dwrite d0/df/d14/f37 [0,4194304] 0 2024-09-16T09:46:06.693 INFO:tasks.workunit.client.0.smithi111.stdout:1/201: dwrite d3/d10/d1c/f31 [0,4194304] 0 2024-09-16T09:46:06.693 INFO:tasks.workunit.client.0.smithi111.stdout:1/202: chown d3/d24/d3c/l19 96083 1 2024-09-16T09:46:06.695 INFO:tasks.workunit.client.0.smithi111.stdout:6/192: symlink d0/df/d14/l3e 0 2024-09-16T09:46:06.700 INFO:tasks.workunit.client.0.smithi111.stdout:1/203: truncate d3/f6 2480541 0 2024-09-16T09:46:06.701 INFO:tasks.workunit.client.0.smithi111.stdout:0/258: getdents d0/d26/d36/d4a 0 2024-09-16T09:46:06.702 INFO:tasks.workunit.client.0.smithi111.stdout:6/193: rename d0/df/d14/d20/l38 to d0/df/d14/d20/d23/d32/l3f 0 2024-09-16T09:46:06.706 INFO:tasks.workunit.client.0.smithi111.stdout:6/194: dread d0/f1a [0,4194304] 0 2024-09-16T09:46:06.708 INFO:tasks.workunit.client.0.smithi111.stdout:6/195: symlink d0/df/d14/d20/d23/l40 0 2024-09-16T09:46:06.708 INFO:tasks.workunit.client.0.smithi111.stdout:6/196: chown d0/df/d14/d20/d23/l40 679 1 2024-09-16T09:46:06.712 INFO:tasks.workunit.client.0.smithi111.stdout:0/259: fsync d0/f44 0 2024-09-16T09:46:06.712 INFO:tasks.workunit.client.0.smithi111.stdout:0/260: getdents d0/d26/d36/d4a 0 2024-09-16T09:46:06.714 INFO:tasks.workunit.client.0.smithi111.stdout:0/261: unlink d0/f38 0 2024-09-16T09:46:06.717 INFO:tasks.workunit.client.0.smithi111.stdout:0/262: rename d0/d1d/l21 to d0/d26/d36/d54/l61 0 2024-09-16T09:46:06.717 INFO:tasks.workunit.client.0.smithi111.stdout:0/263: readlink d0/d26/d36/d4a/d4f/l5c 0 2024-09-16T09:46:06.717 INFO:tasks.workunit.client.0.smithi111.stdout:0/264: truncate d0/d26/f2c 1034076 0 2024-09-16T09:46:06.719 INFO:tasks.workunit.client.0.smithi111.stdout:0/265: creat d0/d1d/f62 x:0 0 0 2024-09-16T09:46:06.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/266: creat d0/d26/d36/d3a/f63 x:0 0 0 2024-09-16T09:46:06.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/267: fsync d0/d26/f2c 0 2024-09-16T09:46:06.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/268: fdatasync d0/f31 0 2024-09-16T09:46:06.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/269: write d0/f42 [1017273,19724] 0 2024-09-16T09:46:06.733 INFO:tasks.workunit.client.0.smithi111.stdout:6/197: getdents d0/df/d14/d20/d23 0 2024-09-16T09:46:06.735 INFO:tasks.workunit.client.0.smithi111.stdout:1/204: write d3/f6 [762608,75675] 0 2024-09-16T09:46:06.735 INFO:tasks.workunit.client.0.smithi111.stdout:6/198: dread d0/df/f2d [0,4194304] 0 2024-09-16T09:46:06.736 INFO:tasks.workunit.client.0.smithi111.stdout:1/205: read - d3/f3e zero size 2024-09-16T09:46:06.742 INFO:tasks.workunit.client.0.smithi111.stdout:1/206: creat d3/d10/f4a x:0 0 0 2024-09-16T09:46:06.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/199: dwrite d0/df/d14/f1f [4194304,4194304] 0 2024-09-16T09:46:06.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/200: readlink d0/df/d14/d20/d23/d32/l3c 0 2024-09-16T09:46:06.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/201: chown d0/df 125 1 2024-09-16T09:46:06.751 INFO:tasks.workunit.client.0.smithi111.stdout:6/202: mkdir d0/df/d14/d20/d23/d41 0 2024-09-16T09:46:06.761 INFO:tasks.workunit.client.0.smithi111.stdout:1/207: dwrite d3/f27 [0,4194304] 0 2024-09-16T09:46:06.762 INFO:tasks.workunit.client.0.smithi111.stdout:1/208: write d3/f12 [408456,25916] 0 2024-09-16T09:46:06.765 INFO:tasks.workunit.client.0.smithi111.stdout:1/209: rename d3/c38 to d3/d24/d3c/d28/d36/d3d/c4b 0 2024-09-16T09:46:06.766 INFO:tasks.workunit.client.0.smithi111.stdout:1/210: creat d3/d24/d3f/f4c x:0 0 0 2024-09-16T09:46:06.767 INFO:tasks.workunit.client.0.smithi111.stdout:1/211: creat d3/d10/f4d x:0 0 0 2024-09-16T09:46:06.767 INFO:tasks.workunit.client.0.smithi111.stdout:1/212: truncate d3/d10/f4d 180184 0 2024-09-16T09:46:06.768 INFO:tasks.workunit.client.0.smithi111.stdout:1/213: mkdir d3/d24/d4e 0 2024-09-16T09:46:06.768 INFO:tasks.workunit.client.0.smithi111.stdout:1/214: truncate d3/f6 2601234 0 2024-09-16T09:46:06.770 INFO:tasks.workunit.client.0.smithi111.stdout:6/203: dwrite d0/f17 [0,4194304] 0 2024-09-16T09:46:06.771 INFO:tasks.workunit.client.0.smithi111.stdout:1/215: rename d3/cb to d3/d10/d1c/c4f 0 2024-09-16T09:46:06.773 INFO:tasks.workunit.client.0.smithi111.stdout:6/204: mkdir d0/df/d14/d20/d42 0 2024-09-16T09:46:06.773 INFO:tasks.workunit.client.0.smithi111.stdout:6/205: fsync d0/df/d14/d20/d23/f2e 0 2024-09-16T09:46:06.775 INFO:tasks.workunit.client.0.smithi111.stdout:1/216: symlink d3/d24/l50 0 2024-09-16T09:46:06.775 INFO:tasks.workunit.client.0.smithi111.stdout:1/217: truncate d3/f1a 957576 0 2024-09-16T09:46:06.782 INFO:tasks.workunit.client.0.smithi111.stdout:1/218: getdents d3/d24/d3c 0 2024-09-16T09:46:06.793 INFO:tasks.workunit.client.0.smithi111.stdout:1/219: dread d3/f9 [0,4194304] 0 2024-09-16T09:46:06.796 INFO:tasks.workunit.client.0.smithi111.stdout:6/206: dwrite d0/f3a [0,4194304] 0 2024-09-16T09:46:06.797 INFO:tasks.workunit.client.0.smithi111.stdout:1/220: creat d3/d24/d29/f51 x:0 0 0 2024-09-16T09:46:06.801 INFO:tasks.workunit.client.0.smithi111.stdout:1/221: unlink d3/d10/f4a 0 2024-09-16T09:46:06.803 INFO:tasks.workunit.client.0.smithi111.stdout:6/207: symlink d0/l43 0 2024-09-16T09:46:06.803 INFO:tasks.workunit.client.0.smithi111.stdout:6/208: write d0/f17 [11166314,14286] 0 2024-09-16T09:46:06.806 INFO:tasks.workunit.client.0.smithi111.stdout:6/209: dread d0/df/f2d [0,4194304] 0 2024-09-16T09:46:06.806 INFO:tasks.workunit.client.0.smithi111.stdout:6/210: readlink d0/df/d14/l29 0 2024-09-16T09:46:06.807 INFO:tasks.workunit.client.0.smithi111.stdout:8/119: sync 2024-09-16T09:46:06.807 INFO:tasks.workunit.client.0.smithi111.stdout:5/302: sync 2024-09-16T09:46:06.807 INFO:tasks.workunit.client.0.smithi111.stdout:8/120: chown d3/da 3960951 1 2024-09-16T09:46:06.807 INFO:tasks.workunit.client.0.smithi111.stdout:8/121: write d3/de/f14 [1439140,54366] 0 2024-09-16T09:46:06.809 INFO:tasks.workunit.client.0.smithi111.stdout:8/122: write f1 [3342217,115224] 0 2024-09-16T09:46:06.809 INFO:tasks.workunit.client.0.smithi111.stdout:8/123: write d3/f10 [940979,69569] 0 2024-09-16T09:46:06.812 INFO:tasks.workunit.client.0.smithi111.stdout:8/124: mknod d3/de/d1e/c20 0 2024-09-16T09:46:06.817 INFO:tasks.workunit.client.0.smithi111.stdout:8/125: mknod d3/da/c21 0 2024-09-16T09:46:06.817 INFO:tasks.workunit.client.0.smithi111.stdout:8/126: mknod d3/da/db/c22 0 2024-09-16T09:46:06.818 INFO:tasks.workunit.client.0.smithi111.stdout:5/303: read d19/f48 [4084259,83163] 0 2024-09-16T09:46:06.821 INFO:tasks.workunit.client.0.smithi111.stdout:1/222: dwrite d3/d10/d1c/f33 [0,4194304] 0 2024-09-16T09:46:06.821 INFO:tasks.workunit.client.0.smithi111.stdout:8/127: fdatasync d3/f13 0 2024-09-16T09:46:06.826 INFO:tasks.workunit.client.0.smithi111.stdout:5/304: dread f12 [0,4194304] 0 2024-09-16T09:46:06.828 INFO:tasks.workunit.client.0.smithi111.stdout:5/305: link d19/d1b/d1e/d21/f5e d19/d1b/d1e/f76 0 2024-09-16T09:46:06.857 INFO:tasks.workunit.client.0.smithi111.stdout:1/223: dwrite d3/f6 [0,4194304] 0 2024-09-16T09:46:06.857 INFO:tasks.workunit.client.0.smithi111.stdout:1/224: dread - d3/d24/d3c/d28/d36/f3b zero size 2024-09-16T09:46:06.857 INFO:tasks.workunit.client.0.smithi111.stdout:5/306: dwrite d19/d1b/f4d [4194304,4194304] 0 2024-09-16T09:46:06.857 INFO:tasks.workunit.client.0.smithi111.stdout:8/128: dwrite f1 [4194304,4194304] 0 2024-09-16T09:46:06.857 INFO:tasks.workunit.client.0.smithi111.stdout:8/129: read d3/f7 [678761,2584] 0 2024-09-16T09:46:06.858 INFO:tasks.workunit.client.0.smithi111.stdout:1/225: creat d3/d24/d4e/f52 x:0 0 0 2024-09-16T09:46:06.860 INFO:tasks.workunit.client.0.smithi111.stdout:8/130: mknod d3/da/db/c23 0 2024-09-16T09:46:06.869 INFO:tasks.workunit.client.0.smithi111.stdout:1/226: rmdir d3/d10 39 2024-09-16T09:46:06.871 INFO:tasks.workunit.client.0.smithi111.stdout:8/131: creat d3/da/df/f24 x:0 0 0 2024-09-16T09:46:06.873 INFO:tasks.workunit.client.0.smithi111.stdout:1/227: mknod d3/d24/d3c/d28/d36/d3d/c53 0 2024-09-16T09:46:06.873 INFO:tasks.workunit.client.0.smithi111.stdout:5/307: dwrite d19/d1b/d27/d2e/f68 [0,4194304] 0 2024-09-16T09:46:06.873 INFO:tasks.workunit.client.0.smithi111.stdout:5/308: chown d19/d1b/d1e/l2c 114 1 2024-09-16T09:46:06.876 INFO:tasks.workunit.client.0.smithi111.stdout:1/228: unlink d3/d26/l46 0 2024-09-16T09:46:06.880 INFO:tasks.workunit.client.0.smithi111.stdout:8/132: dread d3/f11 [0,4194304] 0 2024-09-16T09:46:06.880 INFO:tasks.workunit.client.0.smithi111.stdout:8/133: write d3/da/df/f24 [796940,58405] 0 2024-09-16T09:46:06.882 INFO:tasks.workunit.client.0.smithi111.stdout:5/309: creat d19/d1b/d27/d2e/d39/f77 x:0 0 0 2024-09-16T09:46:06.882 INFO:tasks.workunit.client.0.smithi111.stdout:5/310: stat d19/d1b/d1e/l2c 0 2024-09-16T09:46:06.882 INFO:tasks.workunit.client.0.smithi111.stdout:5/311: write d19/f43 [30906,53637] 0 2024-09-16T09:46:06.882 INFO:tasks.workunit.client.0.smithi111.stdout:8/134: dread d3/f8 [0,4194304] 0 2024-09-16T09:46:06.883 INFO:tasks.workunit.client.0.smithi111.stdout:8/135: write d3/f13 [1486340,1898] 0 2024-09-16T09:46:06.886 INFO:tasks.workunit.client.0.smithi111.stdout:5/312: dread d19/d1b/d1e/d21/d29/d32/d46/f5b [0,4194304] 0 2024-09-16T09:46:06.886 INFO:tasks.workunit.client.0.smithi111.stdout:5/313: readlink d19/d1b/d27/d2e/l31 0 2024-09-16T09:46:06.887 INFO:tasks.workunit.client.0.smithi111.stdout:8/136: dread d3/da/df/f17 [0,4194304] 0 2024-09-16T09:46:06.887 INFO:tasks.workunit.client.0.smithi111.stdout:8/137: readlink d3/l9 0 2024-09-16T09:46:06.887 INFO:tasks.workunit.client.0.smithi111.stdout:8/138: dread - d3/f19 zero size 2024-09-16T09:46:06.888 INFO:tasks.workunit.client.0.smithi111.stdout:8/139: creat d3/da/df/f25 x:0 0 0 2024-09-16T09:46:06.891 INFO:tasks.workunit.client.0.smithi111.stdout:8/140: dread d3/de/f14 [0,4194304] 0 2024-09-16T09:46:06.900 INFO:tasks.workunit.client.0.smithi111.stdout:8/141: truncate d3/f13 429529 0 2024-09-16T09:46:06.900 INFO:tasks.workunit.client.0.smithi111.stdout:8/142: fdatasync f0 0 2024-09-16T09:46:06.903 INFO:tasks.workunit.client.0.smithi111.stdout:1/229: dwrite d3/fa [0,4194304] 0 2024-09-16T09:46:06.920 INFO:tasks.workunit.client.0.smithi111.stdout:8/143: dwrite d3/f8 [0,4194304] 0 2024-09-16T09:46:06.922 INFO:tasks.workunit.client.0.smithi111.stdout:8/144: mkdir d3/d26 0 2024-09-16T09:46:06.923 INFO:tasks.workunit.client.0.smithi111.stdout:8/145: rmdir d3/da 39 2024-09-16T09:46:06.923 INFO:tasks.workunit.client.0.smithi111.stdout:8/146: fsync d3/da/df/f25 0 2024-09-16T09:46:06.924 INFO:tasks.workunit.client.0.smithi111.stdout:8/147: stat d3/da/df/f1d 0 2024-09-16T09:46:06.924 INFO:tasks.workunit.client.0.smithi111.stdout:8/148: readlink d3/l9 0 2024-09-16T09:46:06.949 INFO:tasks.workunit.client.0.smithi111.stdout:8/149: write d3/de/f14 [297714,123136] 0 2024-09-16T09:46:06.949 INFO:tasks.workunit.client.0.smithi111.stdout:1/230: dwrite d3/d24/d3c/ff [0,4194304] 0 2024-09-16T09:46:06.950 INFO:tasks.workunit.client.0.smithi111.stdout:1/231: dread d3/d10/d23/f2b [0,4194304] 0 2024-09-16T09:46:06.950 INFO:tasks.workunit.client.0.smithi111.stdout:1/232: read - d3/d24/d3f/f4c zero size 2024-09-16T09:46:06.956 INFO:tasks.workunit.client.0.smithi111.stdout:8/150: unlink d3/da/c21 0 2024-09-16T09:46:06.959 INFO:tasks.workunit.client.0.smithi111.stdout:1/233: truncate d3/f27 1015948 0 2024-09-16T09:46:06.961 INFO:tasks.workunit.client.0.smithi111.stdout:8/151: mkdir d3/de/d1e/d27 0 2024-09-16T09:46:06.961 INFO:tasks.workunit.client.0.smithi111.stdout:8/152: write d3/da/df/f24 [852466,66646] 0 2024-09-16T09:46:06.965 INFO:tasks.workunit.client.0.smithi111.stdout:8/153: creat d3/de/d1e/d27/f28 x:0 0 0 2024-09-16T09:46:06.966 INFO:tasks.workunit.client.0.smithi111.stdout:3/199: sync 2024-09-16T09:46:06.966 INFO:tasks.workunit.client.0.smithi111.stdout:3/200: chown d5/d18/f36 1 1 2024-09-16T09:46:06.967 INFO:tasks.workunit.client.0.smithi111.stdout:8/154: mkdir d3/de/d29 0 2024-09-16T09:46:06.972 INFO:tasks.workunit.client.0.smithi111.stdout:3/201: rename d5/da/db/f2d to d5/d18/f3e 0 2024-09-16T09:46:06.972 INFO:tasks.workunit.client.0.smithi111.stdout:3/202: truncate d5/d18/f2e 705582 0 2024-09-16T09:46:06.976 INFO:tasks.workunit.client.0.smithi111.stdout:3/203: unlink d5/da/db/de/c19 0 2024-09-16T09:46:06.978 INFO:tasks.workunit.client.0.smithi111.stdout:3/204: rmdir d5 39 2024-09-16T09:46:06.979 INFO:tasks.workunit.client.0.smithi111.stdout:1/234: dwrite d3/d24/d3c/f35 [4194304,4194304] 0 2024-09-16T09:46:06.980 INFO:tasks.workunit.client.0.smithi111.stdout:1/235: write d3/d10/d1c/f1d [877572,107907] 0 2024-09-16T09:46:06.983 INFO:tasks.workunit.client.0.smithi111.stdout:1/236: creat d3/d10/d1c/f54 x:0 0 0 2024-09-16T09:46:06.985 INFO:tasks.workunit.client.0.smithi111.stdout:1/237: creat d3/d24/d3f/f55 x:0 0 0 2024-09-16T09:46:06.987 INFO:tasks.workunit.client.0.smithi111.stdout:8/155: dwrite d3/da/df/f25 [0,4194304] 0 2024-09-16T09:46:06.988 INFO:tasks.workunit.client.0.smithi111.stdout:1/238: unlink d3/fa 0 2024-09-16T09:46:06.989 INFO:tasks.workunit.client.0.smithi111.stdout:1/239: dread d3/d10/d23/f2b [0,4194304] 0 2024-09-16T09:46:06.991 INFO:tasks.workunit.client.0.smithi111.stdout:1/240: mkdir d3/d56 0 2024-09-16T09:46:06.992 INFO:tasks.workunit.client.0.smithi111.stdout:1/241: write d3/d24/d4e/f52 [177849,29422] 0 2024-09-16T09:46:07.002 INFO:tasks.workunit.client.0.smithi111.stdout:3/205: dwrite d5/d18/f3e [0,4194304] 0 2024-09-16T09:46:07.003 INFO:tasks.workunit.client.0.smithi111.stdout:8/156: write f1 [6199916,49696] 0 2024-09-16T09:46:07.003 INFO:tasks.workunit.client.0.smithi111.stdout:8/157: chown d3/f7 17197314 1 2024-09-16T09:46:07.005 INFO:tasks.workunit.client.0.smithi111.stdout:1/242: write d3/f6 [1559260,106998] 0 2024-09-16T09:46:07.005 INFO:tasks.workunit.client.0.smithi111.stdout:1/243: read - d3/d24/d3f/f4c zero size 2024-09-16T09:46:07.006 INFO:tasks.workunit.client.0.smithi111.stdout:3/206: mknod d5/c3f 0 2024-09-16T09:46:07.011 INFO:tasks.workunit.client.0.smithi111.stdout:3/207: dread d5/da/f11 [0,4194304] 0 2024-09-16T09:46:07.012 INFO:tasks.workunit.client.0.smithi111.stdout:3/208: chown d5/da/db/de/f28 11 1 2024-09-16T09:46:07.018 INFO:tasks.workunit.client.0.smithi111.stdout:8/158: symlink d3/de/d1e/d27/l2a 0 2024-09-16T09:46:07.018 INFO:tasks.workunit.client.0.smithi111.stdout:8/159: chown d3/de/c15 941802 1 2024-09-16T09:46:07.021 INFO:tasks.workunit.client.0.smithi111.stdout:1/244: mkdir d3/d10/d57 0 2024-09-16T09:46:07.021 INFO:tasks.workunit.client.0.smithi111.stdout:1/245: chown d3/d24/d3c 20867323 1 2024-09-16T09:46:07.021 INFO:tasks.workunit.client.0.smithi111.stdout:1/246: chown d3/d24/d3c/f1b 0 1 2024-09-16T09:46:07.025 INFO:tasks.workunit.client.0.smithi111.stdout:1/247: rename d3/d24/d3c/c2c to d3/d24/d3c/d28/d36/c58 0 2024-09-16T09:46:07.042 INFO:tasks.workunit.client.0.smithi111.stdout:3/209: dwrite d5/da/db/f14 [4194304,4194304] 0 2024-09-16T09:46:07.042 INFO:tasks.workunit.client.0.smithi111.stdout:1/248: dwrite d3/f3e [0,4194304] 0 2024-09-16T09:46:07.042 INFO:tasks.workunit.client.0.smithi111.stdout:3/210: write d5/da/db/f14 [468666,78346] 0 2024-09-16T09:46:07.045 INFO:tasks.workunit.client.0.smithi111.stdout:1/249: rename d3/d10/l43 to d3/d24/d29/l59 0 2024-09-16T09:46:07.046 INFO:tasks.workunit.client.0.smithi111.stdout:3/211: write d5/d18/f2e [323353,66187] 0 2024-09-16T09:46:07.047 INFO:tasks.workunit.client.0.smithi111.stdout:3/212: stat d5/l33 0 2024-09-16T09:46:07.049 INFO:tasks.workunit.client.0.smithi111.stdout:1/250: mkdir d3/d24/d3c/d28/d36/d3d/d47/d5a 0 2024-09-16T09:46:07.050 INFO:tasks.workunit.client.0.smithi111.stdout:3/213: write d5/d18/f29 [1043800,32358] 0 2024-09-16T09:46:07.053 INFO:tasks.workunit.client.0.smithi111.stdout:1/251: unlink d3/d24/d3c/f48 0 2024-09-16T09:46:07.054 INFO:tasks.workunit.client.0.smithi111.stdout:1/252: creat d3/d24/d4e/f5b x:0 0 0 2024-09-16T09:46:07.055 INFO:tasks.workunit.client.0.smithi111.stdout:3/214: dread d5/d18/f2e [0,4194304] 0 2024-09-16T09:46:07.056 INFO:tasks.workunit.client.0.smithi111.stdout:1/253: symlink d3/d24/d3c/d28/l5c 0 2024-09-16T09:46:07.058 INFO:tasks.workunit.client.0.smithi111.stdout:3/215: link d5/d18/c38 d5/da/db/de/c40 0 2024-09-16T09:46:07.059 INFO:tasks.workunit.client.0.smithi111.stdout:3/216: mkdir d5/da/db/d35/d41 0 2024-09-16T09:46:07.065 INFO:tasks.workunit.client.0.smithi111.stdout:1/254: dread d3/d24/d3c/f35 [0,4194304] 0 2024-09-16T09:46:07.066 INFO:tasks.workunit.client.0.smithi111.stdout:1/255: mknod d3/d24/d4e/c5d 0 2024-09-16T09:46:07.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/256: creat d3/d24/f5e x:0 0 0 2024-09-16T09:46:07.070 INFO:tasks.workunit.client.0.smithi111.stdout:1/257: truncate d3/d10/d1c/f1d 688144 0 2024-09-16T09:46:07.077 INFO:tasks.workunit.client.0.smithi111.stdout:1/258: dread d3/f27 [0,4194304] 0 2024-09-16T09:46:07.077 INFO:tasks.workunit.client.0.smithi111.stdout:3/217: dwrite d5/f22 [0,4194304] 0 2024-09-16T09:46:07.079 INFO:tasks.workunit.client.0.smithi111.stdout:1/259: symlink d3/d24/d3f/l5f 0 2024-09-16T09:46:07.079 INFO:tasks.workunit.client.0.smithi111.stdout:1/260: fdatasync d3/d24/d29/f37 0 2024-09-16T09:46:07.101 INFO:tasks.workunit.client.0.smithi111.stdout:3/218: dwrite d5/da/db/de/f27 [0,4194304] 0 2024-09-16T09:46:07.102 INFO:tasks.workunit.client.0.smithi111.stdout:1/261: dwrite d3/d24/d29/f37 [0,4194304] 0 2024-09-16T09:46:07.102 INFO:tasks.workunit.client.0.smithi111.stdout:1/262: truncate d3/d24/d3c/d28/d36/f3b 136772 0 2024-09-16T09:46:07.102 INFO:tasks.workunit.client.0.smithi111.stdout:1/263: fsync d3/d10/d1c/f25 0 2024-09-16T09:46:07.107 INFO:tasks.workunit.client.0.smithi111.stdout:4/257: sync 2024-09-16T09:46:07.114 INFO:tasks.workunit.client.0.smithi111.stdout:3/219: mkdir d5/da/d42 0 2024-09-16T09:46:07.116 INFO:tasks.workunit.client.0.smithi111.stdout:3/220: creat d5/da/db/d35/f43 x:0 0 0 2024-09-16T09:46:07.116 INFO:tasks.workunit.client.0.smithi111.stdout:1/264: write d3/d24/d29/f39 [1404154,23099] 0 2024-09-16T09:46:07.116 INFO:tasks.workunit.client.0.smithi111.stdout:1/265: readlink d3/d26/l3a 0 2024-09-16T09:46:07.119 INFO:tasks.workunit.client.0.smithi111.stdout:1/266: write d3/f27 [387200,54498] 0 2024-09-16T09:46:07.119 INFO:tasks.workunit.client.0.smithi111.stdout:3/221: creat d5/da/db/de/f44 x:0 0 0 2024-09-16T09:46:07.122 INFO:tasks.workunit.client.0.smithi111.stdout:1/267: mkdir d3/d24/d3c/d28/d36/d3d/d47/d5a/d60 0 2024-09-16T09:46:07.123 INFO:tasks.workunit.client.0.smithi111.stdout:3/222: mkdir d5/da/db/d35/d45 0 2024-09-16T09:46:07.125 INFO:tasks.workunit.client.0.smithi111.stdout:1/268: mknod d3/d24/d3c/d28/d36/d3d/d47/d5a/c61 0 2024-09-16T09:46:07.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/269: mkdir d3/d24/d62 0 2024-09-16T09:46:07.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/270: fdatasync d3/d24/d3c/f35 0 2024-09-16T09:46:07.129 INFO:tasks.workunit.client.0.smithi111.stdout:1/271: unlink d3/d10/d1c/f1d 0 2024-09-16T09:46:07.129 INFO:tasks.workunit.client.0.smithi111.stdout:1/272: write d3/d24/d4e/f52 [843465,5465] 0 2024-09-16T09:46:07.134 INFO:tasks.workunit.client.0.smithi111.stdout:4/258: dwrite d2/d6/f48 [0,4194304] 0 2024-09-16T09:46:07.136 INFO:tasks.workunit.client.0.smithi111.stdout:4/259: creat d2/d6/dd/d1b/d38/f4f x:0 0 0 2024-09-16T09:46:07.136 INFO:tasks.workunit.client.0.smithi111.stdout:4/260: truncate d2/d6/dd/d1b/f4c 971141 0 2024-09-16T09:46:07.138 INFO:tasks.workunit.client.0.smithi111.stdout:4/261: rename d2/d6/f3c to d2/d30/f50 0 2024-09-16T09:46:07.138 INFO:tasks.workunit.client.0.smithi111.stdout:4/262: fsync d2/d6/dd/d1c/f2c 0 2024-09-16T09:46:07.138 INFO:tasks.workunit.client.0.smithi111.stdout:4/263: write d2/d6/dd/f40 [4032574,71433] 0 2024-09-16T09:46:07.142 INFO:tasks.workunit.client.0.smithi111.stdout:4/264: dread d2/d6/dd/d1c/f2c [0,4194304] 0 2024-09-16T09:46:07.142 INFO:tasks.workunit.client.0.smithi111.stdout:3/223: dwrite d5/da/db/de/f44 [0,4194304] 0 2024-09-16T09:46:07.146 INFO:tasks.workunit.client.0.smithi111.stdout:4/265: dread d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:07.148 INFO:tasks.workunit.client.0.smithi111.stdout:1/273: dwrite d3/d24/d3c/d28/d36/f3b [0,4194304] 0 2024-09-16T09:46:07.148 INFO:tasks.workunit.client.0.smithi111.stdout:1/274: chown d3/d24/d4e/c5d 193829 1 2024-09-16T09:46:07.149 INFO:tasks.workunit.client.0.smithi111.stdout:3/224: creat d5/da/db/d35/d45/f46 x:0 0 0 2024-09-16T09:46:07.149 INFO:tasks.workunit.client.0.smithi111.stdout:3/225: chown d5/da/db/de/f44 4564 1 2024-09-16T09:46:07.149 INFO:tasks.workunit.client.0.smithi111.stdout:4/266: stat d2/d6/c21 0 2024-09-16T09:46:07.149 INFO:tasks.workunit.client.0.smithi111.stdout:4/267: chown d2/d6/dd/d1b/d38 10 1 2024-09-16T09:46:07.151 INFO:tasks.workunit.client.0.smithi111.stdout:1/275: rmdir d3/d24/d3c/d28 39 2024-09-16T09:46:07.157 INFO:tasks.workunit.client.0.smithi111.stdout:3/226: unlink d5/f22 0 2024-09-16T09:46:07.158 INFO:tasks.workunit.client.0.smithi111.stdout:4/268: unlink d2/d6/dd/d1b/f4c 0 2024-09-16T09:46:07.158 INFO:tasks.workunit.client.0.smithi111.stdout:4/269: fsync d2/d6/dd/f2a 0 2024-09-16T09:46:07.159 INFO:tasks.workunit.client.0.smithi111.stdout:3/227: link d5/da/db/de/l1e d5/da/db/d35/d41/l47 0 2024-09-16T09:46:07.160 INFO:tasks.workunit.client.0.smithi111.stdout:4/270: symlink d2/l51 0 2024-09-16T09:46:07.161 INFO:tasks.workunit.client.0.smithi111.stdout:3/228: creat d5/da/d42/f48 x:0 0 0 2024-09-16T09:46:07.164 INFO:tasks.workunit.client.0.smithi111.stdout:3/229: symlink d5/da/db/d35/l49 0 2024-09-16T09:46:07.164 INFO:tasks.workunit.client.0.smithi111.stdout:3/230: stat d5/da/db/de/l3b 0 2024-09-16T09:46:07.166 INFO:tasks.workunit.client.0.smithi111.stdout:3/231: link d5/d18/l20 d5/da/db/d3a/l4a 0 2024-09-16T09:46:07.167 INFO:tasks.workunit.client.0.smithi111.stdout:1/276: dwrite d3/d24/d3c/f35 [8388608,4194304] 0 2024-09-16T09:46:07.170 INFO:tasks.workunit.client.0.smithi111.stdout:3/232: creat d5/da/db/d35/d41/f4b x:0 0 0 2024-09-16T09:46:07.172 INFO:tasks.workunit.client.0.smithi111.stdout:1/277: mkdir d3/d26/d63 0 2024-09-16T09:46:07.173 INFO:tasks.workunit.client.0.smithi111.stdout:3/233: rmdir d5/da/d42 39 2024-09-16T09:46:07.173 INFO:tasks.workunit.client.0.smithi111.stdout:3/234: chown d5/da/d42/f48 509 1 2024-09-16T09:46:07.175 INFO:tasks.workunit.client.0.smithi111.stdout:3/235: mknod d5/da/db/d35/c4c 0 2024-09-16T09:46:07.175 INFO:tasks.workunit.client.0.smithi111.stdout:3/236: dread - d5/da/db/d35/f43 zero size 2024-09-16T09:46:07.177 INFO:tasks.workunit.client.0.smithi111.stdout:4/271: getdents d2/d6/dd/d1b 0 2024-09-16T09:46:07.179 INFO:tasks.workunit.client.0.smithi111.stdout:1/278: write d3/f3e [1633267,57463] 0 2024-09-16T09:46:07.179 INFO:tasks.workunit.client.0.smithi111.stdout:1/279: write d3/d24/d3c/f17 [3700508,15626] 0 2024-09-16T09:46:07.184 INFO:tasks.workunit.client.0.smithi111.stdout:3/237: write d5/da/db/de/f27 [973942,53369] 0 2024-09-16T09:46:07.184 INFO:tasks.workunit.client.0.smithi111.stdout:3/238: readlink d5/l2c 0 2024-09-16T09:46:07.185 INFO:tasks.workunit.client.0.smithi111.stdout:4/272: dread d2/fb [0,4194304] 0 2024-09-16T09:46:07.208 INFO:tasks.workunit.client.0.smithi111.stdout:1/280: dwrite d3/f27 [0,4194304] 0 2024-09-16T09:46:07.209 INFO:tasks.workunit.client.0.smithi111.stdout:3/239: dwrite d5/f8 [0,4194304] 0 2024-09-16T09:46:07.209 INFO:tasks.workunit.client.0.smithi111.stdout:4/273: dwrite d2/d30/d44/f47 [0,4194304] 0 2024-09-16T09:46:07.209 INFO:tasks.workunit.client.0.smithi111.stdout:4/274: write d2/d6/f3f [120012,82104] 0 2024-09-16T09:46:07.209 INFO:tasks.workunit.client.0.smithi111.stdout:1/281: rename d3/f12 to d3/d24/d3c/d28/d36/f64 0 2024-09-16T09:46:07.213 INFO:tasks.workunit.client.0.smithi111.stdout:4/275: symlink d2/d6/dd/d1b/l52 0 2024-09-16T09:46:07.214 INFO:tasks.workunit.client.0.smithi111.stdout:3/240: rename d5/l33 to d5/da/db/l4d 0 2024-09-16T09:46:07.214 INFO:tasks.workunit.client.0.smithi111.stdout:3/241: dread - d5/da/d42/f48 zero size 2024-09-16T09:46:07.217 INFO:tasks.workunit.client.0.smithi111.stdout:1/282: rmdir d3/d56 0 2024-09-16T09:46:07.217 INFO:tasks.workunit.client.0.smithi111.stdout:1/283: readlink d3/d10/l22 0 2024-09-16T09:46:07.220 INFO:tasks.workunit.client.0.smithi111.stdout:4/276: link d2/d6/c1a d2/d6/dd/c53 0 2024-09-16T09:46:07.225 INFO:tasks.workunit.client.0.smithi111.stdout:1/284: mkdir d3/d24/d3c/d28/d36/d3d/d47/d65 0 2024-09-16T09:46:07.240 INFO:tasks.workunit.client.0.smithi111.stdout:4/277: dwrite d2/fb [0,4194304] 0 2024-09-16T09:46:07.244 INFO:tasks.workunit.client.0.smithi111.stdout:3/242: rename d5/da/db/d35/d41/f4b to d5/da/d42/f4e 0 2024-09-16T09:46:07.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/243: dwrite d5/da/db/d35/d45/f46 [0,4194304] 0 2024-09-16T09:46:07.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/244: fsync d5/da/db/d35/f43 0 2024-09-16T09:46:07.331 INFO:tasks.workunit.client.0.smithi111.stdout:1/285: dwrite d3/d24/d3c/d28/d36/f3b [0,4194304] 0 2024-09-16T09:46:07.331 INFO:tasks.workunit.client.0.smithi111.stdout:4/278: dwrite d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:07.331 INFO:tasks.workunit.client.0.smithi111.stdout:3/245: dwrite d5/d18/f29 [0,4194304] 0 2024-09-16T09:46:07.332 INFO:tasks.workunit.client.0.smithi111.stdout:1/286: symlink d3/d26/d63/l66 0 2024-09-16T09:46:07.333 INFO:tasks.workunit.client.0.smithi111.stdout:4/279: truncate d2/f17 1169543 0 2024-09-16T09:46:07.338 INFO:tasks.workunit.client.0.smithi111.stdout:3/246: getdents d5/d18 0 2024-09-16T09:46:07.339 INFO:tasks.workunit.client.0.smithi111.stdout:1/287: mknod d3/d24/d3c/d28/d36/d3d/c67 0 2024-09-16T09:46:07.340 INFO:tasks.workunit.client.0.smithi111.stdout:3/247: creat d5/da/db/d35/f4f x:0 0 0 2024-09-16T09:46:07.343 INFO:tasks.workunit.client.0.smithi111.stdout:1/288: rename d3/f27 to d3/d10/d57/f68 0 2024-09-16T09:46:07.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/289: link d3/d10/d1c/c4f d3/d24/d3c/d28/d36/d3d/d47/d65/c69 0 2024-09-16T09:46:07.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/290: fsync d3/d26/f2d 0 2024-09-16T09:46:07.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/291: dread - d3/d24/d3f/f4c zero size 2024-09-16T09:46:07.345 INFO:tasks.workunit.client.0.smithi111.stdout:4/280: dread d2/fb [0,4194304] 0 2024-09-16T09:46:07.345 INFO:tasks.workunit.client.0.smithi111.stdout:3/248: dread d5/d18/f24 [0,4194304] 0 2024-09-16T09:46:07.346 INFO:tasks.workunit.client.0.smithi111.stdout:4/281: rmdir d2/d6/dd/d1b/d38/d3b 0 2024-09-16T09:46:07.350 INFO:tasks.workunit.client.0.smithi111.stdout:7/182: sync 2024-09-16T09:46:07.351 INFO:tasks.workunit.client.0.smithi111.stdout:9/156: sync 2024-09-16T09:46:07.353 INFO:tasks.workunit.client.0.smithi111.stdout:9/157: mknod d0/d21/d22/c32 0 2024-09-16T09:46:07.353 INFO:tasks.workunit.client.0.smithi111.stdout:1/292: dread d3/d26/f2d [0,4194304] 0 2024-09-16T09:46:07.353 INFO:tasks.workunit.client.0.smithi111.stdout:1/293: truncate d3/d24/d29/f37 4755517 0 2024-09-16T09:46:07.353 INFO:tasks.workunit.client.0.smithi111.stdout:1/294: write d3/d24/d29/f51 [807235,2726] 0 2024-09-16T09:46:07.357 INFO:tasks.workunit.client.0.smithi111.stdout:9/158: creat d0/d6/d8/f33 x:0 0 0 2024-09-16T09:46:07.357 INFO:tasks.workunit.client.0.smithi111.stdout:1/295: mknod d3/d10/d23/c6a 0 2024-09-16T09:46:07.358 INFO:tasks.workunit.client.0.smithi111.stdout:2/315: sync 2024-09-16T09:46:07.358 INFO:tasks.workunit.client.0.smithi111.stdout:0/270: sync 2024-09-16T09:46:07.358 INFO:tasks.workunit.client.0.smithi111.stdout:2/316: fsync d0/d29/f2b 0 2024-09-16T09:46:07.360 INFO:tasks.workunit.client.0.smithi111.stdout:9/159: getdents d0/d21 0 2024-09-16T09:46:07.360 INFO:tasks.workunit.client.0.smithi111.stdout:9/160: stat d0/d6 0 2024-09-16T09:46:07.360 INFO:tasks.workunit.client.0.smithi111.stdout:9/161: readlink d0/d6/l17 0 2024-09-16T09:46:07.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/296: mknod d3/d24/d3c/d28/c6b 0 2024-09-16T09:46:07.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/297: chown d3/d10/d57 7864 1 2024-09-16T09:46:07.362 INFO:tasks.workunit.client.0.smithi111.stdout:1/298: chown d3/f6 60623680 1 2024-09-16T09:46:07.362 INFO:tasks.workunit.client.0.smithi111.stdout:1/299: write d3/d24/d29/f51 [1053940,2968] 0 2024-09-16T09:46:07.364 INFO:tasks.workunit.client.0.smithi111.stdout:2/317: rename d0/da/c34 to d0/d2/d44/c6d 0 2024-09-16T09:46:07.365 INFO:tasks.workunit.client.0.smithi111.stdout:9/162: creat d0/d6/f34 x:0 0 0 2024-09-16T09:46:07.366 INFO:tasks.workunit.client.0.smithi111.stdout:1/300: dread d3/d24/d3c/fe [0,4194304] 0 2024-09-16T09:46:07.369 INFO:tasks.workunit.client.0.smithi111.stdout:9/163: rename d0/d21/d22/c32 to d0/d6/d30/c35 0 2024-09-16T09:46:07.370 INFO:tasks.workunit.client.0.smithi111.stdout:0/271: write d0/f12 [42809,27378] 0 2024-09-16T09:46:07.371 INFO:tasks.workunit.client.0.smithi111.stdout:0/272: rmdir d0/d1d 39 2024-09-16T09:46:07.373 INFO:tasks.workunit.client.0.smithi111.stdout:0/273: rename d0/d26/d36/d4a to d0/d1d/d58/d64 0 2024-09-16T09:46:07.380 INFO:tasks.workunit.client.0.smithi111.stdout:9/164: dread d0/f1e [0,4194304] 0 2024-09-16T09:46:07.385 INFO:tasks.workunit.client.0.smithi111.stdout:1/301: write d3/d24/d3c/d28/d36/f3b [2232964,59397] 0 2024-09-16T09:46:07.385 INFO:tasks.workunit.client.0.smithi111.stdout:1/302: chown d3/d26/f2d 473415 1 2024-09-16T09:46:07.385 INFO:tasks.workunit.client.0.smithi111.stdout:1/303: truncate d3/d10/f4d 454507 0 2024-09-16T09:46:07.385 INFO:tasks.workunit.client.0.smithi111.stdout:1/304: fsync d3/d24/d3c/f1b 0 2024-09-16T09:46:07.385 INFO:tasks.workunit.client.0.smithi111.stdout:1/305: fdatasync d3/f3e 0 2024-09-16T09:46:07.388 INFO:tasks.workunit.client.0.smithi111.stdout:1/306: rename d3/c4 to d3/d24/d3c/d28/c6c 0 2024-09-16T09:46:07.389 INFO:tasks.workunit.client.0.smithi111.stdout:1/307: unlink d3/d24/d3c/d28/d36/d3d/c53 0 2024-09-16T09:46:07.391 INFO:tasks.workunit.client.0.smithi111.stdout:1/308: mknod d3/d24/d3c/d28/d36/d3d/d47/d65/c6d 0 2024-09-16T09:46:07.393 INFO:tasks.workunit.client.0.smithi111.stdout:1/309: mknod d3/d26/d63/c6e 0 2024-09-16T09:46:07.394 INFO:tasks.workunit.client.0.smithi111.stdout:4/282: dwrite d2/d6/fe [4194304,4194304] 0 2024-09-16T09:46:07.394 INFO:tasks.workunit.client.0.smithi111.stdout:3/249: dwrite d5/f1a [0,4194304] 0 2024-09-16T09:46:07.394 INFO:tasks.workunit.client.0.smithi111.stdout:3/250: read d5/d18/f24 [2221144,53201] 0 2024-09-16T09:46:07.395 INFO:tasks.workunit.client.0.smithi111.stdout:1/310: mkdir d3/d24/d4e/d6f 0 2024-09-16T09:46:07.395 INFO:tasks.workunit.client.0.smithi111.stdout:1/311: read - d3/d24/d3f/f55 zero size 2024-09-16T09:46:07.398 INFO:tasks.workunit.client.0.smithi111.stdout:7/183: dwrite d1/d9/f34 [4194304,4194304] 0 2024-09-16T09:46:07.400 INFO:tasks.workunit.client.0.smithi111.stdout:2/318: dwrite d0/d22/f58 [0,4194304] 0 2024-09-16T09:46:07.400 INFO:tasks.workunit.client.0.smithi111.stdout:0/274: dwrite d0/f13 [0,4194304] 0 2024-09-16T09:46:07.414 INFO:tasks.workunit.client.0.smithi111.stdout:1/312: truncate d3/d10/f18 1760370 0 2024-09-16T09:46:07.418 INFO:tasks.workunit.client.0.smithi111.stdout:9/165: getdents d0/d6 0 2024-09-16T09:46:07.420 INFO:tasks.workunit.client.0.smithi111.stdout:3/251: dwrite d5/d18/f2a [0,4194304] 0 2024-09-16T09:46:07.421 INFO:tasks.workunit.client.0.smithi111.stdout:4/283: dwrite d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:07.429 INFO:tasks.workunit.client.0.smithi111.stdout:3/252: dread d5/d18/f24 [0,4194304] 0 2024-09-16T09:46:07.439 INFO:tasks.workunit.client.0.smithi111.stdout:4/284: dwrite d2/d6/f14 [0,4194304] 0 2024-09-16T09:46:07.439 INFO:tasks.workunit.client.0.smithi111.stdout:4/285: dread - d2/d6/dd/d1b/f29 zero size 2024-09-16T09:46:07.439 INFO:tasks.workunit.client.0.smithi111.stdout:2/319: rmdir d0/d2/d5a 39 2024-09-16T09:46:07.442 INFO:tasks.workunit.client.0.smithi111.stdout:9/166: creat d0/d6/d8/f36 x:0 0 0 2024-09-16T09:46:07.442 INFO:tasks.workunit.client.0.smithi111.stdout:9/167: readlink d0/d6/l1a 0 2024-09-16T09:46:07.444 INFO:tasks.workunit.client.0.smithi111.stdout:7/184: mkdir d1/d3e 0 2024-09-16T09:46:07.444 INFO:tasks.workunit.client.0.smithi111.stdout:7/185: fsync d1/d16/d27/f2b 0 2024-09-16T09:46:07.446 INFO:tasks.workunit.client.0.smithi111.stdout:7/186: dread d1/d9/f15 [0,4194304] 0 2024-09-16T09:46:07.446 INFO:tasks.workunit.client.0.smithi111.stdout:7/187: fdatasync d1/d9/f15 0 2024-09-16T09:46:07.450 INFO:tasks.workunit.client.0.smithi111.stdout:3/253: creat d5/f50 x:0 0 0 2024-09-16T09:46:07.452 INFO:tasks.workunit.client.0.smithi111.stdout:4/286: link d2/f8 d2/d6/dd/d1c/f54 0 2024-09-16T09:46:07.455 INFO:tasks.workunit.client.0.smithi111.stdout:2/320: mknod d0/d45/d5c/d67/c6e 0 2024-09-16T09:46:07.455 INFO:tasks.workunit.client.0.smithi111.stdout:2/321: chown d0/d21/l26 2530 1 2024-09-16T09:46:07.456 INFO:tasks.workunit.client.0.smithi111.stdout:2/322: write d0/d45/f65 [829459,123909] 0 2024-09-16T09:46:07.456 INFO:tasks.workunit.client.0.smithi111.stdout:2/323: read d0/d2/f2c [58494,121097] 0 2024-09-16T09:46:07.458 INFO:tasks.workunit.client.0.smithi111.stdout:9/168: mknod d0/d6/c37 0 2024-09-16T09:46:07.459 INFO:tasks.workunit.client.0.smithi111.stdout:7/188: truncate d1/f1a 91797 0 2024-09-16T09:46:07.461 INFO:tasks.workunit.client.0.smithi111.stdout:7/189: dread d1/f32 [0,4194304] 0 2024-09-16T09:46:07.463 INFO:tasks.workunit.client.0.smithi111.stdout:3/254: creat d5/da/db/de/f51 x:0 0 0 2024-09-16T09:46:07.464 INFO:tasks.workunit.client.0.smithi111.stdout:2/324: link d0/l38 d0/d29/l6f 0 2024-09-16T09:46:07.465 INFO:tasks.workunit.client.0.smithi111.stdout:0/275: truncate d0/f12 447118 0 2024-09-16T09:46:07.468 INFO:tasks.workunit.client.0.smithi111.stdout:7/190: mknod d1/d20/c3f 0 2024-09-16T09:46:07.468 INFO:tasks.workunit.client.0.smithi111.stdout:7/191: truncate d1/d16/f29 770011 0 2024-09-16T09:46:07.468 INFO:tasks.workunit.client.0.smithi111.stdout:7/192: dread - d1/d9/f3c zero size 2024-09-16T09:46:07.469 INFO:tasks.workunit.client.0.smithi111.stdout:6/211: sync 2024-09-16T09:46:07.469 INFO:tasks.workunit.client.0.smithi111.stdout:5/314: sync 2024-09-16T09:46:07.469 INFO:tasks.workunit.client.0.smithi111.stdout:8/160: sync 2024-09-16T09:46:07.470 INFO:tasks.workunit.client.0.smithi111.stdout:6/212: dread d0/df/f2d [0,4194304] 0 2024-09-16T09:46:07.474 INFO:tasks.workunit.client.0.smithi111.stdout:2/325: unlink d0/d22/f58 0 2024-09-16T09:46:07.474 INFO:tasks.workunit.client.0.smithi111.stdout:2/326: chown d0/d29/f2b 577 1 2024-09-16T09:46:07.476 INFO:tasks.workunit.client.0.smithi111.stdout:0/276: creat d0/d26/d36/f65 x:0 0 0 2024-09-16T09:46:07.477 INFO:tasks.workunit.client.0.smithi111.stdout:7/193: symlink d1/d16/d17/d18/d1d/l40 0 2024-09-16T09:46:07.478 INFO:tasks.workunit.client.0.smithi111.stdout:4/287: dwrite d2/d6/fe [4194304,4194304] 0 2024-09-16T09:46:07.478 INFO:tasks.workunit.client.0.smithi111.stdout:4/288: chown d2/d6/dd/l24 1823308 1 2024-09-16T09:46:07.478 INFO:tasks.workunit.client.0.smithi111.stdout:4/289: fdatasync d2/d6/f14 0 2024-09-16T09:46:07.479 INFO:tasks.workunit.client.0.smithi111.stdout:6/213: mknod d0/df/d14/d20/d23/d32/c44 0 2024-09-16T09:46:07.480 INFO:tasks.workunit.client.0.smithi111.stdout:6/214: chown d0/df/d14/c1c 38044866 1 2024-09-16T09:46:07.480 INFO:tasks.workunit.client.0.smithi111.stdout:3/255: symlink d5/da/l52 0 2024-09-16T09:46:07.482 INFO:tasks.workunit.client.0.smithi111.stdout:2/327: creat d0/d45/d5c/d67/f70 x:0 0 0 2024-09-16T09:46:07.485 INFO:tasks.workunit.client.0.smithi111.stdout:0/277: creat d0/d1d/d58/d64/d5e/f66 x:0 0 0 2024-09-16T09:46:07.487 INFO:tasks.workunit.client.0.smithi111.stdout:4/290: creat d2/d6/f55 x:0 0 0 2024-09-16T09:46:07.487 INFO:tasks.workunit.client.0.smithi111.stdout:4/291: chown d2/d6/dd/f40 270 1 2024-09-16T09:46:07.488 INFO:tasks.workunit.client.0.smithi111.stdout:6/215: rename d0/df/c18 to d0/df/d14/d20/c45 0 2024-09-16T09:46:07.489 INFO:tasks.workunit.client.0.smithi111.stdout:3/256: creat d5/da/db/d35/d41/f53 x:0 0 0 2024-09-16T09:46:07.491 INFO:tasks.workunit.client.0.smithi111.stdout:4/292: creat d2/f56 x:0 0 0 2024-09-16T09:46:07.492 INFO:tasks.workunit.client.0.smithi111.stdout:6/216: creat d0/f46 x:0 0 0 2024-09-16T09:46:07.493 INFO:tasks.workunit.client.0.smithi111.stdout:4/293: symlink d2/d6/dd/d1c/l57 0 2024-09-16T09:46:07.494 INFO:tasks.workunit.client.0.smithi111.stdout:6/217: mkdir d0/df/d47 0 2024-09-16T09:46:07.495 INFO:tasks.workunit.client.0.smithi111.stdout:6/218: write d0/df/d14/f31 [674918,5802] 0 2024-09-16T09:46:07.495 INFO:tasks.workunit.client.0.smithi111.stdout:6/219: readlink d0/l3d 0 2024-09-16T09:46:07.495 INFO:tasks.workunit.client.0.smithi111.stdout:6/220: getdents d0/df/d47 0 2024-09-16T09:46:07.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/194: write d1/d9/f34 [5465430,67253] 0 2024-09-16T09:46:07.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/195: write d1/d9/f35 [293419,103876] 0 2024-09-16T09:46:07.497 INFO:tasks.workunit.client.0.smithi111.stdout:9/169: dwrite d0/f1e [0,4194304] 0 2024-09-16T09:46:07.497 INFO:tasks.workunit.client.0.smithi111.stdout:9/170: read d0/f1e [6138508,71652] 0 2024-09-16T09:46:07.497 INFO:tasks.workunit.client.0.smithi111.stdout:7/196: rmdir d1/d16/d17/d18/d1d 39 2024-09-16T09:46:07.498 INFO:tasks.workunit.client.0.smithi111.stdout:7/197: write d1/d16/f29 [504238,20785] 0 2024-09-16T09:46:07.498 INFO:tasks.workunit.client.0.smithi111.stdout:7/198: write d1/f14 [1460449,36105] 0 2024-09-16T09:46:07.499 INFO:tasks.workunit.client.0.smithi111.stdout:9/171: mknod d0/d6/d8/c38 0 2024-09-16T09:46:07.508 INFO:tasks.workunit.client.0.smithi111.stdout:3/257: write d5/d18/f29 [1490849,76493] 0 2024-09-16T09:46:07.510 INFO:tasks.workunit.client.0.smithi111.stdout:7/199: dread d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:07.512 INFO:tasks.workunit.client.0.smithi111.stdout:4/294: write d2/f32 [3892091,114785] 0 2024-09-16T09:46:07.512 INFO:tasks.workunit.client.0.smithi111.stdout:4/295: chown d2/d6/dd/d1b/d38/c3d 14510 1 2024-09-16T09:46:07.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/200: mknod d1/d16/c41 0 2024-09-16T09:46:07.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/201: chown d1/d16/d17/d18/d1b/l3b 328204125 1 2024-09-16T09:46:07.515 INFO:tasks.workunit.client.0.smithi111.stdout:9/172: write d0/d6/f7 [391506,44066] 0 2024-09-16T09:46:07.517 INFO:tasks.workunit.client.0.smithi111.stdout:8/161: dwrite d3/f10 [0,4194304] 0 2024-09-16T09:46:07.517 INFO:tasks.workunit.client.0.smithi111.stdout:5/315: dwrite d19/d1b/d27/d2e/f53 [0,4194304] 0 2024-09-16T09:46:07.518 INFO:tasks.workunit.client.0.smithi111.stdout:9/173: creat d0/d6/d30/f39 x:0 0 0 2024-09-16T09:46:07.518 INFO:tasks.workunit.client.0.smithi111.stdout:9/174: chown d0/d6/d8/de/f11 221093 1 2024-09-16T09:46:07.518 INFO:tasks.workunit.client.0.smithi111.stdout:9/175: readlink d0/d18/l1b 0 2024-09-16T09:46:07.523 INFO:tasks.workunit.client.0.smithi111.stdout:5/316: creat d19/d1b/d1e/d21/d29/d32/d46/f78 x:0 0 0 2024-09-16T09:46:07.523 INFO:tasks.workunit.client.0.smithi111.stdout:5/317: truncate d19/d1b/d27/d25/f2b 4952004 0 2024-09-16T09:46:07.524 INFO:tasks.workunit.client.0.smithi111.stdout:2/328: dwrite d0/f4 [0,4194304] 0 2024-09-16T09:46:07.524 INFO:tasks.workunit.client.0.smithi111.stdout:2/329: getdents d0/d2/d61 0 2024-09-16T09:46:07.524 INFO:tasks.workunit.client.0.smithi111.stdout:0/278: dwrite d0/d26/d36/d3a/d3d/f46 [0,4194304] 0 2024-09-16T09:46:07.525 INFO:tasks.workunit.client.0.smithi111.stdout:5/318: rename d19/d1b/d1e/f59 to d19/d1b/d1e/d21/d29/d32/f79 0 2024-09-16T09:46:07.525 INFO:tasks.workunit.client.0.smithi111.stdout:5/319: chown d19/d1b/d27/d2e/d39/d54/d60/f64 22074 1 2024-09-16T09:46:07.534 INFO:tasks.workunit.client.0.smithi111.stdout:2/330: read d0/d29/f31 [8072552,114937] 0 2024-09-16T09:46:07.538 INFO:tasks.workunit.client.0.smithi111.stdout:0/279: rename d0/d26/d36 to d0/d1d/d67 0 2024-09-16T09:46:07.538 INFO:tasks.workunit.client.0.smithi111.stdout:0/280: readlink d0/l5 0 2024-09-16T09:46:07.539 INFO:tasks.workunit.client.0.smithi111.stdout:5/320: mknod d19/d1b/d1e/d21/d29/c7a 0 2024-09-16T09:46:07.539 INFO:tasks.workunit.client.0.smithi111.stdout:5/321: chown d19/d1b/d27/d25/f36 0 1 2024-09-16T09:46:07.542 INFO:tasks.workunit.client.0.smithi111.stdout:2/331: rename d0/d2/d5a/f66 to d0/d2/d59/f71 0 2024-09-16T09:46:07.542 INFO:tasks.workunit.client.0.smithi111.stdout:2/332: dread - d0/d21/f46 zero size 2024-09-16T09:46:07.543 INFO:tasks.workunit.client.0.smithi111.stdout:0/281: rename d0/d1d/d67/l37 to d0/d1d/d67/l68 0 2024-09-16T09:46:07.543 INFO:tasks.workunit.client.0.smithi111.stdout:0/282: fdatasync d0/f32 0 2024-09-16T09:46:07.545 INFO:tasks.workunit.client.0.smithi111.stdout:5/322: mknod d19/d1b/d27/d2e/d4a/d4b/c7b 0 2024-09-16T09:46:07.545 INFO:tasks.workunit.client.0.smithi111.stdout:5/323: chown d19/d1b 3 1 2024-09-16T09:46:07.545 INFO:tasks.workunit.client.0.smithi111.stdout:2/333: creat d0/d45/d5c/f72 x:0 0 0 2024-09-16T09:46:07.548 INFO:tasks.workunit.client.0.smithi111.stdout:0/283: symlink d0/d1d/d67/d3a/d3d/l69 0 2024-09-16T09:46:07.548 INFO:tasks.workunit.client.0.smithi111.stdout:0/284: chown d0/d1d/d58/d64/d4f/l5c 2 1 2024-09-16T09:46:07.548 INFO:tasks.workunit.client.0.smithi111.stdout:5/324: truncate d19/d1b/d27/d2e/f52 96155 0 2024-09-16T09:46:07.551 INFO:tasks.workunit.client.0.smithi111.stdout:2/334: unlink d0/d45/d5c/d67/d63/l69 0 2024-09-16T09:46:07.551 INFO:tasks.workunit.client.0.smithi111.stdout:2/335: chown d0/da/f5f 6568 1 2024-09-16T09:46:07.551 INFO:tasks.workunit.client.0.smithi111.stdout:2/336: write d0/d29/f42 [1029892,124981] 0 2024-09-16T09:46:07.551 INFO:tasks.workunit.client.0.smithi111.stdout:0/285: rmdir d0/d1d 39 2024-09-16T09:46:07.555 INFO:tasks.workunit.client.0.smithi111.stdout:5/325: rename d19/d1b/d27/d2e/f68 to d19/d1b/d27/d25/d2a/f7c 0 2024-09-16T09:46:07.556 INFO:tasks.workunit.client.0.smithi111.stdout:2/337: mknod d0/d21/c73 0 2024-09-16T09:46:07.556 INFO:tasks.workunit.client.0.smithi111.stdout:2/338: chown d0/d2/d5a 1685605736 1 2024-09-16T09:46:07.556 INFO:tasks.workunit.client.0.smithi111.stdout:2/339: fdatasync d0/d21/f46 0 2024-09-16T09:46:07.556 INFO:tasks.workunit.client.0.smithi111.stdout:2/340: fsync d0/d2/f39 0 2024-09-16T09:46:07.558 INFO:tasks.workunit.client.0.smithi111.stdout:2/341: creat d0/da/d4e/f74 x:0 0 0 2024-09-16T09:46:07.560 INFO:tasks.workunit.client.0.smithi111.stdout:2/342: rename d0/l49 to d0/d2/d5a/l75 0 2024-09-16T09:46:07.562 INFO:tasks.workunit.client.0.smithi111.stdout:2/343: symlink d0/d45/d5c/d67/d63/l76 0 2024-09-16T09:46:07.565 INFO:tasks.workunit.client.0.smithi111.stdout:2/344: unlink d0/d21/l54 0 2024-09-16T09:46:07.569 INFO:tasks.workunit.client.0.smithi111.stdout:2/345: truncate d0/f7 161923 0 2024-09-16T09:46:07.571 INFO:tasks.workunit.client.0.smithi111.stdout:2/346: creat d0/da/d4e/f77 x:0 0 0 2024-09-16T09:46:07.572 INFO:tasks.workunit.client.0.smithi111.stdout:6/221: dwrite d0/f12 [0,4194304] 0 2024-09-16T09:46:07.574 INFO:tasks.workunit.client.0.smithi111.stdout:2/347: symlink d0/d2/d59/l78 0 2024-09-16T09:46:07.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/222: unlink d0/df/c15 0 2024-09-16T09:46:07.580 INFO:tasks.workunit.client.0.smithi111.stdout:2/348: creat d0/d45/f79 x:0 0 0 2024-09-16T09:46:07.593 INFO:tasks.workunit.client.0.smithi111.stdout:0/286: read d0/d1d/d67/d54/f56 [2608257,84876] 0 2024-09-16T09:46:07.594 INFO:tasks.workunit.client.0.smithi111.stdout:6/223: mknod d0/df/d14/c48 0 2024-09-16T09:46:07.597 INFO:tasks.workunit.client.0.smithi111.stdout:0/287: creat d0/d1d/d67/d3a/d3d/d59/f6a x:0 0 0 2024-09-16T09:46:07.603 INFO:tasks.workunit.client.0.smithi111.stdout:7/202: stat d1/f1a 0 2024-09-16T09:46:07.607 INFO:tasks.workunit.client.0.smithi111.stdout:7/203: rename d1/d9/fe to d1/d20/f42 0 2024-09-16T09:46:07.609 INFO:tasks.workunit.client.0.smithi111.stdout:7/204: mkdir d1/d9/d43 0 2024-09-16T09:46:07.611 INFO:tasks.workunit.client.0.smithi111.stdout:7/205: getdents d1/d16/d17/d18/d1d 0 2024-09-16T09:46:07.612 INFO:tasks.workunit.client.0.smithi111.stdout:7/206: readlink d1/d9/l12 0 2024-09-16T09:46:07.612 INFO:tasks.workunit.client.0.smithi111.stdout:7/207: chown d1/d16/d17/d18/d1d/d2f/l33 22509 1 2024-09-16T09:46:07.623 INFO:tasks.workunit.client.0.smithi111.stdout:5/326: dwrite d19/f6b [0,4194304] 0 2024-09-16T09:46:07.623 INFO:tasks.workunit.client.0.smithi111.stdout:5/327: write d19/d1b/d27/d25/d2a/f71 [766736,115785] 0 2024-09-16T09:46:07.623 INFO:tasks.workunit.client.0.smithi111.stdout:5/328: fdatasync d19/d1b/d1e/d21/d29/d32/d46/f5b 0 2024-09-16T09:46:07.625 INFO:tasks.workunit.client.0.smithi111.stdout:5/329: mkdir d19/d1b/d1e/d21/d29/d32/d46/d7d 0 2024-09-16T09:46:07.625 INFO:tasks.workunit.client.0.smithi111.stdout:5/330: chown d19/d1b/d1e/f50 84 1 2024-09-16T09:46:07.625 INFO:tasks.workunit.client.0.smithi111.stdout:7/208: write d1/f26 [2959392,37557] 0 2024-09-16T09:46:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:4/296: dwrite d2/d6/dd/f2a [0,4194304] 0 2024-09-16T09:46:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:4/297: fsync d2/d6/dd/f16 0 2024-09-16T09:46:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:7/209: write d1/d9/fa [2701243,70406] 0 2024-09-16T09:46:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:7/210: chown d1/d16/d27/f2b 184551 1 2024-09-16T09:46:07.626 INFO:tasks.workunit.client.0.smithi111.stdout:5/331: creat d19/d1b/d27/d2e/d39/d6c/f7e x:0 0 0 2024-09-16T09:46:07.628 INFO:tasks.workunit.client.0.smithi111.stdout:4/298: creat d2/d6/dd/d1c/d2f/f58 x:0 0 0 2024-09-16T09:46:07.630 INFO:tasks.workunit.client.0.smithi111.stdout:5/332: unlink fe 0 2024-09-16T09:46:07.630 INFO:tasks.workunit.client.0.smithi111.stdout:4/299: rmdir d2/d6/dd/d1b 39 2024-09-16T09:46:07.632 INFO:tasks.workunit.client.0.smithi111.stdout:4/300: creat d2/d6/dd/d1c/d2f/d4e/f59 x:0 0 0 2024-09-16T09:46:07.633 INFO:tasks.workunit.client.0.smithi111.stdout:4/301: rmdir d2/d6 39 2024-09-16T09:46:07.660 INFO:tasks.workunit.client.0.smithi111.stdout:6/224: truncate d0/f12 1209249 0 2024-09-16T09:46:07.660 INFO:tasks.workunit.client.0.smithi111.stdout:6/225: chown d0/df 45 1 2024-09-16T09:46:07.668 INFO:tasks.workunit.client.0.smithi111.stdout:3/258: dwrite d5/da/db/f14 [4194304,4194304] 0 2024-09-16T09:46:07.668 INFO:tasks.workunit.client.0.smithi111.stdout:9/176: dwrite d0/d6/d8/f33 [0,4194304] 0 2024-09-16T09:46:07.670 INFO:tasks.workunit.client.0.smithi111.stdout:0/288: dwrite d0/d26/f2c [0,4194304] 0 2024-09-16T09:46:07.670 INFO:tasks.workunit.client.0.smithi111.stdout:0/289: truncate d0/d1d/d67/d3a/d3d/d59/f6a 871746 0 2024-09-16T09:46:07.673 INFO:tasks.workunit.client.0.smithi111.stdout:0/290: dread d0/f32 [0,4194304] 0 2024-09-16T09:46:07.673 INFO:tasks.workunit.client.0.smithi111.stdout:6/226: dread d0/df/d14/f37 [0,4194304] 0 2024-09-16T09:46:07.673 INFO:tasks.workunit.client.0.smithi111.stdout:6/227: dread - d0/df/d14/d20/d23/d33/f34 zero size 2024-09-16T09:46:07.675 INFO:tasks.workunit.client.0.smithi111.stdout:0/291: mknod d0/d26/c6b 0 2024-09-16T09:46:07.675 INFO:tasks.workunit.client.0.smithi111.stdout:5/333: dwrite d19/d1b/d27/d2e/d39/d54/d60/f64 [0,4194304] 0 2024-09-16T09:46:07.675 INFO:tasks.workunit.client.0.smithi111.stdout:4/302: dwrite d2/d6/dd/d1c/d2f/f46 [0,4194304] 0 2024-09-16T09:46:07.675 INFO:tasks.workunit.client.0.smithi111.stdout:4/303: getdents d2/d30/d44 0 2024-09-16T09:46:07.676 INFO:tasks.workunit.client.0.smithi111.stdout:6/228: mkdir d0/df/d49 0 2024-09-16T09:46:07.676 INFO:tasks.workunit.client.0.smithi111.stdout:6/229: write d0/f19 [416215,33700] 0 2024-09-16T09:46:07.679 INFO:tasks.workunit.client.0.smithi111.stdout:0/292: rename d0/d26/c6b to d0/d1d/d58/d64/c6c 0 2024-09-16T09:46:07.680 INFO:tasks.workunit.client.0.smithi111.stdout:5/334: mknod d19/d1b/d1e/d21/d29/d32/d46/d7d/c7f 0 2024-09-16T09:46:07.681 INFO:tasks.workunit.client.0.smithi111.stdout:5/335: read d19/d1b/d27/d2e/d4a/f4c [253537,66698] 0 2024-09-16T09:46:07.681 INFO:tasks.workunit.client.0.smithi111.stdout:5/336: write d19/d1b/d27/d2e/f52 [1060786,94735] 0 2024-09-16T09:46:07.682 INFO:tasks.workunit.client.0.smithi111.stdout:4/304: symlink d2/d6/dd/d1c/l5a 0 2024-09-16T09:46:07.685 INFO:tasks.workunit.client.0.smithi111.stdout:6/230: rename d0/fd to d0/df/f4a 0 2024-09-16T09:46:07.686 INFO:tasks.workunit.client.0.smithi111.stdout:0/293: creat d0/d1d/d67/d54/f6d x:0 0 0 2024-09-16T09:46:07.688 INFO:tasks.workunit.client.0.smithi111.stdout:6/231: unlink d0/df/d14/d20/l24 0 2024-09-16T09:46:07.690 INFO:tasks.workunit.client.0.smithi111.stdout:0/294: unlink d0/d1d/d58/d64/d5e/f66 0 2024-09-16T09:46:07.691 INFO:tasks.workunit.client.0.smithi111.stdout:5/337: read d19/d1b/d27/f3b [1983569,107013] 0 2024-09-16T09:46:07.692 INFO:tasks.workunit.client.0.smithi111.stdout:0/295: getdents d0/d1d/d67 0 2024-09-16T09:46:07.693 INFO:tasks.workunit.client.0.smithi111.stdout:5/338: creat d19/d1b/d27/d25/d2a/f80 x:0 0 0 2024-09-16T09:46:07.697 INFO:tasks.workunit.client.0.smithi111.stdout:0/296: creat d0/f6e x:0 0 0 2024-09-16T09:46:07.704 INFO:tasks.workunit.client.0.smithi111.stdout:4/305: dwrite d2/fb [0,4194304] 0 2024-09-16T09:46:07.709 INFO:tasks.workunit.client.0.smithi111.stdout:5/339: read d19/d1b/d1e/f40 [1226441,9467] 0 2024-09-16T09:46:07.710 INFO:tasks.workunit.client.0.smithi111.stdout:5/340: chown d19/d1b/d27/d25/f2b 1768 1 2024-09-16T09:46:07.710 INFO:tasks.workunit.client.0.smithi111.stdout:4/306: dread d2/f17 [0,4194304] 0 2024-09-16T09:46:07.711 INFO:tasks.workunit.client.0.smithi111.stdout:0/297: write d0/f13 [1201476,110730] 0 2024-09-16T09:46:07.715 INFO:tasks.workunit.client.0.smithi111.stdout:5/341: mkdir d19/d1b/d1e/d81 0 2024-09-16T09:46:07.715 INFO:tasks.workunit.client.0.smithi111.stdout:5/342: dread - d19/d1b/d1e/f50 zero size 2024-09-16T09:46:07.715 INFO:tasks.workunit.client.0.smithi111.stdout:5/343: chown l6 1 1 2024-09-16T09:46:07.716 INFO:tasks.workunit.client.0.smithi111.stdout:4/307: rename d2/c4b to d2/d6/dd/d1b/c5b 0 2024-09-16T09:46:07.719 INFO:tasks.workunit.client.0.smithi111.stdout:4/308: symlink d2/d6/dd/d1c/d2f/l5c 0 2024-09-16T09:46:07.719 INFO:tasks.workunit.client.0.smithi111.stdout:4/309: fsync d2/f1f 0 2024-09-16T09:46:07.728 INFO:tasks.workunit.client.0.smithi111.stdout:5/344: dread d19/d1b/d27/d2e/f53 [0,4194304] 0 2024-09-16T09:46:07.729 INFO:tasks.workunit.client.0.smithi111.stdout:5/345: creat d19/d1b/f82 x:0 0 0 2024-09-16T09:46:07.729 INFO:tasks.workunit.client.0.smithi111.stdout:5/346: chown d19/d1b/d1e/d21/d29/l3a 178419543 1 2024-09-16T09:46:07.733 INFO:tasks.workunit.client.0.smithi111.stdout:0/298: dwrite d0/f17 [4194304,4194304] 0 2024-09-16T09:46:07.740 INFO:tasks.workunit.client.0.smithi111.stdout:4/310: dwrite d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:07.740 INFO:tasks.workunit.client.0.smithi111.stdout:4/311: write d2/d6/dd/d1b/d38/f4f [576858,34230] 0 2024-09-16T09:46:07.740 INFO:tasks.workunit.client.0.smithi111.stdout:4/312: fdatasync d2/d6/f20 0 2024-09-16T09:46:07.741 INFO:tasks.workunit.client.0.smithi111.stdout:4/313: stat d2/d6/dd/c11 0 2024-09-16T09:46:07.759 INFO:tasks.workunit.client.0.smithi111.stdout:0/299: dwrite d0/d1d/f3c [4194304,4194304] 0 2024-09-16T09:46:07.759 INFO:tasks.workunit.client.0.smithi111.stdout:0/300: fdatasync d0/d1d/d67/d54/f6d 0 2024-09-16T09:46:07.763 INFO:tasks.workunit.client.0.smithi111.stdout:0/301: creat d0/d1d/d67/d3a/f6f x:0 0 0 2024-09-16T09:46:07.766 INFO:tasks.workunit.client.0.smithi111.stdout:0/302: mknod d0/d26/d4b/c70 0 2024-09-16T09:46:07.766 INFO:tasks.workunit.client.0.smithi111.stdout:0/303: truncate d0/f11 4470296 0 2024-09-16T09:46:07.767 INFO:tasks.workunit.client.0.smithi111.stdout:7/211: dwrite d1/f1a [0,4194304] 0 2024-09-16T09:46:07.769 INFO:tasks.workunit.client.0.smithi111.stdout:0/304: creat d0/d1d/d67/d3a/d3d/f71 x:0 0 0 2024-09-16T09:46:07.778 INFO:tasks.workunit.client.0.smithi111.stdout:7/212: mknod d1/d20/c44 0 2024-09-16T09:46:07.778 INFO:tasks.workunit.client.0.smithi111.stdout:7/213: getdents d1/d9/d43 0 2024-09-16T09:46:07.780 INFO:tasks.workunit.client.0.smithi111.stdout:7/214: dread d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:07.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/305: creat d0/d1d/d67/d3a/f72 x:0 0 0 2024-09-16T09:46:07.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/306: fsync d0/d1d/d67/d54/f56 0 2024-09-16T09:46:07.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/215: creat d1/d16/d27/f45 x:0 0 0 2024-09-16T09:46:07.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/216: fdatasync d1/d16/f1c 0 2024-09-16T09:46:07.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/217: write d1/d16/d17/d18/d1d/f24 [4539128,118428] 0 2024-09-16T09:46:07.791 INFO:tasks.workunit.client.0.smithi111.stdout:7/218: write d1/f14 [3551060,34036] 0 2024-09-16T09:46:07.792 INFO:tasks.workunit.client.0.smithi111.stdout:0/307: mknod d0/d1d/d67/d54/c73 0 2024-09-16T09:46:07.796 INFO:tasks.workunit.client.0.smithi111.stdout:7/219: link d1/d16/d17/d18/d1d/d2f/c39 d1/d16/d17/d18/d1d/d2f/c46 0 2024-09-16T09:46:07.799 INFO:tasks.workunit.client.0.smithi111.stdout:9/177: truncate d0/d6/d8/f33 2376223 0 2024-09-16T09:46:07.802 INFO:tasks.workunit.client.0.smithi111.stdout:0/308: symlink d0/d26/d4b/l74 0 2024-09-16T09:46:07.802 INFO:tasks.workunit.client.0.smithi111.stdout:0/309: truncate d0/d1d/f62 222508 0 2024-09-16T09:46:07.803 INFO:tasks.workunit.client.0.smithi111.stdout:7/220: symlink d1/d9/l47 0 2024-09-16T09:46:07.809 INFO:tasks.workunit.client.0.smithi111.stdout:9/178: getdents d0/d6/d8 0 2024-09-16T09:46:07.810 INFO:tasks.workunit.client.0.smithi111.stdout:9/179: write d0/d6/f34 [616422,84526] 0 2024-09-16T09:46:07.820 INFO:tasks.workunit.client.0.smithi111.stdout:5/347: rename d19/d1b/d27/d25 to d19/d1b/d27/d83 0 2024-09-16T09:46:07.826 INFO:tasks.workunit.client.0.smithi111.stdout:9/180: dread d0/d6/f34 [0,4194304] 0 2024-09-16T09:46:07.830 INFO:tasks.workunit.client.0.smithi111.stdout:0/310: dwrite d0/f31 [0,4194304] 0 2024-09-16T09:46:07.830 INFO:tasks.workunit.client.0.smithi111.stdout:0/311: stat d0/d1d/d67/d54/f56 0 2024-09-16T09:46:07.831 INFO:tasks.workunit.client.0.smithi111.stdout:0/312: fsync d0/d1d/d67/f43 0 2024-09-16T09:46:07.831 INFO:tasks.workunit.client.0.smithi111.stdout:9/181: mknod d0/d6/d8/c3a 0 2024-09-16T09:46:07.839 INFO:tasks.workunit.client.0.smithi111.stdout:9/182: link d0/d6/d8/de/cf d0/d6/d30/c3b 0 2024-09-16T09:46:07.854 INFO:tasks.workunit.client.0.smithi111.stdout:4/314: truncate d2/d6/f14 75247 0 2024-09-16T09:46:07.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/313: dwrite d0/f42 [0,4194304] 0 2024-09-16T09:46:07.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/314: truncate d0/f6e 469335 0 2024-09-16T09:46:07.856 INFO:tasks.workunit.client.0.smithi111.stdout:4/315: creat d2/d6/dd/d1b/f5d x:0 0 0 2024-09-16T09:46:07.856 INFO:tasks.workunit.client.0.smithi111.stdout:4/316: chown d2/f1f 2568173 1 2024-09-16T09:46:07.856 INFO:tasks.workunit.client.0.smithi111.stdout:5/348: dwrite d19/d1b/d1e/d21/d29/d32/f79 [0,4194304] 0 2024-09-16T09:46:07.856 INFO:tasks.workunit.client.0.smithi111.stdout:5/349: truncate d19/d1b/d1e/f76 602707 0 2024-09-16T09:46:07.859 INFO:tasks.workunit.client.0.smithi111.stdout:4/317: symlink d2/d6/dd/d1c/l5e 0 2024-09-16T09:46:07.866 INFO:tasks.workunit.client.0.smithi111.stdout:5/350: truncate d19/d1b/d27/f3b 1103056 0 2024-09-16T09:46:07.866 INFO:tasks.workunit.client.0.smithi111.stdout:5/351: readlink d19/l47 0 2024-09-16T09:46:07.868 INFO:tasks.workunit.client.0.smithi111.stdout:4/318: creat d2/d6/dd/d1c/f5f x:0 0 0 2024-09-16T09:46:07.870 INFO:tasks.workunit.client.0.smithi111.stdout:5/352: getdents d19/d1b/d1e/d21/d29 0 2024-09-16T09:46:07.871 INFO:tasks.workunit.client.0.smithi111.stdout:4/319: mknod d2/d30/d44/c60 0 2024-09-16T09:46:07.873 INFO:tasks.workunit.client.0.smithi111.stdout:5/353: write d19/d1b/d1e/d21/d29/d32/d46/f5b [1440976,46424] 0 2024-09-16T09:46:07.873 INFO:tasks.workunit.client.0.smithi111.stdout:5/354: truncate d19/d1b/d1e/d21/d29/d32/f74 13565 0 2024-09-16T09:46:07.879 INFO:tasks.workunit.client.0.smithi111.stdout:5/355: dread fc [4194304,4194304] 0 2024-09-16T09:46:07.885 INFO:tasks.workunit.client.0.smithi111.stdout:5/356: dread d19/d1b/d27/d2e/d39/f62 [0,4194304] 0 2024-09-16T09:46:07.887 INFO:tasks.workunit.client.0.smithi111.stdout:9/183: rename d0/d6/d8/f33 to d0/d6/f3c 0 2024-09-16T09:46:07.887 INFO:tasks.workunit.client.0.smithi111.stdout:9/184: chown d0/f2a 53 1 2024-09-16T09:46:07.887 INFO:tasks.workunit.client.0.smithi111.stdout:9/185: chown d0/d6/d8/de/f2f 3684 1 2024-09-16T09:46:07.888 INFO:tasks.workunit.client.0.smithi111.stdout:9/186: chown d0/d18/c1f 19854 1 2024-09-16T09:46:07.889 INFO:tasks.workunit.client.0.smithi111.stdout:5/357: creat d19/d1b/d27/d83/d2a/f84 x:0 0 0 2024-09-16T09:46:07.889 INFO:tasks.workunit.client.0.smithi111.stdout:5/358: stat d19/d1b/d27 0 2024-09-16T09:46:07.889 INFO:tasks.workunit.client.0.smithi111.stdout:5/359: truncate d19/d1b/d27/d2e/d39/f62 4683366 0 2024-09-16T09:46:07.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/315: rename d0/f15 to d0/d1d/d58/d64/d4f/f75 0 2024-09-16T09:46:07.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/316: write d0/d1d/d67/d3a/d3d/f71 [419535,119317] 0 2024-09-16T09:46:07.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/317: dread - d0/f55 zero size 2024-09-16T09:46:07.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/318: write d0/d1d/d67/d3a/f63 [725943,109121] 0 2024-09-16T09:46:07.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/319: chown d0/d1d/d67/f65 376599351 1 2024-09-16T09:46:07.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/360: rmdir d19/d1b/d1e/d21/d29/d32/d46 39 2024-09-16T09:46:07.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/361: read fc [8213764,116278] 0 2024-09-16T09:46:07.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/362: dread - d19/d1b/d1e/d21/d29/d32/d46/f78 zero size 2024-09-16T09:46:07.894 INFO:tasks.workunit.client.0.smithi111.stdout:4/320: rename d2/d6/dd/d1b/f2b to d2/d30/f61 0 2024-09-16T09:46:07.894 INFO:tasks.workunit.client.0.smithi111.stdout:4/321: chown d2/d6/c10 5905768 1 2024-09-16T09:46:07.894 INFO:tasks.workunit.client.0.smithi111.stdout:4/322: dread - d2/d6/f55 zero size 2024-09-16T09:46:07.896 INFO:tasks.workunit.client.0.smithi111.stdout:0/320: creat d0/d26/d35/f76 x:0 0 0 2024-09-16T09:46:07.896 INFO:tasks.workunit.client.0.smithi111.stdout:0/321: fdatasync d0/f13 0 2024-09-16T09:46:07.897 INFO:tasks.workunit.client.0.smithi111.stdout:5/363: creat d19/d1b/d1e/f85 x:0 0 0 2024-09-16T09:46:07.899 INFO:tasks.workunit.client.0.smithi111.stdout:4/323: rmdir d2/d6/dd/d1c/d2f 39 2024-09-16T09:46:07.899 INFO:tasks.workunit.client.0.smithi111.stdout:4/324: dread - d2/f56 zero size 2024-09-16T09:46:07.899 INFO:tasks.workunit.client.0.smithi111.stdout:4/325: chown d2/c9 52304006 1 2024-09-16T09:46:07.899 INFO:tasks.workunit.client.0.smithi111.stdout:4/326: truncate d2/f17 1261131 0 2024-09-16T09:46:07.899 INFO:tasks.workunit.client.0.smithi111.stdout:5/364: creat d19/d1b/d27/d2e/d39/d54/d60/f86 x:0 0 0 2024-09-16T09:46:07.900 INFO:tasks.workunit.client.0.smithi111.stdout:4/327: unlink d2/f1f 0 2024-09-16T09:46:07.901 INFO:tasks.workunit.client.0.smithi111.stdout:5/365: mkdir d19/d1b/d1e/d21/d29/d32/d46/d7d/d87 0 2024-09-16T09:46:07.902 INFO:tasks.workunit.client.0.smithi111.stdout:5/366: mknod d19/d1b/d27/d2e/d39/d54/d60/c88 0 2024-09-16T09:46:07.903 INFO:tasks.workunit.client.0.smithi111.stdout:5/367: symlink d19/d1b/d1e/d21/d29/d32/d46/d7d/l89 0 2024-09-16T09:46:07.903 INFO:tasks.workunit.client.0.smithi111.stdout:5/368: chown d19/d1b/d27/d83/f63 931912 1 2024-09-16T09:46:07.903 INFO:tasks.workunit.client.0.smithi111.stdout:5/369: stat d19/d1b/d27/f37 0 2024-09-16T09:46:07.904 INFO:tasks.workunit.client.0.smithi111.stdout:5/370: rmdir d19/d1b/d27/d2e/d39/d54/d60 39 2024-09-16T09:46:07.904 INFO:tasks.workunit.client.0.smithi111.stdout:5/371: fdatasync fd 0 2024-09-16T09:46:07.904 INFO:tasks.workunit.client.0.smithi111.stdout:5/372: fsync d19/d1b/d27/d83/f3f 0 2024-09-16T09:46:07.904 INFO:tasks.workunit.client.0.smithi111.stdout:5/373: chown d19/d1b/d27/d83/d2a/f80 6070 1 2024-09-16T09:46:07.959 INFO:tasks.workunit.client.0.smithi111.stdout:5/374: write d19/d1b/d27/d83/f3f [3517183,113531] 0 2024-09-16T09:46:07.961 INFO:tasks.workunit.client.0.smithi111.stdout:4/328: dread d2/d30/d44/f47 [0,4194304] 0 2024-09-16T09:46:07.961 INFO:tasks.workunit.client.0.smithi111.stdout:4/329: stat d2/d6/dd/d1b/d38/f4f 0 2024-09-16T09:46:07.963 INFO:tasks.workunit.client.0.smithi111.stdout:0/322: dread d0/d1d/d67/f41 [0,4194304] 0 2024-09-16T09:46:07.968 INFO:tasks.workunit.client.0.smithi111.stdout:5/375: mkdir d19/d1b/d27/d8a 0 2024-09-16T09:46:07.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/323: mkdir d0/d1d/d67/d3a/d77 0 2024-09-16T09:46:07.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/324: write d0/d1d/d67/d3a/f72 [459766,30280] 0 2024-09-16T09:46:07.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/325: fsync d0/d1d/d67/d3a/d3d/f48 0 2024-09-16T09:46:07.973 INFO:tasks.workunit.client.0.smithi111.stdout:5/376: rmdir d19/d1b/d1e/d21/d29/d32/d46/d7d/d87 0 2024-09-16T09:46:07.978 INFO:tasks.workunit.client.0.smithi111.stdout:5/377: truncate fd 2210142 0 2024-09-16T09:46:07.981 INFO:tasks.workunit.client.0.smithi111.stdout:5/378: getdents d19/d1b/d1e 0 2024-09-16T09:46:07.981 INFO:tasks.workunit.client.0.smithi111.stdout:5/379: readlink d19/d1b/d1e/d21/d29/l3a 0 2024-09-16T09:46:07.981 INFO:tasks.workunit.client.0.smithi111.stdout:5/380: write f7 [2895648,40485] 0 2024-09-16T09:46:07.981 INFO:tasks.workunit.client.0.smithi111.stdout:5/381: readlink d19/d1b/d1e/d41/l4f 0 2024-09-16T09:46:08.001 INFO:tasks.workunit.client.0.smithi111.stdout:1/313: sync 2024-09-16T09:46:08.001 INFO:tasks.workunit.client.0.smithi111.stdout:8/162: sync 2024-09-16T09:46:08.017 INFO:tasks.workunit.client.0.smithi111.stdout:1/314: dwrite d3/d24/d3c/ff [0,4194304] 0 2024-09-16T09:46:08.020 INFO:tasks.workunit.client.0.smithi111.stdout:1/315: mkdir d3/d10/d23/d70 0 2024-09-16T09:46:08.028 INFO:tasks.workunit.client.0.smithi111.stdout:1/316: dread d3/f1a [0,4194304] 0 2024-09-16T09:46:08.039 INFO:tasks.workunit.client.0.smithi111.stdout:5/382: dwrite d19/d1b/d1e/d21/d29/f56 [0,4194304] 0 2024-09-16T09:46:08.047 INFO:tasks.workunit.client.0.smithi111.stdout:1/317: dwrite d3/d24/d4e/f52 [0,4194304] 0 2024-09-16T09:46:08.048 INFO:tasks.workunit.client.0.smithi111.stdout:1/318: readlink d3/d26/d63/l66 0 2024-09-16T09:46:08.054 INFO:tasks.workunit.client.0.smithi111.stdout:1/319: write d3/f14 [1260714,98512] 0 2024-09-16T09:46:08.056 INFO:tasks.workunit.client.0.smithi111.stdout:1/320: creat d3/d24/d3f/f71 x:0 0 0 2024-09-16T09:46:08.056 INFO:tasks.workunit.client.0.smithi111.stdout:1/321: write d3/d24/f5e [424685,129508] 0 2024-09-16T09:46:08.057 INFO:tasks.workunit.client.0.smithi111.stdout:5/383: dwrite d19/d1b/d27/d2e/f52 [0,4194304] 0 2024-09-16T09:46:08.063 INFO:tasks.workunit.client.0.smithi111.stdout:5/384: getdents d19/d1b/d1e/d21/d29/d32/d46/d7d 0 2024-09-16T09:46:08.066 INFO:tasks.workunit.client.0.smithi111.stdout:5/385: symlink d19/d1b/d27/d2e/d39/d6c/l8b 0 2024-09-16T09:46:08.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/386: creat d19/d1b/d27/d2e/d4a/f8c x:0 0 0 2024-09-16T09:46:08.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/387: write d19/d1b/d1e/d21/d29/d32/f51 [159781,88332] 0 2024-09-16T09:46:08.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/388: getdents d19/d1b/d1e/d21/d29 0 2024-09-16T09:46:08.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/389: write d19/d1b/f82 [313777,40522] 0 2024-09-16T09:46:08.071 INFO:tasks.workunit.client.0.smithi111.stdout:5/390: creat d19/d1b/d27/d83/d2a/f8d x:0 0 0 2024-09-16T09:46:08.071 INFO:tasks.workunit.client.0.smithi111.stdout:5/391: readlink d19/d1b/d1e/l2c 0 2024-09-16T09:46:08.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/392: dread d19/d1b/d27/d2e/d39/d54/d60/f64 [0,4194304] 0 2024-09-16T09:46:08.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/393: chown d19/d1b/d1e/f76 43277248 1 2024-09-16T09:46:08.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/394: chown d19/d1b/d1e/f55 4 1 2024-09-16T09:46:08.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/395: fdatasync f7 0 2024-09-16T09:46:08.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/396: read - d19/d1b/d27/d83/f66 zero size 2024-09-16T09:46:08.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/397: truncate d19/d1b/d1e/f85 76904 0 2024-09-16T09:46:08.113 INFO:tasks.workunit.client.0.smithi111.stdout:2/349: sync 2024-09-16T09:46:08.114 INFO:tasks.workunit.client.0.smithi111.stdout:2/350: link d0/l1b d0/d2/d5a/l7a 0 2024-09-16T09:46:08.131 INFO:tasks.workunit.client.0.smithi111.stdout:2/351: dwrite d0/da/f3b [0,4194304] 0 2024-09-16T09:46:08.138 INFO:tasks.workunit.client.0.smithi111.stdout:2/352: dread d0/f36 [0,4194304] 0 2024-09-16T09:46:08.138 INFO:tasks.workunit.client.0.smithi111.stdout:2/353: readlink d0/d45/l4a 0 2024-09-16T09:46:08.139 INFO:tasks.workunit.client.0.smithi111.stdout:2/354: symlink d0/d2/d5a/l7b 0 2024-09-16T09:46:08.148 INFO:tasks.workunit.client.0.smithi111.stdout:2/355: read d0/da/f3b [1899856,72691] 0 2024-09-16T09:46:08.171 INFO:tasks.workunit.client.0.smithi111.stdout:2/356: dwrite d0/d22/f40 [0,4194304] 0 2024-09-16T09:46:08.176 INFO:tasks.workunit.client.0.smithi111.stdout:2/357: dread d0/da/f3f [0,4194304] 0 2024-09-16T09:46:08.192 INFO:tasks.workunit.client.0.smithi111.stdout:2/358: dwrite d0/d2/d44/f4b [0,4194304] 0 2024-09-16T09:46:08.198 INFO:tasks.workunit.client.0.smithi111.stdout:2/359: dread d0/da/f33 [0,4194304] 0 2024-09-16T09:46:08.199 INFO:tasks.workunit.client.0.smithi111.stdout:2/360: creat d0/da/d4e/f7c x:0 0 0 2024-09-16T09:46:08.199 INFO:tasks.workunit.client.0.smithi111.stdout:2/361: chown d0/da/d4e/f74 10 1 2024-09-16T09:46:08.207 INFO:tasks.workunit.client.0.smithi111.stdout:2/362: dread d0/d22/f23 [0,4194304] 0 2024-09-16T09:46:08.209 INFO:tasks.workunit.client.0.smithi111.stdout:2/363: unlink d0/d2/d59/l78 0 2024-09-16T09:46:08.211 INFO:tasks.workunit.client.0.smithi111.stdout:2/364: link d0/d22/l47 d0/d45/l7d 0 2024-09-16T09:46:08.213 INFO:tasks.workunit.client.0.smithi111.stdout:2/365: rmdir d0/d45/d5c 39 2024-09-16T09:46:08.215 INFO:tasks.workunit.client.0.smithi111.stdout:2/366: symlink d0/da/d4e/l7e 0 2024-09-16T09:46:08.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/367: creat d0/d21/f7f x:0 0 0 2024-09-16T09:46:08.219 INFO:tasks.workunit.client.0.smithi111.stdout:2/368: mkdir d0/d29/d80 0 2024-09-16T09:46:08.219 INFO:tasks.workunit.client.0.smithi111.stdout:2/369: stat d0/da/d4e 0 2024-09-16T09:46:08.222 INFO:tasks.workunit.client.0.smithi111.stdout:2/370: mkdir d0/d45/d81 0 2024-09-16T09:46:08.222 INFO:tasks.workunit.client.0.smithi111.stdout:2/371: write d0/da/d4e/f74 [1037461,103483] 0 2024-09-16T09:46:08.222 INFO:tasks.workunit.client.0.smithi111.stdout:2/372: fsync d0/d29/f2b 0 2024-09-16T09:46:08.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/373: chown d0/d2/l37 27 1 2024-09-16T09:46:08.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/374: truncate d0/d45/d5c/f72 45764 0 2024-09-16T09:46:08.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/375: readlink d0/da/l43 0 2024-09-16T09:46:08.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/376: rmdir d0/da 39 2024-09-16T09:46:08.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/377: write d0/d2/d44/f4b [4799696,88922] 0 2024-09-16T09:46:08.226 INFO:tasks.workunit.client.0.smithi111.stdout:2/378: symlink d0/da/l82 0 2024-09-16T09:46:08.228 INFO:tasks.workunit.client.0.smithi111.stdout:2/379: link d0/d21/l26 d0/d2/d5a/l83 0 2024-09-16T09:46:08.234 INFO:tasks.workunit.client.0.smithi111.stdout:2/380: dread d0/d2/f15 [0,4194304] 0 2024-09-16T09:46:08.235 INFO:tasks.workunit.client.0.smithi111.stdout:2/381: stat d0/d2/d5a/l7a 0 2024-09-16T09:46:08.235 INFO:tasks.workunit.client.0.smithi111.stdout:2/382: readlink d0/l38 0 2024-09-16T09:46:08.237 INFO:tasks.workunit.client.0.smithi111.stdout:2/383: creat d0/d2/d61/f84 x:0 0 0 2024-09-16T09:46:08.237 INFO:tasks.workunit.client.0.smithi111.stdout:2/384: chown d0/d21/c3c 114564 1 2024-09-16T09:46:08.237 INFO:tasks.workunit.client.0.smithi111.stdout:2/385: stat d0/d45/f79 0 2024-09-16T09:46:08.241 INFO:tasks.workunit.client.0.smithi111.stdout:2/386: dread d0/fc [0,4194304] 0 2024-09-16T09:46:08.242 INFO:tasks.workunit.client.0.smithi111.stdout:2/387: truncate d0/f3d 3826833 0 2024-09-16T09:46:08.242 INFO:tasks.workunit.client.0.smithi111.stdout:2/388: write d0/d22/f23 [4865095,53473] 0 2024-09-16T09:46:08.251 INFO:tasks.workunit.client.0.smithi111.stdout:2/389: write d0/d2/d44/f4b [3708162,104114] 0 2024-09-16T09:46:08.251 INFO:tasks.workunit.client.0.smithi111.stdout:2/390: rmdir d0 39 2024-09-16T09:46:08.252 INFO:tasks.workunit.client.0.smithi111.stdout:2/391: fdatasync d0/f4 0 2024-09-16T09:46:08.253 INFO:tasks.workunit.client.0.smithi111.stdout:2/392: creat d0/d29/d80/f85 x:0 0 0 2024-09-16T09:46:08.254 INFO:tasks.workunit.client.0.smithi111.stdout:2/393: getdents d0/d2/d5a 0 2024-09-16T09:46:08.256 INFO:tasks.workunit.client.0.smithi111.stdout:2/394: mkdir d0/d2/d59/d86 0 2024-09-16T09:46:08.282 INFO:tasks.workunit.client.0.smithi111.stdout:2/395: dwrite d0/d22/f23 [0,4194304] 0 2024-09-16T09:46:08.282 INFO:tasks.workunit.client.0.smithi111.stdout:2/396: fdatasync d0/d22/f23 0 2024-09-16T09:46:08.282 INFO:tasks.workunit.client.0.smithi111.stdout:2/397: fsync d0/f7 0 2024-09-16T09:46:08.286 INFO:tasks.workunit.client.0.smithi111.stdout:2/398: symlink d0/d2/d59/l87 0 2024-09-16T09:46:08.287 INFO:tasks.workunit.client.0.smithi111.stdout:2/399: symlink d0/d2/d5a/l88 0 2024-09-16T09:46:08.296 INFO:tasks.workunit.client.0.smithi111.stdout:2/400: dread d0/da/f48 [0,4194304] 0 2024-09-16T09:46:08.297 INFO:tasks.workunit.client.0.smithi111.stdout:2/401: link d0/d2/d44/c6d d0/d2/c89 0 2024-09-16T09:46:08.298 INFO:tasks.workunit.client.0.smithi111.stdout:2/402: read d0/d29/f2b [340679,49852] 0 2024-09-16T09:46:08.313 INFO:tasks.workunit.client.0.smithi111.stdout:3/259: sync 2024-09-16T09:46:08.314 INFO:tasks.workunit.client.0.smithi111.stdout:3/260: mknod d5/da/db/d3a/c54 0 2024-09-16T09:46:08.332 INFO:tasks.workunit.client.0.smithi111.stdout:3/261: dwrite f3 [0,4194304] 0 2024-09-16T09:46:08.349 INFO:tasks.workunit.client.0.smithi111.stdout:3/262: dwrite d5/f1a [0,4194304] 0 2024-09-16T09:46:08.349 INFO:tasks.workunit.client.0.smithi111.stdout:3/263: read d5/da/f11 [3561272,48238] 0 2024-09-16T09:46:08.353 INFO:tasks.workunit.client.0.smithi111.stdout:3/264: symlink d5/da/l55 0 2024-09-16T09:46:08.367 INFO:tasks.workunit.client.0.smithi111.stdout:3/265: write d5/f1a [3289371,92304] 0 2024-09-16T09:46:08.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:08 smithi111 ceph-mon[27997]: pgmap v257: 65 pgs: 65 active+clean; 623 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34 MiB/s rd, 41 MiB/s wr, 444 op/s 2024-09-16T09:46:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:08 smithi114 ceph-mon[35635]: pgmap v257: 65 pgs: 65 active+clean; 623 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34 MiB/s rd, 41 MiB/s wr, 444 op/s 2024-09-16T09:46:08.477 INFO:tasks.workunit.client.0.smithi111.stdout:3/266: creat d5/f56 x:0 0 0 2024-09-16T09:46:08.477 INFO:tasks.workunit.client.0.smithi111.stdout:3/267: stat d5/da/db/de/l37 0 2024-09-16T09:46:08.477 INFO:tasks.workunit.client.0.smithi111.stdout:3/268: write d5/f56 [944963,77418] 0 2024-09-16T09:46:08.477 INFO:tasks.workunit.client.0.smithi111.stdout:3/269: chown d5/c3f 65476124 1 2024-09-16T09:46:08.477 INFO:tasks.workunit.client.0.smithi111.stdout:3/270: chown d5/da/d42 1710254704 1 2024-09-16T09:46:08.478 INFO:tasks.workunit.client.0.smithi111.stdout:3/271: dread d5/d18/f2e [0,4194304] 0 2024-09-16T09:46:08.480 INFO:tasks.workunit.client.0.smithi111.stdout:3/272: rmdir d5/da/db/d3a 39 2024-09-16T09:46:08.481 INFO:tasks.workunit.client.0.smithi111.stdout:3/273: getdents d5/da/db/d35/d41 0 2024-09-16T09:46:08.499 INFO:tasks.workunit.client.0.smithi111.stdout:3/274: dwrite d5/da/db/d35/d41/f53 [0,4194304] 0 2024-09-16T09:46:08.499 INFO:tasks.workunit.client.0.smithi111.stdout:3/275: truncate d5/da/db/de/f28 270855 0 2024-09-16T09:46:08.507 INFO:tasks.workunit.client.0.smithi111.stdout:3/276: dread d5/da/db/d35/d45/f46 [0,4194304] 0 2024-09-16T09:46:08.508 INFO:tasks.workunit.client.0.smithi111.stdout:3/277: chown d5/d18/c38 104 1 2024-09-16T09:46:08.509 INFO:tasks.workunit.client.0.smithi111.stdout:3/278: rmdir d5 39 2024-09-16T09:46:08.512 INFO:tasks.workunit.client.0.smithi111.stdout:3/279: rename d5/da/l52 to d5/da/db/d35/d41/l57 0 2024-09-16T09:46:08.512 INFO:tasks.workunit.client.0.smithi111.stdout:3/280: stat d5/f50 0 2024-09-16T09:46:08.534 INFO:tasks.workunit.client.0.smithi111.stdout:3/281: dwrite d5/da/db/de/f51 [0,4194304] 0 2024-09-16T09:46:08.558 INFO:tasks.workunit.client.0.smithi111.stdout:3/282: dwrite d5/d18/f36 [0,4194304] 0 2024-09-16T09:46:08.558 INFO:tasks.workunit.client.0.smithi111.stdout:3/283: dread - d5/f50 zero size 2024-09-16T09:46:08.568 INFO:tasks.workunit.client.0.smithi111.stdout:3/284: dread d5/d18/f3e [0,4194304] 0 2024-09-16T09:46:08.579 INFO:tasks.workunit.client.0.smithi111.stdout:3/285: dread d5/da/db/de/f44 [0,4194304] 0 2024-09-16T09:46:08.581 INFO:tasks.workunit.client.0.smithi111.stdout:3/286: unlink d5/da/db/de/f51 0 2024-09-16T09:46:08.582 INFO:tasks.workunit.client.0.smithi111.stdout:7/221: sync 2024-09-16T09:46:08.582 INFO:tasks.workunit.client.0.smithi111.stdout:6/232: sync 2024-09-16T09:46:08.582 INFO:tasks.workunit.client.0.smithi111.stdout:7/222: readlink d1/d16/d17/d18/d1b/l3b 0 2024-09-16T09:46:08.583 INFO:tasks.workunit.client.0.smithi111.stdout:9/187: sync 2024-09-16T09:46:08.583 INFO:tasks.workunit.client.0.smithi111.stdout:4/330: sync 2024-09-16T09:46:08.583 INFO:tasks.workunit.client.0.smithi111.stdout:3/287: creat d5/d18/f58 x:0 0 0 2024-09-16T09:46:08.587 INFO:tasks.workunit.client.0.smithi111.stdout:6/233: rename d0/df/d14/d20/d23/l28 to d0/df/d14/d20/d23/d32/l4b 0 2024-09-16T09:46:08.587 INFO:tasks.workunit.client.0.smithi111.stdout:6/234: write d0/df/f4a [2842812,85691] 0 2024-09-16T09:46:08.587 INFO:tasks.workunit.client.0.smithi111.stdout:6/235: read d0/df/d14/f21 [986668,2272] 0 2024-09-16T09:46:08.587 INFO:tasks.workunit.client.0.smithi111.stdout:6/236: write d0/f1a [4293075,79496] 0 2024-09-16T09:46:08.587 INFO:tasks.workunit.client.0.smithi111.stdout:9/188: mknod d0/d21/c3d 0 2024-09-16T09:46:08.592 INFO:tasks.workunit.client.0.smithi111.stdout:3/288: mkdir d5/da/db/d3a/d59 0 2024-09-16T09:46:08.592 INFO:tasks.workunit.client.0.smithi111.stdout:3/289: fdatasync d5/da/db/d35/d41/f53 0 2024-09-16T09:46:08.593 INFO:tasks.workunit.client.0.smithi111.stdout:4/331: rename d2/d30/f4a to d2/d6/dd/d1c/f62 0 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:8/163: sync 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:0/326: sync 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:5/398: sync 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:2/403: sync 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:5/399: readlink d19/d1b/d1e/d21/l44 0 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:1/322: sync 2024-09-16T09:46:08.595 INFO:tasks.workunit.client.0.smithi111.stdout:1/323: chown d3/d10/d57/f68 228831 1 2024-09-16T09:46:08.597 INFO:tasks.workunit.client.0.smithi111.stdout:3/290: mkdir d5/da/db/d5a 0 2024-09-16T09:46:08.598 INFO:tasks.workunit.client.0.smithi111.stdout:0/327: rename d0/f12 to d0/d1d/d67/d54/f78 0 2024-09-16T09:46:08.598 INFO:tasks.workunit.client.0.smithi111.stdout:3/291: dread d5/da/db/de/f28 [0,4194304] 0 2024-09-16T09:46:08.600 INFO:tasks.workunit.client.0.smithi111.stdout:2/404: symlink d0/l8a 0 2024-09-16T09:46:08.600 INFO:tasks.workunit.client.0.smithi111.stdout:2/405: chown d0/d2 323550 1 2024-09-16T09:46:08.600 INFO:tasks.workunit.client.0.smithi111.stdout:2/406: write d0/f3d [2179606,63926] 0 2024-09-16T09:46:08.603 INFO:tasks.workunit.client.0.smithi111.stdout:8/164: rename d3/da/df/f1d to d3/de/d1e/d27/f2b 0 2024-09-16T09:46:08.603 INFO:tasks.workunit.client.0.smithi111.stdout:5/400: dread fd [0,4194304] 0 2024-09-16T09:46:08.605 INFO:tasks.workunit.client.0.smithi111.stdout:0/328: dread d0/d1d/f30 [0,4194304] 0 2024-09-16T09:46:08.605 INFO:tasks.workunit.client.0.smithi111.stdout:5/401: dread d19/d1b/d1e/f85 [0,4194304] 0 2024-09-16T09:46:08.605 INFO:tasks.workunit.client.0.smithi111.stdout:4/332: dread d2/d6/fe [4194304,4194304] 0 2024-09-16T09:46:08.606 INFO:tasks.workunit.client.0.smithi111.stdout:3/292: getdents d5/da/d42 0 2024-09-16T09:46:08.606 INFO:tasks.workunit.client.0.smithi111.stdout:3/293: chown d5/da/db/de/f15 2046358 1 2024-09-16T09:46:08.607 INFO:tasks.workunit.client.0.smithi111.stdout:2/407: creat d0/d45/d5c/d67/d63/f8b x:0 0 0 2024-09-16T09:46:08.607 INFO:tasks.workunit.client.0.smithi111.stdout:2/408: stat d0/f3d 0 2024-09-16T09:46:08.609 INFO:tasks.workunit.client.0.smithi111.stdout:1/324: rename d3/d10/d23/d70 to d3/d10/d72 0 2024-09-16T09:46:08.611 INFO:tasks.workunit.client.0.smithi111.stdout:8/165: creat d3/da/f2c x:0 0 0 2024-09-16T09:46:08.611 INFO:tasks.workunit.client.0.smithi111.stdout:7/223: dwrite d1/d9/fa [0,4194304] 0 2024-09-16T09:46:08.611 INFO:tasks.workunit.client.0.smithi111.stdout:9/189: dwrite d0/d6/f3c [0,4194304] 0 2024-09-16T09:46:08.611 INFO:tasks.workunit.client.0.smithi111.stdout:9/190: dread - d0/d6/d8/de/f2f zero size 2024-09-16T09:46:08.614 INFO:tasks.workunit.client.0.smithi111.stdout:0/329: creat d0/d26/f79 x:0 0 0 2024-09-16T09:46:08.617 INFO:tasks.workunit.client.0.smithi111.stdout:5/402: creat d19/d1b/d1e/d41/f8e x:0 0 0 2024-09-16T09:46:08.619 INFO:tasks.workunit.client.0.smithi111.stdout:2/409: creat d0/d45/d5c/d67/f8c x:0 0 0 2024-09-16T09:46:08.624 INFO:tasks.workunit.client.0.smithi111.stdout:4/333: dread d2/d6/dd/d1c/d2f/f46 [0,4194304] 0 2024-09-16T09:46:08.625 INFO:tasks.workunit.client.0.smithi111.stdout:4/334: chown d2/c3 232067420 1 2024-09-16T09:46:08.625 INFO:tasks.workunit.client.0.smithi111.stdout:8/166: mknod d3/da/c2d 0 2024-09-16T09:46:08.625 INFO:tasks.workunit.client.0.smithi111.stdout:4/335: mkdir d2/d30/d63 0 2024-09-16T09:46:08.630 INFO:tasks.workunit.client.0.smithi111.stdout:7/224: dread d1/f26 [0,4194304] 0 2024-09-16T09:46:08.630 INFO:tasks.workunit.client.0.smithi111.stdout:8/167: rename d3/de/d29 to d3/de/d1e/d2e 0 2024-09-16T09:46:08.630 INFO:tasks.workunit.client.0.smithi111.stdout:8/168: read d3/f13 [15143,110868] 0 2024-09-16T09:46:08.631 INFO:tasks.workunit.client.0.smithi111.stdout:4/336: mkdir d2/d6/dd/d1b/d38/d64 0 2024-09-16T09:46:08.632 INFO:tasks.workunit.client.0.smithi111.stdout:8/169: mkdir d3/de/d1e/d2e/d2f 0 2024-09-16T09:46:08.632 INFO:tasks.workunit.client.0.smithi111.stdout:8/170: write d3/de/d1e/d27/f28 [799978,95381] 0 2024-09-16T09:46:08.634 INFO:tasks.workunit.client.0.smithi111.stdout:8/171: link d3/de/d1e/c20 d3/de/d1e/d2e/d2f/c30 0 2024-09-16T09:46:08.634 INFO:tasks.workunit.client.0.smithi111.stdout:8/172: chown d3/f19 312133668 1 2024-09-16T09:46:08.635 INFO:tasks.workunit.client.0.smithi111.stdout:8/173: mknod d3/de/d1e/d2e/c31 0 2024-09-16T09:46:08.648 INFO:tasks.workunit.client.0.smithi111.stdout:8/174: dread d3/f7 [0,4194304] 0 2024-09-16T09:46:08.659 INFO:tasks.workunit.client.0.smithi111.stdout:7/225: write d1/d9/fa [4107096,128754] 0 2024-09-16T09:46:08.659 INFO:tasks.workunit.client.0.smithi111.stdout:7/226: fdatasync d1/f26 0 2024-09-16T09:46:08.659 INFO:tasks.workunit.client.0.smithi111.stdout:9/191: dwrite d0/d6/d30/f31 [0,4194304] 0 2024-09-16T09:46:08.661 INFO:tasks.workunit.client.0.smithi111.stdout:7/227: creat d1/d16/f48 x:0 0 0 2024-09-16T09:46:08.662 INFO:tasks.workunit.client.0.smithi111.stdout:7/228: unlink d1/c2a 0 2024-09-16T09:46:08.662 INFO:tasks.workunit.client.0.smithi111.stdout:7/229: chown d1/d9/l47 1399299 1 2024-09-16T09:46:08.665 INFO:tasks.workunit.client.0.smithi111.stdout:9/192: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:08.676 INFO:tasks.workunit.client.0.smithi111.stdout:0/330: dwrite d0/d1d/d67/d54/f6d [0,4194304] 0 2024-09-16T09:46:08.680 INFO:tasks.workunit.client.0.smithi111.stdout:9/193: dread d0/d6/f3c [0,4194304] 0 2024-09-16T09:46:08.682 INFO:tasks.workunit.client.0.smithi111.stdout:9/194: creat d0/d21/d22/f3e x:0 0 0 2024-09-16T09:46:08.682 INFO:tasks.workunit.client.0.smithi111.stdout:9/195: getdents d0/d6/d30 0 2024-09-16T09:46:08.683 INFO:tasks.workunit.client.0.smithi111.stdout:9/196: creat d0/f3f x:0 0 0 2024-09-16T09:46:08.684 INFO:tasks.workunit.client.0.smithi111.stdout:9/197: mkdir d0/d6/d40 0 2024-09-16T09:46:08.685 INFO:tasks.workunit.client.0.smithi111.stdout:8/175: dwrite d3/f13 [0,4194304] 0 2024-09-16T09:46:08.685 INFO:tasks.workunit.client.0.smithi111.stdout:8/176: readlink d3/da/ld 0 2024-09-16T09:46:08.685 INFO:tasks.workunit.client.0.smithi111.stdout:5/403: dwrite d19/d1b/d27/d2e/d4a/d4b/f5f [0,4194304] 0 2024-09-16T09:46:08.685 INFO:tasks.workunit.client.0.smithi111.stdout:5/404: write d19/d1b/d27/d83/f26 [2644373,59503] 0 2024-09-16T09:46:08.685 INFO:tasks.workunit.client.0.smithi111.stdout:9/198: creat d0/d6/d8/f41 x:0 0 0 2024-09-16T09:46:08.687 INFO:tasks.workunit.client.0.smithi111.stdout:1/325: dwrite d3/d24/d3f/f71 [0,4194304] 0 2024-09-16T09:46:08.687 INFO:tasks.workunit.client.0.smithi111.stdout:2/410: dwrite d0/da/f3f [0,4194304] 0 2024-09-16T09:46:08.687 INFO:tasks.workunit.client.0.smithi111.stdout:2/411: readlink d0/da/d4e/l7e 0 2024-09-16T09:46:08.687 INFO:tasks.workunit.client.0.smithi111.stdout:3/294: dwrite d5/da/db/f14 [4194304,4194304] 0 2024-09-16T09:46:08.687 INFO:tasks.workunit.client.0.smithi111.stdout:3/295: fdatasync d5/f13 0 2024-09-16T09:46:08.687 INFO:tasks.workunit.client.0.smithi111.stdout:3/296: chown d5/da/db/d35/d45 4 1 2024-09-16T09:46:08.692 INFO:tasks.workunit.client.0.smithi111.stdout:7/230: dwrite d1/f32 [0,4194304] 0 2024-09-16T09:46:08.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/405: mkdir d19/d1b/d1e/d21/d29/d32/d8f 0 2024-09-16T09:46:08.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/406: stat d19/d1b/d1e/d21/d29/d32 0 2024-09-16T09:46:08.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/407: write d19/d1b/d27/d83/f3f [3730839,83992] 0 2024-09-16T09:46:08.694 INFO:tasks.workunit.client.0.smithi111.stdout:5/408: truncate d19/d1b/d27/d83/f66 633008 0 2024-09-16T09:46:08.696 INFO:tasks.workunit.client.0.smithi111.stdout:0/331: dwrite d0/f31 [0,4194304] 0 2024-09-16T09:46:08.696 INFO:tasks.workunit.client.0.smithi111.stdout:0/332: getdents d0/d1d/d67/d3a/d77 0 2024-09-16T09:46:08.697 INFO:tasks.workunit.client.0.smithi111.stdout:9/199: dread d0/f1e [0,4194304] 0 2024-09-16T09:46:08.700 INFO:tasks.workunit.client.0.smithi111.stdout:1/326: link d3/d24/d3c/d28/d36/d3d/c4b d3/d10/d72/c73 0 2024-09-16T09:46:08.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/412: creat d0/d29/d80/f8d x:0 0 0 2024-09-16T09:46:08.703 INFO:tasks.workunit.client.0.smithi111.stdout:3/297: getdents d5/da/db/de 0 2024-09-16T09:46:08.703 INFO:tasks.workunit.client.0.smithi111.stdout:3/298: write d5/da/db/d35/d41/f53 [5107087,18209] 0 2024-09-16T09:46:08.706 INFO:tasks.workunit.client.0.smithi111.stdout:7/231: rmdir d1/d16/d17/d18/d1b 39 2024-09-16T09:46:08.713 INFO:tasks.workunit.client.0.smithi111.stdout:5/409: dwrite d19/d1b/d27/d2e/f52 [4194304,4194304] 0 2024-09-16T09:46:08.718 INFO:tasks.workunit.client.0.smithi111.stdout:0/333: symlink d0/d26/d35/l7a 0 2024-09-16T09:46:08.718 INFO:tasks.workunit.client.0.smithi111.stdout:0/334: fsync d0/d1d/d67/f41 0 2024-09-16T09:46:08.718 INFO:tasks.workunit.client.0.smithi111.stdout:0/335: readlink d0/d26/l2e 0 2024-09-16T09:46:08.720 INFO:tasks.workunit.client.0.smithi111.stdout:9/200: symlink d0/d18/l42 0 2024-09-16T09:46:08.722 INFO:tasks.workunit.client.0.smithi111.stdout:3/299: creat d5/da/db/d3a/d59/f5b x:0 0 0 2024-09-16T09:46:08.722 INFO:tasks.workunit.client.0.smithi111.stdout:3/300: truncate d5/f50 844127 0 2024-09-16T09:46:08.724 INFO:tasks.workunit.client.0.smithi111.stdout:0/336: dread d0/d1d/d67/d3a/f72 [0,4194304] 0 2024-09-16T09:46:08.725 INFO:tasks.workunit.client.0.smithi111.stdout:7/232: rmdir d1/d16/d17/d18/d1d 39 2024-09-16T09:46:08.725 INFO:tasks.workunit.client.0.smithi111.stdout:7/233: read d1/d16/f1c [1170044,86077] 0 2024-09-16T09:46:08.730 INFO:tasks.workunit.client.0.smithi111.stdout:5/410: rename d19/d1b/d27/d2e/d39/d54/d60/f64 to d19/d1b/d1e/d21/d29/d32/d46/f90 0 2024-09-16T09:46:08.730 INFO:tasks.workunit.client.0.smithi111.stdout:5/411: write f15 [2603254,50361] 0 2024-09-16T09:46:08.731 INFO:tasks.workunit.client.0.smithi111.stdout:3/301: creat d5/da/db/d35/f5c x:0 0 0 2024-09-16T09:46:08.732 INFO:tasks.workunit.client.0.smithi111.stdout:8/177: dwrite d3/da/df/f25 [0,4194304] 0 2024-09-16T09:46:08.732 INFO:tasks.workunit.client.0.smithi111.stdout:8/178: write f1 [7582597,23559] 0 2024-09-16T09:46:08.734 INFO:tasks.workunit.client.0.smithi111.stdout:7/234: symlink d1/d16/d27/l49 0 2024-09-16T09:46:08.734 INFO:tasks.workunit.client.0.smithi111.stdout:7/235: write d1/d20/f23 [909881,48811] 0 2024-09-16T09:46:08.736 INFO:tasks.workunit.client.0.smithi111.stdout:8/179: creat d3/de/d1e/d2e/d2f/f32 x:0 0 0 2024-09-16T09:46:08.738 INFO:tasks.workunit.client.0.smithi111.stdout:8/180: unlink d3/da/db/c16 0 2024-09-16T09:46:08.738 INFO:tasks.workunit.client.0.smithi111.stdout:8/181: readlink d3/de/d1e/d27/l2a 0 2024-09-16T09:46:08.863 INFO:tasks.workunit.client.0.smithi111.stdout:2/413: dwrite d0/d29/f42 [0,4194304] 0 2024-09-16T09:46:08.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/414: creat d0/d45/d5c/d67/f8e x:0 0 0 2024-09-16T09:46:08.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/415: chown d0/d22/c4d 146496 1 2024-09-16T09:46:08.867 INFO:tasks.workunit.client.0.smithi111.stdout:2/416: chown d0/d2/f17 312 1 2024-09-16T09:46:08.868 INFO:tasks.workunit.client.0.smithi111.stdout:2/417: rmdir d0/d22 39 2024-09-16T09:46:08.870 INFO:tasks.workunit.client.0.smithi111.stdout:2/418: creat d0/d45/d5c/d67/f8f x:0 0 0 2024-09-16T09:46:08.871 INFO:tasks.workunit.client.0.smithi111.stdout:2/419: creat d0/d45/f90 x:0 0 0 2024-09-16T09:46:08.872 INFO:tasks.workunit.client.0.smithi111.stdout:7/236: dread d1/d20/f42 [0,4194304] 0 2024-09-16T09:46:08.873 INFO:tasks.workunit.client.0.smithi111.stdout:2/420: symlink d0/d2/d44/l91 0 2024-09-16T09:46:08.873 INFO:tasks.workunit.client.0.smithi111.stdout:9/201: dwrite d0/d6/d8/f26 [0,4194304] 0 2024-09-16T09:46:08.874 INFO:tasks.workunit.client.0.smithi111.stdout:0/337: dwrite d0/d1d/d67/d3a/d3d/f71 [0,4194304] 0 2024-09-16T09:46:08.875 INFO:tasks.workunit.client.0.smithi111.stdout:7/237: creat d1/d16/d17/d18/f4a x:0 0 0 2024-09-16T09:46:08.877 INFO:tasks.workunit.client.0.smithi111.stdout:2/421: mknod d0/d2/c92 0 2024-09-16T09:46:08.879 INFO:tasks.workunit.client.0.smithi111.stdout:9/202: read d0/f1e [609061,20463] 0 2024-09-16T09:46:08.879 INFO:tasks.workunit.client.0.smithi111.stdout:9/203: fsync d0/d6/d8/f1c 0 2024-09-16T09:46:08.879 INFO:tasks.workunit.client.0.smithi111.stdout:9/204: dread - d0/d6/d30/f39 zero size 2024-09-16T09:46:08.883 INFO:tasks.workunit.client.0.smithi111.stdout:0/338: unlink d0/f55 0 2024-09-16T09:46:08.883 INFO:tasks.workunit.client.0.smithi111.stdout:0/339: chown d0/f17 1 1 2024-09-16T09:46:08.887 INFO:tasks.workunit.client.0.smithi111.stdout:2/422: dread d0/d21/f4f [0,4194304] 0 2024-09-16T09:46:08.889 INFO:tasks.workunit.client.0.smithi111.stdout:7/238: unlink d1/d9/l47 0 2024-09-16T09:46:08.890 INFO:tasks.workunit.client.0.smithi111.stdout:9/205: mknod d0/d6/d30/c43 0 2024-09-16T09:46:08.890 INFO:tasks.workunit.client.0.smithi111.stdout:9/206: chown d0/d21/d22 501243289 1 2024-09-16T09:46:08.890 INFO:tasks.workunit.client.0.smithi111.stdout:3/302: dwrite d5/da/db/d35/d41/f53 [0,4194304] 0 2024-09-16T09:46:08.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/340: mknod d0/d1d/d67/d3a/d3d/c7b 0 2024-09-16T09:46:08.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/341: fsync d0/f31 0 2024-09-16T09:46:08.892 INFO:tasks.workunit.client.0.smithi111.stdout:2/423: creat d0/d2/d5a/f93 x:0 0 0 2024-09-16T09:46:08.895 INFO:tasks.workunit.client.0.smithi111.stdout:9/207: creat d0/d6/f44 x:0 0 0 2024-09-16T09:46:08.895 INFO:tasks.workunit.client.0.smithi111.stdout:9/208: fdatasync d0/d6/d30/f39 0 2024-09-16T09:46:08.895 INFO:tasks.workunit.client.0.smithi111.stdout:3/303: mkdir d5/da/db/d5a/d5d 0 2024-09-16T09:46:08.906 INFO:tasks.workunit.client.0.smithi111.stdout:0/342: creat d0/d26/d4b/f7c x:0 0 0 2024-09-16T09:46:08.906 INFO:tasks.workunit.client.0.smithi111.stdout:7/239: mknod d1/c4b 0 2024-09-16T09:46:08.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/209: mkdir d0/d6/d45 0 2024-09-16T09:46:08.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/210: chown d0/d6/d8/de/f2f 7746711 1 2024-09-16T09:46:08.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/211: chown d0/d6/l14 151 1 2024-09-16T09:46:08.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/212: chown d0/d6/d30/c3b 130055 1 2024-09-16T09:46:08.909 INFO:tasks.workunit.client.0.smithi111.stdout:3/304: rename d5/d18/f3e to d5/da/db/d5a/d5d/f5e 0 2024-09-16T09:46:08.911 INFO:tasks.workunit.client.0.smithi111.stdout:7/240: dread d1/f26 [0,4194304] 0 2024-09-16T09:46:08.912 INFO:tasks.workunit.client.0.smithi111.stdout:7/241: readlink d1/l10 0 2024-09-16T09:46:08.914 INFO:tasks.workunit.client.0.smithi111.stdout:7/242: dread d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:08.914 INFO:tasks.workunit.client.0.smithi111.stdout:0/343: rename d0/d1d/d58/d64/c57 to d0/d1d/d67/d54/c7d 0 2024-09-16T09:46:08.914 INFO:tasks.workunit.client.0.smithi111.stdout:0/344: write d0/d1d/f2d [4520369,34000] 0 2024-09-16T09:46:08.915 INFO:tasks.workunit.client.0.smithi111.stdout:3/305: symlink d5/da/db/d3a/d59/l5f 0 2024-09-16T09:46:08.916 INFO:tasks.workunit.client.0.smithi111.stdout:7/243: write d1/d16/d27/f2b [1211809,20679] 0 2024-09-16T09:46:08.917 INFO:tasks.workunit.client.0.smithi111.stdout:9/213: rename d0/d6/d8/c9 to d0/d21/d22/c46 0 2024-09-16T09:46:08.919 INFO:tasks.workunit.client.0.smithi111.stdout:0/345: unlink d0/c34 0 2024-09-16T09:46:08.920 INFO:tasks.workunit.client.0.smithi111.stdout:3/306: creat d5/da/db/d35/d45/f60 x:0 0 0 2024-09-16T09:46:08.922 INFO:tasks.workunit.client.0.smithi111.stdout:7/244: rename d1/f26 to d1/d16/d17/d18/f4c 0 2024-09-16T09:46:08.924 INFO:tasks.workunit.client.0.smithi111.stdout:0/346: mknod d0/d1d/d58/d64/d4f/c7e 0 2024-09-16T09:46:08.927 INFO:tasks.workunit.client.0.smithi111.stdout:7/245: mknod d1/d16/d17/d18/c4d 0 2024-09-16T09:46:08.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/307: write f3 [2974305,130078] 0 2024-09-16T09:46:08.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/308: chown d5/d18/f29 4211517 1 2024-09-16T09:46:08.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/309: chown d5/f1a 57733856 1 2024-09-16T09:46:08.930 INFO:tasks.workunit.client.0.smithi111.stdout:0/347: link d0/d1d/d67/d3a/f72 d0/d1d/d58/d64/d4f/f7f 0 2024-09-16T09:46:08.932 INFO:tasks.workunit.client.0.smithi111.stdout:7/246: rename d1/d16/d17/d18/d1d/d2f/l33 to d1/d16/d27/l4e 0 2024-09-16T09:46:08.936 INFO:tasks.workunit.client.0.smithi111.stdout:3/310: dread f3 [0,4194304] 0 2024-09-16T09:46:08.936 INFO:tasks.workunit.client.0.smithi111.stdout:7/247: mkdir d1/d16/d17/d18/d4f 0 2024-09-16T09:46:08.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/311: creat d5/da/db/d3a/d59/f61 x:0 0 0 2024-09-16T09:46:08.941 INFO:tasks.workunit.client.0.smithi111.stdout:3/312: mknod d5/da/db/c62 0 2024-09-16T09:46:08.945 INFO:tasks.workunit.client.0.smithi111.stdout:7/248: dread d1/f1a [0,4194304] 0 2024-09-16T09:46:08.945 INFO:tasks.workunit.client.0.smithi111.stdout:0/348: rename d0/d1d/d67/d54 to d0/d1d/d67/d3a/d80 0 2024-09-16T09:46:08.945 INFO:tasks.workunit.client.0.smithi111.stdout:0/349: fsync d0/d1d/f29 0 2024-09-16T09:46:08.946 INFO:tasks.workunit.client.0.smithi111.stdout:3/313: creat d5/da/db/d35/d45/f63 x:0 0 0 2024-09-16T09:46:08.952 INFO:tasks.workunit.client.0.smithi111.stdout:3/314: dread d5/da/db/d5a/d5d/f5e [0,4194304] 0 2024-09-16T09:46:08.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/337: sync 2024-09-16T09:46:08.953 INFO:tasks.workunit.client.0.smithi111.stdout:6/237: sync 2024-09-16T09:46:08.954 INFO:tasks.workunit.client.0.smithi111.stdout:7/249: write d1/f32 [3940762,111446] 0 2024-09-16T09:46:08.958 INFO:tasks.workunit.client.0.smithi111.stdout:3/315: symlink d5/da/db/d3a/l64 0 2024-09-16T09:46:08.959 INFO:tasks.workunit.client.0.smithi111.stdout:4/338: mkdir d2/d6/dd/d1b/d38/d64/d65 0 2024-09-16T09:46:08.961 INFO:tasks.workunit.client.0.smithi111.stdout:6/238: creat d0/df/d49/f4c x:0 0 0 2024-09-16T09:46:08.962 INFO:tasks.workunit.client.0.smithi111.stdout:3/316: write d5/da/db/d5a/d5d/f5e [1374648,78762] 0 2024-09-16T09:46:08.963 INFO:tasks.workunit.client.0.smithi111.stdout:4/339: unlink d2/d30/d44/c60 0 2024-09-16T09:46:08.963 INFO:tasks.workunit.client.0.smithi111.stdout:6/239: mknod d0/df/c4d 0 2024-09-16T09:46:08.964 INFO:tasks.workunit.client.0.smithi111.stdout:3/317: mknod d5/da/db/c65 0 2024-09-16T09:46:08.965 INFO:tasks.workunit.client.0.smithi111.stdout:4/340: dread d2/d6/dd/f2a [0,4194304] 0 2024-09-16T09:46:08.965 INFO:tasks.workunit.client.0.smithi111.stdout:4/341: write d2/d6/f14 [728757,90611] 0 2024-09-16T09:46:08.966 INFO:tasks.workunit.client.0.smithi111.stdout:6/240: mkdir d0/df/d14/d20/d42/d4e 0 2024-09-16T09:46:08.966 INFO:tasks.workunit.client.0.smithi111.stdout:0/350: dwrite d0/d26/d4b/f7c [0,4194304] 0 2024-09-16T09:46:08.966 INFO:tasks.workunit.client.0.smithi111.stdout:0/351: fdatasync d0/d26/f2c 0 2024-09-16T09:46:08.967 INFO:tasks.workunit.client.0.smithi111.stdout:0/352: chown d0/l40 1 1 2024-09-16T09:46:08.967 INFO:tasks.workunit.client.0.smithi111.stdout:0/353: dread - d0/d26/f79 zero size 2024-09-16T09:46:08.967 INFO:tasks.workunit.client.0.smithi111.stdout:0/354: write d0/d1d/f29 [514252,29565] 0 2024-09-16T09:46:08.967 INFO:tasks.workunit.client.0.smithi111.stdout:4/342: rename d2/d6/dd/f40 to d2/d6/dd/d1b/d38/d64/f66 0 2024-09-16T09:46:08.968 INFO:tasks.workunit.client.0.smithi111.stdout:6/241: mkdir d0/df/d14/d20/d23/d41/d4f 0 2024-09-16T09:46:08.972 INFO:tasks.workunit.client.0.smithi111.stdout:0/355: truncate d0/f18 6029468 0 2024-09-16T09:46:08.973 INFO:tasks.workunit.client.0.smithi111.stdout:0/356: write d0/f1c [205532,112034] 0 2024-09-16T09:46:08.974 INFO:tasks.workunit.client.0.smithi111.stdout:4/343: creat d2/d6/f67 x:0 0 0 2024-09-16T09:46:08.975 INFO:tasks.workunit.client.0.smithi111.stdout:3/318: write d5/f8 [1451987,21914] 0 2024-09-16T09:46:08.975 INFO:tasks.workunit.client.0.smithi111.stdout:7/250: dwrite d1/d16/d27/f45 [0,4194304] 0 2024-09-16T09:46:09.021 INFO:tasks.workunit.client.0.smithi111.stdout:0/357: rename d0/c5f to d0/d1d/c81 0 2024-09-16T09:46:09.022 INFO:tasks.workunit.client.0.smithi111.stdout:4/344: rmdir d2/d30/d63 0 2024-09-16T09:46:09.034 INFO:tasks.workunit.client.0.smithi111.stdout:3/319: rename d5/da/db/de/c2b to d5/da/db/d35/d45/c66 0 2024-09-16T09:46:09.034 INFO:tasks.workunit.client.0.smithi111.stdout:3/320: dread - d5/da/d42/f48 zero size 2024-09-16T09:46:09.034 INFO:tasks.workunit.client.0.smithi111.stdout:3/321: chown d5/da/db/d3a/d59 17220751 1 2024-09-16T09:46:09.035 INFO:tasks.workunit.client.0.smithi111.stdout:3/322: chown d5/d18 50318026 1 2024-09-16T09:46:09.035 INFO:tasks.workunit.client.0.smithi111.stdout:0/358: creat d0/d26/d4b/f82 x:0 0 0 2024-09-16T09:46:09.036 INFO:tasks.workunit.client.0.smithi111.stdout:4/345: creat d2/d6/dd/d1b/d38/f68 x:0 0 0 2024-09-16T09:46:09.038 INFO:tasks.workunit.client.0.smithi111.stdout:3/323: creat d5/da/db/d5a/f67 x:0 0 0 2024-09-16T09:46:09.040 INFO:tasks.workunit.client.0.smithi111.stdout:0/359: mkdir d0/d1d/d58/d83 0 2024-09-16T09:46:09.041 INFO:tasks.workunit.client.0.smithi111.stdout:3/324: mknod d5/da/db/d3a/d59/c68 0 2024-09-16T09:46:09.042 INFO:tasks.workunit.client.0.smithi111.stdout:4/346: dread d2/d30/d44/f47 [0,4194304] 0 2024-09-16T09:46:09.045 INFO:tasks.workunit.client.0.smithi111.stdout:0/360: creat d0/d1d/d67/d3a/d77/f84 x:0 0 0 2024-09-16T09:46:09.047 INFO:tasks.workunit.client.0.smithi111.stdout:3/325: creat d5/f69 x:0 0 0 2024-09-16T09:46:09.047 INFO:tasks.workunit.client.0.smithi111.stdout:3/326: read - d5/da/db/d35/f39 zero size 2024-09-16T09:46:09.047 INFO:tasks.workunit.client.0.smithi111.stdout:3/327: chown d5/da/db/de 53334336 1 2024-09-16T09:46:09.047 INFO:tasks.workunit.client.0.smithi111.stdout:3/328: read - d5/da/db/d35/d45/f63 zero size 2024-09-16T09:46:09.050 INFO:tasks.workunit.client.0.smithi111.stdout:3/329: mknod d5/da/db/d5a/d5d/c6a 0 2024-09-16T09:46:09.064 INFO:tasks.workunit.client.0.smithi111.stdout:0/361: dwrite d0/d26/d4b/f7c [0,4194304] 0 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:0/362: truncate d0/f17 8198780 0 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/327: sync 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:8/182: sync 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:8/183: truncate d3/f19 4808 0 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/412: sync 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/328: write d3/d26/f34 [142475,74423] 0 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/329: chown d3/d10/d72 1578834 1 2024-09-16T09:46:09.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/413: fsync d19/d1b/d1e/d21/d29/d32/f79 0 2024-09-16T09:46:09.070 INFO:tasks.workunit.client.0.smithi111.stdout:3/330: dwrite d5/d18/f29 [0,4194304] 0 2024-09-16T09:46:09.070 INFO:tasks.workunit.client.0.smithi111.stdout:3/331: write d5/f13 [5239191,19131] 0 2024-09-16T09:46:09.070 INFO:tasks.workunit.client.0.smithi111.stdout:3/332: read - d5/da/db/d35/f39 zero size 2024-09-16T09:46:09.073 INFO:tasks.workunit.client.0.smithi111.stdout:5/414: creat d19/d1b/d27/d2e/f91 x:0 0 0 2024-09-16T09:46:09.077 INFO:tasks.workunit.client.0.smithi111.stdout:5/415: creat d19/d1b/d27/d2e/d39/d54/f92 x:0 0 0 2024-09-16T09:46:09.083 INFO:tasks.workunit.client.0.smithi111.stdout:5/416: dread d19/d1b/d27/d83/d2a/f71 [0,4194304] 0 2024-09-16T09:46:09.083 INFO:tasks.workunit.client.0.smithi111.stdout:5/417: chown d19/d1b/d1e/d21/d29/c7a 14345038 1 2024-09-16T09:46:09.087 INFO:tasks.workunit.client.0.smithi111.stdout:3/333: dread d5/da/db/f14 [4194304,4194304] 0 2024-09-16T09:46:09.087 INFO:tasks.workunit.client.0.smithi111.stdout:5/418: mkdir d19/d1b/d1e/d81/d93 0 2024-09-16T09:46:09.087 INFO:tasks.workunit.client.0.smithi111.stdout:5/419: readlink d19/l47 0 2024-09-16T09:46:09.093 INFO:tasks.workunit.client.0.smithi111.stdout:3/334: write d5/da/db/de/f15 [7767234,24830] 0 2024-09-16T09:46:09.097 INFO:tasks.workunit.client.0.smithi111.stdout:0/363: dwrite d0/d1d/f62 [0,4194304] 0 2024-09-16T09:46:09.098 INFO:tasks.workunit.client.0.smithi111.stdout:3/335: link d5/da/db/de/l37 d5/da/d42/l6b 0 2024-09-16T09:46:09.103 INFO:tasks.workunit.client.0.smithi111.stdout:3/336: mknod d5/da/db/d3a/d59/c6c 0 2024-09-16T09:46:09.107 INFO:tasks.workunit.client.0.smithi111.stdout:1/330: dwrite d3/d24/d29/f39 [0,4194304] 0 2024-09-16T09:46:09.107 INFO:tasks.workunit.client.0.smithi111.stdout:5/420: dwrite d19/d1b/d27/d83/d2a/f71 [0,4194304] 0 2024-09-16T09:46:09.114 INFO:tasks.workunit.client.0.smithi111.stdout:1/331: dread d3/d10/f18 [0,4194304] 0 2024-09-16T09:46:09.114 INFO:tasks.workunit.client.0.smithi111.stdout:1/332: readlink d3/d24/d3f/l5f 0 2024-09-16T09:46:09.114 INFO:tasks.workunit.client.0.smithi111.stdout:1/333: truncate d3/d10/f4d 1324201 0 2024-09-16T09:46:09.116 INFO:tasks.workunit.client.0.smithi111.stdout:1/334: truncate d3/d10/d1c/f31 671802 0 2024-09-16T09:46:09.116 INFO:tasks.workunit.client.0.smithi111.stdout:1/335: write d3/d10/d1c/f25 [4254138,76068] 0 2024-09-16T09:46:09.117 INFO:tasks.workunit.client.0.smithi111.stdout:1/336: dread - d3/d24/d3c/f2a zero size 2024-09-16T09:46:09.117 INFO:tasks.workunit.client.0.smithi111.stdout:1/337: write d3/d24/d4e/f5b [321904,85790] 0 2024-09-16T09:46:09.118 INFO:tasks.workunit.client.0.smithi111.stdout:1/338: mkdir d3/d24/d3c/d28/d36/d3d/d47/d65/d74 0 2024-09-16T09:46:09.119 INFO:tasks.workunit.client.0.smithi111.stdout:1/339: creat d3/d24/f75 x:0 0 0 2024-09-16T09:46:09.120 INFO:tasks.workunit.client.0.smithi111.stdout:1/340: write d3/f6 [4732080,113260] 0 2024-09-16T09:46:09.123 INFO:tasks.workunit.client.0.smithi111.stdout:1/341: unlink d3/d24/d3c/d28/d36/f3b 0 2024-09-16T09:46:09.124 INFO:tasks.workunit.client.0.smithi111.stdout:0/364: dwrite d0/d1d/d58/d64/d4f/f7f [0,4194304] 0 2024-09-16T09:46:09.125 INFO:tasks.workunit.client.0.smithi111.stdout:1/342: creat d3/d10/d1c/f76 x:0 0 0 2024-09-16T09:46:09.125 INFO:tasks.workunit.client.0.smithi111.stdout:1/343: readlink d3/d26/l3a 0 2024-09-16T09:46:09.127 INFO:tasks.workunit.client.0.smithi111.stdout:5/421: dwrite d19/d1b/d1e/f55 [0,4194304] 0 2024-09-16T09:46:09.127 INFO:tasks.workunit.client.0.smithi111.stdout:5/422: write d19/d1b/d27/d2e/d39/d54/f92 [325918,34903] 0 2024-09-16T09:46:09.127 INFO:tasks.workunit.client.0.smithi111.stdout:0/365: creat d0/d1d/d67/d3a/d3d/d59/f85 x:0 0 0 2024-09-16T09:46:09.127 INFO:tasks.workunit.client.0.smithi111.stdout:0/366: chown d0/d1d/d67/d3a/l47 1600362 1 2024-09-16T09:46:09.127 INFO:tasks.workunit.client.0.smithi111.stdout:0/367: read d0/d1d/d67/d3a/d80/f78 [444541,107472] 0 2024-09-16T09:46:09.127 INFO:tasks.workunit.client.0.smithi111.stdout:0/368: fsync d0/f11 0 2024-09-16T09:46:09.129 INFO:tasks.workunit.client.0.smithi111.stdout:1/344: rename d3/d26/d63/l66 to d3/d24/d3c/d28/d36/d3d/d47/d65/d74/l77 0 2024-09-16T09:46:09.130 INFO:tasks.workunit.client.0.smithi111.stdout:5/423: unlink d19/d1b/d1e/l2c 0 2024-09-16T09:46:09.136 INFO:tasks.workunit.client.0.smithi111.stdout:0/369: write d0/d1d/d67/d3a/d3d/f71 [294944,104307] 0 2024-09-16T09:46:09.139 INFO:tasks.workunit.client.0.smithi111.stdout:5/424: write fa [2576794,62216] 0 2024-09-16T09:46:09.140 INFO:tasks.workunit.client.0.smithi111.stdout:1/345: getdents d3/d10 0 2024-09-16T09:46:09.145 INFO:tasks.workunit.client.0.smithi111.stdout:0/370: getdents d0/d26 0 2024-09-16T09:46:09.145 INFO:tasks.workunit.client.0.smithi111.stdout:0/371: fdatasync d0/f6e 0 2024-09-16T09:46:09.147 INFO:tasks.workunit.client.0.smithi111.stdout:0/372: read d0/f32 [525786,127429] 0 2024-09-16T09:46:09.147 INFO:tasks.workunit.client.0.smithi111.stdout:0/373: stat d0/d1d/d67/d3a/f63 0 2024-09-16T09:46:09.151 INFO:tasks.workunit.client.0.smithi111.stdout:5/425: mknod d19/d1b/d27/d2e/d4a/d4b/c94 0 2024-09-16T09:46:09.152 INFO:tasks.workunit.client.0.smithi111.stdout:5/426: read d19/d1b/f82 [1210,9655] 0 2024-09-16T09:46:09.154 INFO:tasks.workunit.client.0.smithi111.stdout:5/427: creat d19/f95 x:0 0 0 2024-09-16T09:46:09.155 INFO:tasks.workunit.client.0.smithi111.stdout:1/346: dwrite d3/d10/d1c/f33 [4194304,4194304] 0 2024-09-16T09:46:09.157 INFO:tasks.workunit.client.0.smithi111.stdout:5/428: dread d19/d1b/d27/d2e/d4a/f4c [0,4194304] 0 2024-09-16T09:46:09.157 INFO:tasks.workunit.client.0.smithi111.stdout:5/429: fdatasync d19/d1b/d27/d2e/f52 0 2024-09-16T09:46:09.158 INFO:tasks.workunit.client.0.smithi111.stdout:0/374: dread d0/fd [0,4194304] 0 2024-09-16T09:46:09.164 INFO:tasks.workunit.client.0.smithi111.stdout:1/347: write d3/f6 [820499,114111] 0 2024-09-16T09:46:09.164 INFO:tasks.workunit.client.0.smithi111.stdout:1/348: write d3/d24/d3f/f55 [674929,23147] 0 2024-09-16T09:46:09.165 INFO:tasks.workunit.client.0.smithi111.stdout:1/349: creat d3/d24/d3c/d28/d36/d3d/d47/d65/f78 x:0 0 0 2024-09-16T09:46:09.166 INFO:tasks.workunit.client.0.smithi111.stdout:1/350: rename d3/d24/d4e/c5d to d3/d24/d3c/d28/d36/d3d/d47/d65/d74/c79 0 2024-09-16T09:46:09.180 INFO:tasks.workunit.client.0.smithi111.stdout:2/424: sync 2024-09-16T09:46:09.180 INFO:tasks.workunit.client.0.smithi111.stdout:9/214: sync 2024-09-16T09:46:09.182 INFO:tasks.workunit.client.0.smithi111.stdout:2/425: rename d0/da/c2d to d0/da/d4e/c94 0 2024-09-16T09:46:09.183 INFO:tasks.workunit.client.0.smithi111.stdout:2/426: getdents d0/d2/d59 0 2024-09-16T09:46:09.185 INFO:tasks.workunit.client.0.smithi111.stdout:2/427: creat d0/d2/d5a/f95 x:0 0 0 2024-09-16T09:46:09.187 INFO:tasks.workunit.client.0.smithi111.stdout:5/430: dwrite d19/d1b/d27/d83/f75 [0,4194304] 0 2024-09-16T09:46:09.187 INFO:tasks.workunit.client.0.smithi111.stdout:1/351: dwrite d3/d24/d3c/d28/d36/f64 [0,4194304] 0 2024-09-16T09:46:09.193 INFO:tasks.workunit.client.0.smithi111.stdout:1/352: rmdir d3/d24/d3c/d28 39 2024-09-16T09:46:09.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/431: mknod d19/d1b/d1e/d21/d29/d32/d8f/c96 0 2024-09-16T09:46:09.194 INFO:tasks.workunit.client.0.smithi111.stdout:5/432: stat d19/d1b/d27/d83/l34 0 2024-09-16T09:46:09.195 INFO:tasks.workunit.client.0.smithi111.stdout:9/215: dread d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:09.196 INFO:tasks.workunit.client.0.smithi111.stdout:1/353: creat d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f7a x:0 0 0 2024-09-16T09:46:09.197 INFO:tasks.workunit.client.0.smithi111.stdout:5/433: rename d19/d1b/d1e/d21/d29/d32/f79 to d19/d1b/f97 0 2024-09-16T09:46:09.198 INFO:tasks.workunit.client.0.smithi111.stdout:5/434: write d19/f48 [3656158,30878] 0 2024-09-16T09:46:09.202 INFO:tasks.workunit.client.0.smithi111.stdout:9/216: unlink d0/d6/d8/f41 0 2024-09-16T09:46:09.202 INFO:tasks.workunit.client.0.smithi111.stdout:9/217: fdatasync d0/f3f 0 2024-09-16T09:46:09.204 INFO:tasks.workunit.client.0.smithi111.stdout:1/354: dread d3/f3e [0,4194304] 0 2024-09-16T09:46:09.204 INFO:tasks.workunit.client.0.smithi111.stdout:1/355: write d3/d24/d29/f51 [1349420,22458] 0 2024-09-16T09:46:09.208 INFO:tasks.workunit.client.0.smithi111.stdout:5/435: dread d19/d1b/d27/d83/f26 [0,4194304] 0 2024-09-16T09:46:09.208 INFO:tasks.workunit.client.0.smithi111.stdout:5/436: dread - d19/d1b/d27/d2e/d39/d54/d60/f86 zero size 2024-09-16T09:46:09.209 INFO:tasks.workunit.client.0.smithi111.stdout:5/437: truncate d19/d1b/d1e/d21/d29/d32/d46/f90 2167851 0 2024-09-16T09:46:09.213 INFO:tasks.workunit.client.0.smithi111.stdout:5/438: mkdir d19/d1b/d27/d2e/d98 0 2024-09-16T09:46:09.215 INFO:tasks.workunit.client.0.smithi111.stdout:9/218: dread d0/d6/d8/f26 [0,4194304] 0 2024-09-16T09:46:09.215 INFO:tasks.workunit.client.0.smithi111.stdout:9/219: write d0/d6/f34 [882199,66337] 0 2024-09-16T09:46:09.218 INFO:tasks.workunit.client.0.smithi111.stdout:5/439: unlink d19/d1b/d27/f37 0 2024-09-16T09:46:09.223 INFO:tasks.workunit.client.0.smithi111.stdout:5/440: getdents d19/d1b/d1e/d81 0 2024-09-16T09:46:09.269 INFO:tasks.workunit.client.0.smithi111.stdout:2/428: dwrite d0/d2/f51 [0,4194304] 0 2024-09-16T09:46:09.271 INFO:tasks.workunit.client.0.smithi111.stdout:2/429: mkdir d0/d2/d59/d86/d96 0 2024-09-16T09:46:09.273 INFO:tasks.workunit.client.0.smithi111.stdout:1/356: dwrite d3/d24/d3c/f1b [0,4194304] 0 2024-09-16T09:46:09.274 INFO:tasks.workunit.client.0.smithi111.stdout:2/430: dread d0/d2/f15 [0,4194304] 0 2024-09-16T09:46:09.274 INFO:tasks.workunit.client.0.smithi111.stdout:2/431: write d0/d45/f79 [869916,51637] 0 2024-09-16T09:46:09.276 INFO:tasks.workunit.client.0.smithi111.stdout:1/357: unlink d3/d24/d3c/d28/d36/d3d/d47/d65/f78 0 2024-09-16T09:46:09.277 INFO:tasks.workunit.client.0.smithi111.stdout:2/432: creat d0/d45/d81/f97 x:0 0 0 2024-09-16T09:46:09.277 INFO:tasks.workunit.client.0.smithi111.stdout:9/220: dwrite d0/d6/d8/f36 [0,4194304] 0 2024-09-16T09:46:09.277 INFO:tasks.workunit.client.0.smithi111.stdout:9/221: chown d0/d6/d8/c38 46784340 1 2024-09-16T09:46:09.283 INFO:tasks.workunit.client.0.smithi111.stdout:9/222: mkdir d0/d6/d30/d47 0 2024-09-16T09:46:09.283 INFO:tasks.workunit.client.0.smithi111.stdout:9/223: chown d0/d6/d30/c35 324 1 2024-09-16T09:46:09.283 INFO:tasks.workunit.client.0.smithi111.stdout:9/224: truncate d0/d6/d30/f39 71364 0 2024-09-16T09:46:09.288 INFO:tasks.workunit.client.0.smithi111.stdout:1/358: dread d3/d24/d4e/f52 [0,4194304] 0 2024-09-16T09:46:09.289 INFO:tasks.workunit.client.0.smithi111.stdout:1/359: mknod d3/d24/d3c/d28/d36/d3d/d47/c7b 0 2024-09-16T09:46:09.292 INFO:tasks.workunit.client.0.smithi111.stdout:1/360: dread d3/d24/d3f/f55 [0,4194304] 0 2024-09-16T09:46:09.294 INFO:tasks.workunit.client.0.smithi111.stdout:1/361: dread d3/d24/d4e/f5b [0,4194304] 0 2024-09-16T09:46:09.294 INFO:tasks.workunit.client.0.smithi111.stdout:1/362: chown d3/d24/d3c/d28/c6b 50 1 2024-09-16T09:46:09.299 INFO:tasks.workunit.client.0.smithi111.stdout:1/363: dread d3/d24/d4e/f52 [0,4194304] 0 2024-09-16T09:46:09.299 INFO:tasks.workunit.client.0.smithi111.stdout:1/364: chown d3/d24/d3c/d28/d36/d3d/d47/d65/d74/l77 101668916 1 2024-09-16T09:46:09.300 INFO:tasks.workunit.client.0.smithi111.stdout:1/365: truncate d3/d10/f18 1134272 0 2024-09-16T09:46:09.300 INFO:tasks.workunit.client.0.smithi111.stdout:1/366: stat d3/d24/d3c/f2a 0 2024-09-16T09:46:09.301 INFO:tasks.workunit.client.0.smithi111.stdout:9/225: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:09.302 INFO:tasks.workunit.client.0.smithi111.stdout:1/367: creat d3/d10/d1c/f7c x:0 0 0 2024-09-16T09:46:09.304 INFO:tasks.workunit.client.0.smithi111.stdout:9/226: mkdir d0/d48 0 2024-09-16T09:46:09.304 INFO:tasks.workunit.client.0.smithi111.stdout:9/227: stat d0/d48 0 2024-09-16T09:46:09.304 INFO:tasks.workunit.client.0.smithi111.stdout:9/228: chown d0/d6/l14 3 1 2024-09-16T09:46:09.305 INFO:tasks.workunit.client.0.smithi111.stdout:1/368: mknod d3/d24/d4e/d6f/c7d 0 2024-09-16T09:46:09.305 INFO:tasks.workunit.client.0.smithi111.stdout:1/369: write d3/d24/d29/f37 [595191,47789] 0 2024-09-16T09:46:09.306 INFO:tasks.workunit.client.0.smithi111.stdout:9/229: symlink d0/d6/d45/l49 0 2024-09-16T09:46:09.306 INFO:tasks.workunit.client.0.smithi111.stdout:9/230: fsync d0/d6/d8/de/f11 0 2024-09-16T09:46:09.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/231: rename d0/d6/l17 to d0/d21/d22/l4a 0 2024-09-16T09:46:09.309 INFO:tasks.workunit.client.0.smithi111.stdout:9/232: creat d0/d21/d22/f4b x:0 0 0 2024-09-16T09:46:09.312 INFO:tasks.workunit.client.0.smithi111.stdout:9/233: unlink d0/d6/d8/de/c20 0 2024-09-16T09:46:09.313 INFO:tasks.workunit.client.0.smithi111.stdout:9/234: rmdir d0/d6 39 2024-09-16T09:46:09.313 INFO:tasks.workunit.client.0.smithi111.stdout:9/235: write d0/f3f [521269,117788] 0 2024-09-16T09:46:09.326 INFO:tasks.workunit.client.0.smithi111.stdout:1/370: dwrite d3/d24/d3c/f17 [0,4194304] 0 2024-09-16T09:46:09.328 INFO:tasks.workunit.client.0.smithi111.stdout:1/371: truncate d3/d24/d3f/f71 633744 0 2024-09-16T09:46:09.329 INFO:tasks.workunit.client.0.smithi111.stdout:9/236: dwrite d0/d6/d30/f31 [0,4194304] 0 2024-09-16T09:46:09.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/372: creat d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f7e x:0 0 0 2024-09-16T09:46:09.334 INFO:tasks.workunit.client.0.smithi111.stdout:9/237: rename d0/d6/d30/f31 to d0/d6/d45/f4c 0 2024-09-16T09:46:09.335 INFO:tasks.workunit.client.0.smithi111.stdout:9/238: fsync d0/d6/d8/de/f2f 0 2024-09-16T09:46:09.336 INFO:tasks.workunit.client.0.smithi111.stdout:1/373: rmdir d3/d24/d3c/d28/d36/d3d/d47/d5a/d60 0 2024-09-16T09:46:09.336 INFO:tasks.workunit.client.0.smithi111.stdout:1/374: dread - d3/d24/d3c/f2a zero size 2024-09-16T09:46:09.338 INFO:tasks.workunit.client.0.smithi111.stdout:9/239: mkdir d0/d6/d30/d4d 0 2024-09-16T09:46:09.338 INFO:tasks.workunit.client.0.smithi111.stdout:9/240: write d0/d6/d8/f36 [4962165,64169] 0 2024-09-16T09:46:09.340 INFO:tasks.workunit.client.0.smithi111.stdout:9/241: fsync d0/d6/d8/f36 0 2024-09-16T09:46:09.340 INFO:tasks.workunit.client.0.smithi111.stdout:1/375: symlink d3/d10/d1c/l7f 0 2024-09-16T09:46:09.342 INFO:tasks.workunit.client.0.smithi111.stdout:9/242: mkdir d0/d6/d30/d4d/d4e 0 2024-09-16T09:46:09.345 INFO:tasks.workunit.client.0.smithi111.stdout:1/376: creat d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f80 x:0 0 0 2024-09-16T09:46:09.346 INFO:tasks.workunit.client.0.smithi111.stdout:1/377: creat d3/d24/d62/f81 x:0 0 0 2024-09-16T09:46:09.347 INFO:tasks.workunit.client.0.smithi111.stdout:9/243: read d0/d6/d8/f26 [2139019,18706] 0 2024-09-16T09:46:09.347 INFO:tasks.workunit.client.0.smithi111.stdout:9/244: read d0/d6/d30/f39 [37402,93861] 0 2024-09-16T09:46:09.349 INFO:tasks.workunit.client.0.smithi111.stdout:9/245: creat d0/d48/f4f x:0 0 0 2024-09-16T09:46:09.352 INFO:tasks.workunit.client.0.smithi111.stdout:9/246: mknod d0/d6/d30/d4d/d4e/c50 0 2024-09-16T09:46:09.359 INFO:tasks.workunit.client.0.smithi111.stdout:6/242: sync 2024-09-16T09:46:09.363 INFO:tasks.workunit.client.0.smithi111.stdout:1/378: dwrite d3/d24/d3c/f35 [12582912,4194304] 0 2024-09-16T09:46:09.367 INFO:tasks.workunit.client.0.smithi111.stdout:1/379: dread d3/d24/f5e [0,4194304] 0 2024-09-16T09:46:09.371 INFO:tasks.workunit.client.0.smithi111.stdout:9/247: dwrite d0/f1e [0,4194304] 0 2024-09-16T09:46:09.371 INFO:tasks.workunit.client.0.smithi111.stdout:9/248: read d0/f3f [559993,28692] 0 2024-09-16T09:46:09.371 INFO:tasks.workunit.client.0.smithi111.stdout:9/249: read d0/d6/d8/f26 [3139973,87000] 0 2024-09-16T09:46:09.376 INFO:tasks.workunit.client.0.smithi111.stdout:9/250: write d0/d6/f3c [98194,128256] 0 2024-09-16T09:46:09.376 INFO:tasks.workunit.client.0.smithi111.stdout:9/251: write d0/d6/f34 [830492,66432] 0 2024-09-16T09:46:09.378 INFO:tasks.workunit.client.0.smithi111.stdout:9/252: unlink d0/d21/d22/f4b 0 2024-09-16T09:46:09.379 INFO:tasks.workunit.client.0.smithi111.stdout:6/243: dwrite d0/df/d14/f31 [0,4194304] 0 2024-09-16T09:46:09.379 INFO:tasks.workunit.client.0.smithi111.stdout:9/253: mkdir d0/d18/d51 0 2024-09-16T09:46:09.379 INFO:tasks.workunit.client.0.smithi111.stdout:9/254: write d0/d21/d22/f3e [459805,94954] 0 2024-09-16T09:46:09.380 INFO:tasks.workunit.client.0.smithi111.stdout:1/380: dread d3/d24/d3c/f17 [0,4194304] 0 2024-09-16T09:46:09.384 INFO:tasks.workunit.client.0.smithi111.stdout:6/244: rename d0/df/d14/d20/d23/d32 to d0/df/d14/d20/d42/d50 0 2024-09-16T09:46:09.387 INFO:tasks.workunit.client.0.smithi111.stdout:1/381: symlink d3/d24/d3f/l82 0 2024-09-16T09:46:09.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/245: creat d0/df/d14/d20/d23/d41/d4f/f51 x:0 0 0 2024-09-16T09:46:09.390 INFO:tasks.workunit.client.0.smithi111.stdout:1/382: unlink d3/d24/d3c/f2a 0 2024-09-16T09:46:09.391 INFO:tasks.workunit.client.0.smithi111.stdout:6/246: mkdir d0/df/d47/d52 0 2024-09-16T09:46:09.392 INFO:tasks.workunit.client.0.smithi111.stdout:6/247: fdatasync d0/df/d14/f1f 0 2024-09-16T09:46:09.392 INFO:tasks.workunit.client.0.smithi111.stdout:1/383: mknod d3/d24/d3c/d28/d36/d3d/d47/c83 0 2024-09-16T09:46:09.393 INFO:tasks.workunit.client.0.smithi111.stdout:6/248: mknod d0/df/d14/d20/c53 0 2024-09-16T09:46:09.394 INFO:tasks.workunit.client.0.smithi111.stdout:9/255: dwrite d0/d21/d22/f3e [0,4194304] 0 2024-09-16T09:46:09.394 INFO:tasks.workunit.client.0.smithi111.stdout:6/249: dread d0/df/f2d [0,4194304] 0 2024-09-16T09:46:09.395 INFO:tasks.workunit.client.0.smithi111.stdout:1/384: mkdir d3/d26/d63/d84 0 2024-09-16T09:46:09.396 INFO:tasks.workunit.client.0.smithi111.stdout:6/250: truncate d0/f13 406086 0 2024-09-16T09:46:09.398 INFO:tasks.workunit.client.0.smithi111.stdout:1/385: mkdir d3/d24/d3c/d28/d36/d3d/d47/d65/d85 0 2024-09-16T09:46:09.398 INFO:tasks.workunit.client.0.smithi111.stdout:1/386: readlink d3/d24/d3c/d28/d36/d3d/d47/d65/d74/l77 0 2024-09-16T09:46:09.398 INFO:tasks.workunit.client.0.smithi111.stdout:6/251: creat d0/df/d14/d20/d23/d41/f54 x:0 0 0 2024-09-16T09:46:09.400 INFO:tasks.workunit.client.0.smithi111.stdout:1/387: dread d3/d24/d3c/fe [0,4194304] 0 2024-09-16T09:46:09.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/388: mknod d3/d26/d63/d84/c86 0 2024-09-16T09:46:09.418 INFO:tasks.workunit.client.0.smithi111.stdout:9/256: dwrite d0/d6/d8/f1c [8388608,4194304] 0 2024-09-16T09:46:09.421 INFO:tasks.workunit.client.0.smithi111.stdout:9/257: creat d0/d6/d30/d47/f52 x:0 0 0 2024-09-16T09:46:09.423 INFO:tasks.workunit.client.0.smithi111.stdout:9/258: link d0/d6/f44 d0/d6/d8/f53 0 2024-09-16T09:46:09.424 INFO:tasks.workunit.client.0.smithi111.stdout:6/252: dwrite d0/df/d14/f1b [0,4194304] 0 2024-09-16T09:46:09.426 INFO:tasks.workunit.client.0.smithi111.stdout:9/259: mknod d0/d18/d51/c54 0 2024-09-16T09:46:09.426 INFO:tasks.workunit.client.0.smithi111.stdout:1/389: dwrite d3/d10/d23/f2b [0,4194304] 0 2024-09-16T09:46:09.427 INFO:tasks.workunit.client.0.smithi111.stdout:6/253: truncate d0/df/d14/f1f 1703228 0 2024-09-16T09:46:09.427 INFO:tasks.workunit.client.0.smithi111.stdout:6/254: readlink d0/df/d14/d20/l39 0 2024-09-16T09:46:09.432 INFO:tasks.workunit.client.0.smithi111.stdout:6/255: read d0/f1a [3297736,36026] 0 2024-09-16T09:46:09.432 INFO:tasks.workunit.client.0.smithi111.stdout:6/256: fsync d0/df/d14/f21 0 2024-09-16T09:46:09.435 INFO:tasks.workunit.client.0.smithi111.stdout:1/390: rename d3/d26/f2d to d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f87 0 2024-09-16T09:46:09.438 INFO:tasks.workunit.client.0.smithi111.stdout:1/391: chown d3/f7 204420032 1 2024-09-16T09:46:09.462 INFO:tasks.workunit.client.0.smithi111.stdout:1/392: dwrite d3/f3e [0,4194304] 0 2024-09-16T09:46:09.462 INFO:tasks.workunit.client.0.smithi111.stdout:1/393: write d3/f14 [1363687,84126] 0 2024-09-16T09:46:09.462 INFO:tasks.workunit.client.0.smithi111.stdout:6/257: dwrite d0/df/d14/d20/d23/d41/d4f/f51 [0,4194304] 0 2024-09-16T09:46:09.462 INFO:tasks.workunit.client.0.smithi111.stdout:9/260: dwrite d0/d48/f4f [0,4194304] 0 2024-09-16T09:46:09.467 INFO:tasks.workunit.client.0.smithi111.stdout:1/394: dread d3/d24/d3f/f71 [0,4194304] 0 2024-09-16T09:46:09.467 INFO:tasks.workunit.client.0.smithi111.stdout:1/395: chown d3/d24/d29/l59 7 1 2024-09-16T09:46:09.470 INFO:tasks.workunit.client.0.smithi111.stdout:6/258: dread d0/f17 [0,4194304] 0 2024-09-16T09:46:09.471 INFO:tasks.workunit.client.0.smithi111.stdout:9/261: rename d0/d18/l1b to d0/d21/d22/l55 0 2024-09-16T09:46:09.473 INFO:tasks.workunit.client.0.smithi111.stdout:1/396: symlink d3/d24/d3c/d28/l88 0 2024-09-16T09:46:09.475 INFO:tasks.workunit.client.0.smithi111.stdout:6/259: link d0/df/d14/f21 d0/df/d14/d20/d42/f55 0 2024-09-16T09:46:09.475 INFO:tasks.workunit.client.0.smithi111.stdout:6/260: truncate d0/df/d49/f4c 714218 0 2024-09-16T09:46:09.483 INFO:tasks.workunit.client.0.smithi111.stdout:1/397: write d3/f7 [2315024,33735] 0 2024-09-16T09:46:09.485 INFO:tasks.workunit.client.0.smithi111.stdout:9/262: rename d0/d6/d30/d4d to d0/d6/d8/de/d56 0 2024-09-16T09:46:09.485 INFO:tasks.workunit.client.0.smithi111.stdout:9/263: stat d0/c2 0 2024-09-16T09:46:09.487 INFO:tasks.workunit.client.0.smithi111.stdout:6/261: unlink d0/f46 0 2024-09-16T09:46:09.487 INFO:tasks.workunit.client.0.smithi111.stdout:6/262: write d0/df/d14/d20/d23/f3b [1028189,49573] 0 2024-09-16T09:46:09.489 INFO:tasks.workunit.client.0.smithi111.stdout:1/398: mkdir d3/d24/d3f/d89 0 2024-09-16T09:46:09.491 INFO:tasks.workunit.client.0.smithi111.stdout:7/251: sync 2024-09-16T09:46:09.491 INFO:tasks.workunit.client.0.smithi111.stdout:7/252: dread - d1/d9/f3c zero size 2024-09-16T09:46:09.494 INFO:tasks.workunit.client.0.smithi111.stdout:1/399: read d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f87 [636653,81163] 0 2024-09-16T09:46:09.494 INFO:tasks.workunit.client.0.smithi111.stdout:1/400: write d3/d26/f34 [235899,32389] 0 2024-09-16T09:46:09.495 INFO:tasks.workunit.client.0.smithi111.stdout:1/401: chown d3/d24/d3f/f71 0 1 2024-09-16T09:46:09.495 INFO:tasks.workunit.client.0.smithi111.stdout:6/263: dread d0/df/d14/d20/d42/f55 [0,4194304] 0 2024-09-16T09:46:09.495 INFO:tasks.workunit.client.0.smithi111.stdout:6/264: truncate d0/df/d14/f31 4308727 0 2024-09-16T09:46:09.495 INFO:tasks.workunit.client.0.smithi111.stdout:1/402: truncate d3/d10/d23/f2b 2634402 0 2024-09-16T09:46:09.495 INFO:tasks.workunit.client.0.smithi111.stdout:1/403: readlink d3/d24/d3f/l82 0 2024-09-16T09:46:09.496 INFO:tasks.workunit.client.0.smithi111.stdout:6/265: creat d0/df/d14/d20/d42/f56 x:0 0 0 2024-09-16T09:46:09.499 INFO:tasks.workunit.client.0.smithi111.stdout:6/266: mkdir d0/d57 0 2024-09-16T09:46:09.499 INFO:tasks.workunit.client.0.smithi111.stdout:7/253: dread d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:09.499 INFO:tasks.workunit.client.0.smithi111.stdout:7/254: read d1/d9/fa [3663082,35449] 0 2024-09-16T09:46:09.499 INFO:tasks.workunit.client.0.smithi111.stdout:7/255: dread - d1/d9/f3c zero size 2024-09-16T09:46:09.504 INFO:tasks.workunit.client.0.smithi111.stdout:1/404: read d3/d10/d1c/f33 [6801863,84327] 0 2024-09-16T09:46:09.504 INFO:tasks.workunit.client.0.smithi111.stdout:1/405: chown d3/d24/d3c/d28/c6c 433270 1 2024-09-16T09:46:09.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/264: dwrite d0/f3f [0,4194304] 0 2024-09-16T09:46:09.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/265: truncate d0/d21/d22/f3e 4366890 0 2024-09-16T09:46:09.505 INFO:tasks.workunit.client.0.smithi111.stdout:7/256: dread d1/d16/d27/f2b [0,4194304] 0 2024-09-16T09:46:09.505 INFO:tasks.workunit.client.0.smithi111.stdout:7/257: write d1/d20/f23 [999788,102846] 0 2024-09-16T09:46:09.507 INFO:tasks.workunit.client.0.smithi111.stdout:1/406: rename d3/d24/d3f/c44 to d3/d24/d62/c8a 0 2024-09-16T09:46:09.513 INFO:tasks.workunit.client.0.smithi111.stdout:9/266: symlink d0/d6/d8/de/l57 0 2024-09-16T09:46:09.514 INFO:tasks.workunit.client.0.smithi111.stdout:7/258: link d1/d16/d17/d18/f4a d1/d16/d17/d18/d4f/f50 0 2024-09-16T09:46:09.515 INFO:tasks.workunit.client.0.smithi111.stdout:1/407: getdents d3/d24/d3c/d28/d36/d3d/d47 0 2024-09-16T09:46:09.516 INFO:tasks.workunit.client.0.smithi111.stdout:9/267: mkdir d0/d6/d45/d58 0 2024-09-16T09:46:09.518 INFO:tasks.workunit.client.0.smithi111.stdout:1/408: creat d3/d10/d23/f8b x:0 0 0 2024-09-16T09:46:09.518 INFO:tasks.workunit.client.0.smithi111.stdout:6/267: dwrite d0/f1a [0,4194304] 0 2024-09-16T09:46:09.519 INFO:tasks.workunit.client.0.smithi111.stdout:6/268: fsync d0/df/d14/f37 0 2024-09-16T09:46:09.519 INFO:tasks.workunit.client.0.smithi111.stdout:6/269: truncate d0/df/d14/f1f 1992722 0 2024-09-16T09:46:09.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/268: mkdir d0/d21/d59 0 2024-09-16T09:46:09.520 INFO:tasks.workunit.client.0.smithi111.stdout:1/409: mkdir d3/d10/d1c/d8c 0 2024-09-16T09:46:09.524 INFO:tasks.workunit.client.0.smithi111.stdout:7/259: write d1/d16/d17/d18/d1d/f24 [1964825,68550] 0 2024-09-16T09:46:09.525 INFO:tasks.workunit.client.0.smithi111.stdout:7/260: fsync d1/d16/d27/f45 0 2024-09-16T09:46:09.528 INFO:tasks.workunit.client.0.smithi111.stdout:7/261: rmdir d1/d16 39 2024-09-16T09:46:09.533 INFO:tasks.workunit.client.0.smithi111.stdout:1/410: dread d3/d10/d1c/f25 [0,4194304] 0 2024-09-16T09:46:09.533 INFO:tasks.workunit.client.0.smithi111.stdout:1/411: truncate d3/d10/d1c/f31 1085868 0 2024-09-16T09:46:09.535 INFO:tasks.workunit.client.0.smithi111.stdout:1/412: unlink d3/d24/l50 0 2024-09-16T09:46:09.547 INFO:tasks.workunit.client.0.smithi111.stdout:6/270: dwrite d0/df/d14/d20/d42/f55 [0,4194304] 0 2024-09-16T09:46:09.547 INFO:tasks.workunit.client.0.smithi111.stdout:6/271: chown d0/df/d14/l3e 208 1 2024-09-16T09:46:09.547 INFO:tasks.workunit.client.0.smithi111.stdout:6/272: write d0/df/d14/d20/d23/d33/f34 [574440,127316] 0 2024-09-16T09:46:09.548 INFO:tasks.workunit.client.0.smithi111.stdout:9/269: dwrite d0/f2a [0,4194304] 0 2024-09-16T09:46:09.548 INFO:tasks.workunit.client.0.smithi111.stdout:9/270: write d0/d6/d8/f26 [2174732,27085] 0 2024-09-16T09:46:09.548 INFO:tasks.workunit.client.0.smithi111.stdout:9/271: write d0/d6/d8/de/f2f [271097,41666] 0 2024-09-16T09:46:09.550 INFO:tasks.workunit.client.0.smithi111.stdout:6/273: symlink d0/df/d47/d52/l58 0 2024-09-16T09:46:09.550 INFO:tasks.workunit.client.0.smithi111.stdout:6/274: readlink d0/df/d14/d20/d42/d50/l4b 0 2024-09-16T09:46:09.550 INFO:tasks.workunit.client.0.smithi111.stdout:6/275: fsync d0/df/d14/d20/d42/f55 0 2024-09-16T09:46:09.551 INFO:tasks.workunit.client.0.smithi111.stdout:7/262: dwrite d1/d16/d27/f2b [0,4194304] 0 2024-09-16T09:46:09.556 INFO:tasks.workunit.client.0.smithi111.stdout:7/263: stat d1/l30 0 2024-09-16T09:46:09.556 INFO:tasks.workunit.client.0.smithi111.stdout:7/264: mknod d1/d16/c51 0 2024-09-16T09:46:09.558 INFO:tasks.workunit.client.0.smithi111.stdout:7/265: creat d1/d16/d17/f52 x:0 0 0 2024-09-16T09:46:09.561 INFO:tasks.workunit.client.0.smithi111.stdout:9/272: dread d0/d6/d8/f1c [8388608,4194304] 0 2024-09-16T09:46:09.561 INFO:tasks.workunit.client.0.smithi111.stdout:9/273: write d0/d6/d30/f39 [167114,38894] 0 2024-09-16T09:46:09.561 INFO:tasks.workunit.client.0.smithi111.stdout:9/274: readlink d0/d21/d22/l4a 0 2024-09-16T09:46:09.561 INFO:tasks.workunit.client.0.smithi111.stdout:9/275: fsync d0/f3f 0 2024-09-16T09:46:09.562 INFO:tasks.workunit.client.0.smithi111.stdout:1/413: dwrite d3/d24/d3c/fe [0,4194304] 0 2024-09-16T09:46:09.562 INFO:tasks.workunit.client.0.smithi111.stdout:1/414: chown d3/d10 2090 1 2024-09-16T09:46:09.570 INFO:tasks.workunit.client.0.smithi111.stdout:9/276: symlink d0/d18/d51/l5a 0 2024-09-16T09:46:09.574 INFO:tasks.workunit.client.0.smithi111.stdout:1/415: mknod d3/d10/d1c/c8d 0 2024-09-16T09:46:09.579 INFO:tasks.workunit.client.0.smithi111.stdout:7/266: dwrite d1/f14 [4194304,4194304] 0 2024-09-16T09:46:09.580 INFO:tasks.workunit.client.0.smithi111.stdout:7/267: read - d1/d16/d17/d18/d4f/f50 zero size 2024-09-16T09:46:09.580 INFO:tasks.workunit.client.0.smithi111.stdout:1/416: mkdir d3/d10/d23/d8e 0 2024-09-16T09:46:09.581 INFO:tasks.workunit.client.0.smithi111.stdout:1/417: mkdir d3/d10/d57/d8f 0 2024-09-16T09:46:09.585 INFO:tasks.workunit.client.0.smithi111.stdout:1/418: rename d3/f3e to d3/d24/d62/f90 0 2024-09-16T09:46:09.585 INFO:tasks.workunit.client.0.smithi111.stdout:1/419: write d3/d24/f5e [1090437,24124] 0 2024-09-16T09:46:09.594 INFO:tasks.workunit.client.0.smithi111.stdout:7/268: read d1/d9/f34 [1801200,126029] 0 2024-09-16T09:46:09.594 INFO:tasks.workunit.client.0.smithi111.stdout:7/269: write d1/d16/d17/d18/f4a [124841,48135] 0 2024-09-16T09:46:09.594 INFO:tasks.workunit.client.0.smithi111.stdout:7/270: chown d1/d16/d27/f2b 36 1 2024-09-16T09:46:09.594 INFO:tasks.workunit.client.0.smithi111.stdout:9/277: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:09.598 INFO:tasks.workunit.client.0.smithi111.stdout:9/278: unlink d0/d18/c1f 0 2024-09-16T09:46:09.623 INFO:tasks.workunit.client.0.smithi111.stdout:1/420: dwrite d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f7a [0,4194304] 0 2024-09-16T09:46:09.623 INFO:tasks.workunit.client.0.smithi111.stdout:7/271: dwrite d1/d9/f15 [0,4194304] 0 2024-09-16T09:46:09.639 INFO:tasks.workunit.client.0.smithi111.stdout:1/421: creat d3/d24/d3f/d89/f91 x:0 0 0 2024-09-16T09:46:09.639 INFO:tasks.workunit.client.0.smithi111.stdout:1/422: write d3/d24/d29/f37 [666148,10094] 0 2024-09-16T09:46:09.639 INFO:tasks.workunit.client.0.smithi111.stdout:9/279: write d0/d6/d45/f4c [601502,130979] 0 2024-09-16T09:46:09.652 INFO:tasks.workunit.client.0.smithi111.stdout:7/272: unlink d1/d16/d17/d18/d1d/c2d 0 2024-09-16T09:46:09.652 INFO:tasks.workunit.client.0.smithi111.stdout:7/273: truncate d1/d9/f15 4885361 0 2024-09-16T09:46:09.652 INFO:tasks.workunit.client.0.smithi111.stdout:7/274: chown d1/d16 199336599 1 2024-09-16T09:46:09.658 INFO:tasks.workunit.client.0.smithi111.stdout:9/280: truncate d0/d6/d8/f26 3194909 0 2024-09-16T09:46:09.659 INFO:tasks.workunit.client.0.smithi111.stdout:9/281: getdents d0/d21/d22 0 2024-09-16T09:46:09.665 INFO:tasks.workunit.client.0.smithi111.stdout:1/423: dwrite d3/d24/d29/f51 [0,4194304] 0 2024-09-16T09:46:09.667 INFO:tasks.workunit.client.0.smithi111.stdout:1/424: dread d3/d24/d3f/f55 [0,4194304] 0 2024-09-16T09:46:09.667 INFO:tasks.workunit.client.0.smithi111.stdout:1/425: readlink d3/d10/l22 0 2024-09-16T09:46:09.667 INFO:tasks.workunit.client.0.smithi111.stdout:1/426: write d3/d24/d3f/f4c [709382,11583] 0 2024-09-16T09:46:09.668 INFO:tasks.workunit.client.0.smithi111.stdout:1/427: write d3/d24/d29/f37 [4284554,126503] 0 2024-09-16T09:46:09.670 INFO:tasks.workunit.client.0.smithi111.stdout:9/282: write d0/f1e [3211881,15059] 0 2024-09-16T09:46:09.670 INFO:tasks.workunit.client.0.smithi111.stdout:9/283: chown d0/d21/d22 114702 1 2024-09-16T09:46:09.671 INFO:tasks.workunit.client.0.smithi111.stdout:9/284: rmdir d0/d6/d40 0 2024-09-16T09:46:09.674 INFO:tasks.workunit.client.0.smithi111.stdout:9/285: symlink d0/d6/d30/l5b 0 2024-09-16T09:46:09.676 INFO:tasks.workunit.client.0.smithi111.stdout:9/286: rename d0/d6/d8/f53 to d0/d6/d45/d58/f5c 0 2024-09-16T09:46:09.676 INFO:tasks.workunit.client.0.smithi111.stdout:9/287: write d0/f3f [4710761,75077] 0 2024-09-16T09:46:09.680 INFO:tasks.workunit.client.0.smithi111.stdout:9/288: mknod d0/d21/d59/c5d 0 2024-09-16T09:46:09.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/289: creat d0/d6/d8/de/d56/f5e x:0 0 0 2024-09-16T09:46:09.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/290: chown d0/d6/d8 1949129691 1 2024-09-16T09:46:09.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/291: chown d0/d21/d22/l55 1055 1 2024-09-16T09:46:09.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/292: rename d0/d18/d51/l5a to d0/d18/d51/l5f 0 2024-09-16T09:46:09.682 INFO:tasks.workunit.client.0.smithi111.stdout:9/293: write d0/d6/d45/f4c [4919080,58706] 0 2024-09-16T09:46:09.682 INFO:tasks.workunit.client.0.smithi111.stdout:7/275: truncate d1/d9/f15 4884672 0 2024-09-16T09:46:09.683 INFO:tasks.workunit.client.0.smithi111.stdout:1/428: dwrite d3/d24/d3c/f1b [4194304,4194304] 0 2024-09-16T09:46:09.683 INFO:tasks.workunit.client.0.smithi111.stdout:7/276: getdents d1/d16/d17/d18/d1d/d2f 0 2024-09-16T09:46:09.683 INFO:tasks.workunit.client.0.smithi111.stdout:7/277: read d1/d16/d17/d18/f21 [3571035,41137] 0 2024-09-16T09:46:09.685 INFO:tasks.workunit.client.0.smithi111.stdout:1/429: rename d3/d24/f5e to d3/d24/d3f/f92 0 2024-09-16T09:46:09.685 INFO:tasks.workunit.client.0.smithi111.stdout:1/430: chown d3/d24/d3c/d28/d36/d3d/d47/d65/d85 21023 1 2024-09-16T09:46:09.685 INFO:tasks.workunit.client.0.smithi111.stdout:1/431: chown d3/d24/d3c/d28/d36/d3d/d47/d5a 327815 1 2024-09-16T09:46:09.686 INFO:tasks.workunit.client.0.smithi111.stdout:7/278: mkdir d1/d9/d53 0 2024-09-16T09:46:09.686 INFO:tasks.workunit.client.0.smithi111.stdout:4/347: sync 2024-09-16T09:46:09.686 INFO:tasks.workunit.client.0.smithi111.stdout:8/184: sync 2024-09-16T09:46:09.687 INFO:tasks.workunit.client.0.smithi111.stdout:1/432: symlink d3/d10/d57/d8f/l93 0 2024-09-16T09:46:09.690 INFO:tasks.workunit.client.0.smithi111.stdout:7/279: rename d1/d16/d17/d18/d1b/c2c to d1/d16/d27/c54 0 2024-09-16T09:46:09.690 INFO:tasks.workunit.client.0.smithi111.stdout:8/185: read d3/de/d1e/d27/f28 [80507,63100] 0 2024-09-16T09:46:09.690 INFO:tasks.workunit.client.0.smithi111.stdout:8/186: chown d3/de/d1e/d2e/c31 10606752 1 2024-09-16T09:46:09.692 INFO:tasks.workunit.client.0.smithi111.stdout:1/433: creat d3/d10/d1c/f94 x:0 0 0 2024-09-16T09:46:09.693 INFO:tasks.workunit.client.0.smithi111.stdout:7/280: symlink d1/d9/d43/l55 0 2024-09-16T09:46:09.695 INFO:tasks.workunit.client.0.smithi111.stdout:8/187: creat d3/de/d1e/d2e/d2f/f33 x:0 0 0 2024-09-16T09:46:09.695 INFO:tasks.workunit.client.0.smithi111.stdout:8/188: chown d3/f1a 1930600 1 2024-09-16T09:46:09.695 INFO:tasks.workunit.client.0.smithi111.stdout:8/189: write d3/da/df/f24 [1626630,98550] 0 2024-09-16T09:46:09.697 INFO:tasks.workunit.client.0.smithi111.stdout:7/281: mkdir d1/d16/d17/d18/d4f/d56 0 2024-09-16T09:46:09.697 INFO:tasks.workunit.client.0.smithi111.stdout:1/434: dread d3/d26/f34 [0,4194304] 0 2024-09-16T09:46:09.698 INFO:tasks.workunit.client.0.smithi111.stdout:8/190: mkdir d3/de/d34 0 2024-09-16T09:46:09.699 INFO:tasks.workunit.client.0.smithi111.stdout:7/282: rmdir d1/d16/d17/d18 39 2024-09-16T09:46:09.701 INFO:tasks.workunit.client.0.smithi111.stdout:1/435: mkdir d3/d10/d57/d95 0 2024-09-16T09:46:09.701 INFO:tasks.workunit.client.0.smithi111.stdout:1/436: write d3/d26/f34 [1175973,29100] 0 2024-09-16T09:46:09.704 INFO:tasks.workunit.client.0.smithi111.stdout:9/294: dwrite d0/d6/d8/f26 [0,4194304] 0 2024-09-16T09:46:09.704 INFO:tasks.workunit.client.0.smithi111.stdout:9/295: chown d0/d6/f34 3450 1 2024-09-16T09:46:09.704 INFO:tasks.workunit.client.0.smithi111.stdout:1/437: creat d3/d10/f96 x:0 0 0 2024-09-16T09:46:09.706 INFO:tasks.workunit.client.0.smithi111.stdout:4/348: dwrite d2/d6/f3f [0,4194304] 0 2024-09-16T09:46:09.706 INFO:tasks.workunit.client.0.smithi111.stdout:8/191: dread d3/f7 [0,4194304] 0 2024-09-16T09:46:09.725 INFO:tasks.workunit.client.0.smithi111.stdout:9/296: dwrite d0/d6/d30/f39 [0,4194304] 0 2024-09-16T09:46:09.734 INFO:tasks.workunit.client.0.smithi111.stdout:8/192: mknod d3/d26/c35 0 2024-09-16T09:46:09.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/349: mkdir d2/d30/d44/d69 0 2024-09-16T09:46:09.743 INFO:tasks.workunit.client.0.smithi111.stdout:9/297: symlink d0/d48/l60 0 2024-09-16T09:46:09.744 INFO:tasks.workunit.client.0.smithi111.stdout:8/193: mknod d3/de/d1e/d2e/d2f/c36 0 2024-09-16T09:46:09.745 INFO:tasks.workunit.client.0.smithi111.stdout:8/194: chown d3/f10 13997 1 2024-09-16T09:46:09.745 INFO:tasks.workunit.client.0.smithi111.stdout:0/375: sync 2024-09-16T09:46:09.745 INFO:tasks.workunit.client.0.smithi111.stdout:3/337: sync 2024-09-16T09:46:09.745 INFO:tasks.workunit.client.0.smithi111.stdout:0/376: chown d0/d1d/f29 31 1 2024-09-16T09:46:09.745 INFO:tasks.workunit.client.0.smithi111.stdout:0/377: write d0/f31 [4693632,54700] 0 2024-09-16T09:46:09.747 INFO:tasks.workunit.client.0.smithi111.stdout:9/298: unlink d0/d18/l42 0 2024-09-16T09:46:09.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/195: creat d3/de/d1e/d2e/f37 x:0 0 0 2024-09-16T09:46:09.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/196: truncate d3/de/d1e/d2e/f37 454024 0 2024-09-16T09:46:09.750 INFO:tasks.workunit.client.0.smithi111.stdout:3/338: mkdir d5/da/db/d3a/d6d 0 2024-09-16T09:46:09.754 INFO:tasks.workunit.client.0.smithi111.stdout:9/299: write d0/d21/d22/f3e [1567287,64347] 0 2024-09-16T09:46:09.754 INFO:tasks.workunit.client.0.smithi111.stdout:9/300: write d0/d6/d45/d58/f5c [859866,118088] 0 2024-09-16T09:46:09.755 INFO:tasks.workunit.client.0.smithi111.stdout:0/378: mkdir d0/d26/d35/d86 0 2024-09-16T09:46:09.758 INFO:tasks.workunit.client.0.smithi111.stdout:3/339: rename d5/da/db/d5a/d5d/f5e to d5/da/d42/f6e 0 2024-09-16T09:46:09.759 INFO:tasks.workunit.client.0.smithi111.stdout:0/379: mknod d0/d1d/d67/d3a/d3d/c87 0 2024-09-16T09:46:09.762 INFO:tasks.workunit.client.0.smithi111.stdout:3/340: rename d5/da/db/de/f44 to d5/da/f6f 0 2024-09-16T09:46:09.762 INFO:tasks.workunit.client.0.smithi111.stdout:3/341: write d5/d18/f58 [47390,82421] 0 2024-09-16T09:46:09.762 INFO:tasks.workunit.client.0.smithi111.stdout:9/301: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:09.763 INFO:tasks.workunit.client.0.smithi111.stdout:9/302: creat d0/d21/d59/f61 x:0 0 0 2024-09-16T09:46:09.765 INFO:tasks.workunit.client.0.smithi111.stdout:3/342: mknod d5/da/c70 0 2024-09-16T09:46:09.765 INFO:tasks.workunit.client.0.smithi111.stdout:3/343: symlink d5/l71 0 2024-09-16T09:46:09.766 INFO:tasks.workunit.client.0.smithi111.stdout:3/344: symlink d5/da/db/de/l72 0 2024-09-16T09:46:09.767 INFO:tasks.workunit.client.0.smithi111.stdout:3/345: truncate d5/da/db/d35/f43 63719 0 2024-09-16T09:46:09.771 INFO:tasks.workunit.client.0.smithi111.stdout:8/197: dwrite d3/de/d1e/d2e/d2f/f32 [0,4194304] 0 2024-09-16T09:46:09.776 INFO:tasks.workunit.client.0.smithi111.stdout:8/198: creat d3/de/d34/f38 x:0 0 0 2024-09-16T09:46:09.795 INFO:tasks.workunit.client.0.smithi111.stdout:0/380: dwrite d0/d1d/f62 [0,4194304] 0 2024-09-16T09:46:09.796 INFO:tasks.workunit.client.0.smithi111.stdout:9/303: dwrite d0/f1e [0,4194304] 0 2024-09-16T09:46:09.796 INFO:tasks.workunit.client.0.smithi111.stdout:9/304: write d0/d6/d45/f4c [3313000,114767] 0 2024-09-16T09:46:09.796 INFO:tasks.workunit.client.0.smithi111.stdout:8/199: dwrite f0 [0,4194304] 0 2024-09-16T09:46:09.797 INFO:tasks.workunit.client.0.smithi111.stdout:8/200: readlink d3/l9 0 2024-09-16T09:46:09.799 INFO:tasks.workunit.client.0.smithi111.stdout:0/381: creat d0/d1d/d58/d64/f88 x:0 0 0 2024-09-16T09:46:09.800 INFO:tasks.workunit.client.0.smithi111.stdout:9/305: rename d0/d6/d8/de/c23 to d0/d18/c62 0 2024-09-16T09:46:09.801 INFO:tasks.workunit.client.0.smithi111.stdout:9/306: truncate d0/d6/d8/de/f11 1496110 0 2024-09-16T09:46:09.804 INFO:tasks.workunit.client.0.smithi111.stdout:9/307: symlink d0/l63 0 2024-09-16T09:46:09.804 INFO:tasks.workunit.client.0.smithi111.stdout:2/433: sync 2024-09-16T09:46:09.805 INFO:tasks.workunit.client.0.smithi111.stdout:6/276: sync 2024-09-16T09:46:09.805 INFO:tasks.workunit.client.0.smithi111.stdout:5/441: sync 2024-09-16T09:46:09.805 INFO:tasks.workunit.client.0.smithi111.stdout:2/434: write d0/f7 [638474,125911] 0 2024-09-16T09:46:09.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/308: link d0/d21/d22/c46 d0/d6/d8/de/c64 0 2024-09-16T09:46:09.809 INFO:tasks.workunit.client.0.smithi111.stdout:6/277: symlink d0/df/l59 0 2024-09-16T09:46:09.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/442: mkdir d19/d1b/d27/d83/d2a/d99 0 2024-09-16T09:46:09.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/443: write d19/d1b/d27/d83/f3f [2305418,44520] 0 2024-09-16T09:46:09.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/444: write d19/d1b/d1e/f40 [2629168,106040] 0 2024-09-16T09:46:09.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/445: readlink d19/d1b/d1e/d21/d29/l2f 0 2024-09-16T09:46:09.814 INFO:tasks.workunit.client.0.smithi111.stdout:2/435: mkdir d0/d22/d98 0 2024-09-16T09:46:09.816 INFO:tasks.workunit.client.0.smithi111.stdout:9/309: link d0/d6/d8/c1d d0/d6/d45/d58/c65 0 2024-09-16T09:46:09.817 INFO:tasks.workunit.client.0.smithi111.stdout:9/310: truncate d0/d6/d45/d58/f5c 1512495 0 2024-09-16T09:46:09.817 INFO:tasks.workunit.client.0.smithi111.stdout:9/311: chown d0/d6/d45/d58 22826 1 2024-09-16T09:46:09.819 INFO:tasks.workunit.client.0.smithi111.stdout:5/446: creat d19/d1b/d27/d2e/d4a/d4b/f9a x:0 0 0 2024-09-16T09:46:09.819 INFO:tasks.workunit.client.0.smithi111.stdout:5/447: rename d19/d1b/d27/d2e/d39/d54 to d19/d1b/d27/d2e/d39/d54/d60/d9b 22 2024-09-16T09:46:09.819 INFO:tasks.workunit.client.0.smithi111.stdout:2/436: mknod d0/d45/c99 0 2024-09-16T09:46:09.819 INFO:tasks.workunit.client.0.smithi111.stdout:8/201: dwrite d3/de/d1e/d27/f2b [0,4194304] 0 2024-09-16T09:46:09.821 INFO:tasks.workunit.client.0.smithi111.stdout:6/278: write d0/f19 [524365,25865] 0 2024-09-16T09:46:09.821 INFO:tasks.workunit.client.0.smithi111.stdout:6/279: chown d0/df/d14/d20/l39 5456180 1 2024-09-16T09:46:09.821 INFO:tasks.workunit.client.0.smithi111.stdout:9/312: creat d0/d21/f66 x:0 0 0 2024-09-16T09:46:09.822 INFO:tasks.workunit.client.0.smithi111.stdout:5/448: mkdir d19/d1b/d27/d2e/d4a/d4b/d9c 0 2024-09-16T09:46:09.822 INFO:tasks.workunit.client.0.smithi111.stdout:0/382: dwrite d0/f11 [0,4194304] 0 2024-09-16T09:46:09.823 INFO:tasks.workunit.client.0.smithi111.stdout:6/280: fdatasync d0/f19 0 2024-09-16T09:46:09.824 INFO:tasks.workunit.client.0.smithi111.stdout:2/437: mknod d0/d2/c9a 0 2024-09-16T09:46:09.831 INFO:tasks.workunit.client.0.smithi111.stdout:9/313: rename d0/d21/d22/c46 to d0/d6/d8/de/c67 0 2024-09-16T09:46:09.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/202: write d3/de/d1e/d27/f2b [936794,3685] 0 2024-09-16T09:46:09.833 INFO:tasks.workunit.client.0.smithi111.stdout:5/449: mkdir d19/d1b/d27/d9d 0 2024-09-16T09:46:09.833 INFO:tasks.workunit.client.0.smithi111.stdout:5/450: truncate d19/d1b/d1e/d41/f8e 223505 0 2024-09-16T09:46:09.835 INFO:tasks.workunit.client.0.smithi111.stdout:0/383: getdents d0/d1d/d58/d64/d5e 0 2024-09-16T09:46:09.840 INFO:tasks.workunit.client.0.smithi111.stdout:2/438: dwrite d0/d29/f2b [0,4194304] 0 2024-09-16T09:46:09.842 INFO:tasks.workunit.client.0.smithi111.stdout:9/314: rename d0/d48/f4f to d0/d18/d51/f68 0 2024-09-16T09:46:09.843 INFO:tasks.workunit.client.0.smithi111.stdout:9/315: read - d0/d6/d8/de/d56/f5e zero size 2024-09-16T09:46:09.845 INFO:tasks.workunit.client.0.smithi111.stdout:8/203: rmdir d3/da 39 2024-09-16T09:46:09.850 INFO:tasks.workunit.client.0.smithi111.stdout:0/384: dread d0/d26/d4b/f7c [0,4194304] 0 2024-09-16T09:46:09.853 INFO:tasks.workunit.client.0.smithi111.stdout:2/439: creat d0/d22/d98/f9b x:0 0 0 2024-09-16T09:46:09.856 INFO:tasks.workunit.client.0.smithi111.stdout:5/451: rename d19/d1b/d27/d2e/l31 to d19/d1b/d1e/d81/d93/l9e 0 2024-09-16T09:46:09.857 INFO:tasks.workunit.client.0.smithi111.stdout:0/385: mknod d0/d1d/d67/d3a/d77/c89 0 2024-09-16T09:46:09.860 INFO:tasks.workunit.client.0.smithi111.stdout:2/440: symlink d0/da/d4e/l9c 0 2024-09-16T09:46:09.861 INFO:tasks.workunit.client.0.smithi111.stdout:9/316: dwrite d0/d6/f3c [0,4194304] 0 2024-09-16T09:46:09.864 INFO:tasks.workunit.client.0.smithi111.stdout:5/452: unlink d19/l47 0 2024-09-16T09:46:09.865 INFO:tasks.workunit.client.0.smithi111.stdout:2/441: unlink d0/c1a 0 2024-09-16T09:46:09.867 INFO:tasks.workunit.client.0.smithi111.stdout:9/317: creat d0/d6/d45/f69 x:0 0 0 2024-09-16T09:46:09.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/453: mkdir d19/d1b/d9f 0 2024-09-16T09:46:09.870 INFO:tasks.workunit.client.0.smithi111.stdout:2/442: unlink d0/d2/d5a/l7a 0 2024-09-16T09:46:09.871 INFO:tasks.workunit.client.0.smithi111.stdout:8/204: dwrite d3/f13 [0,4194304] 0 2024-09-16T09:46:09.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/454: mknod d19/d1b/d27/d2e/ca0 0 2024-09-16T09:46:09.872 INFO:tasks.workunit.client.0.smithi111.stdout:9/318: dread d0/d6/f7 [0,4194304] 0 2024-09-16T09:46:09.875 INFO:tasks.workunit.client.0.smithi111.stdout:2/443: creat d0/da/d4e/f9d x:0 0 0 2024-09-16T09:46:09.877 INFO:tasks.workunit.client.0.smithi111.stdout:8/205: mknod d3/de/d1e/d27/c39 0 2024-09-16T09:46:09.877 INFO:tasks.workunit.client.0.smithi111.stdout:5/455: mknod d19/d1b/d1e/d21/ca1 0 2024-09-16T09:46:09.897 INFO:tasks.workunit.client.0.smithi111.stdout:9/319: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:09.899 INFO:tasks.workunit.client.0.smithi111.stdout:5/456: dwrite d19/d1b/d1e/f50 [0,4194304] 0 2024-09-16T09:46:09.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/457: chown d19/d1b/d1e/d21/d29/d32/d46/d7d/c7f 111 1 2024-09-16T09:46:09.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/458: stat d19/d1b/d27/d83/l30 0 2024-09-16T09:46:09.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/459: chown d19/d1b/d27/d2e/d39/d54/f92 0 1 2024-09-16T09:46:09.900 INFO:tasks.workunit.client.0.smithi111.stdout:8/206: dwrite d3/de/d1e/d2e/d2f/f32 [0,4194304] 0 2024-09-16T09:46:09.900 INFO:tasks.workunit.client.0.smithi111.stdout:9/320: truncate d0/f3f 631593 0 2024-09-16T09:46:09.900 INFO:tasks.workunit.client.0.smithi111.stdout:9/321: chown d0/d18 28038 1 2024-09-16T09:46:09.903 INFO:tasks.workunit.client.0.smithi111.stdout:5/460: creat d19/d1b/d1e/d21/d29/d32/d46/fa2 x:0 0 0 2024-09-16T09:46:09.903 INFO:tasks.workunit.client.0.smithi111.stdout:8/207: symlink d3/de/d1e/d2e/d2f/l3a 0 2024-09-16T09:46:09.906 INFO:tasks.workunit.client.0.smithi111.stdout:9/322: symlink d0/d18/d51/l6a 0 2024-09-16T09:46:09.906 INFO:tasks.workunit.client.0.smithi111.stdout:9/323: dread - d0/d6/d45/f69 zero size 2024-09-16T09:46:09.907 INFO:tasks.workunit.client.0.smithi111.stdout:8/208: rename d3/de/d1e/d2e/d2f/f32 to d3/da/db/f3b 0 2024-09-16T09:46:09.910 INFO:tasks.workunit.client.0.smithi111.stdout:9/324: creat d0/d48/f6b x:0 0 0 2024-09-16T09:46:09.912 INFO:tasks.workunit.client.0.smithi111.stdout:9/325: getdents d0 0 2024-09-16T09:46:09.916 INFO:tasks.workunit.client.0.smithi111.stdout:8/209: dread d3/da/db/f3b [0,4194304] 0 2024-09-16T09:46:09.917 INFO:tasks.workunit.client.0.smithi111.stdout:8/210: write d3/de/d1e/d2e/f37 [979579,121433] 0 2024-09-16T09:46:09.921 INFO:tasks.workunit.client.0.smithi111.stdout:9/326: write d0/d6/d8/f26 [4179988,122293] 0 2024-09-16T09:46:09.925 INFO:tasks.workunit.client.0.smithi111.stdout:8/211: symlink d3/da/df/l3c 0 2024-09-16T09:46:09.925 INFO:tasks.workunit.client.0.smithi111.stdout:8/212: truncate d3/de/d1e/d2e/d2f/f33 170598 0 2024-09-16T09:46:09.926 INFO:tasks.workunit.client.0.smithi111.stdout:8/213: chown d3/da/db/f3b 6330347 1 2024-09-16T09:46:09.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/327: mkdir d0/d6c 0 2024-09-16T09:46:09.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/328: stat d0/d6/d8/de/f2f 0 2024-09-16T09:46:09.929 INFO:tasks.workunit.client.0.smithi111.stdout:8/214: creat d3/de/d1e/d2e/f3d x:0 0 0 2024-09-16T09:46:09.930 INFO:tasks.workunit.client.0.smithi111.stdout:9/329: symlink d0/d6/d45/l6d 0 2024-09-16T09:46:09.930 INFO:tasks.workunit.client.0.smithi111.stdout:9/330: fsync d0/d6/d8/de/f11 0 2024-09-16T09:46:09.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/331: chown d0/d6/d45/f4c 147171799 1 2024-09-16T09:46:09.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/332: chown d0/d6/f34 1951321826 1 2024-09-16T09:46:09.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/333: write d0/d6/d45/f4c [1000541,129810] 0 2024-09-16T09:46:09.932 INFO:tasks.workunit.client.0.smithi111.stdout:8/215: mkdir d3/da/db/d3e 0 2024-09-16T09:46:09.936 INFO:tasks.workunit.client.0.smithi111.stdout:8/216: creat d3/de/d1e/d27/f3f x:0 0 0 2024-09-16T09:46:09.936 INFO:tasks.workunit.client.0.smithi111.stdout:8/217: fdatasync f1 0 2024-09-16T09:46:09.936 INFO:tasks.workunit.client.0.smithi111.stdout:8/218: truncate d3/da/db/f3b 4450025 0 2024-09-16T09:46:09.937 INFO:tasks.workunit.client.0.smithi111.stdout:8/219: chown d3/de/d1e/d2e/d2f 13492508 1 2024-09-16T09:46:09.938 INFO:tasks.workunit.client.0.smithi111.stdout:8/220: creat d3/d26/f40 x:0 0 0 2024-09-16T09:46:09.938 INFO:tasks.workunit.client.0.smithi111.stdout:8/221: truncate d3/f19 833024 0 2024-09-16T09:46:10.078 INFO:tasks.workunit.client.0.smithi111.stdout:9/334: rename d0/d18 to d0/d21/d22/d6e 0 2024-09-16T09:46:10.083 INFO:tasks.workunit.client.0.smithi111.stdout:9/335: unlink d0/d21/d59/f61 0 2024-09-16T09:46:10.086 INFO:tasks.workunit.client.0.smithi111.stdout:9/336: mknod d0/d6/d30/c6f 0 2024-09-16T09:46:10.089 INFO:tasks.workunit.client.0.smithi111.stdout:9/337: mkdir d0/d6c/d70 0 2024-09-16T09:46:10.093 INFO:tasks.workunit.client.0.smithi111.stdout:9/338: creat d0/d6/d8/de/d56/f71 x:0 0 0 2024-09-16T09:46:10.093 INFO:tasks.workunit.client.0.smithi111.stdout:9/339: chown d0/d21/f66 121538 1 2024-09-16T09:46:10.349 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:10 smithi114 ceph-mon[35635]: pgmap v258: 65 pgs: 65 active+clean; 623 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34 MiB/s rd, 41 MiB/s wr, 334 op/s 2024-09-16T09:46:10.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:10 smithi111 ceph-mon[27997]: pgmap v258: 65 pgs: 65 active+clean; 623 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 34 MiB/s rd, 41 MiB/s wr, 334 op/s 2024-09-16T09:46:10.444 INFO:tasks.workunit.client.0.smithi111.stdout:9/340: rename d0/d6/f34 to d0/d6/d8/f72 0 2024-09-16T09:46:10.444 INFO:tasks.workunit.client.0.smithi111.stdout:9/341: fdatasync d0/d6/d8/f72 0 2024-09-16T09:46:10.445 INFO:tasks.workunit.client.0.smithi111.stdout:9/342: creat d0/d6/d8/de/d56/d4e/f73 x:0 0 0 2024-09-16T09:46:10.450 INFO:tasks.workunit.client.0.smithi111.stdout:8/222: unlink d3/f7 0 2024-09-16T09:46:10.450 INFO:tasks.workunit.client.0.smithi111.stdout:8/223: write d3/da/f2c [793698,87192] 0 2024-09-16T09:46:10.451 INFO:tasks.workunit.client.0.smithi111.stdout:8/224: creat d3/de/d1e/d27/f41 x:0 0 0 2024-09-16T09:46:10.451 INFO:tasks.workunit.client.0.smithi111.stdout:8/225: chown d3/de/d1e/c20 683198123 1 2024-09-16T09:46:10.452 INFO:tasks.workunit.client.0.smithi111.stdout:8/226: creat d3/da/db/f42 x:0 0 0 2024-09-16T09:46:10.454 INFO:tasks.workunit.client.0.smithi111.stdout:9/343: write d0/d21/d22/d6e/d51/f68 [3936156,24414] 0 2024-09-16T09:46:10.455 INFO:tasks.workunit.client.0.smithi111.stdout:9/344: creat d0/d6c/f74 x:0 0 0 2024-09-16T09:46:10.456 INFO:tasks.workunit.client.0.smithi111.stdout:9/345: mkdir d0/d6/d75 0 2024-09-16T09:46:10.457 INFO:tasks.workunit.client.0.smithi111.stdout:9/346: getdents d0/d6/d8/de/d56 0 2024-09-16T09:46:10.458 INFO:tasks.workunit.client.0.smithi111.stdout:9/347: getdents d0/d21/d22/d6e 0 2024-09-16T09:46:10.460 INFO:tasks.workunit.client.0.smithi111.stdout:8/227: write d3/f8 [2448292,81753] 0 2024-09-16T09:46:10.460 INFO:tasks.workunit.client.0.smithi111.stdout:8/228: dread - d3/de/d1e/d27/f3f zero size 2024-09-16T09:46:10.460 INFO:tasks.workunit.client.0.smithi111.stdout:8/229: readlink d3/da/ld 0 2024-09-16T09:46:10.460 INFO:tasks.workunit.client.0.smithi111.stdout:9/348: unlink d0/d6/f7 0 2024-09-16T09:46:10.465 INFO:tasks.workunit.client.0.smithi111.stdout:9/349: rename d0/d6/d45/d58 to d0/d21/d22/d6e/d51/d76 0 2024-09-16T09:46:10.466 INFO:tasks.workunit.client.0.smithi111.stdout:9/350: truncate d0/d6/f3c 1317168 0 2024-09-16T09:46:10.466 INFO:tasks.workunit.client.0.smithi111.stdout:9/351: chown d0/d21/d22/d6e/d51/l6a 120422 1 2024-09-16T09:46:10.468 INFO:tasks.workunit.client.0.smithi111.stdout:8/230: dread f1 [0,4194304] 0 2024-09-16T09:46:10.469 INFO:tasks.workunit.client.0.smithi111.stdout:8/231: rename d3/da/f2c to d3/f43 0 2024-09-16T09:46:10.469 INFO:tasks.workunit.client.0.smithi111.stdout:8/232: chown d3/d26 9112073 1 2024-09-16T09:46:10.471 INFO:tasks.workunit.client.0.smithi111.stdout:8/233: truncate d3/da/df/f17 4037083 0 2024-09-16T09:46:10.472 INFO:tasks.workunit.client.0.smithi111.stdout:8/234: rename d3/de/d1e/c1f to d3/de/d34/c44 0 2024-09-16T09:46:10.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/235: dread d3/f1a [0,4194304] 0 2024-09-16T09:46:10.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/236: fsync d3/f13 0 2024-09-16T09:46:10.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/237: fsync d3/de/d1e/d27/f28 0 2024-09-16T09:46:10.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/238: chown d3/da/df/f24 992015245 1 2024-09-16T09:46:10.483 INFO:tasks.workunit.client.0.smithi111.stdout:8/239: dread d3/da/df/f25 [0,4194304] 0 2024-09-16T09:46:10.489 INFO:tasks.workunit.client.0.smithi111.stdout:9/352: dwrite d0/f1e [4194304,4194304] 0 2024-09-16T09:46:10.489 INFO:tasks.workunit.client.0.smithi111.stdout:9/353: chown d0/d48 2023655 1 2024-09-16T09:46:10.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/354: chown d0/d21/d22/c2e 47 1 2024-09-16T09:46:10.494 INFO:tasks.workunit.client.0.smithi111.stdout:8/240: creat d3/de/d1e/d27/f45 x:0 0 0 2024-09-16T09:46:10.494 INFO:tasks.workunit.client.0.smithi111.stdout:8/241: dread - d3/d26/f40 zero size 2024-09-16T09:46:10.495 INFO:tasks.workunit.client.0.smithi111.stdout:9/355: symlink d0/d48/l77 0 2024-09-16T09:46:10.497 INFO:tasks.workunit.client.0.smithi111.stdout:8/242: creat d3/d26/f46 x:0 0 0 2024-09-16T09:46:10.497 INFO:tasks.workunit.client.0.smithi111.stdout:8/243: write d3/d26/f40 [163348,113609] 0 2024-09-16T09:46:10.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/244: fdatasync d3/da/db/f3b 0 2024-09-16T09:46:10.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/245: chown d3/f1a 30905048 1 2024-09-16T09:46:10.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/246: chown d3/de/d1e 29756210 1 2024-09-16T09:46:10.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/247: chown d3/da 1714 1 2024-09-16T09:46:10.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/356: dread d0/f1e [0,4194304] 0 2024-09-16T09:46:10.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/357: write d0/d6/d8/f36 [5309981,111795] 0 2024-09-16T09:46:10.505 INFO:tasks.workunit.client.0.smithi111.stdout:8/248: write d3/de/f14 [2076863,22069] 0 2024-09-16T09:46:10.506 INFO:tasks.workunit.client.0.smithi111.stdout:9/358: rename d0/d6c/f74 to d0/d6/d8/de/f78 0 2024-09-16T09:46:10.508 INFO:tasks.workunit.client.0.smithi111.stdout:3/346: sync 2024-09-16T09:46:10.508 INFO:tasks.workunit.client.0.smithi111.stdout:4/350: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:1/438: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:5/461: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/444: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:6/281: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:6/282: chown d0/df/d14/d20/l27 3 1 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:0/386: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:6/283: chown d0/df/d14/d20/c45 16320 1 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:0/387: getdents d0/d26 0 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:7/283: sync 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:7/284: write d1/d9/f3c [377241,21521] 0 2024-09-16T09:46:10.509 INFO:tasks.workunit.client.0.smithi111.stdout:7/285: readlink d1/d16/d17/d18/d1d/l25 0 2024-09-16T09:46:10.511 INFO:tasks.workunit.client.0.smithi111.stdout:8/249: rename d3/da/db/f3b to d3/da/df/f47 0 2024-09-16T09:46:10.511 INFO:tasks.workunit.client.0.smithi111.stdout:8/250: write f0 [4585793,15592] 0 2024-09-16T09:46:10.516 INFO:tasks.workunit.client.0.smithi111.stdout:1/439: truncate d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f87 3294796 0 2024-09-16T09:46:10.516 INFO:tasks.workunit.client.0.smithi111.stdout:1/440: write d3/d24/d62/f81 [85459,102826] 0 2024-09-16T09:46:10.516 INFO:tasks.workunit.client.0.smithi111.stdout:2/445: symlink d0/d2/d59/l9e 0 2024-09-16T09:46:10.519 INFO:tasks.workunit.client.0.smithi111.stdout:6/284: symlink d0/df/d14/d20/d23/l5a 0 2024-09-16T09:46:10.522 INFO:tasks.workunit.client.0.smithi111.stdout:0/388: mknod d0/d1d/d58/d83/c8a 0 2024-09-16T09:46:10.526 INFO:tasks.workunit.client.0.smithi111.stdout:7/286: creat d1/d16/d17/d18/d4f/d56/f57 x:0 0 0 2024-09-16T09:46:10.528 INFO:tasks.workunit.client.0.smithi111.stdout:1/441: link d3/d24/d62/c8a d3/d24/d3f/d89/c97 0 2024-09-16T09:46:10.528 INFO:tasks.workunit.client.0.smithi111.stdout:1/442: stat d3/d24/d29 0 2024-09-16T09:46:10.531 INFO:tasks.workunit.client.0.smithi111.stdout:0/389: mknod d0/d26/d35/c8b 0 2024-09-16T09:46:10.537 INFO:tasks.workunit.client.0.smithi111.stdout:1/443: symlink d3/d24/d3c/d28/d36/d3d/d47/d65/l98 0 2024-09-16T09:46:10.537 INFO:tasks.workunit.client.0.smithi111.stdout:1/444: chown d3/d24/d3c/d28/d36/d3d/d47/d65/l98 149 1 2024-09-16T09:46:10.537 INFO:tasks.workunit.client.0.smithi111.stdout:0/390: creat d0/d1d/d67/d3a/f8c x:0 0 0 2024-09-16T09:46:10.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/251: dread d3/da/df/f47 [0,4194304] 0 2024-09-16T09:46:10.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/252: write d3/de/d1e/d2e/d2f/f33 [699999,116111] 0 2024-09-16T09:46:10.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/253: truncate d3/de/d1e/d27/f41 810850 0 2024-09-16T09:46:10.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/254: write d3/d26/f40 [595460,2977] 0 2024-09-16T09:46:10.540 INFO:tasks.workunit.client.0.smithi111.stdout:8/255: readlink d3/l9 0 2024-09-16T09:46:10.541 INFO:tasks.workunit.client.0.smithi111.stdout:7/287: rename d1/l8 to d1/d16/d27/l58 0 2024-09-16T09:46:10.544 INFO:tasks.workunit.client.0.smithi111.stdout:1/445: rename d3/d10/d1c/d8c to d3/d24/d3c/d99 0 2024-09-16T09:46:10.544 INFO:tasks.workunit.client.0.smithi111.stdout:9/359: dwrite d0/d6/d45/f69 [0,4194304] 0 2024-09-16T09:46:10.544 INFO:tasks.workunit.client.0.smithi111.stdout:6/285: dread d0/f1a [0,4194304] 0 2024-09-16T09:46:10.544 INFO:tasks.workunit.client.0.smithi111.stdout:6/286: readlink d0/df/d14/l29 0 2024-09-16T09:46:10.548 INFO:tasks.workunit.client.0.smithi111.stdout:7/288: write d1/d9/f1f [2719248,16263] 0 2024-09-16T09:46:10.548 INFO:tasks.workunit.client.0.smithi111.stdout:9/360: link d0/d21/d22/l4a d0/d6/d8/de/d56/d4e/l79 0 2024-09-16T09:46:10.551 INFO:tasks.workunit.client.0.smithi111.stdout:0/391: dread d0/d26/f2a [0,4194304] 0 2024-09-16T09:46:10.551 INFO:tasks.workunit.client.0.smithi111.stdout:8/256: rename d3/da/df/f24 to d3/de/d1e/d27/f48 0 2024-09-16T09:46:10.551 INFO:tasks.workunit.client.0.smithi111.stdout:8/257: read d3/d26/f40 [87827,69620] 0 2024-09-16T09:46:10.555 INFO:tasks.workunit.client.0.smithi111.stdout:9/361: dread d0/d6/d8/f72 [0,4194304] 0 2024-09-16T09:46:10.556 INFO:tasks.workunit.client.0.smithi111.stdout:0/392: chown d0/c23 8 1 2024-09-16T09:46:10.557 INFO:tasks.workunit.client.0.smithi111.stdout:8/258: creat d3/de/d1e/d2e/d2f/f49 x:0 0 0 2024-09-16T09:46:10.558 INFO:tasks.workunit.client.0.smithi111.stdout:6/287: write d0/df/d14/d20/d23/f2e [34834,17874] 0 2024-09-16T09:46:10.559 INFO:tasks.workunit.client.0.smithi111.stdout:7/289: mkdir d1/d59 0 2024-09-16T09:46:10.560 INFO:tasks.workunit.client.0.smithi111.stdout:7/290: chown d1/d16/d17/d18/c4d 1439221 1 2024-09-16T09:46:10.560 INFO:tasks.workunit.client.0.smithi111.stdout:9/362: link d0/l63 d0/l7a 0 2024-09-16T09:46:10.561 INFO:tasks.workunit.client.0.smithi111.stdout:0/393: truncate d0/f32 362445 0 2024-09-16T09:46:10.562 INFO:tasks.workunit.client.0.smithi111.stdout:8/259: creat d3/de/f4a x:0 0 0 2024-09-16T09:46:10.564 INFO:tasks.workunit.client.0.smithi111.stdout:6/288: mkdir d0/df/d49/d5b 0 2024-09-16T09:46:10.564 INFO:tasks.workunit.client.0.smithi111.stdout:6/289: fdatasync d0/df/d14/d20/d42/f55 0 2024-09-16T09:46:10.564 INFO:tasks.workunit.client.0.smithi111.stdout:8/260: fdatasync d3/f8 0 2024-09-16T09:46:10.565 INFO:tasks.workunit.client.0.smithi111.stdout:9/363: mkdir d0/d7b 0 2024-09-16T09:46:10.566 INFO:tasks.workunit.client.0.smithi111.stdout:3/347: dwrite d5/f1a [0,4194304] 0 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:3/348: dread - d5/da/db/d35/f5c zero size 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:3/349: readlink d5/da/db/d35/d41/l57 0 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:3/350: read - d5/da/db/d35/f39 zero size 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:5/462: dwrite d19/d1b/f82 [0,4194304] 0 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:5/463: chown d19/d1b/d27/d83/c28 365 1 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:0/394: creat d0/d1d/d67/d3a/f8d x:0 0 0 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:0/395: fdatasync d0/d1d/d67/d3a/f6f 0 2024-09-16T09:46:10.567 INFO:tasks.workunit.client.0.smithi111.stdout:0/396: fsync d0/d26/f2a 0 2024-09-16T09:46:10.568 INFO:tasks.workunit.client.0.smithi111.stdout:6/290: creat d0/df/d14/d20/d42/f5c x:0 0 0 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:8/261: mknod d3/de/d1e/d2e/c4b 0 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:2/446: dwrite d0/f53 [0,4194304] 0 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:2/447: fdatasync d0/d45/f65 0 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:1/446: dwrite d3/d24/d3c/fe [0,4194304] 0 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:1/447: chown d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f87 419847 1 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:1/448: readlink d3/d24/d3c/d28/d36/d3d/d47/d65/d74/l77 0 2024-09-16T09:46:10.570 INFO:tasks.workunit.client.0.smithi111.stdout:1/449: chown d3/d24/d3f/f71 57782 1 2024-09-16T09:46:10.572 INFO:tasks.workunit.client.0.smithi111.stdout:7/291: write d1/f14 [6277985,64987] 0 2024-09-16T09:46:10.572 INFO:tasks.workunit.client.0.smithi111.stdout:4/351: dwrite d2/f56 [0,4194304] 0 2024-09-16T09:46:10.572 INFO:tasks.workunit.client.0.smithi111.stdout:4/352: stat d2/d6/dd/d1b/d38/d64 0 2024-09-16T09:46:10.572 INFO:tasks.workunit.client.0.smithi111.stdout:9/364: rename d0/d21/c2b to d0/d6/d30/c7c 0 2024-09-16T09:46:10.573 INFO:tasks.workunit.client.0.smithi111.stdout:8/262: read d3/da/df/f25 [3475085,105211] 0 2024-09-16T09:46:10.574 INFO:tasks.workunit.client.0.smithi111.stdout:6/291: dread d0/f1a [0,4194304] 0 2024-09-16T09:46:10.574 INFO:tasks.workunit.client.0.smithi111.stdout:6/292: fdatasync d0/df/d14/f1b 0 2024-09-16T09:46:10.576 INFO:tasks.workunit.client.0.smithi111.stdout:0/397: mknod d0/d26/d4b/c8e 0 2024-09-16T09:46:10.580 INFO:tasks.workunit.client.0.smithi111.stdout:2/448: mkdir d0/d2/d61/d9f 0 2024-09-16T09:46:10.584 INFO:tasks.workunit.client.0.smithi111.stdout:1/450: mknod d3/d24/d4e/c9a 0 2024-09-16T09:46:10.586 INFO:tasks.workunit.client.0.smithi111.stdout:7/292: truncate d1/d20/f23 218245 0 2024-09-16T09:46:10.588 INFO:tasks.workunit.client.0.smithi111.stdout:3/351: rename d5/d18/l20 to d5/da/db/d3a/l73 0 2024-09-16T09:46:10.588 INFO:tasks.workunit.client.0.smithi111.stdout:3/352: fdatasync d5/da/db/d35/f43 0 2024-09-16T09:46:10.590 INFO:tasks.workunit.client.0.smithi111.stdout:8/263: mkdir d3/de/d1e/d2e/d2f/d4c 0 2024-09-16T09:46:10.591 INFO:tasks.workunit.client.0.smithi111.stdout:6/293: truncate d0/df/d14/d20/d23/f3b 955372 0 2024-09-16T09:46:10.592 INFO:tasks.workunit.client.0.smithi111.stdout:2/449: symlink d0/da/la0 0 2024-09-16T09:46:10.595 INFO:tasks.workunit.client.0.smithi111.stdout:5/464: rename d19/d1b/d1e/d21/d29/d32/d46/f5b to d19/d1b/d27/d2e/d4a/d4b/fa3 0 2024-09-16T09:46:10.598 INFO:tasks.workunit.client.0.smithi111.stdout:8/264: unlink d3/de/d1e/d2e/c31 0 2024-09-16T09:46:10.600 INFO:tasks.workunit.client.0.smithi111.stdout:6/294: write d0/f1a [1125619,124562] 0 2024-09-16T09:46:10.601 INFO:tasks.workunit.client.0.smithi111.stdout:4/353: rename d2/d6/dd/d1b/l52 to d2/d30/d44/d69/l6a 0 2024-09-16T09:46:10.603 INFO:tasks.workunit.client.0.smithi111.stdout:5/465: symlink d19/d1b/d27/d2e/d4a/d4b/d9c/la4 0 2024-09-16T09:46:10.603 INFO:tasks.workunit.client.0.smithi111.stdout:5/466: chown d19/d1b/d27/d9d 1 1 2024-09-16T09:46:10.604 INFO:tasks.workunit.client.0.smithi111.stdout:8/265: mknod d3/da/db/c4d 0 2024-09-16T09:46:10.606 INFO:tasks.workunit.client.0.smithi111.stdout:8/266: write d3/f19 [237804,49374] 0 2024-09-16T09:46:10.606 INFO:tasks.workunit.client.0.smithi111.stdout:8/267: dread - d3/da/db/f42 zero size 2024-09-16T09:46:10.609 INFO:tasks.workunit.client.0.smithi111.stdout:6/295: creat d0/df/d49/f5d x:0 0 0 2024-09-16T09:46:10.609 INFO:tasks.workunit.client.0.smithi111.stdout:6/296: write d0/f17 [2841693,21292] 0 2024-09-16T09:46:10.609 INFO:tasks.workunit.client.0.smithi111.stdout:6/297: chown d0/df/d14/f37 7 1 2024-09-16T09:46:10.610 INFO:tasks.workunit.client.0.smithi111.stdout:4/354: stat d2/d6/c22 0 2024-09-16T09:46:10.610 INFO:tasks.workunit.client.0.smithi111.stdout:4/355: readlink d2/d6/dd/d1b/l3e 0 2024-09-16T09:46:10.614 INFO:tasks.workunit.client.0.smithi111.stdout:8/268: rename d3/de/d1e/d27/f41 to d3/de/d34/f4e 0 2024-09-16T09:46:10.616 INFO:tasks.workunit.client.0.smithi111.stdout:6/298: mknod d0/df/d14/d20/d42/d50/c5e 0 2024-09-16T09:46:10.616 INFO:tasks.workunit.client.0.smithi111.stdout:5/467: dread d19/d1b/d27/d83/f75 [0,4194304] 0 2024-09-16T09:46:10.617 INFO:tasks.workunit.client.0.smithi111.stdout:4/356: creat d2/d6/dd/d1b/d38/d64/f6b x:0 0 0 2024-09-16T09:46:10.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/365: dwrite d0/f2a [4194304,4194304] 0 2024-09-16T09:46:10.622 INFO:tasks.workunit.client.0.smithi111.stdout:8/269: rmdir d3/de/d1e/d2e/d2f 39 2024-09-16T09:46:10.622 INFO:tasks.workunit.client.0.smithi111.stdout:8/270: fdatasync d3/de/d1e/d27/f28 0 2024-09-16T09:46:10.624 INFO:tasks.workunit.client.0.smithi111.stdout:6/299: unlink d0/df/d14/d20/l27 0 2024-09-16T09:46:10.624 INFO:tasks.workunit.client.0.smithi111.stdout:6/300: chown d0/f3a 119222486 1 2024-09-16T09:46:10.626 INFO:tasks.workunit.client.0.smithi111.stdout:0/398: dwrite d0/d1d/d67/d3a/d3d/f53 [0,4194304] 0 2024-09-16T09:46:10.627 INFO:tasks.workunit.client.0.smithi111.stdout:9/366: mkdir d0/d21/d22/d6e/d7d 0 2024-09-16T09:46:10.627 INFO:tasks.workunit.client.0.smithi111.stdout:9/367: chown d0/f2a 388200164 1 2024-09-16T09:46:10.627 INFO:tasks.workunit.client.0.smithi111.stdout:1/451: dwrite d3/d24/d3f/f55 [0,4194304] 0 2024-09-16T09:46:10.627 INFO:tasks.workunit.client.0.smithi111.stdout:4/357: write d2/d6/f20 [445777,45754] 0 2024-09-16T09:46:10.628 INFO:tasks.workunit.client.0.smithi111.stdout:8/271: rmdir d3/de/d34 39 2024-09-16T09:46:10.628 INFO:tasks.workunit.client.0.smithi111.stdout:8/272: chown d3/da/db/d3e 2410 1 2024-09-16T09:46:10.829 INFO:tasks.workunit.client.0.smithi111.stdout:9/368: unlink d0/d21/d22/d6e/d51/f68 0 2024-09-16T09:46:10.829 INFO:tasks.workunit.client.0.smithi111.stdout:7/293: dwrite d1/d9/f34 [8388608,4194304] 0 2024-09-16T09:46:10.829 INFO:tasks.workunit.client.0.smithi111.stdout:2/450: dwrite d0/da/d4e/f9d [0,4194304] 0 2024-09-16T09:46:10.829 INFO:tasks.workunit.client.0.smithi111.stdout:3/353: dwrite d5/da/db/d3a/d59/f61 [0,4194304] 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:0/399: creat d0/d1d/f8f x:0 0 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:0/400: write d0/d1d/d67/d3a/d77/f84 [407136,35135] 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:8/273: creat d3/da/db/d3e/f4f x:0 0 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/369: truncate d0/d6/d8/f1c 11149934 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/370: chown d0/d21/l2c 0 1 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:1/452: dread d3/d24/d29/f51 [0,4194304] 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:0/401: write d0/f32 [1078407,85182] 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:7/294: creat d1/d16/d17/d18/d4f/d56/f5a x:0 0 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:3/354: read d5/d18/f29 [3514779,74351] 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:2/451: link d0/da/f33 d0/d45/d5c/d67/fa1 0 2024-09-16T09:46:10.830 INFO:tasks.workunit.client.0.smithi111.stdout:2/452: chown d0/d21/c3c 16 1 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/274: write d3/f10 [1823371,72647] 0 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/275: chown d3/de/d1e/d2e/d2f 164 1 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/276: chown d3/da/df/f17 102 1 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/277: write d3/da/df/f25 [1438692,51422] 0 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:0/402: dread d0/d1d/f3c [0,4194304] 0 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:0/403: chown d0/d1d/d67/d3a/f63 1443800 1 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/355: dread d5/f8 [0,4194304] 0 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/356: dread - d5/da/db/d5a/f67 zero size 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:9/371: rmdir d0/d21/d22 39 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:1/453: creat d3/d26/d63/f9b x:0 0 0 2024-09-16T09:46:10.831 INFO:tasks.workunit.client.0.smithi111.stdout:4/358: dwrite d2/d30/d44/f47 [4194304,4194304] 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:4/359: write d2/d6/dd/d1b/f29 [662496,1794] 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:6/301: dwrite d0/f13 [0,4194304] 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:6/302: stat d0/df/d14/d20/c53 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:6/303: read d0/df/d49/f4c [650323,120516] 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:7/295: mknod d1/d16/c5b 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:7/296: write d1/d16/d17/d18/f4c [4359235,36245] 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:2/453: mknod d0/d45/d81/ca2 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:8/278: creat d3/f50 x:0 0 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:3/357: unlink d5/da/c21 0 2024-09-16T09:46:10.832 INFO:tasks.workunit.client.0.smithi111.stdout:3/358: stat d5/da/db/c3d 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:1/454: mknod d3/d26/c9c 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:6/304: symlink d0/df/d49/d5b/l5f 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:7/297: creat d1/d16/d17/d18/d1d/d2f/f5c x:0 0 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:3/359: mkdir d5/da/d42/d74 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:3/360: chown d5/da/db/de/c17 1 1 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:3/361: chown d5/l9 294555 1 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:3/362: fdatasync d5/da/d42/f4e 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:0/404: dwrite d0/d1d/d67/d3a/f8c [0,4194304] 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:0/405: chown d0/d26/l2e 150913069 1 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:1/455: rename d3/d24/d3c/d28/l88 to d3/d24/d3c/d28/d36/d3d/d47/d65/d85/l9d 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:6/305: link d0/df/d14/d20/d23/d41/f54 d0/df/d14/d20/d23/d41/d4f/f60 0 2024-09-16T09:46:10.833 INFO:tasks.workunit.client.0.smithi111.stdout:7/298: creat d1/d16/d17/d18/d1d/f5d x:0 0 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/363: mkdir d5/da/db/d5a/d5d/d75 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/364: stat d5/da/db/d35/c4c 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/365: dread - d5/da/d42/f48 zero size 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:2/454: dread d0/f7 [0,4194304] 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:2/455: write d0/d29/f2b [4245742,121783] 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/406: truncate d0/d1d/d67/d3a/d80/f6d 1172181 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:1/456: creat d3/d10/d72/f9e x:0 0 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:6/306: rename d0/df/d49/f5d to d0/df/d14/d20/d42/d50/f61 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:6/307: chown d0/df/d14/d20/l39 114187255 1 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/366: creat d5/da/db/d5a/f76 x:0 0 0 2024-09-16T09:46:10.834 INFO:tasks.workunit.client.0.smithi111.stdout:3/367: chown d5/da/db/de 1 1 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:3/368: dread d5/da/db/d35/f43 [0,4194304] 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:2/456: mknod d0/d22/d98/ca3 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:0/407: creat d0/d1d/d58/d64/f90 x:0 0 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:6/308: mkdir d0/df/d14/d20/d42/d4e/d62 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:3/369: creat d5/da/d42/f77 x:0 0 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:3/370: fsync d5/f69 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:2/457: rmdir d0 39 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:0/408: mknod d0/d1d/d58/d64/c91 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:0/409: write d0/d1d/f8f [57052,44023] 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:4/360: dwrite d2/fb [4194304,4194304] 0 2024-09-16T09:46:10.835 INFO:tasks.workunit.client.0.smithi111.stdout:2/458: creat d0/d45/d5c/fa4 x:0 0 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:2/459: fdatasync d0/d2/d5a/f95 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:7/299: dwrite d1/d16/d17/d18/d1d/f24 [4194304,4194304] 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:9/372: dwrite d0/d6/d8/f26 [4194304,4194304] 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:9/373: readlink d0/d6/d8/de/l13 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:4/361: mkdir d2/d6/dd/d1c/d2f/d6c 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:4/362: truncate d2/d6/dd/d1c/d2f/d4e/f59 805991 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:4/363: fdatasync d2/d6/dd/d1b/d38/d64/f6b 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:6/309: unlink d0/df/d14/d20/d23/f3b 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:6/310: dread - d0/df/d14/d20/d23/d41/d4f/f60 zero size 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:2/460: mknod d0/d29/d80/ca5 0 2024-09-16T09:46:10.836 INFO:tasks.workunit.client.0.smithi111.stdout:8/279: getdents d3/de/d1e/d2e 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:7/300: creat d1/d16/d17/d18/d1b/f5e x:0 0 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:9/374: symlink d0/d6/d8/de/l7e 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:9/375: fdatasync d0/d21/f66 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:4/364: mkdir d2/d6/dd/d1b/d6d 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:4/365: getdents d2/d6/dd/d1b/d38/d64/d65 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:6/311: symlink d0/df/d14/d20/d23/d41/l63 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:6/312: read - d0/df/d14/d20/d42/d50/f61 zero size 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:1/457: dwrite d3/d10/d57/f68 [0,4194304] 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:2/461: mkdir d0/da6 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:8/280: rename d3/de/d1e/d27/f48 to d3/de/d1e/f51 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:3/371: dwrite d5/f8 [0,4194304] 0 2024-09-16T09:46:10.837 INFO:tasks.workunit.client.0.smithi111.stdout:0/410: dread d0/d1d/d67/d3a/d3d/f48 [0,4194304] 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:3/372: write d5/d18/f29 [2604554,75750] 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:3/373: stat d5/c3f 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:3/374: fdatasync f3 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/301: creat d1/d16/f5f x:0 0 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:4/366: creat d2/d30/f6e x:0 0 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:4/367: dread - d2/d30/f6e zero size 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:4/368: chown d2/d30/d44/f47 26292 1 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:6/313: mkdir d0/df/d14/d20/d42/d4e/d64 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:1/458: link d3/d24/d3f/l5f d3/d24/d3c/d28/l9f 0 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:8/281: rmdir d3/da/db 39 2024-09-16T09:46:10.838 INFO:tasks.workunit.client.0.smithi111.stdout:0/411: mkdir d0/d1d/d67/d3a/d92 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:3/375: mkdir d5/d18/d78 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:7/302: link d1/d20/c44 d1/d9/c60 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:4/369: dread d2/d6/dd/d1c/d2f/f46 [0,4194304] 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:4/370: fdatasync d2/d6/f14 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/314: rmdir d0 39 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:1/459: dread d3/f14 [0,4194304] 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:0/412: unlink d0/d1d/d67/d3a/d80/c60 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:7/303: rename d1/d9/l3d to d1/d9/l61 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:7/304: chown d1/d16/d17/d18/d1d/d2f/c46 480 1 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:4/371: unlink d2/d6/dd/f2a 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/315: creat d0/df/d14/d20/d42/d50/f65 x:0 0 0 2024-09-16T09:46:10.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/316: chown d0/l43 7 1 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:6/317: chown d0/df/d14/l29 16777 1 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/305: creat d1/d16/d17/d18/f62 x:0 0 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/306: readlink d1/d16/d27/l49 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:4/372: symlink d2/d6/dd/d1c/l6f 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:4/373: write d2/f17 [1759904,101868] 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:4/374: stat d2/d6/dd/d1b/d38/f68 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/307: truncate d1/d16/d27/f45 3771724 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/308: unlink d1/l10 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:7/309: mknod d1/d16/d17/c63 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:9/376: dwrite d0/d6/d8/f26 [4194304,4194304] 0 2024-09-16T09:46:10.840 INFO:tasks.workunit.client.0.smithi111.stdout:2/462: dwrite d0/d2/d44/f4b [0,4194304] 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/463: read d0/f3d [2642705,122866] 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:7/310: rename d1/d20/c28 to d1/d16/d17/d18/d4f/d56/c64 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/464: truncate d0/f36 3702194 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/465: creat d0/fa7 x:0 0 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/466: mkdir d0/da/d4e/da8 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/467: chown d0/d21/c73 3 1 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:7/311: dread d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:7/312: mknod d1/d20/c65 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:7/313: unlink d1/d20/f23 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:7/314: symlink d1/d20/l66 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/468: write d0/d29/f31 [2652056,3579] 0 2024-09-16T09:46:10.841 INFO:tasks.workunit.client.0.smithi111.stdout:2/469: dread - d0/da/d4e/f77 zero size 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:2/470: link d0/d2/d5a/f62 d0/da/d4e/fa9 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:8/282: dwrite d3/de/f14 [0,4194304] 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/376: dwrite d5/da/db/d3a/d59/f5b [0,4194304] 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/377: truncate f3 4218199 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/378: symlink d5/da/db/d5a/d5d/l79 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/379: creat d5/da/db/d35/d45/f7a x:0 0 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/380: creat d5/da/db/d5a/f7b x:0 0 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/381: fdatasync d5/da/db/d35/d45/f63 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/382: write d5/da/db/d35/f4f [486703,88172] 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:3/383: write d5/da/db/d35/d45/f7a [790162,20571] 0 2024-09-16T09:46:10.842 INFO:tasks.workunit.client.0.smithi111.stdout:1/460: dwrite d3/d24/d3c/d28/d36/d3d/d47/d65/d74/f80 [0,4194304] 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:1/461: readlink d3/d24/d3c/d28/d36/d3d/d47/d65/l98 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:1/462: fsync d3/d24/d3f/f55 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:0/413: dwrite d0/d1d/d58/d64/d4f/f52 [0,4194304] 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:0/414: fsync d0/d1d/d58/d64/d4f/f52 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/384: symlink d5/l7c 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:9/377: dwrite d0/d6/d45/f4c [4194304,4194304] 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:0/415: read d0/fd [884928,126998] 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/385: creat d5/da/db/f7d x:0 0 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/386: fdatasync d5/d18/f24 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/387: creat d5/da/db/f7e x:0 0 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/388: truncate d5/da/db/de/f28 790545 0 2024-09-16T09:46:10.843 INFO:tasks.workunit.client.0.smithi111.stdout:3/389: read d5/da/f6f [2636674,113748] 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:6/318: dwrite d0/f12 [0,4194304] 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:6/319: dread - d0/df/d14/d20/d23/d41/f54 zero size 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:6/320: truncate d0/df/d14/d20/d23/f2e 4501209 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:2/471: dwrite d0/f53 [4194304,4194304] 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:4/375: dwrite d2/d6/dd/d1c/d2f/f58 [0,4194304] 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:3/390: rename d5/da/db/d3a/l64 to d5/da/db/d5a/d5d/d75/l7f 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:3/391: readlink d5/l23 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:6/321: dread d0/df/d14/f1f [0,4194304] 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:2/472: symlink d0/d2/d59/d86/d96/laa 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:8/283: dwrite d3/f1a [0,4194304] 0 2024-09-16T09:46:10.844 INFO:tasks.workunit.client.0.smithi111.stdout:1/463: dwrite d3/d24/d3c/f1b [8388608,4194304] 0 2024-09-16T09:46:10.845 INFO:tasks.workunit.client.0.smithi111.stdout:1/464: chown d3/d24 1 1 2024-09-16T09:46:10.845 INFO:tasks.workunit.client.0.smithi111.stdout:2/473: mkdir d0/d2/d61/d9f/dab 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:1/465: symlink d3/d24/d3c/d28/d36/la0 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:2/474: mkdir d0/d22/dac 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:0/416: dwrite d0/d1d/d67/d3a/d3d/f71 [0,4194304] 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:9/378: dwrite d0/d6/d30/f39 [4194304,4194304] 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:2/475: rename d0/d2/d5a/f95 to d0/d2/fad 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:1/466: write d3/d24/d29/f51 [2864708,101164] 0 2024-09-16T09:46:10.846 INFO:tasks.workunit.client.0.smithi111.stdout:2/476: write d0/fc [442396,125595] 0 2024-09-16T09:46:10.849 INFO:tasks.workunit.client.0.smithi111.stdout:9/379: dread d0/f1e [0,4194304] 0 2024-09-16T09:46:10.850 INFO:tasks.workunit.client.0.smithi111.stdout:2/477: link d0/d2/d59/d86/d96/laa d0/d2/d61/d9f/dab/lae 0 2024-09-16T09:46:10.851 INFO:tasks.workunit.client.0.smithi111.stdout:3/392: dwrite d5/da/db/d5a/f67 [0,4194304] 0 2024-09-16T09:46:10.851 INFO:tasks.workunit.client.0.smithi111.stdout:0/417: mkdir d0/d93 0 2024-09-16T09:46:10.851 INFO:tasks.workunit.client.0.smithi111.stdout:0/418: fdatasync d0/d1d/d67/f43 0 2024-09-16T09:46:10.854 INFO:tasks.workunit.client.0.smithi111.stdout:2/478: creat d0/d2/d61/d9f/faf x:0 0 0 2024-09-16T09:46:10.854 INFO:tasks.workunit.client.0.smithi111.stdout:3/393: mknod d5/d18/d78/c80 0 2024-09-16T09:46:10.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/419: creat d0/d1d/d67/d3a/d3d/d59/f94 x:0 0 0 2024-09-16T09:46:10.858 INFO:tasks.workunit.client.0.smithi111.stdout:3/394: unlink d5/da/db/l4d 0 2024-09-16T09:46:10.871 INFO:tasks.workunit.client.0.smithi111.stdout:4/376: getdents d2/d6/dd 0 2024-09-16T09:46:10.872 INFO:tasks.workunit.client.0.smithi111.stdout:4/377: fdatasync d2/d6/dd/d1b/d38/d64/f66 0 2024-09-16T09:46:10.874 INFO:tasks.workunit.client.0.smithi111.stdout:2/479: dwrite d0/da/d4e/f9d [0,4194304] 0 2024-09-16T09:46:10.877 INFO:tasks.workunit.client.0.smithi111.stdout:2/480: creat d0/d2/fb0 x:0 0 0 2024-09-16T09:46:10.888 INFO:tasks.workunit.client.0.smithi111.stdout:4/378: read d2/fb [126447,11186] 0 2024-09-16T09:46:10.888 INFO:tasks.workunit.client.0.smithi111.stdout:3/395: dwrite d5/d18/f29 [0,4194304] 0 2024-09-16T09:46:10.888 INFO:tasks.workunit.client.0.smithi111.stdout:3/396: chown d5/da/db/d35/d41/l47 32799245 1 2024-09-16T09:46:10.888 INFO:tasks.workunit.client.0.smithi111.stdout:3/397: write d5/da/db/d35/d45/f7a [1592376,48403] 0 2024-09-16T09:46:10.928 INFO:tasks.workunit.client.0.smithi111.stdout:3/398: creat d5/da/db/d35/f81 x:0 0 0 2024-09-16T09:46:10.928 INFO:tasks.workunit.client.0.smithi111.stdout:3/399: fsync d5/da/db/d3a/d59/f5b 0 2024-09-16T09:46:10.969 INFO:tasks.workunit.client.0.smithi111.stdout:4/379: unlink d2/d6/dd/c3a 0 2024-09-16T09:46:10.971 INFO:tasks.workunit.client.0.smithi111.stdout:3/400: creat d5/d18/d78/f82 x:0 0 0 2024-09-16T09:46:10.974 INFO:tasks.workunit.client.0.smithi111.stdout:4/380: creat d2/d6/dd/d1b/d38/d64/d65/f70 x:0 0 0 2024-09-16T09:46:10.978 INFO:tasks.workunit.client.0.smithi111.stdout:3/401: creat d5/da/db/d5a/d5d/f83 x:0 0 0 2024-09-16T09:46:10.978 INFO:tasks.workunit.client.0.smithi111.stdout:3/402: dread - d5/da/d42/f77 zero size 2024-09-16T09:46:10.979 INFO:tasks.workunit.client.0.smithi111.stdout:4/381: getdents d2 0 2024-09-16T09:46:10.982 INFO:tasks.workunit.client.0.smithi111.stdout:3/403: dread d5/f56 [0,4194304] 0 2024-09-16T09:46:10.982 INFO:tasks.workunit.client.0.smithi111.stdout:3/404: write d5/da/db/f7d [542546,781] 0 2024-09-16T09:46:10.983 INFO:tasks.workunit.client.0.smithi111.stdout:4/382: creat d2/d6/dd/d1c/d2f/d4e/f71 x:0 0 0 2024-09-16T09:46:10.984 INFO:tasks.workunit.client.0.smithi111.stdout:3/405: rmdir d5/da/db/de 39 2024-09-16T09:46:10.985 INFO:tasks.workunit.client.0.smithi111.stdout:4/383: symlink d2/d6/dd/d1b/d6d/l72 0 2024-09-16T09:46:10.992 INFO:tasks.workunit.client.0.smithi111.stdout:4/384: creat d2/d6/dd/d1c/f73 x:0 0 0 2024-09-16T09:46:10.999 INFO:tasks.workunit.client.0.smithi111.stdout:1/467: rename d3/d24/d3c to d3/d10/d72/da1 0 2024-09-16T09:46:10.999 INFO:tasks.workunit.client.0.smithi111.stdout:9/380: rename d0/d21/d22/d6e to d0/d21/d22/d6e/d51/d76/d7f 22 2024-09-16T09:46:11.000 INFO:tasks.workunit.client.0.smithi111.stdout:3/406: rename d5/da/d42/f77 to d5/da/db/f84 0 2024-09-16T09:46:11.000 INFO:tasks.workunit.client.0.smithi111.stdout:3/407: write d5/da/db/de/f27 [2064229,16105] 0 2024-09-16T09:46:11.001 INFO:tasks.workunit.client.0.smithi111.stdout:4/385: dread d2/f56 [0,4194304] 0 2024-09-16T09:46:11.001 INFO:tasks.workunit.client.0.smithi111.stdout:4/386: chown d2/d6/dd/d1b/d38/d64/d65 615645220 1 2024-09-16T09:46:11.001 INFO:tasks.workunit.client.0.smithi111.stdout:9/381: link d0/d6/d8/f26 d0/d48/f80 0 2024-09-16T09:46:11.003 INFO:tasks.workunit.client.0.smithi111.stdout:1/468: link d3/d10/d72/da1/d28/d36/d3d/d47/d5a/c61 d3/d10/d23/ca2 0 2024-09-16T09:46:11.004 INFO:tasks.workunit.client.0.smithi111.stdout:4/387: creat d2/d6/dd/d1c/d2f/d4e/f74 x:0 0 0 2024-09-16T09:46:11.005 INFO:tasks.workunit.client.0.smithi111.stdout:4/388: chown d2/d6/dd/d1b/d38/f68 21060394 1 2024-09-16T09:46:11.005 INFO:tasks.workunit.client.0.smithi111.stdout:4/389: read - d2/d6/dd/d1b/d38/d64/f6b zero size 2024-09-16T09:46:11.005 INFO:tasks.workunit.client.0.smithi111.stdout:1/469: unlink d3/d24/d3f/f71 0 2024-09-16T09:46:11.006 INFO:tasks.workunit.client.0.smithi111.stdout:9/382: dread d0/d6/f3c [0,4194304] 0 2024-09-16T09:46:11.006 INFO:tasks.workunit.client.0.smithi111.stdout:4/390: mknod d2/d6/dd/d1c/c75 0 2024-09-16T09:46:11.009 INFO:tasks.workunit.client.0.smithi111.stdout:4/391: creat d2/d6/dd/f76 x:0 0 0 2024-09-16T09:46:11.012 INFO:tasks.workunit.client.0.smithi111.stdout:3/408: dread d5/d18/f2a [0,4194304] 0 2024-09-16T09:46:11.013 INFO:tasks.workunit.client.0.smithi111.stdout:4/392: link d2/d6/cf d2/d30/d44/c77 0 2024-09-16T09:46:11.013 INFO:tasks.workunit.client.0.smithi111.stdout:4/393: read - d2/d6/dd/d1b/f5d zero size 2024-09-16T09:46:11.014 INFO:tasks.workunit.client.0.smithi111.stdout:3/409: creat d5/da/db/d3a/d6d/f85 x:0 0 0 2024-09-16T09:46:11.016 INFO:tasks.workunit.client.0.smithi111.stdout:4/394: creat d2/d6/dd/d1b/d6d/f78 x:0 0 0 2024-09-16T09:46:11.016 INFO:tasks.workunit.client.0.smithi111.stdout:4/395: chown d2/f17 72064034 1 2024-09-16T09:46:11.016 INFO:tasks.workunit.client.0.smithi111.stdout:4/396: write d2/d6/dd/d1c/f43 [132505,78282] 0 2024-09-16T09:46:11.022 INFO:tasks.workunit.client.0.smithi111.stdout:4/397: write d2/f56 [1494884,88266] 0 2024-09-16T09:46:11.024 INFO:tasks.workunit.client.0.smithi111.stdout:4/398: symlink d2/d6/dd/d1c/d2f/l79 0 2024-09-16T09:46:11.025 INFO:tasks.workunit.client.0.smithi111.stdout:4/399: creat d2/d6/dd/d1c/d2f/f7a x:0 0 0 2024-09-16T09:46:11.032 INFO:tasks.workunit.client.0.smithi111.stdout:1/470: dwrite d3/d10/d72/da1/d28/d36/f64 [0,4194304] 0 2024-09-16T09:46:11.033 INFO:tasks.workunit.client.0.smithi111.stdout:1/471: fdatasync d3/d24/d3f/d89/f91 0 2024-09-16T09:46:11.033 INFO:tasks.workunit.client.0.smithi111.stdout:3/410: dwrite d5/f50 [0,4194304] 0 2024-09-16T09:46:11.045 INFO:tasks.workunit.client.0.smithi111.stdout:3/411: dwrite d5/da/db/d5a/f7b [0,4194304] 0 2024-09-16T09:46:11.046 INFO:tasks.workunit.client.0.smithi111.stdout:3/412: write d5/da/db/d35/f81 [590342,106656] 0 2024-09-16T09:46:11.046 INFO:tasks.workunit.client.0.smithi111.stdout:3/413: chown d5/da/db/c62 9 1 2024-09-16T09:46:11.052 INFO:tasks.workunit.client.0.smithi111.stdout:3/414: write d5/da/db/d5a/f7b [626389,30780] 0 2024-09-16T09:46:11.058 INFO:tasks.workunit.client.0.smithi111.stdout:4/400: getdents d2/d6/dd/d1c 0 2024-09-16T09:46:11.060 INFO:tasks.workunit.client.0.smithi111.stdout:9/383: truncate d0/d6/d8/f26 1834835 0 2024-09-16T09:46:11.067 INFO:tasks.workunit.client.0.smithi111.stdout:2/481: truncate d0/d2/f28 2677384 0 2024-09-16T09:46:11.067 INFO:tasks.workunit.client.0.smithi111.stdout:2/482: truncate d0/d45/d5c/d67/f8e 425275 0 2024-09-16T09:46:11.067 INFO:tasks.workunit.client.0.smithi111.stdout:2/483: fsync d0/d21/f2f 0 2024-09-16T09:46:11.070 INFO:tasks.workunit.client.0.smithi111.stdout:4/401: mknod d2/d6/dd/d1b/d38/d64/d65/c7b 0 2024-09-16T09:46:11.070 INFO:tasks.workunit.client.0.smithi111.stdout:4/402: chown d2/d6/dd/d1b/f29 6 1 2024-09-16T09:46:11.071 INFO:tasks.workunit.client.0.smithi111.stdout:3/415: dwrite d5/da/db/d35/d41/f53 [0,4194304] 0 2024-09-16T09:46:11.071 INFO:tasks.workunit.client.0.smithi111.stdout:3/416: dread - d5/da/db/d5a/f76 zero size 2024-09-16T09:46:11.096 INFO:tasks.workunit.client.0.smithi111.stdout:4/403: dwrite d2/d6/dd/d1c/f62 [0,4194304] 0 2024-09-16T09:46:11.097 INFO:tasks.workunit.client.0.smithi111.stdout:2/484: dwrite d0/da/d4e/f7c [0,4194304] 0 2024-09-16T09:46:11.097 INFO:tasks.workunit.client.0.smithi111.stdout:2/485: fdatasync d0/d2/f1e 0 2024-09-16T09:46:11.097 INFO:tasks.workunit.client.0.smithi111.stdout:2/486: fsync d0/d22/f24 0 2024-09-16T09:46:11.097 INFO:tasks.workunit.client.0.smithi111.stdout:3/417: dwrite d5/da/db/f7e [0,4194304] 0 2024-09-16T09:46:11.097 INFO:tasks.workunit.client.0.smithi111.stdout:3/418: chown d5/da/db/d35/d41/l57 0 1 2024-09-16T09:46:11.101 INFO:tasks.workunit.client.0.smithi111.stdout:4/404: mknod d2/d6/dd/d1c/d2f/c7c 0 2024-09-16T09:46:11.102 INFO:tasks.workunit.client.0.smithi111.stdout:4/405: chown d2/d6/dd/d1c/f54 1645 1 2024-09-16T09:46:11.104 INFO:tasks.workunit.client.0.smithi111.stdout:3/419: rmdir d5/da/db/de 39 2024-09-16T09:46:11.105 INFO:tasks.workunit.client.0.smithi111.stdout:3/420: creat d5/f86 x:0 0 0 2024-09-16T09:46:11.106 INFO:tasks.workunit.client.0.smithi111.stdout:3/421: creat d5/f87 x:0 0 0 2024-09-16T09:46:11.106 INFO:tasks.workunit.client.0.smithi111.stdout:3/422: getdents d5/da/db/d5a/d5d 0 2024-09-16T09:46:11.106 INFO:tasks.workunit.client.0.smithi111.stdout:3/423: truncate d5/d18/f2e 1638108 0 2024-09-16T09:46:11.107 INFO:tasks.workunit.client.0.smithi111.stdout:3/424: mkdir d5/da/db/d5a/d5d/d88 0 2024-09-16T09:46:11.109 INFO:tasks.workunit.client.0.smithi111.stdout:3/425: truncate d5/f13 2154763 0 2024-09-16T09:46:11.117 INFO:tasks.workunit.client.0.smithi111.stdout:2/487: dwrite d0/d22/f24 [0,4194304] 0 2024-09-16T09:46:11.124 INFO:tasks.workunit.client.0.smithi111.stdout:3/426: dwrite d5/da/d42/f48 [0,4194304] 0 2024-09-16T09:46:11.124 INFO:tasks.workunit.client.0.smithi111.stdout:3/427: chown d5/d18/f2e 1554621 1 2024-09-16T09:46:11.124 INFO:tasks.workunit.client.0.smithi111.stdout:3/428: chown d5/da/db/c65 0 1 2024-09-16T09:46:11.126 INFO:tasks.workunit.client.0.smithi111.stdout:3/429: creat d5/da/db/d5a/f89 x:0 0 0 2024-09-16T09:46:11.128 INFO:tasks.workunit.client.0.smithi111.stdout:3/430: creat d5/da/db/d5a/d5d/d75/f8a x:0 0 0 2024-09-16T09:46:11.129 INFO:tasks.workunit.client.0.smithi111.stdout:3/431: getdents d5/da/db/d35 0 2024-09-16T09:46:11.130 INFO:tasks.workunit.client.0.smithi111.stdout:3/432: rmdir d5/da 39 2024-09-16T09:46:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/433: rename f3 to d5/d18/f8b 0 2024-09-16T09:46:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/434: chown d5/da/db/de 82479557 1 2024-09-16T09:46:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/435: write d5/da/db/d5a/d5d/d75/f8a [174280,90287] 0 2024-09-16T09:46:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/436: write d5/da/db/d35/d45/f63 [531963,48061] 0 2024-09-16T09:46:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/437: write d5/d18/d78/f82 [670486,12759] 0 2024-09-16T09:46:11.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/438: chown d5/da/db/d5a/f7b 901187 1 2024-09-16T09:46:11.133 INFO:tasks.workunit.client.0.smithi111.stdout:3/439: creat d5/da/db/d3a/f8c x:0 0 0 2024-09-16T09:46:11.134 INFO:tasks.workunit.client.0.smithi111.stdout:3/440: stat d5/da/db/d5a/d5d/f83 0 2024-09-16T09:46:11.138 INFO:tasks.workunit.client.0.smithi111.stdout:3/441: rename d5/da/db/d5a/d5d/c6a to d5/da/db/d5a/d5d/c8d 0 2024-09-16T09:46:11.139 INFO:tasks.workunit.client.0.smithi111.stdout:3/442: fdatasync d5/da/db/d35/d45/f60 0 2024-09-16T09:46:11.142 INFO:tasks.workunit.client.0.smithi111.stdout:2/488: dwrite d0/da/d4e/fa9 [0,4194304] 0 2024-09-16T09:46:11.152 INFO:tasks.workunit.client.0.smithi111.stdout:2/489: read d0/da/d4e/fa9 [3747382,84569] 0 2024-09-16T09:46:11.154 INFO:tasks.workunit.client.0.smithi111.stdout:2/490: mkdir d0/d2/d59/d86/db1 0 2024-09-16T09:46:11.155 INFO:tasks.workunit.client.0.smithi111.stdout:2/491: symlink d0/d2/d59/d86/d96/lb2 0 2024-09-16T09:46:11.155 INFO:tasks.workunit.client.0.smithi111.stdout:2/492: dread - d0/d29/f6c zero size 2024-09-16T09:46:11.155 INFO:tasks.workunit.client.0.smithi111.stdout:2/493: write d0/da/f57 [489078,112548] 0 2024-09-16T09:46:11.156 INFO:tasks.workunit.client.0.smithi111.stdout:3/443: dwrite d5/d18/f2e [0,4194304] 0 2024-09-16T09:46:11.157 INFO:tasks.workunit.client.0.smithi111.stdout:3/444: symlink d5/da/db/d5a/d5d/d88/l8e 0 2024-09-16T09:46:11.157 INFO:tasks.workunit.client.0.smithi111.stdout:3/445: symlink d5/da/db/d5a/d5d/d88/l8f 0 2024-09-16T09:46:11.158 INFO:tasks.workunit.client.0.smithi111.stdout:3/446: symlink d5/da/db/l90 0 2024-09-16T09:46:11.166 INFO:tasks.workunit.client.0.smithi111.stdout:2/494: write d0/d22/f40 [1941569,6069] 0 2024-09-16T09:46:11.172 INFO:tasks.workunit.client.0.smithi111.stdout:3/447: dwrite d5/da/db/d35/d45/f7a [0,4194304] 0 2024-09-16T09:46:11.172 INFO:tasks.workunit.client.0.smithi111.stdout:3/448: write d5/da/db/de/f27 [2880291,48793] 0 2024-09-16T09:46:11.177 INFO:tasks.workunit.client.0.smithi111.stdout:2/495: dread d0/da/f3f [0,4194304] 0 2024-09-16T09:46:11.177 INFO:tasks.workunit.client.0.smithi111.stdout:2/496: chown d0/d2/c89 84828 1 2024-09-16T09:46:11.180 INFO:tasks.workunit.client.0.smithi111.stdout:2/497: truncate d0/d2/d5a/f62 4178251 0 2024-09-16T09:46:11.183 INFO:tasks.workunit.client.0.smithi111.stdout:3/449: dread d5/f1a [0,4194304] 0 2024-09-16T09:46:11.192 INFO:tasks.workunit.client.0.smithi111.stdout:2/498: dread d0/d21/f2f [0,4194304] 0 2024-09-16T09:46:11.207 INFO:tasks.workunit.client.0.smithi111.stdout:3/450: dwrite d5/d18/f36 [0,4194304] 0 2024-09-16T09:46:11.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/499: dwrite d0/da/d4e/f74 [0,4194304] 0 2024-09-16T09:46:11.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/500: write d0/d2/f41 [397121,7891] 0 2024-09-16T09:46:11.220 INFO:tasks.workunit.client.0.smithi111.stdout:3/451: write d5/d18/f29 [3134420,2400] 0 2024-09-16T09:46:11.221 INFO:tasks.workunit.client.0.smithi111.stdout:2/501: creat d0/d22/fb3 x:0 0 0 2024-09-16T09:46:11.225 INFO:tasks.workunit.client.0.smithi111.stdout:3/452: unlink d5/da/db/d35/d41/l47 0 2024-09-16T09:46:11.227 INFO:tasks.workunit.client.0.smithi111.stdout:3/453: mkdir d5/da/db/d5a/d5d/d88/d91 0 2024-09-16T09:46:11.227 INFO:tasks.workunit.client.0.smithi111.stdout:3/454: chown d5/da/db/d3a/d59/c6c 49 1 2024-09-16T09:46:11.227 INFO:tasks.workunit.client.0.smithi111.stdout:3/455: write d5/f56 [1132538,116066] 0 2024-09-16T09:46:11.227 INFO:tasks.workunit.client.0.smithi111.stdout:2/502: dread d0/fc [0,4194304] 0 2024-09-16T09:46:11.227 INFO:tasks.workunit.client.0.smithi111.stdout:3/456: rmdir d5/da/db/d35/d41 39 2024-09-16T09:46:11.307 INFO:tasks.workunit.client.0.smithi111.stdout:2/503: symlink d0/d22/d98/lb4 0 2024-09-16T09:46:11.307 INFO:tasks.workunit.client.0.smithi111.stdout:3/457: rmdir d5/da/db/d35/d41 39 2024-09-16T09:46:11.309 INFO:tasks.workunit.client.0.smithi111.stdout:2/504: creat d0/da6/fb5 x:0 0 0 2024-09-16T09:46:11.317 INFO:tasks.workunit.client.0.smithi111.stdout:3/458: write d5/da/db/d35/d45/f46 [4136240,75282] 0 2024-09-16T09:46:11.318 INFO:tasks.workunit.client.0.smithi111.stdout:3/459: dread d5/da/d42/f6e [0,4194304] 0 2024-09-16T09:46:11.318 INFO:tasks.workunit.client.0.smithi111.stdout:3/460: write d5/d18/f8b [1687407,113489] 0 2024-09-16T09:46:11.333 INFO:tasks.workunit.client.0.smithi111.stdout:5/468: sync 2024-09-16T09:46:11.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/469: unlink d19/d1b/d27/d2e/d39/d54/f92 0 2024-09-16T09:46:11.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/470: getdents d19/d1b/d27/d8a 0 2024-09-16T09:46:11.336 INFO:tasks.workunit.client.0.smithi111.stdout:5/471: creat d19/d1b/d27/d8a/fa5 x:0 0 0 2024-09-16T09:46:11.337 INFO:tasks.workunit.client.0.smithi111.stdout:3/461: dwrite d5/da/db/d35/d45/f60 [0,4194304] 0 2024-09-16T09:46:11.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/472: mknod d19/d1b/d27/d2e/d39/d6c/ca6 0 2024-09-16T09:46:11.341 INFO:tasks.workunit.client.0.smithi111.stdout:5/473: dread d19/d1b/d27/d2e/d39/f4e [0,4194304] 0 2024-09-16T09:46:11.347 INFO:tasks.workunit.client.0.smithi111.stdout:5/474: rename d19/d1b/d1e/d81/d93/l9e to d19/la7 0 2024-09-16T09:46:11.349 INFO:tasks.workunit.client.0.smithi111.stdout:3/462: mkdir d5/da/d92 0 2024-09-16T09:46:11.351 INFO:tasks.workunit.client.0.smithi111.stdout:3/463: mkdir d5/da/d42/d74/d93 0 2024-09-16T09:46:11.353 INFO:tasks.workunit.client.0.smithi111.stdout:3/464: dread d5/d18/f58 [0,4194304] 0 2024-09-16T09:46:11.372 INFO:tasks.workunit.client.0.smithi111.stdout:3/465: dwrite d5/da/d42/f6e [0,4194304] 0 2024-09-16T09:46:11.373 INFO:tasks.workunit.client.0.smithi111.stdout:5/475: dwrite d19/d1b/d1e/d21/d29/f56 [4194304,4194304] 0 2024-09-16T09:46:11.374 INFO:tasks.workunit.client.0.smithi111.stdout:3/466: creat d5/da/db/d5a/d5d/d88/f94 x:0 0 0 2024-09-16T09:46:11.378 INFO:tasks.workunit.client.0.smithi111.stdout:5/476: creat d19/d1b/d27/d2e/d4a/d4b/d9c/fa8 x:0 0 0 2024-09-16T09:46:11.379 INFO:tasks.workunit.client.0.smithi111.stdout:5/477: rmdir d19/d1b/d27/d83/d2a/d99 0 2024-09-16T09:46:11.379 INFO:tasks.workunit.client.0.smithi111.stdout:5/478: chown d19/d1b/d27/d2e/d4a/d4b/d9c/la4 1210511459 1 2024-09-16T09:46:11.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/479: symlink d19/d1b/d1e/d21/d29/d32/d8f/la9 0 2024-09-16T09:46:11.382 INFO:tasks.workunit.client.0.smithi111.stdout:5/480: creat d19/d1b/d27/d2e/d98/faa x:0 0 0 2024-09-16T09:46:11.391 INFO:tasks.workunit.client.0.smithi111.stdout:3/467: dwrite d5/f13 [0,4194304] 0 2024-09-16T09:46:11.392 INFO:tasks.workunit.client.0.smithi111.stdout:3/468: mknod d5/da/db/d35/c95 0 2024-09-16T09:46:11.400 INFO:tasks.workunit.client.0.smithi111.stdout:5/481: dwrite f15 [4194304,4194304] 0 2024-09-16T09:46:11.400 INFO:tasks.workunit.client.0.smithi111.stdout:5/482: fsync d19/d1b/d27/d2e/f6d 0 2024-09-16T09:46:11.414 INFO:tasks.workunit.client.0.smithi111.stdout:3/469: dwrite d5/d18/f2e [0,4194304] 0 2024-09-16T09:46:11.414 INFO:tasks.workunit.client.0.smithi111.stdout:5/483: dread d19/d1b/d27/f3d [0,4194304] 0 2024-09-16T09:46:11.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/470: write d5/f56 [863957,63891] 0 2024-09-16T09:46:11.416 INFO:tasks.workunit.client.0.smithi111.stdout:5/484: dread d19/d1b/d1e/d21/f5e [0,4194304] 0 2024-09-16T09:46:11.416 INFO:tasks.workunit.client.0.smithi111.stdout:5/485: creat d19/fab x:0 0 0 2024-09-16T09:46:11.416 INFO:tasks.workunit.client.0.smithi111.stdout:5/486: chown d19/d1b/d27/d83/f2b 494038 1 2024-09-16T09:46:11.417 INFO:tasks.workunit.client.0.smithi111.stdout:5/487: truncate d19/d1b/d1e/d21/d29/d32/f61 3874581 0 2024-09-16T09:46:11.431 INFO:tasks.workunit.client.0.smithi111.stdout:6/322: sync 2024-09-16T09:46:11.431 INFO:tasks.workunit.client.0.smithi111.stdout:1/472: sync 2024-09-16T09:46:11.431 INFO:tasks.workunit.client.0.smithi111.stdout:7/315: sync 2024-09-16T09:46:11.431 INFO:tasks.workunit.client.0.smithi111.stdout:8/284: sync 2024-09-16T09:46:11.432 INFO:tasks.workunit.client.0.smithi111.stdout:0/420: sync 2024-09-16T09:46:11.448 INFO:tasks.workunit.client.0.smithi111.stdout:1/473: dwrite d3/d10/f96 [0,4194304] 0 2024-09-16T09:46:11.456 INFO:tasks.workunit.client.0.smithi111.stdout:5/488: rename d19/d1b/d1e/d21/d29/d32/d46/d7d to d19/d1b/d27/d2e/d4a/d4b/dac 0 2024-09-16T09:46:11.457 INFO:tasks.workunit.client.0.smithi111.stdout:6/323: symlink d0/df/l66 0 2024-09-16T09:46:11.458 INFO:tasks.workunit.client.0.smithi111.stdout:0/421: mknod d0/d1d/d58/c95 0 2024-09-16T09:46:11.459 INFO:tasks.workunit.client.0.smithi111.stdout:8/285: creat d3/d26/f52 x:0 0 0 2024-09-16T09:46:11.461 INFO:tasks.workunit.client.0.smithi111.stdout:7/316: creat d1/d9/d43/f67 x:0 0 0 2024-09-16T09:46:11.462 INFO:tasks.workunit.client.0.smithi111.stdout:7/317: write d1/d9/fa [4368491,110761] 0 2024-09-16T09:46:11.462 INFO:tasks.workunit.client.0.smithi111.stdout:7/318: chown d1/d16/d27/f45 500 1 2024-09-16T09:46:11.462 INFO:tasks.workunit.client.0.smithi111.stdout:7/319: write d1/d20/f42 [1019800,69506] 0 2024-09-16T09:46:11.466 INFO:tasks.workunit.client.0.smithi111.stdout:1/474: link d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f7e d3/d10/d23/d8e/fa3 0 2024-09-16T09:46:11.469 INFO:tasks.workunit.client.0.smithi111.stdout:5/489: getdents d19/d1b/d27/d2e/d39 0 2024-09-16T09:46:11.471 INFO:tasks.workunit.client.0.smithi111.stdout:6/324: mknod d0/df/d14/d20/d42/d50/c67 0 2024-09-16T09:46:11.474 INFO:tasks.workunit.client.0.smithi111.stdout:0/422: truncate d0/f17 7795826 0 2024-09-16T09:46:11.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/286: creat d3/da/db/f53 x:0 0 0 2024-09-16T09:46:11.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/287: stat d3/de/f14 0 2024-09-16T09:46:11.476 INFO:tasks.workunit.client.0.smithi111.stdout:7/320: dwrite d1/f32 [4194304,4194304] 0 2024-09-16T09:46:11.482 INFO:tasks.workunit.client.0.smithi111.stdout:5/490: mknod d19/cad 0 2024-09-16T09:46:11.484 INFO:tasks.workunit.client.0.smithi111.stdout:8/288: unlink d3/da/df/l3c 0 2024-09-16T09:46:11.486 INFO:tasks.workunit.client.0.smithi111.stdout:1/475: link d3/d24/d3f/d89/c97 d3/ca4 0 2024-09-16T09:46:11.486 INFO:tasks.workunit.client.0.smithi111.stdout:7/321: dread d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:11.486 INFO:tasks.workunit.client.0.smithi111.stdout:7/322: chown d1/d16/d17 2 1 2024-09-16T09:46:11.487 INFO:tasks.workunit.client.0.smithi111.stdout:7/323: write d1/d16/d17/d18/d4f/d56/f5a [302062,113712] 0 2024-09-16T09:46:11.487 INFO:tasks.workunit.client.0.smithi111.stdout:5/491: mknod d19/d1b/d27/d2e/d4a/d4b/d9c/cae 0 2024-09-16T09:46:11.487 INFO:tasks.workunit.client.0.smithi111.stdout:0/423: mknod d0/c96 0 2024-09-16T09:46:11.487 INFO:tasks.workunit.client.0.smithi111.stdout:0/424: read d0/f22 [3233938,8773] 0 2024-09-16T09:46:11.488 INFO:tasks.workunit.client.0.smithi111.stdout:8/289: creat d3/da/df/f54 x:0 0 0 2024-09-16T09:46:11.488 INFO:tasks.workunit.client.0.smithi111.stdout:8/290: fsync d3/de/f4a 0 2024-09-16T09:46:11.488 INFO:tasks.workunit.client.0.smithi111.stdout:8/291: dread - d3/d26/f52 zero size 2024-09-16T09:46:11.488 INFO:tasks.workunit.client.0.smithi111.stdout:7/324: symlink d1/d16/d17/d18/d1b/l68 0 2024-09-16T09:46:11.489 INFO:tasks.workunit.client.0.smithi111.stdout:5/492: creat d19/d1b/d1e/d81/faf x:0 0 0 2024-09-16T09:46:11.490 INFO:tasks.workunit.client.0.smithi111.stdout:8/292: link d3/de/d34/f38 d3/d26/f55 0 2024-09-16T09:46:11.490 INFO:tasks.workunit.client.0.smithi111.stdout:7/325: mknod d1/d16/d27/c69 0 2024-09-16T09:46:11.492 INFO:tasks.workunit.client.0.smithi111.stdout:5/493: rename d19/d1b/c6a to d19/d1b/d27/cb0 0 2024-09-16T09:46:11.492 INFO:tasks.workunit.client.0.smithi111.stdout:0/425: dread d0/d26/d4b/f4c [0,4194304] 0 2024-09-16T09:46:11.493 INFO:tasks.workunit.client.0.smithi111.stdout:8/293: creat d3/de/d1e/d27/f56 x:0 0 0 2024-09-16T09:46:11.493 INFO:tasks.workunit.client.0.smithi111.stdout:6/325: dwrite d0/df/d14/f37 [0,4194304] 0 2024-09-16T09:46:11.494 INFO:tasks.workunit.client.0.smithi111.stdout:7/326: rename d1/d16/d27/l58 to d1/d59/l6a 0 2024-09-16T09:46:11.496 INFO:tasks.workunit.client.0.smithi111.stdout:5/494: mkdir d19/d1b/d1e/d81/d93/db1 0 2024-09-16T09:46:11.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/294: creat d3/da/db/d3e/f57 x:0 0 0 2024-09-16T09:46:11.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/295: chown d3/f11 4152566 1 2024-09-16T09:46:11.498 INFO:tasks.workunit.client.0.smithi111.stdout:8/296: write d3/de/d34/f38 [28528,125939] 0 2024-09-16T09:46:11.498 INFO:tasks.workunit.client.0.smithi111.stdout:1/476: write d3/d10/d23/f2b [2287989,57431] 0 2024-09-16T09:46:11.499 INFO:tasks.workunit.client.0.smithi111.stdout:6/326: truncate d0/df/d14/f31 1285094 0 2024-09-16T09:46:11.504 INFO:tasks.workunit.client.0.smithi111.stdout:5/495: symlink d19/d1b/d27/d2e/d98/lb2 0 2024-09-16T09:46:11.505 INFO:tasks.workunit.client.0.smithi111.stdout:8/297: mknod d3/de/c58 0 2024-09-16T09:46:11.505 INFO:tasks.workunit.client.0.smithi111.stdout:8/298: truncate d3/de/d34/f38 224201 0 2024-09-16T09:46:11.509 INFO:tasks.workunit.client.0.smithi111.stdout:6/327: unlink d0/df/f2d 0 2024-09-16T09:46:11.510 INFO:tasks.workunit.client.0.smithi111.stdout:6/328: read d0/df/d49/f4c [102762,52450] 0 2024-09-16T09:46:11.512 INFO:tasks.workunit.client.0.smithi111.stdout:5/496: link d19/d1b/d1e/d21/d29/d32/d46/f90 d19/d1b/d1e/fb3 0 2024-09-16T09:46:11.512 INFO:tasks.workunit.client.0.smithi111.stdout:5/497: chown d19/d1b/d1e/d21/d29/d32/d46/fa2 93 1 2024-09-16T09:46:11.514 INFO:tasks.workunit.client.0.smithi111.stdout:8/299: mkdir d3/da/db/d59 0 2024-09-16T09:46:11.519 INFO:tasks.workunit.client.0.smithi111.stdout:6/329: truncate d0/df/d49/f4c 643021 0 2024-09-16T09:46:11.520 INFO:tasks.workunit.client.0.smithi111.stdout:8/300: mknod d3/da/c5a 0 2024-09-16T09:46:11.529 INFO:tasks.workunit.client.0.smithi111.stdout:8/301: dread d3/f13 [0,4194304] 0 2024-09-16T09:46:11.529 INFO:tasks.workunit.client.0.smithi111.stdout:8/302: read d3/de/d1e/d2e/f37 [551294,10571] 0 2024-09-16T09:46:11.530 INFO:tasks.workunit.client.0.smithi111.stdout:8/303: write d3/de/d1e/d27/f2b [1788411,96513] 0 2024-09-16T09:46:11.530 INFO:tasks.workunit.client.0.smithi111.stdout:8/304: chown d3/l6 4893 1 2024-09-16T09:46:11.530 INFO:tasks.workunit.client.0.smithi111.stdout:8/305: symlink d3/de/d1e/d2e/d2f/l5b 0 2024-09-16T09:46:11.538 INFO:tasks.workunit.client.0.smithi111.stdout:0/426: dwrite d0/d1d/d67/f43 [0,4194304] 0 2024-09-16T09:46:11.538 INFO:tasks.workunit.client.0.smithi111.stdout:0/427: fsync d0/d1d/f29 0 2024-09-16T09:46:11.540 INFO:tasks.workunit.client.0.smithi111.stdout:0/428: rmdir d0/d93 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:7/327: dwrite d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:1/477: dwrite d3/d10/d23/f2b [0,4194304] 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:1/478: readlink d3/d24/d29/l49 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:1/479: write d3/d24/d29/f51 [1470722,50662] 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:1/480: fdatasync d3/d10/d72/f9e 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:5/498: dwrite d19/d1b/d27/d83/d2a/f71 [0,4194304] 0 2024-09-16T09:46:11.542 INFO:tasks.workunit.client.0.smithi111.stdout:8/306: dread d3/da/df/f25 [0,4194304] 0 2024-09-16T09:46:11.543 INFO:tasks.workunit.client.0.smithi111.stdout:0/429: creat d0/d1d/d67/d3a/d92/f97 x:0 0 0 2024-09-16T09:46:11.543 INFO:tasks.workunit.client.0.smithi111.stdout:0/430: getdents d0/d26/d35/d86 0 2024-09-16T09:46:11.543 INFO:tasks.workunit.client.0.smithi111.stdout:7/328: getdents d1/d16/d17/d18/d4f/d56 0 2024-09-16T09:46:11.546 INFO:tasks.workunit.client.0.smithi111.stdout:5/499: dread d19/d1b/d27/d2e/d39/f4e [0,4194304] 0 2024-09-16T09:46:11.548 INFO:tasks.workunit.client.0.smithi111.stdout:1/481: link d3/d10/d1c/f94 d3/d10/d72/da1/d28/d36/fa5 0 2024-09-16T09:46:11.548 INFO:tasks.workunit.client.0.smithi111.stdout:1/482: dread - d3/d10/d72/f9e zero size 2024-09-16T09:46:11.548 INFO:tasks.workunit.client.0.smithi111.stdout:1/483: truncate d3/d24/d62/f90 4916382 0 2024-09-16T09:46:11.551 INFO:tasks.workunit.client.0.smithi111.stdout:1/484: dread d3/d26/f34 [0,4194304] 0 2024-09-16T09:46:11.551 INFO:tasks.workunit.client.0.smithi111.stdout:1/485: stat d3/d10/d1c/f76 0 2024-09-16T09:46:11.551 INFO:tasks.workunit.client.0.smithi111.stdout:1/486: dread - d3/d10/d1c/f7c zero size 2024-09-16T09:46:11.551 INFO:tasks.workunit.client.0.smithi111.stdout:1/487: readlink d3/d10/d72/da1/d28/d36/d3d/d47/d65/d85/l9d 0 2024-09-16T09:46:11.556 INFO:tasks.workunit.client.0.smithi111.stdout:0/431: dwrite d0/d1d/d67/d3a/d3d/d59/f6a [0,4194304] 0 2024-09-16T09:46:11.562 INFO:tasks.workunit.client.0.smithi111.stdout:8/307: mkdir d3/de/d5c 0 2024-09-16T09:46:11.563 INFO:tasks.workunit.client.0.smithi111.stdout:7/329: symlink d1/d20/l6b 0 2024-09-16T09:46:11.563 INFO:tasks.workunit.client.0.smithi111.stdout:7/330: fsync d1/d16/d17/d18/d1d/d2f/f5c 0 2024-09-16T09:46:11.564 INFO:tasks.workunit.client.0.smithi111.stdout:1/488: creat d3/d24/d3f/d89/fa6 x:0 0 0 2024-09-16T09:46:11.564 INFO:tasks.workunit.client.0.smithi111.stdout:5/500: dwrite d19/d1b/d27/d2e/d39/d54/d60/f86 [0,4194304] 0 2024-09-16T09:46:11.567 INFO:tasks.workunit.client.0.smithi111.stdout:0/432: mknod d0/d1d/d58/d64/c98 0 2024-09-16T09:46:11.568 INFO:tasks.workunit.client.0.smithi111.stdout:8/308: creat d3/de/d1e/d2e/d2f/f5d x:0 0 0 2024-09-16T09:46:11.570 INFO:tasks.workunit.client.0.smithi111.stdout:7/331: symlink d1/d9/d53/l6c 0 2024-09-16T09:46:11.577 INFO:tasks.workunit.client.0.smithi111.stdout:5/501: creat d19/d1b/d1e/d21/d29/d32/fb4 x:0 0 0 2024-09-16T09:46:11.581 INFO:tasks.workunit.client.0.smithi111.stdout:0/433: dwrite d0/f1c [0,4194304] 0 2024-09-16T09:46:11.582 INFO:tasks.workunit.client.0.smithi111.stdout:8/309: creat d3/de/d1e/d2e/d2f/f5e x:0 0 0 2024-09-16T09:46:11.582 INFO:tasks.workunit.client.0.smithi111.stdout:8/310: write d3/da/df/f54 [830626,128706] 0 2024-09-16T09:46:11.582 INFO:tasks.workunit.client.0.smithi111.stdout:8/311: stat d3/f8 0 2024-09-16T09:46:11.583 INFO:tasks.workunit.client.0.smithi111.stdout:5/502: creat d19/d1b/d1e/d41/fb5 x:0 0 0 2024-09-16T09:46:11.585 INFO:tasks.workunit.client.0.smithi111.stdout:5/503: rmdir d19/d1b/d27/d2e/d39/d6c 39 2024-09-16T09:46:11.587 INFO:tasks.workunit.client.0.smithi111.stdout:5/504: mknod d19/cb6 0 2024-09-16T09:46:11.587 INFO:tasks.workunit.client.0.smithi111.stdout:5/505: write d19/d1b/d1e/d41/f8e [474991,103769] 0 2024-09-16T09:46:11.591 INFO:tasks.workunit.client.0.smithi111.stdout:6/330: truncate d0/df/d14/f31 63562 0 2024-09-16T09:46:11.601 INFO:tasks.workunit.client.0.smithi111.stdout:8/312: dwrite d3/de/d1e/d2e/f3d [0,4194304] 0 2024-09-16T09:46:11.603 INFO:tasks.workunit.client.0.smithi111.stdout:8/313: creat d3/f5f x:0 0 0 2024-09-16T09:46:11.603 INFO:tasks.workunit.client.0.smithi111.stdout:8/314: fdatasync d3/de/d1e/d2e/d2f/f5e 0 2024-09-16T09:46:11.605 INFO:tasks.workunit.client.0.smithi111.stdout:6/331: dread d0/f12 [0,4194304] 0 2024-09-16T09:46:11.605 INFO:tasks.workunit.client.0.smithi111.stdout:6/332: write d0/df/f4a [199229,40752] 0 2024-09-16T09:46:11.605 INFO:tasks.workunit.client.0.smithi111.stdout:6/333: chown d0/df/l2f 40764042 1 2024-09-16T09:46:11.611 INFO:tasks.workunit.client.0.smithi111.stdout:4/406: sync 2024-09-16T09:46:11.611 INFO:tasks.workunit.client.0.smithi111.stdout:9/384: sync 2024-09-16T09:46:11.611 INFO:tasks.workunit.client.0.smithi111.stdout:9/385: chown d0/d48/f6b 6784 1 2024-09-16T09:46:11.611 INFO:tasks.workunit.client.0.smithi111.stdout:4/407: dread - d2/d6/dd/f76 zero size 2024-09-16T09:46:11.611 INFO:tasks.workunit.client.0.smithi111.stdout:4/408: readlink d2/d6/dd/d1c/d2f/l79 0 2024-09-16T09:46:11.611 INFO:tasks.workunit.client.0.smithi111.stdout:2/505: sync 2024-09-16T09:46:11.612 INFO:tasks.workunit.client.0.smithi111.stdout:3/471: sync 2024-09-16T09:46:11.612 INFO:tasks.workunit.client.0.smithi111.stdout:3/472: write d5/da/db/d5a/f76 [225334,73980] 0 2024-09-16T09:46:11.612 INFO:tasks.workunit.client.0.smithi111.stdout:3/473: write d5/d18/f36 [4767370,10659] 0 2024-09-16T09:46:11.612 INFO:tasks.workunit.client.0.smithi111.stdout:3/474: fdatasync d5/da/db/d35/f39 0 2024-09-16T09:46:11.614 INFO:tasks.workunit.client.0.smithi111.stdout:4/409: write d2/d6/f20 [2572668,58056] 0 2024-09-16T09:46:11.619 INFO:tasks.workunit.client.0.smithi111.stdout:3/475: creat d5/da/db/de/f96 x:0 0 0 2024-09-16T09:46:11.625 INFO:tasks.workunit.client.0.smithi111.stdout:4/410: creat d2/f7d x:0 0 0 2024-09-16T09:46:11.639 INFO:tasks.workunit.client.0.smithi111.stdout:4/411: read d2/f8 [2781859,12090] 0 2024-09-16T09:46:11.639 INFO:tasks.workunit.client.0.smithi111.stdout:8/315: dwrite d3/f11 [0,4194304] 0 2024-09-16T09:46:11.644 INFO:tasks.workunit.client.0.smithi111.stdout:8/316: creat d3/de/d1e/d27/f60 x:0 0 0 2024-09-16T09:46:11.649 INFO:tasks.workunit.client.0.smithi111.stdout:8/317: truncate d3/de/d1e/d2e/f37 166374 0 2024-09-16T09:46:11.649 INFO:tasks.workunit.client.0.smithi111.stdout:8/318: write d3/d26/f46 [843431,23624] 0 2024-09-16T09:46:11.649 INFO:tasks.workunit.client.0.smithi111.stdout:6/334: dwrite d0/df/d14/d20/d23/f2e [4194304,4194304] 0 2024-09-16T09:46:11.649 INFO:tasks.workunit.client.0.smithi111.stdout:2/506: dwrite d0/d45/d5c/d67/f70 [0,4194304] 0 2024-09-16T09:46:11.649 INFO:tasks.workunit.client.0.smithi111.stdout:2/507: readlink d0/da/d4e/l9c 0 2024-09-16T09:46:11.649 INFO:tasks.workunit.client.0.smithi111.stdout:9/386: dwrite d0/d6/d8/f72 [0,4194304] 0 2024-09-16T09:46:11.651 INFO:tasks.workunit.client.0.smithi111.stdout:6/335: mkdir d0/df/d47/d68 0 2024-09-16T09:46:11.651 INFO:tasks.workunit.client.0.smithi111.stdout:3/476: dwrite d5/da/db/d5a/d5d/d88/f94 [0,4194304] 0 2024-09-16T09:46:11.659 INFO:tasks.workunit.client.0.smithi111.stdout:9/387: mkdir d0/d6/d30/d81 0 2024-09-16T09:46:11.659 INFO:tasks.workunit.client.0.smithi111.stdout:9/388: chown d0/d21/d22/c2e 0 1 2024-09-16T09:46:11.660 INFO:tasks.workunit.client.0.smithi111.stdout:6/336: creat d0/df/d14/d20/d42/d4e/d64/f69 x:0 0 0 2024-09-16T09:46:11.664 INFO:tasks.workunit.client.0.smithi111.stdout:3/477: link d5/da/d42/l6b d5/da/d92/l97 0 2024-09-16T09:46:11.665 INFO:tasks.workunit.client.0.smithi111.stdout:8/319: dwrite d3/f50 [0,4194304] 0 2024-09-16T09:46:11.665 INFO:tasks.workunit.client.0.smithi111.stdout:8/320: dread - d3/de/d1e/d2e/d2f/f5e zero size 2024-09-16T09:46:11.666 INFO:tasks.workunit.client.0.smithi111.stdout:4/412: dwrite d2/fb [4194304,4194304] 0 2024-09-16T09:46:11.677 INFO:tasks.workunit.client.0.smithi111.stdout:3/478: unlink d5/da/db/d3a/d6d/f85 0 2024-09-16T09:46:11.677 INFO:tasks.workunit.client.0.smithi111.stdout:3/479: chown d5/d18 28676571 1 2024-09-16T09:46:11.682 INFO:tasks.workunit.client.0.smithi111.stdout:8/321: link d3/da/ld d3/de/d1e/d2e/l61 0 2024-09-16T09:46:11.682 INFO:tasks.workunit.client.0.smithi111.stdout:8/322: fdatasync d3/de/d1e/d27/f60 0 2024-09-16T09:46:11.682 INFO:tasks.workunit.client.0.smithi111.stdout:8/323: write d3/de/d1e/d2e/d2f/f5d [953418,12841] 0 2024-09-16T09:46:11.686 INFO:tasks.workunit.client.0.smithi111.stdout:3/480: unlink d5/da/db/d35/d45/f46 0 2024-09-16T09:46:11.687 INFO:tasks.workunit.client.0.smithi111.stdout:8/324: symlink d3/de/d1e/l62 0 2024-09-16T09:46:11.688 INFO:tasks.workunit.client.0.smithi111.stdout:3/481: truncate d5/da/db/f14 2287082 0 2024-09-16T09:46:11.688 INFO:tasks.workunit.client.0.smithi111.stdout:3/482: chown d5/da/db/d5a/d5d/d88/f94 22 1 2024-09-16T09:46:11.689 INFO:tasks.workunit.client.0.smithi111.stdout:8/325: unlink d3/de/d1e/d27/c39 0 2024-09-16T09:46:11.689 INFO:tasks.workunit.client.0.smithi111.stdout:8/326: readlink d3/l6 0 2024-09-16T09:46:11.689 INFO:tasks.workunit.client.0.smithi111.stdout:3/483: creat d5/da/d42/d74/f98 x:0 0 0 2024-09-16T09:46:11.690 INFO:tasks.workunit.client.0.smithi111.stdout:8/327: unlink d3/de/d1e/d2e/d2f/l5b 0 2024-09-16T09:46:11.691 INFO:tasks.workunit.client.0.smithi111.stdout:3/484: mknod d5/d18/c99 0 2024-09-16T09:46:11.692 INFO:tasks.workunit.client.0.smithi111.stdout:3/485: truncate d5/d18/f24 618074 0 2024-09-16T09:46:11.692 INFO:tasks.workunit.client.0.smithi111.stdout:3/486: fdatasync d5/da/db/f7d 0 2024-09-16T09:46:11.695 INFO:tasks.workunit.client.0.smithi111.stdout:8/328: dread d3/f8 [0,4194304] 0 2024-09-16T09:46:11.696 INFO:tasks.workunit.client.0.smithi111.stdout:8/329: creat d3/de/d1e/d2e/d2f/f63 x:0 0 0 2024-09-16T09:46:11.696 INFO:tasks.workunit.client.0.smithi111.stdout:8/330: fdatasync d3/da/db/f53 0 2024-09-16T09:46:11.696 INFO:tasks.workunit.client.0.smithi111.stdout:8/331: mknod d3/da/c64 0 2024-09-16T09:46:11.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/332: write d3/de/d1e/d2e/f3d [4221180,69387] 0 2024-09-16T09:46:11.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/333: truncate d3/d26/f40 1560916 0 2024-09-16T09:46:11.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/334: symlink d3/de/d1e/d2e/l65 0 2024-09-16T09:46:11.703 INFO:tasks.workunit.client.0.smithi111.stdout:6/337: dwrite d0/f19 [0,4194304] 0 2024-09-16T09:46:11.703 INFO:tasks.workunit.client.0.smithi111.stdout:9/389: dwrite d0/d6/d8/f72 [0,4194304] 0 2024-09-16T09:46:11.704 INFO:tasks.workunit.client.0.smithi111.stdout:6/338: mkdir d0/df/d47/d68/d6a 0 2024-09-16T09:46:11.705 INFO:tasks.workunit.client.0.smithi111.stdout:9/390: truncate d0/d21/d22/f3e 1609403 0 2024-09-16T09:46:11.707 INFO:tasks.workunit.client.0.smithi111.stdout:9/391: symlink d0/d21/d22/d6e/d7d/l82 0 2024-09-16T09:46:11.707 INFO:tasks.workunit.client.0.smithi111.stdout:9/392: getdents d0/d6/d8/de 0 2024-09-16T09:46:11.709 INFO:tasks.workunit.client.0.smithi111.stdout:4/413: dwrite d2/d6/dd/d1b/f29 [0,4194304] 0 2024-09-16T09:46:11.709 INFO:tasks.workunit.client.0.smithi111.stdout:3/487: dread d5/da/db/f7e [0,4194304] 0 2024-09-16T09:46:11.712 INFO:tasks.workunit.client.0.smithi111.stdout:4/414: mknod d2/d6/dd/d1b/d38/c7e 0 2024-09-16T09:46:11.713 INFO:tasks.workunit.client.0.smithi111.stdout:3/488: rename d5/f50 to d5/da/db/d3a/d6d/f9a 0 2024-09-16T09:46:11.715 INFO:tasks.workunit.client.0.smithi111.stdout:8/335: dread d3/de/d1e/d2e/f3d [0,4194304] 0 2024-09-16T09:46:11.718 INFO:tasks.workunit.client.0.smithi111.stdout:4/415: link d2/d6/dd/d1b/d38/d64/d65/f70 d2/d6/dd/d1b/d38/d64/f7f 0 2024-09-16T09:46:11.718 INFO:tasks.workunit.client.0.smithi111.stdout:4/416: fsync d2/f56 0 2024-09-16T09:46:11.719 INFO:tasks.workunit.client.0.smithi111.stdout:4/417: write d2/d6/dd/d1b/d38/f68 [227847,102346] 0 2024-09-16T09:46:11.719 INFO:tasks.workunit.client.0.smithi111.stdout:4/418: dread - d2/d6/dd/d1c/d2f/d4e/f74 zero size 2024-09-16T09:46:11.719 INFO:tasks.workunit.client.0.smithi111.stdout:3/489: symlink d5/d18/l9b 0 2024-09-16T09:46:11.723 INFO:tasks.workunit.client.0.smithi111.stdout:9/393: write d0/d6/d8/f72 [36210,10047] 0 2024-09-16T09:46:11.723 INFO:tasks.workunit.client.0.smithi111.stdout:9/394: read - d0/d6/d8/de/f78 zero size 2024-09-16T09:46:11.723 INFO:tasks.workunit.client.0.smithi111.stdout:8/336: link d3/de/f14 d3/da/f66 0 2024-09-16T09:46:11.723 INFO:tasks.workunit.client.0.smithi111.stdout:8/337: getdents d3/da/db/d59 0 2024-09-16T09:46:11.723 INFO:tasks.workunit.client.0.smithi111.stdout:6/339: write d0/df/d14/d20/d23/d41/d4f/f51 [2084403,61997] 0 2024-09-16T09:46:11.724 INFO:tasks.workunit.client.0.smithi111.stdout:4/419: write d2/d6/f55 [75101,26356] 0 2024-09-16T09:46:11.725 INFO:tasks.workunit.client.0.smithi111.stdout:8/338: read d3/f43 [202424,12017] 0 2024-09-16T09:46:11.725 INFO:tasks.workunit.client.0.smithi111.stdout:8/339: write d3/da/db/f42 [526404,125123] 0 2024-09-16T09:46:11.729 INFO:tasks.workunit.client.0.smithi111.stdout:6/340: creat d0/df/d14/d20/d23/f6b x:0 0 0 2024-09-16T09:46:11.733 INFO:tasks.workunit.client.0.smithi111.stdout:8/340: creat d3/de/d1e/d2e/d2f/d4c/f67 x:0 0 0 2024-09-16T09:46:11.734 INFO:tasks.workunit.client.0.smithi111.stdout:6/341: creat d0/df/d14/d20/d42/d4e/d62/f6c x:0 0 0 2024-09-16T09:46:11.740 INFO:tasks.workunit.client.0.smithi111.stdout:4/420: mkdir d2/d6/d80 0 2024-09-16T09:46:11.740 INFO:tasks.workunit.client.0.smithi111.stdout:4/421: stat d2/d6/dd/d1c/l57 0 2024-09-16T09:46:11.742 INFO:tasks.workunit.client.0.smithi111.stdout:8/341: rename d3/da/df/f54 to d3/de/d1e/d2e/f68 0 2024-09-16T09:46:11.742 INFO:tasks.workunit.client.0.smithi111.stdout:8/342: write f1 [3984926,46210] 0 2024-09-16T09:46:11.743 INFO:tasks.workunit.client.0.smithi111.stdout:6/342: symlink d0/df/d14/d20/d42/l6d 0 2024-09-16T09:46:11.745 INFO:tasks.workunit.client.0.smithi111.stdout:4/422: creat d2/d6/dd/d1c/d2f/f81 x:0 0 0 2024-09-16T09:46:11.745 INFO:tasks.workunit.client.0.smithi111.stdout:4/423: fsync d2/d6/dd/d1c/f73 0 2024-09-16T09:46:11.746 INFO:tasks.workunit.client.0.smithi111.stdout:6/343: symlink d0/df/d49/l6e 0 2024-09-16T09:46:11.748 INFO:tasks.workunit.client.0.smithi111.stdout:6/344: creat d0/df/d14/d20/d42/d50/f6f x:0 0 0 2024-09-16T09:46:11.748 INFO:tasks.workunit.client.0.smithi111.stdout:6/345: write d0/df/d14/d20/d42/d4e/d64/f69 [1004468,97818] 0 2024-09-16T09:46:11.749 INFO:tasks.workunit.client.0.smithi111.stdout:6/346: creat d0/df/d14/d20/d42/d4e/d62/f70 x:0 0 0 2024-09-16T09:46:11.749 INFO:tasks.workunit.client.0.smithi111.stdout:6/347: read - d0/df/d14/d20/d42/d4e/d62/f6c zero size 2024-09-16T09:46:11.750 INFO:tasks.workunit.client.0.smithi111.stdout:6/348: getdents d0/df/d14/d20/d23/d41/d4f 0 2024-09-16T09:46:11.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/490: dwrite d5/da/db/d5a/d5d/d88/f94 [0,4194304] 0 2024-09-16T09:46:11.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/491: readlink d5/da/db/d3a/d59/l5f 0 2024-09-16T09:46:11.753 INFO:tasks.workunit.client.0.smithi111.stdout:3/492: write d5/f86 [33637,129958] 0 2024-09-16T09:46:11.753 INFO:tasks.workunit.client.0.smithi111.stdout:3/493: fsync d5/da/db/d5a/f67 0 2024-09-16T09:46:11.753 INFO:tasks.workunit.client.0.smithi111.stdout:9/395: dwrite d0/d21/d22/d6e/d51/d76/f5c [0,4194304] 0 2024-09-16T09:46:11.754 INFO:tasks.workunit.client.0.smithi111.stdout:9/396: chown d0/d21/d22/c2e 793284217 1 2024-09-16T09:46:11.754 INFO:tasks.workunit.client.0.smithi111.stdout:3/494: creat d5/da/db/d5a/d5d/d88/d91/f9c x:0 0 0 2024-09-16T09:46:11.757 INFO:tasks.workunit.client.0.smithi111.stdout:4/424: dread d2/d6/dd/d1b/d38/f68 [0,4194304] 0 2024-09-16T09:46:11.757 INFO:tasks.workunit.client.0.smithi111.stdout:8/343: write d3/f1a [477700,8872] 0 2024-09-16T09:46:11.757 INFO:tasks.workunit.client.0.smithi111.stdout:8/344: truncate d3/de/d1e/d27/f3f 1037986 0 2024-09-16T09:46:11.758 INFO:tasks.workunit.client.0.smithi111.stdout:9/397: creat d0/d21/d22/d6e/d51/d76/f83 x:0 0 0 2024-09-16T09:46:11.765 INFO:tasks.workunit.client.0.smithi111.stdout:6/349: write d0/df/d14/f21 [2263619,118099] 0 2024-09-16T09:46:11.770 INFO:tasks.workunit.client.0.smithi111.stdout:4/425: write d2/d6/dd/d1c/d2f/f36 [1792814,35372] 0 2024-09-16T09:46:11.770 INFO:tasks.workunit.client.0.smithi111.stdout:4/426: write d2/d6/dd/d1b/d38/d64/f7f [35578,126279] 0 2024-09-16T09:46:11.776 INFO:tasks.workunit.client.0.smithi111.stdout:8/345: link d3/de/d34/f38 d3/de/d1e/d27/f69 0 2024-09-16T09:46:11.776 INFO:tasks.workunit.client.0.smithi111.stdout:8/346: chown d3/de/d5c 428766202 1 2024-09-16T09:46:11.778 INFO:tasks.workunit.client.0.smithi111.stdout:9/398: unlink d0/d6/d8/c38 0 2024-09-16T09:46:11.778 INFO:tasks.workunit.client.0.smithi111.stdout:6/350: creat d0/df/d49/f71 x:0 0 0 2024-09-16T09:46:11.779 INFO:tasks.workunit.client.0.smithi111.stdout:6/351: write d0/df/d14/d20/d23/d41/f54 [943915,108789] 0 2024-09-16T09:46:11.780 INFO:tasks.workunit.client.0.smithi111.stdout:4/427: write d2/d30/d44/f47 [2824198,117271] 0 2024-09-16T09:46:11.780 INFO:tasks.workunit.client.0.smithi111.stdout:4/428: chown d2/d6/dd/d1c/d2f/f36 4993289 1 2024-09-16T09:46:11.781 INFO:tasks.workunit.client.0.smithi111.stdout:8/347: mknod d3/da/db/d3e/c6a 0 2024-09-16T09:46:11.784 INFO:tasks.workunit.client.0.smithi111.stdout:9/399: creat d0/d6/d45/f84 x:0 0 0 2024-09-16T09:46:11.785 INFO:tasks.workunit.client.0.smithi111.stdout:6/352: rename d0/df/d14/d20/d42/d50 to d0/d57/d72 0 2024-09-16T09:46:11.787 INFO:tasks.workunit.client.0.smithi111.stdout:4/429: rmdir d2/d6/dd/d1b/d38/d64 39 2024-09-16T09:46:11.788 INFO:tasks.workunit.client.0.smithi111.stdout:8/348: mkdir d3/de/d1e/d27/d6b 0 2024-09-16T09:46:11.788 INFO:tasks.workunit.client.0.smithi111.stdout:8/349: dread - d3/da/db/d3e/f4f zero size 2024-09-16T09:46:11.788 INFO:tasks.workunit.client.0.smithi111.stdout:8/350: read d3/f10 [3006791,3952] 0 2024-09-16T09:46:11.789 INFO:tasks.workunit.client.0.smithi111.stdout:4/430: dread d2/d6/dd/d1b/d38/f4f [0,4194304] 0 2024-09-16T09:46:11.789 INFO:tasks.workunit.client.0.smithi111.stdout:4/431: chown d2/d6/dd/d1c/d2f/d6c 512266587 1 2024-09-16T09:46:11.789 INFO:tasks.workunit.client.0.smithi111.stdout:4/432: truncate d2/d6/dd/f76 302216 0 2024-09-16T09:46:11.792 INFO:tasks.workunit.client.0.smithi111.stdout:9/400: mknod d0/d6c/c85 0 2024-09-16T09:46:11.797 INFO:tasks.workunit.client.0.smithi111.stdout:6/353: creat d0/df/d47/d68/f73 x:0 0 0 2024-09-16T09:46:11.798 INFO:tasks.workunit.client.0.smithi111.stdout:8/351: link d3/da/db/c4d d3/da/db/d59/c6c 0 2024-09-16T09:46:11.801 INFO:tasks.workunit.client.0.smithi111.stdout:6/354: unlink d0/df/c22 0 2024-09-16T09:46:11.802 INFO:tasks.workunit.client.0.smithi111.stdout:1/489: sync 2024-09-16T09:46:11.805 INFO:tasks.workunit.client.0.smithi111.stdout:6/355: creat d0/df/d14/f74 x:0 0 0 2024-09-16T09:46:11.806 INFO:tasks.workunit.client.0.smithi111.stdout:6/356: creat d0/d57/f75 x:0 0 0 2024-09-16T09:46:11.807 INFO:tasks.workunit.client.0.smithi111.stdout:6/357: write d0/d57/f75 [51243,117081] 0 2024-09-16T09:46:11.807 INFO:tasks.workunit.client.0.smithi111.stdout:6/358: readlink d0/df/l59 0 2024-09-16T09:46:11.807 INFO:tasks.workunit.client.0.smithi111.stdout:6/359: symlink d0/df/d49/l76 0 2024-09-16T09:46:11.807 INFO:tasks.workunit.client.0.smithi111.stdout:6/360: stat d0/df/d14/d20/c45 0 2024-09-16T09:46:11.808 INFO:tasks.workunit.client.0.smithi111.stdout:6/361: unlink d0/df/c11 0 2024-09-16T09:46:11.809 INFO:tasks.workunit.client.0.smithi111.stdout:6/362: write d0/df/d14/d20/d23/d41/f54 [1336957,106440] 0 2024-09-16T09:46:11.809 INFO:tasks.workunit.client.0.smithi111.stdout:6/363: chown d0/df/d49/f4c 145116623 1 2024-09-16T09:46:11.809 INFO:tasks.workunit.client.0.smithi111.stdout:6/364: creat d0/df/d47/f77 x:0 0 0 2024-09-16T09:46:11.813 INFO:tasks.workunit.client.0.smithi111.stdout:6/365: dread d0/df/d14/f1f [0,4194304] 0 2024-09-16T09:46:11.813 INFO:tasks.workunit.client.0.smithi111.stdout:4/433: dwrite d2/f56 [0,4194304] 0 2024-09-16T09:46:11.815 INFO:tasks.workunit.client.0.smithi111.stdout:8/352: rename d3/da/db/d3e to d3/d26/d6d 0 2024-09-16T09:46:11.815 INFO:tasks.workunit.client.0.smithi111.stdout:8/353: write d3/da/db/f53 [485905,62541] 0 2024-09-16T09:46:11.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/366: mknod d0/df/d47/c78 0 2024-09-16T09:46:11.818 INFO:tasks.workunit.client.0.smithi111.stdout:4/434: creat d2/d30/d44/f82 x:0 0 0 2024-09-16T09:46:11.818 INFO:tasks.workunit.client.0.smithi111.stdout:1/490: write d3/d10/d72/da1/f1b [7901469,108932] 0 2024-09-16T09:46:11.818 INFO:tasks.workunit.client.0.smithi111.stdout:1/491: fdatasync d3/d10/d72/da1/f35 0 2024-09-16T09:46:11.819 INFO:tasks.workunit.client.0.smithi111.stdout:8/354: mkdir d3/de/d6e 0 2024-09-16T09:46:11.820 INFO:tasks.workunit.client.0.smithi111.stdout:6/367: symlink d0/df/d49/d5b/l79 0 2024-09-16T09:46:11.820 INFO:tasks.workunit.client.0.smithi111.stdout:6/368: dread - d0/df/d14/d20/d23/f6b zero size 2024-09-16T09:46:11.820 INFO:tasks.workunit.client.0.smithi111.stdout:6/369: write d0/d57/d72/f65 [263953,12318] 0 2024-09-16T09:46:11.821 INFO:tasks.workunit.client.0.smithi111.stdout:4/435: symlink d2/d6/dd/d1c/l83 0 2024-09-16T09:46:11.821 INFO:tasks.workunit.client.0.smithi111.stdout:4/436: fdatasync d2/d6/dd/d1c/d2f/f36 0 2024-09-16T09:46:11.822 INFO:tasks.workunit.client.0.smithi111.stdout:1/492: symlink d3/d10/d72/da1/d99/la7 0 2024-09-16T09:46:11.822 INFO:tasks.workunit.client.0.smithi111.stdout:1/493: chown d3/d10/d57/d8f 60292385 1 2024-09-16T09:46:11.826 INFO:tasks.workunit.client.0.smithi111.stdout:4/437: symlink d2/d6/dd/d1b/d38/d64/l84 0 2024-09-16T09:46:11.828 INFO:tasks.workunit.client.0.smithi111.stdout:6/370: fsync d0/df/d14/f74 0 2024-09-16T09:46:11.828 INFO:tasks.workunit.client.0.smithi111.stdout:6/371: write d0/df/d47/f77 [552641,101333] 0 2024-09-16T09:46:11.834 INFO:tasks.workunit.client.0.smithi111.stdout:8/355: getdents d3/d26 0 2024-09-16T09:46:11.834 INFO:tasks.workunit.client.0.smithi111.stdout:8/356: truncate d3/d26/d6d/f4f 844319 0 2024-09-16T09:46:11.834 INFO:tasks.workunit.client.0.smithi111.stdout:8/357: fdatasync d3/de/d1e/d2e/d2f/f5d 0 2024-09-16T09:46:11.835 INFO:tasks.workunit.client.0.smithi111.stdout:8/358: fdatasync d3/f1a 0 2024-09-16T09:46:11.835 INFO:tasks.workunit.client.0.smithi111.stdout:6/372: dread d0/df/d14/d20/d23/d41/d4f/f51 [0,4194304] 0 2024-09-16T09:46:11.835 INFO:tasks.workunit.client.0.smithi111.stdout:4/438: symlink d2/d6/dd/d1c/l85 0 2024-09-16T09:46:11.835 INFO:tasks.workunit.client.0.smithi111.stdout:4/439: chown d2/d6/dd/c2e 16 1 2024-09-16T09:46:11.836 INFO:tasks.workunit.client.0.smithi111.stdout:8/359: rmdir d3/d26 39 2024-09-16T09:46:11.836 INFO:tasks.workunit.client.0.smithi111.stdout:8/360: stat d3/f43 0 2024-09-16T09:46:11.838 INFO:tasks.workunit.client.0.smithi111.stdout:6/373: mknod d0/d57/c7a 0 2024-09-16T09:46:11.840 INFO:tasks.workunit.client.0.smithi111.stdout:6/374: mkdir d0/df/d14/d20/d42/d4e/d62/d7b 0 2024-09-16T09:46:11.841 INFO:tasks.workunit.client.0.smithi111.stdout:6/375: symlink d0/l7c 0 2024-09-16T09:46:11.841 INFO:tasks.workunit.client.0.smithi111.stdout:6/376: chown d0/l43 32935222 1 2024-09-16T09:46:11.842 INFO:tasks.workunit.client.0.smithi111.stdout:6/377: creat d0/df/d47/f7d x:0 0 0 2024-09-16T09:46:11.843 INFO:tasks.workunit.client.0.smithi111.stdout:8/361: write d3/de/d1e/d2e/f3d [3638280,17110] 0 2024-09-16T09:46:11.843 INFO:tasks.workunit.client.0.smithi111.stdout:8/362: write d3/de/d1e/d2e/d2f/d4c/f67 [320532,116071] 0 2024-09-16T09:46:11.843 INFO:tasks.workunit.client.0.smithi111.stdout:6/378: getdents d0/df/d14/d20/d23 0 2024-09-16T09:46:11.844 INFO:tasks.workunit.client.0.smithi111.stdout:8/363: rename d3/da/db/f42 to d3/de/d34/f6f 0 2024-09-16T09:46:11.846 INFO:tasks.workunit.client.0.smithi111.stdout:6/379: rename d0/df/d14/f21 to d0/df/d14/d20/d23/f7e 0 2024-09-16T09:46:11.847 INFO:tasks.workunit.client.0.smithi111.stdout:6/380: chown d0/l7c 16562250 1 2024-09-16T09:46:11.847 INFO:tasks.workunit.client.0.smithi111.stdout:6/381: chown d0/df/d14/d20/d23/d33/f36 211791449 1 2024-09-16T09:46:11.847 INFO:tasks.workunit.client.0.smithi111.stdout:6/382: write d0/df/d14/d20/d42/f55 [3764230,7213] 0 2024-09-16T09:46:11.848 INFO:tasks.workunit.client.0.smithi111.stdout:6/383: rename d0/df/d14/f1f to d0/df/d47/d68/f7f 0 2024-09-16T09:46:11.849 INFO:tasks.workunit.client.0.smithi111.stdout:6/384: dread d0/df/d49/f4c [0,4194304] 0 2024-09-16T09:46:11.852 INFO:tasks.workunit.client.0.smithi111.stdout:6/385: mkdir d0/df/d14/d20/d42/d4e/d62/d7b/d80 0 2024-09-16T09:46:11.852 INFO:tasks.workunit.client.0.smithi111.stdout:6/386: fdatasync d0/df/d47/f77 0 2024-09-16T09:46:11.852 INFO:tasks.workunit.client.0.smithi111.stdout:6/387: write d0/df/d14/d20/d23/f7e [2503441,19733] 0 2024-09-16T09:46:11.853 INFO:tasks.workunit.client.0.smithi111.stdout:8/364: dread f0 [0,4194304] 0 2024-09-16T09:46:11.853 INFO:tasks.workunit.client.0.smithi111.stdout:6/388: creat d0/df/d14/d20/d42/d4e/d62/d7b/d80/f81 x:0 0 0 2024-09-16T09:46:11.854 INFO:tasks.workunit.client.0.smithi111.stdout:6/389: readlink d0/d57/d72/l3f 0 2024-09-16T09:46:11.854 INFO:tasks.workunit.client.0.smithi111.stdout:8/365: truncate d3/de/d1e/d27/f69 770562 0 2024-09-16T09:46:11.854 INFO:tasks.workunit.client.0.smithi111.stdout:8/366: truncate d3/de/d1e/d2e/d2f/f63 680875 0 2024-09-16T09:46:11.854 INFO:tasks.workunit.client.0.smithi111.stdout:8/367: write d3/de/d1e/d27/f45 [130494,112947] 0 2024-09-16T09:46:11.854 INFO:tasks.workunit.client.0.smithi111.stdout:8/368: dread - d3/de/d1e/d2e/d2f/f49 zero size 2024-09-16T09:46:11.855 INFO:tasks.workunit.client.0.smithi111.stdout:6/390: creat d0/df/d47/d52/f82 x:0 0 0 2024-09-16T09:46:11.855 INFO:tasks.workunit.client.0.smithi111.stdout:8/369: creat d3/d26/d6d/f70 x:0 0 0 2024-09-16T09:46:11.855 INFO:tasks.workunit.client.0.smithi111.stdout:8/370: fsync d3/de/d1e/d2e/d2f/f5d 0 2024-09-16T09:46:11.856 INFO:tasks.workunit.client.0.smithi111.stdout:6/391: symlink d0/df/d47/l83 0 2024-09-16T09:46:11.856 INFO:tasks.workunit.client.0.smithi111.stdout:6/392: stat d0/df/d47/d68/f7f 0 2024-09-16T09:46:11.864 INFO:tasks.workunit.client.0.smithi111.stdout:8/371: dread d3/da/df/f47 [0,4194304] 0 2024-09-16T09:46:11.866 INFO:tasks.workunit.client.0.smithi111.stdout:8/372: dread d3/f43 [0,4194304] 0 2024-09-16T09:46:11.867 INFO:tasks.workunit.client.0.smithi111.stdout:8/373: rmdir d3/da/db/d59 39 2024-09-16T09:46:11.869 INFO:tasks.workunit.client.0.smithi111.stdout:8/374: mknod d3/da/df/c71 0 2024-09-16T09:46:11.871 INFO:tasks.workunit.client.0.smithi111.stdout:8/375: mknod d3/da/db/c72 0 2024-09-16T09:46:11.871 INFO:tasks.workunit.client.0.smithi111.stdout:8/376: write d3/de/d1e/d2e/f3d [4270670,80904] 0 2024-09-16T09:46:11.871 INFO:tasks.workunit.client.0.smithi111.stdout:8/377: dread - d3/de/d1e/d27/f56 zero size 2024-09-16T09:46:11.871 INFO:tasks.workunit.client.0.smithi111.stdout:8/378: chown d3/d26/d6d 2087788682 1 2024-09-16T09:46:11.872 INFO:tasks.workunit.client.0.smithi111.stdout:8/379: creat d3/de/d1e/f73 x:0 0 0 2024-09-16T09:46:11.890 INFO:tasks.workunit.client.0.smithi111.stdout:8/380: dwrite d3/da/df/f47 [0,4194304] 0 2024-09-16T09:46:11.891 INFO:tasks.workunit.client.0.smithi111.stdout:8/381: write d3/de/d34/f4e [855702,35701] 0 2024-09-16T09:46:11.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/382: dread d3/da/db/f53 [0,4194304] 0 2024-09-16T09:46:11.967 INFO:tasks.workunit.client.0.smithi111.stdout:8/383: mkdir d3/de/d1e/d2e/d74 0 2024-09-16T09:46:11.986 INFO:tasks.workunit.client.0.smithi111.stdout:8/384: dwrite d3/d26/d6d/f57 [0,4194304] 0 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:8/385: creat d3/d26/f75 x:0 0 0 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:0/434: sync 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:5/506: sync 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:2/508: sync 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:7/332: sync 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:7/333: readlink d1/d16/d17/d18/d1d/l25 0 2024-09-16T09:46:11.989 INFO:tasks.workunit.client.0.smithi111.stdout:2/509: fdatasync d0/d2/f2c 0 2024-09-16T09:46:11.990 INFO:tasks.workunit.client.0.smithi111.stdout:0/435: mknod d0/d1d/d67/c99 0 2024-09-16T09:46:11.990 INFO:tasks.workunit.client.0.smithi111.stdout:8/386: read d3/da/db/f53 [350466,86764] 0 2024-09-16T09:46:11.990 INFO:tasks.workunit.client.0.smithi111.stdout:8/387: truncate d3/de/d1e/d2e/f68 1640210 0 2024-09-16T09:46:11.991 INFO:tasks.workunit.client.0.smithi111.stdout:2/510: getdents d0/d45/d5c/d67 0 2024-09-16T09:46:11.992 INFO:tasks.workunit.client.0.smithi111.stdout:7/334: creat d1/d16/d17/d18/d1b/f6d x:0 0 0 2024-09-16T09:46:11.994 INFO:tasks.workunit.client.0.smithi111.stdout:0/436: mkdir d0/d1d/d58/d83/d9a 0 2024-09-16T09:46:11.996 INFO:tasks.workunit.client.0.smithi111.stdout:5/507: dread d19/d1b/d1e/d21/d29/d32/f61 [0,4194304] 0 2024-09-16T09:46:11.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/388: mknod d3/da/c76 0 2024-09-16T09:46:11.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/389: write d3/f5f [377333,11033] 0 2024-09-16T09:46:11.997 INFO:tasks.workunit.client.0.smithi111.stdout:2/511: creat d0/da/fb6 x:0 0 0 2024-09-16T09:46:11.997 INFO:tasks.workunit.client.0.smithi111.stdout:2/512: chown d0/da/f3a 11 1 2024-09-16T09:46:11.999 INFO:tasks.workunit.client.0.smithi111.stdout:7/335: symlink d1/d9/d53/l6e 0 2024-09-16T09:46:12.001 INFO:tasks.workunit.client.0.smithi111.stdout:8/390: unlink d3/de/d1e/f73 0 2024-09-16T09:46:12.002 INFO:tasks.workunit.client.0.smithi111.stdout:7/336: creat d1/d16/d17/d18/f6f x:0 0 0 2024-09-16T09:46:12.003 INFO:tasks.workunit.client.0.smithi111.stdout:0/437: dread d0/d1d/f2d [0,4194304] 0 2024-09-16T09:46:12.005 INFO:tasks.workunit.client.0.smithi111.stdout:8/391: symlink d3/da/l77 0 2024-09-16T09:46:12.006 INFO:tasks.workunit.client.0.smithi111.stdout:7/337: creat d1/d3e/f70 x:0 0 0 2024-09-16T09:46:12.008 INFO:tasks.workunit.client.0.smithi111.stdout:7/338: rename d1/d16/f48 to d1/d16/d17/d18/d1d/d2f/f71 0 2024-09-16T09:46:12.011 INFO:tasks.workunit.client.0.smithi111.stdout:7/339: rename d1/d16/d17/f52 to d1/d16/f72 0 2024-09-16T09:46:12.012 INFO:tasks.workunit.client.0.smithi111.stdout:7/340: mkdir d1/d16/d17/d18/d1d/d2f/d73 0 2024-09-16T09:46:12.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/438: dread d0/d1d/d67/d3a/d3d/f46 [0,4194304] 0 2024-09-16T09:46:12.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/439: fdatasync d0/d1d/d67/d3a/d3d/f46 0 2024-09-16T09:46:12.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/440: chown d0/d1d/d67/d3a/f72 1662999 1 2024-09-16T09:46:12.015 INFO:tasks.workunit.client.0.smithi111.stdout:0/441: chown d0/d1d/d67/d3a/d77/c89 13633559 1 2024-09-16T09:46:12.017 INFO:tasks.workunit.client.0.smithi111.stdout:0/442: symlink d0/d26/d35/d86/l9b 0 2024-09-16T09:46:12.017 INFO:tasks.workunit.client.0.smithi111.stdout:0/443: stat d0/d26/d35/f76 0 2024-09-16T09:46:12.018 INFO:tasks.workunit.client.0.smithi111.stdout:0/444: mknod d0/d26/d4b/c9c 0 2024-09-16T09:46:12.018 INFO:tasks.workunit.client.0.smithi111.stdout:0/445: chown d0/d1d/d58/d64/d4f 341 1 2024-09-16T09:46:12.020 INFO:tasks.workunit.client.0.smithi111.stdout:0/446: getdents d0/d1d 0 2024-09-16T09:46:12.023 INFO:tasks.workunit.client.0.smithi111.stdout:0/447: rename d0/d1d/d67/d3a/d3d/f53 to d0/d1d/d67/d3a/d3d/f9d 0 2024-09-16T09:46:12.026 INFO:tasks.workunit.client.0.smithi111.stdout:0/448: unlink d0/d1d/d67/d3a/f72 0 2024-09-16T09:46:12.027 INFO:tasks.workunit.client.0.smithi111.stdout:0/449: mknod d0/d1d/d67/d3a/d92/c9e 0 2024-09-16T09:46:12.027 INFO:tasks.workunit.client.0.smithi111.stdout:0/450: write d0/d1d/d67/d3a/d92/f97 [751061,50090] 0 2024-09-16T09:46:12.029 INFO:tasks.workunit.client.0.smithi111.stdout:0/451: creat d0/d1d/d58/d83/f9f x:0 0 0 2024-09-16T09:46:12.030 INFO:tasks.workunit.client.0.smithi111.stdout:5/508: dwrite d19/d1b/d1e/d21/d29/f56 [4194304,4194304] 0 2024-09-16T09:46:12.030 INFO:tasks.workunit.client.0.smithi111.stdout:0/452: creat d0/fa0 x:0 0 0 2024-09-16T09:46:12.032 INFO:tasks.workunit.client.0.smithi111.stdout:2/513: dwrite d0/d45/d5c/f72 [0,4194304] 0 2024-09-16T09:46:12.033 INFO:tasks.workunit.client.0.smithi111.stdout:2/514: write d0/da/d4e/fa9 [2293320,128900] 0 2024-09-16T09:46:12.033 INFO:tasks.workunit.client.0.smithi111.stdout:8/392: dwrite d3/f10 [0,4194304] 0 2024-09-16T09:46:12.035 INFO:tasks.workunit.client.0.smithi111.stdout:5/509: mknod d19/d1b/d27/d83/cb7 0 2024-09-16T09:46:12.042 INFO:tasks.workunit.client.0.smithi111.stdout:2/515: creat d0/d22/fb7 x:0 0 0 2024-09-16T09:46:12.046 INFO:tasks.workunit.client.0.smithi111.stdout:8/393: mknod d3/de/d1e/d27/d6b/c78 0 2024-09-16T09:46:12.046 INFO:tasks.workunit.client.0.smithi111.stdout:8/394: chown d3/de/d34 163937 1 2024-09-16T09:46:12.047 INFO:tasks.workunit.client.0.smithi111.stdout:8/395: readlink d3/da/l77 0 2024-09-16T09:46:12.050 INFO:tasks.workunit.client.0.smithi111.stdout:7/341: getdents d1/d3e 0 2024-09-16T09:46:12.050 INFO:tasks.workunit.client.0.smithi111.stdout:7/342: fsync d1/d9/f1f 0 2024-09-16T09:46:12.050 INFO:tasks.workunit.client.0.smithi111.stdout:0/453: dwrite d0/d1d/d58/d64/d4f/f75 [0,4194304] 0 2024-09-16T09:46:12.056 INFO:tasks.workunit.client.0.smithi111.stdout:8/396: creat d3/da/f79 x:0 0 0 2024-09-16T09:46:12.060 INFO:tasks.workunit.client.0.smithi111.stdout:5/510: dwrite d19/d1b/d1e/fb3 [0,4194304] 0 2024-09-16T09:46:12.060 INFO:tasks.workunit.client.0.smithi111.stdout:2/516: dwrite d0/d45/d5c/d67/f8e [0,4194304] 0 2024-09-16T09:46:12.060 INFO:tasks.workunit.client.0.smithi111.stdout:5/511: dread - d19/d1b/d27/d2e/d39/d6c/f7e zero size 2024-09-16T09:46:12.060 INFO:tasks.workunit.client.0.smithi111.stdout:7/343: creat d1/d3e/f74 x:0 0 0 2024-09-16T09:46:12.062 INFO:tasks.workunit.client.0.smithi111.stdout:0/454: truncate d0/d26/d4b/f7c 1328329 0 2024-09-16T09:46:12.068 INFO:tasks.workunit.client.0.smithi111.stdout:2/517: creat d0/d45/d5c/d67/d63/fb8 x:0 0 0 2024-09-16T09:46:12.070 INFO:tasks.workunit.client.0.smithi111.stdout:5/512: creat d19/d1b/d1e/d81/fb8 x:0 0 0 2024-09-16T09:46:12.071 INFO:tasks.workunit.client.0.smithi111.stdout:7/344: creat d1/d16/d17/d18/d1d/d2f/f75 x:0 0 0 2024-09-16T09:46:12.074 INFO:tasks.workunit.client.0.smithi111.stdout:0/455: symlink d0/d1d/d67/la1 0 2024-09-16T09:46:12.074 INFO:tasks.workunit.client.0.smithi111.stdout:0/456: fdatasync d0/d26/d35/f76 0 2024-09-16T09:46:12.075 INFO:tasks.workunit.client.0.smithi111.stdout:2/518: creat d0/fb9 x:0 0 0 2024-09-16T09:46:12.075 INFO:tasks.workunit.client.0.smithi111.stdout:2/519: chown d0/f7 2225 1 2024-09-16T09:46:12.076 INFO:tasks.workunit.client.0.smithi111.stdout:7/345: creat d1/d16/d27/f76 x:0 0 0 2024-09-16T09:46:12.079 INFO:tasks.workunit.client.0.smithi111.stdout:8/397: dwrite d3/de/d1e/d2e/d2f/f5e [0,4194304] 0 2024-09-16T09:46:12.080 INFO:tasks.workunit.client.0.smithi111.stdout:0/457: creat d0/d26/d4b/fa2 x:0 0 0 2024-09-16T09:46:12.081 INFO:tasks.workunit.client.0.smithi111.stdout:2/520: getdents d0/da6 0 2024-09-16T09:46:12.083 INFO:tasks.workunit.client.0.smithi111.stdout:7/346: creat d1/d16/d17/d18/d1d/d2f/f77 x:0 0 0 2024-09-16T09:46:12.087 INFO:tasks.workunit.client.0.smithi111.stdout:8/398: creat d3/de/d1e/d2e/d74/f7a x:0 0 0 2024-09-16T09:46:12.087 INFO:tasks.workunit.client.0.smithi111.stdout:0/458: creat d0/d26/d35/d86/fa3 x:0 0 0 2024-09-16T09:46:12.089 INFO:tasks.workunit.client.0.smithi111.stdout:5/513: dwrite d19/d1b/d27/d83/f2b [0,4194304] 0 2024-09-16T09:46:12.090 INFO:tasks.workunit.client.0.smithi111.stdout:2/521: truncate d0/d2/f15 2910160 0 2024-09-16T09:46:12.091 INFO:tasks.workunit.client.0.smithi111.stdout:8/399: creat d3/da/db/f7b x:0 0 0 2024-09-16T09:46:12.091 INFO:tasks.workunit.client.0.smithi111.stdout:8/400: stat d3/de/d1e/d2e/d2f/l3a 0 2024-09-16T09:46:12.096 INFO:tasks.workunit.client.0.smithi111.stdout:5/514: rmdir d19/d1b 39 2024-09-16T09:46:12.097 INFO:tasks.workunit.client.0.smithi111.stdout:2/522: mknod d0/d2/cba 0 2024-09-16T09:46:12.100 INFO:tasks.workunit.client.0.smithi111.stdout:8/401: creat d3/de/d1e/d2e/d2f/f7c x:0 0 0 2024-09-16T09:46:12.100 INFO:tasks.workunit.client.0.smithi111.stdout:8/402: readlink d3/de/d1e/d2e/d2f/l3a 0 2024-09-16T09:46:12.100 INFO:tasks.workunit.client.0.smithi111.stdout:8/403: chown d3/de/d1e/d2e/d2f/f5d 13 1 2024-09-16T09:46:12.103 INFO:tasks.workunit.client.0.smithi111.stdout:5/515: mknod d19/d1b/d27/d2e/d39/d6c/cb9 0 2024-09-16T09:46:12.106 INFO:tasks.workunit.client.0.smithi111.stdout:2/523: truncate d0/d22/f40 2986878 0 2024-09-16T09:46:12.106 INFO:tasks.workunit.client.0.smithi111.stdout:2/524: chown d0/d45/f65 55 1 2024-09-16T09:46:12.107 INFO:tasks.workunit.client.0.smithi111.stdout:7/347: dwrite d1/d16/d27/f2b [0,4194304] 0 2024-09-16T09:46:12.107 INFO:tasks.workunit.client.0.smithi111.stdout:7/348: truncate d1/d3e/f74 752153 0 2024-09-16T09:46:12.110 INFO:tasks.workunit.client.0.smithi111.stdout:5/516: symlink d19/d1b/d27/d83/d2a/lba 0 2024-09-16T09:46:12.111 INFO:tasks.workunit.client.0.smithi111.stdout:8/404: write d3/f10 [2871327,5846] 0 2024-09-16T09:46:12.111 INFO:tasks.workunit.client.0.smithi111.stdout:8/405: write d3/d26/f46 [960092,18177] 0 2024-09-16T09:46:12.111 INFO:tasks.workunit.client.0.smithi111.stdout:8/406: dread - d3/de/f4a zero size 2024-09-16T09:46:12.114 INFO:tasks.workunit.client.0.smithi111.stdout:0/459: rename d0/d26/d4b to d0/da4 0 2024-09-16T09:46:12.115 INFO:tasks.workunit.client.0.smithi111.stdout:2/525: mknod d0/d45/d5c/cbb 0 2024-09-16T09:46:12.115 INFO:tasks.workunit.client.0.smithi111.stdout:2/526: dread - d0/d45/d5c/d67/f8c zero size 2024-09-16T09:46:12.120 INFO:tasks.workunit.client.0.smithi111.stdout:5/517: symlink d19/d1b/d1e/d21/lbb 0 2024-09-16T09:46:12.123 INFO:tasks.workunit.client.0.smithi111.stdout:8/407: symlink d3/de/d1e/l7d 0 2024-09-16T09:46:12.126 INFO:tasks.workunit.client.0.smithi111.stdout:5/518: creat d19/d1b/d27/d2e/d4a/fbc x:0 0 0 2024-09-16T09:46:12.127 INFO:tasks.workunit.client.0.smithi111.stdout:8/408: getdents d3/de/d1e/d2e/d2f/d4c 0 2024-09-16T09:46:12.128 INFO:tasks.workunit.client.0.smithi111.stdout:8/409: fsync d3/de/d1e/d27/f69 0 2024-09-16T09:46:12.133 INFO:tasks.workunit.client.0.smithi111.stdout:5/519: link d19/cb6 d19/d1b/d1e/d81/d93/db1/cbd 0 2024-09-16T09:46:12.133 INFO:tasks.workunit.client.0.smithi111.stdout:5/520: chown d19/d1b/d27/d2e/d4a/d4b/f9a 4080704 1 2024-09-16T09:46:12.133 INFO:tasks.workunit.client.0.smithi111.stdout:5/521: write d19/f48 [619653,12264] 0 2024-09-16T09:46:12.134 INFO:tasks.workunit.client.0.smithi111.stdout:5/522: chown d19/d1b/d27/l38 312156 1 2024-09-16T09:46:12.134 INFO:tasks.workunit.client.0.smithi111.stdout:5/523: truncate d19/d1b/d1e/f50 3731509 0 2024-09-16T09:46:12.137 INFO:tasks.workunit.client.0.smithi111.stdout:5/524: rename d19/d1b/d1e/d81/fb8 to d19/d1b/d27/d2e/d39/fbe 0 2024-09-16T09:46:12.139 INFO:tasks.workunit.client.0.smithi111.stdout:5/525: link d19/d1b/d1e/d21/lbb d19/d1b/d27/d83/d2a/lbf 0 2024-09-16T09:46:12.139 INFO:tasks.workunit.client.0.smithi111.stdout:5/526: write d19/d1b/d27/d83/f3f [3292756,12027] 0 2024-09-16T09:46:12.139 INFO:tasks.workunit.client.0.smithi111.stdout:5/527: truncate d19/d1b/d1e/d81/faf 957221 0 2024-09-16T09:46:12.139 INFO:tasks.workunit.client.0.smithi111.stdout:5/528: chown d19/d1b/d1e/d21/d29/c7a 27432475 1 2024-09-16T09:46:12.140 INFO:tasks.workunit.client.0.smithi111.stdout:2/527: getdents d0/d45/d5c 0 2024-09-16T09:46:12.140 INFO:tasks.workunit.client.0.smithi111.stdout:2/528: chown d0/d22/d98/f9b 34 1 2024-09-16T09:46:12.140 INFO:tasks.workunit.client.0.smithi111.stdout:2/529: write d0/d29/f6c [213314,58846] 0 2024-09-16T09:46:12.140 INFO:tasks.workunit.client.0.smithi111.stdout:2/530: readlink d0/d22/l25 0 2024-09-16T09:46:12.147 INFO:tasks.workunit.client.0.smithi111.stdout:3/495: sync 2024-09-16T09:46:12.149 INFO:tasks.workunit.client.0.smithi111.stdout:3/496: rename d5/da/db/d35/d45/f63 to d5/da/db/d5a/d5d/d88/f9d 0 2024-09-16T09:46:12.151 INFO:tasks.workunit.client.0.smithi111.stdout:0/460: dwrite d0/d1d/d67/d3a/d80/f78 [0,4194304] 0 2024-09-16T09:46:12.151 INFO:tasks.workunit.client.0.smithi111.stdout:0/461: truncate d0/d1d/d67/d3a/d80/f56 4308168 0 2024-09-16T09:46:12.161 INFO:tasks.workunit.client.0.smithi111.stdout:8/410: dwrite d3/f50 [0,4194304] 0 2024-09-16T09:46:12.162 INFO:tasks.workunit.client.0.smithi111.stdout:8/411: mknod d3/c7e 0 2024-09-16T09:46:12.164 INFO:tasks.workunit.client.0.smithi111.stdout:8/412: symlink d3/de/d1e/d2e/l7f 0 2024-09-16T09:46:12.164 INFO:tasks.workunit.client.0.smithi111.stdout:0/462: write d0/d1d/d67/f41 [2153255,75309] 0 2024-09-16T09:46:12.166 INFO:tasks.workunit.client.0.smithi111.stdout:8/413: creat d3/de/d1e/d2e/d2f/f80 x:0 0 0 2024-09-16T09:46:12.166 INFO:tasks.workunit.client.0.smithi111.stdout:8/414: chown d3/de/d1e/d2e/d74/f7a 31 1 2024-09-16T09:46:12.168 INFO:tasks.workunit.client.0.smithi111.stdout:0/463: creat d0/d1d/d67/d3a/fa5 x:0 0 0 2024-09-16T09:46:12.168 INFO:tasks.workunit.client.0.smithi111.stdout:0/464: chown d0/d1d/d58/c95 48823559 1 2024-09-16T09:46:12.169 INFO:tasks.workunit.client.0.smithi111.stdout:8/415: creat d3/de/d6e/f81 x:0 0 0 2024-09-16T09:46:12.171 INFO:tasks.workunit.client.0.smithi111.stdout:0/465: symlink d0/d26/d35/la6 0 2024-09-16T09:46:12.175 INFO:tasks.workunit.client.0.smithi111.stdout:0/466: creat d0/d1d/d67/fa7 x:0 0 0 2024-09-16T09:46:12.175 INFO:tasks.workunit.client.0.smithi111.stdout:0/467: rmdir d0/d1d/d58/d64 39 2024-09-16T09:46:12.183 INFO:tasks.workunit.client.0.smithi111.stdout:0/468: dread d0/d1d/f30 [0,4194304] 0 2024-09-16T09:46:12.183 INFO:tasks.workunit.client.0.smithi111.stdout:0/469: chown d0/d1d/d58/d64/f4d 6 1 2024-09-16T09:46:12.183 INFO:tasks.workunit.client.0.smithi111.stdout:0/470: truncate d0/f44 403035 0 2024-09-16T09:46:12.184 INFO:tasks.workunit.client.0.smithi111.stdout:0/471: rmdir d0 39 2024-09-16T09:46:12.191 INFO:tasks.workunit.client.0.smithi111.stdout:0/472: write d0/fd [4090008,4545] 0 2024-09-16T09:46:12.191 INFO:tasks.workunit.client.0.smithi111.stdout:0/473: mknod d0/d1d/d67/d3a/d80/ca8 0 2024-09-16T09:46:12.192 INFO:tasks.workunit.client.0.smithi111.stdout:0/474: write d0/d1d/d67/d3a/fa5 [624621,9054] 0 2024-09-16T09:46:12.194 INFO:tasks.workunit.client.0.smithi111.stdout:0/475: dread d0/da4/f7c [0,4194304] 0 2024-09-16T09:46:12.195 INFO:tasks.workunit.client.0.smithi111.stdout:0/476: symlink d0/d1d/d58/d64/la9 0 2024-09-16T09:46:12.195 INFO:tasks.workunit.client.0.smithi111.stdout:0/477: write d0/d26/d35/f76 [953507,128797] 0 2024-09-16T09:46:12.196 INFO:tasks.workunit.client.0.smithi111.stdout:0/478: creat d0/d1d/d58/d64/d4f/faa x:0 0 0 2024-09-16T09:46:12.196 INFO:tasks.workunit.client.0.smithi111.stdout:0/479: fsync d0/d1d/d67/d3a/f63 0 2024-09-16T09:46:12.196 INFO:tasks.workunit.client.0.smithi111.stdout:0/480: write d0/f6e [632045,60200] 0 2024-09-16T09:46:12.196 INFO:tasks.workunit.client.0.smithi111.stdout:5/529: dwrite d19/d1b/d1e/d21/d29/d32/fb4 [0,4194304] 0 2024-09-16T09:46:12.197 INFO:tasks.workunit.client.0.smithi111.stdout:5/530: dread - d19/d1b/d1e/d41/f6f zero size 2024-09-16T09:46:12.197 INFO:tasks.workunit.client.0.smithi111.stdout:8/416: dwrite d3/f50 [0,4194304] 0 2024-09-16T09:46:12.197 INFO:tasks.workunit.client.0.smithi111.stdout:8/417: dread - d3/de/d1e/d2e/d2f/f7c zero size 2024-09-16T09:46:12.197 INFO:tasks.workunit.client.0.smithi111.stdout:8/418: readlink d3/da/l77 0 2024-09-16T09:46:12.198 INFO:tasks.workunit.client.0.smithi111.stdout:2/531: dwrite d0/da/d4e/f74 [0,4194304] 0 2024-09-16T09:46:12.201 INFO:tasks.workunit.client.0.smithi111.stdout:3/497: dwrite d5/da/db/de/f28 [0,4194304] 0 2024-09-16T09:46:12.201 INFO:tasks.workunit.client.0.smithi111.stdout:5/531: dread d19/d1b/d27/d2e/f6d [0,4194304] 0 2024-09-16T09:46:12.202 INFO:tasks.workunit.client.0.smithi111.stdout:8/419: symlink d3/d26/d6d/l82 0 2024-09-16T09:46:12.205 INFO:tasks.workunit.client.0.smithi111.stdout:2/532: write d0/da/f48 [1560613,92138] 0 2024-09-16T09:46:12.255 INFO:tasks.workunit.client.0.smithi111.stdout:3/498: creat d5/da/f9e x:0 0 0 2024-09-16T09:46:12.256 INFO:tasks.workunit.client.0.smithi111.stdout:5/532: rename d19/d1b/d1e/d81/d93 to d19/d1b/d27/d8a/dc0 0 2024-09-16T09:46:12.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/533: truncate d19/d1b/d27/d83/d2a/f84 179062 0 2024-09-16T09:46:12.258 INFO:tasks.workunit.client.0.smithi111.stdout:8/420: mkdir d3/de/d1e/d2e/d74/d83 0 2024-09-16T09:46:12.266 INFO:tasks.workunit.client.0.smithi111.stdout:3/499: mknod d5/da/d92/c9f 0 2024-09-16T09:46:12.266 INFO:tasks.workunit.client.0.smithi111.stdout:3/500: fdatasync d5/f8 0 2024-09-16T09:46:12.266 INFO:tasks.workunit.client.0.smithi111.stdout:5/534: mknod d19/d1b/d27/d2e/d39/cc1 0 2024-09-16T09:46:12.267 INFO:tasks.workunit.client.0.smithi111.stdout:8/421: mknod d3/c84 0 2024-09-16T09:46:12.268 INFO:tasks.workunit.client.0.smithi111.stdout:3/501: mkdir d5/da/db/d35/d41/da0 0 2024-09-16T09:46:12.269 INFO:tasks.workunit.client.0.smithi111.stdout:2/533: truncate d0/da/d4e/f74 3642358 0 2024-09-16T09:46:12.270 INFO:tasks.workunit.client.0.smithi111.stdout:5/535: mknod d19/d1b/d27/d8a/cc2 0 2024-09-16T09:46:12.270 INFO:tasks.workunit.client.0.smithi111.stdout:5/536: write d19/d1b/d27/d2e/f91 [763736,2085] 0 2024-09-16T09:46:12.271 INFO:tasks.workunit.client.0.smithi111.stdout:8/422: truncate d3/da/db/f53 422321 0 2024-09-16T09:46:12.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/502: mkdir d5/da/db/d35/d45/da1 0 2024-09-16T09:46:12.274 INFO:tasks.workunit.client.0.smithi111.stdout:2/534: rename d0/c32 to d0/d2/d61/cbc 0 2024-09-16T09:46:12.274 INFO:tasks.workunit.client.0.smithi111.stdout:2/535: chown d0/da/f48 31 1 2024-09-16T09:46:12.274 INFO:tasks.workunit.client.0.smithi111.stdout:3/503: write d5/da/f6f [3609961,119180] 0 2024-09-16T09:46:12.275 INFO:tasks.workunit.client.0.smithi111.stdout:8/423: unlink d3/da/db/c22 0 2024-09-16T09:46:12.275 INFO:tasks.workunit.client.0.smithi111.stdout:8/424: chown d3/de/d1e/l7d 12 1 2024-09-16T09:46:12.277 INFO:tasks.workunit.client.0.smithi111.stdout:5/537: rename d19/d1b/d27/d2e/d39/d54/d60/c72 to d19/d1b/d27/cc3 0 2024-09-16T09:46:12.278 INFO:tasks.workunit.client.0.smithi111.stdout:3/504: mknod d5/da/db/d35/d45/da1/ca2 0 2024-09-16T09:46:12.279 INFO:tasks.workunit.client.0.smithi111.stdout:8/425: creat d3/da/df/f85 x:0 0 0 2024-09-16T09:46:12.281 INFO:tasks.workunit.client.0.smithi111.stdout:2/536: rename d0/d45/d5c/d67/d63/l76 to d0/d2/d59/d86/db1/lbd 0 2024-09-16T09:46:12.282 INFO:tasks.workunit.client.0.smithi111.stdout:3/505: creat d5/da/db/d5a/d5d/fa3 x:0 0 0 2024-09-16T09:46:12.282 INFO:tasks.workunit.client.0.smithi111.stdout:5/538: write d19/d1b/d27/d2e/f6d [459218,127788] 0 2024-09-16T09:46:12.285 INFO:tasks.workunit.client.0.smithi111.stdout:8/426: creat d3/de/d1e/d2e/d74/f86 x:0 0 0 2024-09-16T09:46:12.285 INFO:tasks.workunit.client.0.smithi111.stdout:8/427: write d3/f43 [548994,81718] 0 2024-09-16T09:46:12.285 INFO:tasks.workunit.client.0.smithi111.stdout:5/539: dread d19/d1b/d27/d2e/d4a/f4c [0,4194304] 0 2024-09-16T09:46:12.287 INFO:tasks.workunit.client.0.smithi111.stdout:3/506: mkdir d5/da/d42/d74/da4 0 2024-09-16T09:46:12.290 INFO:tasks.workunit.client.0.smithi111.stdout:3/507: creat d5/da/db/d3a/fa5 x:0 0 0 2024-09-16T09:46:12.296 INFO:tasks.workunit.client.0.smithi111.stdout:1/494: sync 2024-09-16T09:46:12.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/401: sync 2024-09-16T09:46:12.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/402: chown d0/d6/d8/de/d56/d4e/f73 208542 1 2024-09-16T09:46:12.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/403: write d0/d6/d45/f84 [19607,70552] 0 2024-09-16T09:46:12.302 INFO:tasks.workunit.client.0.smithi111.stdout:1/495: rmdir d3/d10/d23/d8e 39 2024-09-16T09:46:12.316 INFO:tasks.workunit.client.0.smithi111.stdout:1/496: dread d3/d24/d4e/f52 [0,4194304] 0 2024-09-16T09:46:12.316 INFO:tasks.workunit.client.0.smithi111.stdout:1/497: write d3/d24/d62/f90 [5013217,37152] 0 2024-09-16T09:46:12.317 INFO:tasks.workunit.client.0.smithi111.stdout:1/498: rmdir d3/d10/d23 39 2024-09-16T09:46:12.317 INFO:tasks.workunit.client.0.smithi111.stdout:1/499: chown d3/d24/d3f/f55 12357682 1 2024-09-16T09:46:12.317 INFO:tasks.workunit.client.0.smithi111.stdout:1/500: write d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f87 [440967,105980] 0 2024-09-16T09:46:12.317 INFO:tasks.workunit.client.0.smithi111.stdout:1/501: write d3/d10/d1c/f31 [2011317,10109] 0 2024-09-16T09:46:12.323 INFO:tasks.workunit.client.0.smithi111.stdout:8/428: dwrite d3/d26/f46 [0,4194304] 0 2024-09-16T09:46:12.323 INFO:tasks.workunit.client.0.smithi111.stdout:8/429: truncate d3/d26/d6d/f4f 1388005 0 2024-09-16T09:46:12.324 INFO:tasks.workunit.client.0.smithi111.stdout:2/537: dwrite d0/d2/f39 [0,4194304] 0 2024-09-16T09:46:12.325 INFO:tasks.workunit.client.0.smithi111.stdout:8/430: creat d3/de/d1e/f87 x:0 0 0 2024-09-16T09:46:12.325 INFO:tasks.workunit.client.0.smithi111.stdout:8/431: chown d3/de/d1e/d2e/d74/d83 179087559 1 2024-09-16T09:46:12.327 INFO:tasks.workunit.client.0.smithi111.stdout:9/404: dwrite d0/d6/d8/de/f78 [0,4194304] 0 2024-09-16T09:46:12.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/508: dwrite d5/da/db/d5a/d5d/fa3 [0,4194304] 0 2024-09-16T09:46:12.330 INFO:tasks.workunit.client.0.smithi111.stdout:3/509: fsync d5/d18/f29 0 2024-09-16T09:46:12.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/502: dread d3/d10/d1c/f25 [0,4194304] 0 2024-09-16T09:46:12.332 INFO:tasks.workunit.client.0.smithi111.stdout:9/405: creat d0/d21/d22/f86 x:0 0 0 2024-09-16T09:46:12.334 INFO:tasks.workunit.client.0.smithi111.stdout:2/538: dread d0/d2/d44/f4b [0,4194304] 0 2024-09-16T09:46:12.334 INFO:tasks.workunit.client.0.smithi111.stdout:2/539: read - d0/d2/d5a/f93 zero size 2024-09-16T09:46:12.336 INFO:tasks.workunit.client.0.smithi111.stdout:3/510: mknod d5/da/d42/d74/da4/ca6 0 2024-09-16T09:46:12.337 INFO:tasks.workunit.client.0.smithi111.stdout:3/511: write d5/d18/f24 [270226,116290] 0 2024-09-16T09:46:12.341 INFO:tasks.workunit.client.0.smithi111.stdout:3/512: dread d5/da/db/d5a/f76 [0,4194304] 0 2024-09-16T09:46:12.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/503: symlink d3/d24/d3f/la8 0 2024-09-16T09:46:12.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/504: fsync d3/d24/d3f/d89/fa6 0 2024-09-16T09:46:12.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/505: fsync d3/d10/d1c/f7c 0 2024-09-16T09:46:12.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/506: chown d3/d24/d4e/f5b 25 1 2024-09-16T09:46:12.342 INFO:tasks.workunit.client.0.smithi111.stdout:9/406: rmdir d0/d6/d8/de/d56/d4e 39 2024-09-16T09:46:12.342 INFO:tasks.workunit.client.0.smithi111.stdout:9/407: fsync d0/d6/d8/de/f78 0 2024-09-16T09:46:12.342 INFO:tasks.workunit.client.0.smithi111.stdout:2/540: creat d0/da/d4e/fbe x:0 0 0 2024-09-16T09:46:12.344 INFO:tasks.workunit.client.0.smithi111.stdout:3/513: creat d5/da/db/d35/d45/fa7 x:0 0 0 2024-09-16T09:46:12.344 INFO:tasks.workunit.client.0.smithi111.stdout:3/514: chown d5/da/db/de/l37 2905480 1 2024-09-16T09:46:12.345 INFO:tasks.workunit.client.0.smithi111.stdout:9/408: truncate d0/d6/f3c 662529 0 2024-09-16T09:46:12.345 INFO:tasks.workunit.client.0.smithi111.stdout:9/409: chown d0/d21/f66 2124 1 2024-09-16T09:46:12.346 INFO:tasks.workunit.client.0.smithi111.stdout:9/410: symlink d0/d6/d45/l87 0 2024-09-16T09:46:12.348 INFO:tasks.workunit.client.0.smithi111.stdout:9/411: mknod d0/d48/c88 0 2024-09-16T09:46:12.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/412: symlink d0/d6/l89 0 2024-09-16T09:46:12.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/413: fsync d0/d6/d8/de/f11 0 2024-09-16T09:46:12.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/414: chown d0/d6/d8/de/d56/d4e 2423 1 2024-09-16T09:46:12.351 INFO:tasks.workunit.client.0.smithi111.stdout:2/541: dread d0/d29/f42 [0,4194304] 0 2024-09-16T09:46:12.354 INFO:tasks.workunit.client.0.smithi111.stdout:3/515: dread d5/da/db/d3a/d59/f61 [0,4194304] 0 2024-09-16T09:46:12.354 INFO:tasks.workunit.client.0.smithi111.stdout:3/516: readlink d5/da/db/d3a/l4a 0 2024-09-16T09:46:12.355 INFO:tasks.workunit.client.0.smithi111.stdout:3/517: getdents d5/da/db/de 0 2024-09-16T09:46:12.356 INFO:tasks.workunit.client.0.smithi111.stdout:3/518: chown d5/da/db/d35/f39 406 1 2024-09-16T09:46:12.359 INFO:tasks.workunit.client.0.smithi111.stdout:3/519: getdents d5/da/db/d35 0 2024-09-16T09:46:12.360 INFO:tasks.workunit.client.0.smithi111.stdout:9/415: dread d0/d6/f44 [0,4194304] 0 2024-09-16T09:46:12.361 INFO:tasks.workunit.client.0.smithi111.stdout:2/542: write d0/d2/f51 [3597006,121755] 0 2024-09-16T09:46:12.362 INFO:tasks.workunit.client.0.smithi111.stdout:3/520: creat d5/da/db/d3a/d6d/fa8 x:0 0 0 2024-09-16T09:46:12.362 INFO:tasks.workunit.client.0.smithi111.stdout:3/521: truncate d5/da/db/d5a/d5d/d88/d91/f9c 654928 0 2024-09-16T09:46:12.364 INFO:tasks.workunit.client.0.smithi111.stdout:9/416: rmdir d0/d6/d45 39 2024-09-16T09:46:12.367 INFO:tasks.workunit.client.0.smithi111.stdout:2/543: rmdir d0/da 39 2024-09-16T09:46:12.368 INFO:tasks.workunit.client.0.smithi111.stdout:9/417: link d0/d6/d8/de/f11 d0/d6c/f8a 0 2024-09-16T09:46:12.369 INFO:tasks.workunit.client.0.smithi111.stdout:2/544: mknod d0/d2/d61/d9f/cbf 0 2024-09-16T09:46:12.370 INFO:tasks.workunit.client.0.smithi111.stdout:9/418: link d0/d6/d8/de/l7e d0/d6/d30/d81/l8b 0 2024-09-16T09:46:12.371 INFO:tasks.workunit.client.0.smithi111.stdout:2/545: symlink d0/da/d4e/lc0 0 2024-09-16T09:46:12.372 INFO:tasks.workunit.client.0.smithi111.stdout:9/419: mkdir d0/d6c/d70/d8c 0 2024-09-16T09:46:12.374 INFO:tasks.workunit.client.0.smithi111.stdout:2/546: creat d0/da/d4e/fc1 x:0 0 0 2024-09-16T09:46:12.375 INFO:tasks.workunit.client.0.smithi111.stdout:3/522: dwrite d5/d18/d78/f82 [0,4194304] 0 2024-09-16T09:46:12.376 INFO:tasks.workunit.client.0.smithi111.stdout:2/547: creat d0/d2/d59/d86/db1/fc2 x:0 0 0 2024-09-16T09:46:12.379 INFO:tasks.workunit.client.0.smithi111.stdout:2/548: stat d0/d45/l4c 0 2024-09-16T09:46:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:12 smithi111 ceph-mon[27997]: pgmap v259: 65 pgs: 65 active+clean; 776 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56 MiB/s rd, 63 MiB/s wr, 400 op/s 2024-09-16T09:46:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:12.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:12 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:12.387 INFO:tasks.workunit.client.0.smithi111.stdout:2/549: dread d0/d45/d5c/f72 [0,4194304] 0 2024-09-16T09:46:12.389 INFO:tasks.workunit.client.0.smithi111.stdout:2/550: mkdir d0/d2/d61/d9f/dab/dc3 0 2024-09-16T09:46:12.390 INFO:tasks.workunit.client.0.smithi111.stdout:2/551: truncate d0/f53 6458542 0 2024-09-16T09:46:12.397 INFO:tasks.workunit.client.0.smithi111.stdout:3/523: dwrite d5/da/db/de/f28 [0,4194304] 0 2024-09-16T09:46:12.402 INFO:tasks.workunit.client.0.smithi111.stdout:2/552: read d0/d29/f2b [478167,59633] 0 2024-09-16T09:46:12.404 INFO:tasks.workunit.client.0.smithi111.stdout:2/553: creat d0/d45/d81/fc4 x:0 0 0 2024-09-16T09:46:12.407 INFO:tasks.workunit.client.0.smithi111.stdout:2/554: getdents d0/d2/d44 0 2024-09-16T09:46:12.407 INFO:tasks.workunit.client.0.smithi111.stdout:2/555: read - d0/d45/d81/f97 zero size 2024-09-16T09:46:12.415 INFO:tasks.workunit.client.0.smithi111.stdout:3/524: dwrite d5/da/db/de/f15 [0,4194304] 0 2024-09-16T09:46:12.416 INFO:tasks.workunit.client.0.smithi111.stdout:3/525: chown d5/da/db/f7d 7466 1 2024-09-16T09:46:12.417 INFO:tasks.workunit.client.0.smithi111.stdout:3/526: rename d5/da/db/d5a/d5d/d75/l7f to d5/da/d92/la9 0 2024-09-16T09:46:12.418 INFO:tasks.workunit.client.0.smithi111.stdout:3/527: mknod d5/da/db/d3a/d59/caa 0 2024-09-16T09:46:12.418 INFO:tasks.workunit.client.0.smithi111.stdout:3/528: mkdir d5/d18/d78/dab 0 2024-09-16T09:46:12.418 INFO:tasks.workunit.client.0.smithi111.stdout:3/529: read d5/da/db/de/f27 [2183374,128509] 0 2024-09-16T09:46:12.420 INFO:tasks.workunit.client.0.smithi111.stdout:3/530: rename d5/da/db/l90 to d5/da/db/d35/d45/da1/lac 0 2024-09-16T09:46:12.420 INFO:tasks.workunit.client.0.smithi111.stdout:2/556: dwrite d0/d22/fb3 [0,4194304] 0 2024-09-16T09:46:12.421 INFO:tasks.workunit.client.0.smithi111.stdout:3/531: rename d5/da/db/f7d to d5/da/db/fad 0 2024-09-16T09:46:12.425 INFO:tasks.workunit.client.0.smithi111.stdout:3/532: rename d5/f87 to d5/da/db/d3a/fae 0 2024-09-16T09:46:12.425 INFO:tasks.workunit.client.0.smithi111.stdout:3/533: stat d5/f86 0 2024-09-16T09:46:12.427 INFO:tasks.workunit.client.0.smithi111.stdout:3/534: unlink d5/f1a 0 2024-09-16T09:46:12.428 INFO:tasks.workunit.client.0.smithi111.stdout:2/557: write d0/d22/fb3 [2810847,77305] 0 2024-09-16T09:46:12.428 INFO:tasks.workunit.client.0.smithi111.stdout:2/558: stat d0/d2/d59/f71 0 2024-09-16T09:46:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:12 smithi114 ceph-mon[35635]: pgmap v259: 65 pgs: 65 active+clean; 776 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 56 MiB/s rd, 63 MiB/s wr, 400 op/s 2024-09-16T09:46:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:12.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:12 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:12.440 INFO:tasks.workunit.client.0.smithi111.stdout:3/535: dread d5/d18/f8b [0,4194304] 0 2024-09-16T09:46:12.440 INFO:tasks.workunit.client.0.smithi111.stdout:3/536: write d5/da/d42/f48 [4871044,5519] 0 2024-09-16T09:46:12.442 INFO:tasks.workunit.client.0.smithi111.stdout:2/559: dwrite d0/fa7 [0,4194304] 0 2024-09-16T09:46:12.442 INFO:tasks.workunit.client.0.smithi111.stdout:2/560: stat d0/d2/d61/d9f/cbf 0 2024-09-16T09:46:12.443 INFO:tasks.workunit.client.0.smithi111.stdout:3/537: dread d5/f56 [0,4194304] 0 2024-09-16T09:46:12.444 INFO:tasks.workunit.client.0.smithi111.stdout:3/538: write d5/da/db/d3a/fa5 [242019,109057] 0 2024-09-16T09:46:12.459 INFO:tasks.workunit.client.0.smithi111.stdout:2/561: dwrite d0/d45/d5c/d67/f8f [0,4194304] 0 2024-09-16T09:46:12.461 INFO:tasks.workunit.client.0.smithi111.stdout:2/562: mkdir d0/dc5 0 2024-09-16T09:46:12.463 INFO:tasks.workunit.client.0.smithi111.stdout:2/563: mkdir d0/d45/d5c/dc6 0 2024-09-16T09:46:12.467 INFO:tasks.workunit.client.0.smithi111.stdout:2/564: dread d0/d22/fb3 [0,4194304] 0 2024-09-16T09:46:12.468 INFO:tasks.workunit.client.0.smithi111.stdout:2/565: unlink d0/d45/d5c/f72 0 2024-09-16T09:46:12.469 INFO:tasks.workunit.client.0.smithi111.stdout:2/566: chown d0/d2/fad 200358282 1 2024-09-16T09:46:12.470 INFO:tasks.workunit.client.0.smithi111.stdout:2/567: mkdir d0/d2/d59/d86/d96/dc7 0 2024-09-16T09:46:12.477 INFO:tasks.workunit.client.0.smithi111.stdout:2/568: write d0/da/d4e/f74 [51420,20647] 0 2024-09-16T09:46:12.477 INFO:tasks.workunit.client.0.smithi111.stdout:2/569: chown d0/d2/d5a/l75 113 1 2024-09-16T09:46:12.478 INFO:tasks.workunit.client.0.smithi111.stdout:2/570: mkdir d0/d2/d61/d9f/dab/dc3/dc8 0 2024-09-16T09:46:12.479 INFO:tasks.workunit.client.0.smithi111.stdout:2/571: mkdir d0/d22/d98/dc9 0 2024-09-16T09:46:12.480 INFO:tasks.workunit.client.0.smithi111.stdout:2/572: creat d0/d2/d59/d86/db1/fca x:0 0 0 2024-09-16T09:46:12.482 INFO:tasks.workunit.client.0.smithi111.stdout:2/573: symlink d0/d45/d5c/d67/lcb 0 2024-09-16T09:46:12.482 INFO:tasks.workunit.client.0.smithi111.stdout:2/574: stat d0/da/d4e/f7c 0 2024-09-16T09:46:12.482 INFO:tasks.workunit.client.0.smithi111.stdout:2/575: fdatasync d0/da/f57 0 2024-09-16T09:46:12.483 INFO:tasks.workunit.client.0.smithi111.stdout:2/576: unlink d0/d45/d5c/d67/d63/f8b 0 2024-09-16T09:46:12.485 INFO:tasks.workunit.client.0.smithi111.stdout:2/577: link d0/d2/d5a/f62 d0/d22/fcc 0 2024-09-16T09:46:12.486 INFO:tasks.workunit.client.0.smithi111.stdout:2/578: mkdir d0/d45/d5c/dcd 0 2024-09-16T09:46:12.488 INFO:tasks.workunit.client.0.smithi111.stdout:2/579: symlink d0/d2/d44/lce 0 2024-09-16T09:46:12.488 INFO:tasks.workunit.client.0.smithi111.stdout:2/580: write d0/d22/d98/f9b [129550,16117] 0 2024-09-16T09:46:12.488 INFO:tasks.workunit.client.0.smithi111.stdout:2/581: chown d0/d22 158 1 2024-09-16T09:46:12.488 INFO:tasks.workunit.client.0.smithi111.stdout:2/582: stat d0/d29/d80/f8d 0 2024-09-16T09:46:12.489 INFO:tasks.workunit.client.0.smithi111.stdout:2/583: mknod d0/d2/d61/d9f/ccf 0 2024-09-16T09:46:12.514 INFO:tasks.workunit.client.0.smithi111.stdout:7/349: sync 2024-09-16T09:46:12.514 INFO:tasks.workunit.client.0.smithi111.stdout:6/393: sync 2024-09-16T09:46:12.514 INFO:tasks.workunit.client.0.smithi111.stdout:4/440: sync 2024-09-16T09:46:12.514 INFO:tasks.workunit.client.0.smithi111.stdout:7/350: write d1/d16/d17/d18/d4f/f50 [285842,70002] 0 2024-09-16T09:46:12.514 INFO:tasks.workunit.client.0.smithi111.stdout:7/351: chown d1/d16/f1c 17323 1 2024-09-16T09:46:12.515 INFO:tasks.workunit.client.0.smithi111.stdout:2/584: dwrite d0/d29/d80/f85 [0,4194304] 0 2024-09-16T09:46:12.515 INFO:tasks.workunit.client.0.smithi111.stdout:2/585: fdatasync d0/d21/f2f 0 2024-09-16T09:46:12.523 INFO:tasks.workunit.client.0.smithi111.stdout:2/586: symlink d0/ld0 0 2024-09-16T09:46:12.523 INFO:tasks.workunit.client.0.smithi111.stdout:2/587: write d0/d22/d98/f9b [513794,44967] 0 2024-09-16T09:46:12.547 INFO:tasks.workunit.client.0.smithi111.stdout:7/352: dwrite d1/d16/d17/d18/d4f/d56/f5a [0,4194304] 0 2024-09-16T09:46:12.548 INFO:tasks.workunit.client.0.smithi111.stdout:6/394: dwrite d0/f19 [0,4194304] 0 2024-09-16T09:46:12.548 INFO:tasks.workunit.client.0.smithi111.stdout:6/395: chown d0/df/d14/d20/d23/d33/f36 3 1 2024-09-16T09:46:12.561 INFO:tasks.workunit.client.0.smithi111.stdout:6/396: dwrite d0/df/d14/d20/d23/d33/f34 [0,4194304] 0 2024-09-16T09:46:12.561 INFO:tasks.workunit.client.0.smithi111.stdout:6/397: truncate d0/df/d14/d20/d42/f56 145306 0 2024-09-16T09:46:12.595 INFO:tasks.workunit.client.0.smithi111.stdout:4/441: truncate d2/d6/fe 2586653 0 2024-09-16T09:46:12.595 INFO:tasks.workunit.client.0.smithi111.stdout:4/442: write d2/d6/dd/d1c/d2f/d4e/f74 [365775,56808] 0 2024-09-16T09:46:12.597 INFO:tasks.workunit.client.0.smithi111.stdout:2/588: mkdir d0/d2/d59/d86/d96/dd1 0 2024-09-16T09:46:12.600 INFO:tasks.workunit.client.0.smithi111.stdout:7/353: creat d1/d9/d53/f78 x:0 0 0 2024-09-16T09:46:12.604 INFO:tasks.workunit.client.0.smithi111.stdout:6/398: symlink d0/df/d49/d5b/l84 0 2024-09-16T09:46:12.612 INFO:tasks.workunit.client.0.smithi111.stdout:2/589: truncate d0/d2/f28 458376 0 2024-09-16T09:46:12.612 INFO:tasks.workunit.client.0.smithi111.stdout:2/590: chown d0/d45/d5c/cbb 0 1 2024-09-16T09:46:12.615 INFO:tasks.workunit.client.0.smithi111.stdout:4/443: mknod d2/d6/c86 0 2024-09-16T09:46:12.617 INFO:tasks.workunit.client.0.smithi111.stdout:2/591: symlink d0/d45/d5c/ld2 0 2024-09-16T09:46:12.617 INFO:tasks.workunit.client.0.smithi111.stdout:2/592: chown d0/d29/d80/ca5 54 1 2024-09-16T09:46:12.617 INFO:tasks.workunit.client.0.smithi111.stdout:6/399: symlink d0/l85 0 2024-09-16T09:46:12.619 INFO:tasks.workunit.client.0.smithi111.stdout:4/444: creat d2/d6/dd/d1c/d2f/d6c/f87 x:0 0 0 2024-09-16T09:46:12.619 INFO:tasks.workunit.client.0.smithi111.stdout:6/400: mknod d0/df/d47/c86 0 2024-09-16T09:46:12.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/401: link d0/df/d49/d5b/l79 d0/df/d47/l87 0 2024-09-16T09:46:12.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/402: dread - d0/d57/d72/f61 zero size 2024-09-16T09:46:12.623 INFO:tasks.workunit.client.0.smithi111.stdout:6/403: chown d0/df/d49/d5b 962122 1 2024-09-16T09:46:12.628 INFO:tasks.workunit.client.0.smithi111.stdout:7/354: dwrite d1/d16/d27/f76 [0,4194304] 0 2024-09-16T09:46:12.628 INFO:tasks.workunit.client.0.smithi111.stdout:6/404: dread d0/df/d14/d20/d42/d4e/d64/f69 [0,4194304] 0 2024-09-16T09:46:12.635 INFO:tasks.workunit.client.0.smithi111.stdout:6/405: mkdir d0/df/d47/d88 0 2024-09-16T09:46:12.636 INFO:tasks.workunit.client.0.smithi111.stdout:2/593: dwrite d0/f3d [0,4194304] 0 2024-09-16T09:46:12.636 INFO:tasks.workunit.client.0.smithi111.stdout:2/594: write d0/d21/f7f [41555,48903] 0 2024-09-16T09:46:12.639 INFO:tasks.workunit.client.0.smithi111.stdout:2/595: rename d0/d2/f28 to d0/d2/d61/d9f/dab/fd3 0 2024-09-16T09:46:12.647 INFO:tasks.workunit.client.0.smithi111.stdout:7/355: dwrite d1/d16/d17/d18/d4f/f50 [0,4194304] 0 2024-09-16T09:46:12.649 INFO:tasks.workunit.client.0.smithi111.stdout:0/481: sync 2024-09-16T09:46:12.649 INFO:tasks.workunit.client.0.smithi111.stdout:0/482: write d0/f18 [5341006,86075] 0 2024-09-16T09:46:12.649 INFO:tasks.workunit.client.0.smithi111.stdout:0/483: truncate d0/d1d/d67/d3a/d77/f84 1049168 0 2024-09-16T09:46:12.649 INFO:tasks.workunit.client.0.smithi111.stdout:0/484: write d0/d26/d35/d86/fa3 [336936,88231] 0 2024-09-16T09:46:12.651 INFO:tasks.workunit.client.0.smithi111.stdout:6/406: write d0/df/d14/d20/d23/f7e [897554,9781] 0 2024-09-16T09:46:12.654 INFO:tasks.workunit.client.0.smithi111.stdout:0/485: dread d0/d1d/f29 [0,4194304] 0 2024-09-16T09:46:12.666 INFO:tasks.workunit.client.0.smithi111.stdout:6/407: creat d0/f89 x:0 0 0 2024-09-16T09:46:12.667 INFO:tasks.workunit.client.0.smithi111.stdout:0/486: creat d0/d1d/d67/d3a/fab x:0 0 0 2024-09-16T09:46:12.668 INFO:tasks.workunit.client.0.smithi111.stdout:0/487: creat d0/d1d/d67/d3a/fac x:0 0 0 2024-09-16T09:46:12.673 INFO:tasks.workunit.client.0.smithi111.stdout:0/488: write d0/d1d/f2d [3003465,19933] 0 2024-09-16T09:46:12.673 INFO:tasks.workunit.client.0.smithi111.stdout:6/408: dread d0/df/d14/d20/d23/d33/f36 [0,4194304] 0 2024-09-16T09:46:12.674 INFO:tasks.workunit.client.0.smithi111.stdout:0/489: mkdir d0/d1d/d67/d3a/d77/dad 0 2024-09-16T09:46:12.674 INFO:tasks.workunit.client.0.smithi111.stdout:0/490: write d0/d1d/d58/d64/f90 [457958,62617] 0 2024-09-16T09:46:12.675 INFO:tasks.workunit.client.0.smithi111.stdout:6/409: symlink d0/df/d14/d20/d23/d33/l8a 0 2024-09-16T09:46:12.676 INFO:tasks.workunit.client.0.smithi111.stdout:7/356: dwrite d1/d16/d17/d18/f62 [0,4194304] 0 2024-09-16T09:46:12.676 INFO:tasks.workunit.client.0.smithi111.stdout:7/357: stat d1/d16/d17/d18/d1b/l3b 0 2024-09-16T09:46:12.677 INFO:tasks.workunit.client.0.smithi111.stdout:7/358: write d1/d16/d17/d18/f21 [1697701,88614] 0 2024-09-16T09:46:12.678 INFO:tasks.workunit.client.0.smithi111.stdout:2/596: rename d0/d2/d61/d9f/dab to d0/d45/d5c/d67/d63/dd4 0 2024-09-16T09:46:12.687 INFO:tasks.workunit.client.0.smithi111.stdout:2/597: mkdir d0/d2/d59/dd5 0 2024-09-16T09:46:12.687 INFO:tasks.workunit.client.0.smithi111.stdout:2/598: chown d0/d29/d80 94611516 1 2024-09-16T09:46:12.690 INFO:tasks.workunit.client.0.smithi111.stdout:2/599: rmdir d0/d45/d5c/dcd 0 2024-09-16T09:46:12.692 INFO:tasks.workunit.client.0.smithi111.stdout:6/410: dread d0/f1a [0,4194304] 0 2024-09-16T09:46:12.694 INFO:tasks.workunit.client.0.smithi111.stdout:6/411: creat d0/d57/d72/f8b x:0 0 0 2024-09-16T09:46:12.694 INFO:tasks.workunit.client.0.smithi111.stdout:6/412: fdatasync d0/df/d14/d20/d23/d41/f54 0 2024-09-16T09:46:12.695 INFO:tasks.workunit.client.0.smithi111.stdout:0/491: dwrite d0/d1d/d67/d3a/fac [0,4194304] 0 2024-09-16T09:46:12.696 INFO:tasks.workunit.client.0.smithi111.stdout:6/413: mknod d0/df/d14/d20/d42/d4e/d62/d7b/c8c 0 2024-09-16T09:46:12.696 INFO:tasks.workunit.client.0.smithi111.stdout:6/414: stat d0/f19 0 2024-09-16T09:46:12.700 INFO:tasks.workunit.client.0.smithi111.stdout:0/492: mknod d0/d1d/d67/d3a/d92/cae 0 2024-09-16T09:46:12.701 INFO:tasks.workunit.client.0.smithi111.stdout:6/415: creat d0/df/d47/d68/d6a/f8d x:0 0 0 2024-09-16T09:46:12.702 INFO:tasks.workunit.client.0.smithi111.stdout:2/600: dread d0/d2/d5a/f62 [0,4194304] 0 2024-09-16T09:46:12.702 INFO:tasks.workunit.client.0.smithi111.stdout:2/601: fsync d0/d2/d5a/f62 0 2024-09-16T09:46:12.702 INFO:tasks.workunit.client.0.smithi111.stdout:6/416: creat d0/df/d47/d88/f8e x:0 0 0 2024-09-16T09:46:12.716 INFO:tasks.workunit.client.0.smithi111.stdout:2/602: write d0/da/f3f [1649214,13362] 0 2024-09-16T09:46:12.717 INFO:tasks.workunit.client.0.smithi111.stdout:2/603: unlink d0/f3d 0 2024-09-16T09:46:12.717 INFO:tasks.workunit.client.0.smithi111.stdout:2/604: chown d0/d22/fcc 403455 1 2024-09-16T09:46:12.718 INFO:tasks.workunit.client.0.smithi111.stdout:2/605: rename d0/da/f33 to d0/d45/d5c/fd6 0 2024-09-16T09:46:12.720 INFO:tasks.workunit.client.0.smithi111.stdout:2/606: truncate d0/d2/f6a 912269 0 2024-09-16T09:46:12.735 INFO:tasks.workunit.client.0.smithi111.stdout:2/607: dread d0/da/d4e/f9d [0,4194304] 0 2024-09-16T09:46:12.737 INFO:tasks.workunit.client.0.smithi111.stdout:2/608: link d0/d45/l4c d0/d2/d61/d9f/ld7 0 2024-09-16T09:46:12.738 INFO:tasks.workunit.client.0.smithi111.stdout:5/540: sync 2024-09-16T09:46:12.739 INFO:tasks.workunit.client.0.smithi111.stdout:5/541: chown d19/d1b/d27/d83/d2a/f7c 810089096 1 2024-09-16T09:46:12.739 INFO:tasks.workunit.client.0.smithi111.stdout:5/542: dread - d19/d1b/d27/d2e/d39/f77 zero size 2024-09-16T09:46:12.739 INFO:tasks.workunit.client.0.smithi111.stdout:2/609: mkdir d0/dd8 0 2024-09-16T09:46:12.739 INFO:tasks.workunit.client.0.smithi111.stdout:2/610: chown d0/d22/d98/dc9 184018635 1 2024-09-16T09:46:12.745 INFO:tasks.workunit.client.0.smithi111.stdout:5/543: rename d19/d1b/d27/d8a to d19/d1b/d27/d83/d2a/dc4 0 2024-09-16T09:46:12.745 INFO:tasks.workunit.client.0.smithi111.stdout:2/611: rename d0/d2/d59/d86/db1/fc2 to d0/d2/fd9 0 2024-09-16T09:46:12.745 INFO:tasks.workunit.client.0.smithi111.stdout:2/612: fsync d0/f55 0 2024-09-16T09:46:12.746 INFO:tasks.workunit.client.0.smithi111.stdout:2/613: truncate d0/d21/f4f 4480498 0 2024-09-16T09:46:12.746 INFO:tasks.workunit.client.0.smithi111.stdout:2/614: write d0/da/d4e/f74 [1921485,74366] 0 2024-09-16T09:46:12.746 INFO:tasks.workunit.client.0.smithi111.stdout:2/615: mknod d0/d2/d59/d86/cda 0 2024-09-16T09:46:12.746 INFO:tasks.workunit.client.0.smithi111.stdout:2/616: read d0/d22/fb3 [1376715,42546] 0 2024-09-16T09:46:12.746 INFO:tasks.workunit.client.0.smithi111.stdout:2/617: chown d0/d2/d61/d9f/ccf 562242226 1 2024-09-16T09:46:12.746 INFO:tasks.workunit.client.0.smithi111.stdout:2/618: mknod d0/d45/d5c/d67/d63/dd4/cdb 0 2024-09-16T09:46:12.747 INFO:tasks.workunit.client.0.smithi111.stdout:2/619: creat d0/d45/fdc x:0 0 0 2024-09-16T09:46:12.749 INFO:tasks.workunit.client.0.smithi111.stdout:2/620: rename d0/d2/d5a/l88 to d0/d21/ldd 0 2024-09-16T09:46:12.753 INFO:tasks.workunit.client.0.smithi111.stdout:5/544: write d19/d1b/d27/d2e/f42 [235010,95449] 0 2024-09-16T09:46:12.756 INFO:tasks.workunit.client.0.smithi111.stdout:5/545: getdents d19/d1b/d27/d2e/d39 0 2024-09-16T09:46:12.758 INFO:tasks.workunit.client.0.smithi111.stdout:5/546: rename d19/d1b/f82 to d19/d1b/d27/d2e/d39/d54/fc5 0 2024-09-16T09:46:12.758 INFO:tasks.workunit.client.0.smithi111.stdout:5/547: readlink d19/d1b/d1e/d21/d29/d32/d46/l6e 0 2024-09-16T09:46:12.760 INFO:tasks.workunit.client.0.smithi111.stdout:5/548: truncate d19/d1b/f97 1010403 0 2024-09-16T09:46:12.784 INFO:tasks.workunit.client.0.smithi111.stdout:5/549: dwrite f10 [4194304,4194304] 0 2024-09-16T09:46:12.884 INFO:tasks.workunit.client.0.smithi111.stdout:8/432: sync 2024-09-16T09:46:12.893 INFO:tasks.workunit.client.0.smithi111.stdout:8/433: read d3/de/d1e/d2e/d2f/f5e [170010,128474] 0 2024-09-16T09:46:12.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/434: creat d3/de/f88 x:0 0 0 2024-09-16T09:46:12.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/435: stat d3/de/d1e/d27/d6b/c78 0 2024-09-16T09:46:12.895 INFO:tasks.workunit.client.0.smithi111.stdout:8/436: mkdir d3/d26/d89 0 2024-09-16T09:46:12.896 INFO:tasks.workunit.client.0.smithi111.stdout:8/437: getdents d3/de/d1e/d27/d6b 0 2024-09-16T09:46:12.898 INFO:tasks.workunit.client.0.smithi111.stdout:8/438: rmdir d3/da/db/d59 39 2024-09-16T09:46:12.899 INFO:tasks.workunit.client.0.smithi111.stdout:8/439: rename d3/de/d1e/d2e/d2f/f33 to d3/de/d5c/f8a 0 2024-09-16T09:46:12.899 INFO:tasks.workunit.client.0.smithi111.stdout:8/440: chown d3/f8 0 1 2024-09-16T09:46:12.900 INFO:tasks.workunit.client.0.smithi111.stdout:8/441: readlink d3/de/d1e/d2e/l65 0 2024-09-16T09:46:12.901 INFO:tasks.workunit.client.0.smithi111.stdout:8/442: creat d3/da/f8b x:0 0 0 2024-09-16T09:46:12.902 INFO:tasks.workunit.client.0.smithi111.stdout:8/443: creat d3/de/d1e/d2e/d74/f8c x:0 0 0 2024-09-16T09:46:12.902 INFO:tasks.workunit.client.0.smithi111.stdout:8/444: fdatasync d3/de/d1e/f87 0 2024-09-16T09:46:12.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/445: creat d3/de/d1e/d2e/d2f/f8d x:0 0 0 2024-09-16T09:46:12.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/446: fsync d3/de/d1e/d27/f2b 0 2024-09-16T09:46:12.904 INFO:tasks.workunit.client.0.smithi111.stdout:8/447: truncate d3/d26/f55 152028 0 2024-09-16T09:46:12.906 INFO:tasks.workunit.client.0.smithi111.stdout:8/448: rmdir d3/de/d6e 39 2024-09-16T09:46:12.908 INFO:tasks.workunit.client.0.smithi111.stdout:8/449: creat d3/de/d34/f8e x:0 0 0 2024-09-16T09:46:12.908 INFO:tasks.workunit.client.0.smithi111.stdout:8/450: fsync d3/de/d1e/d27/f45 0 2024-09-16T09:46:12.908 INFO:tasks.workunit.client.0.smithi111.stdout:8/451: chown d3/de/d6e 551 1 2024-09-16T09:46:12.910 INFO:tasks.workunit.client.0.smithi111.stdout:8/452: rmdir d3/d26/d89 0 2024-09-16T09:46:12.910 INFO:tasks.workunit.client.0.smithi111.stdout:8/453: fdatasync d3/f10 0 2024-09-16T09:46:12.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/454: dread - d3/de/d1e/f87 zero size 2024-09-16T09:46:12.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/455: fsync d3/de/d1e/d27/f28 0 2024-09-16T09:46:12.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/456: fdatasync d3/d26/f55 0 2024-09-16T09:46:12.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/457: chown d3/da/df/c71 75 1 2024-09-16T09:46:12.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/458: mkdir d3/de/d6e/d8f 0 2024-09-16T09:46:12.912 INFO:tasks.workunit.client.0.smithi111.stdout:8/459: truncate d3/da/db/f7b 974445 0 2024-09-16T09:46:12.914 INFO:tasks.workunit.client.0.smithi111.stdout:8/460: rename d3/da/l77 to d3/da/db/d59/l90 0 2024-09-16T09:46:12.914 INFO:tasks.workunit.client.0.smithi111.stdout:8/461: stat d3/de/d1e/d27/d6b/c78 0 2024-09-16T09:46:12.915 INFO:tasks.workunit.client.0.smithi111.stdout:8/462: symlink d3/da/db/d59/l91 0 2024-09-16T09:46:12.935 INFO:tasks.workunit.client.0.smithi111.stdout:8/463: dwrite d3/de/d1e/d2e/d2f/f5d [0,4194304] 0 2024-09-16T09:46:12.951 INFO:tasks.workunit.client.0.smithi111.stdout:8/464: dwrite f0 [0,4194304] 0 2024-09-16T09:46:12.951 INFO:tasks.workunit.client.0.smithi111.stdout:8/465: chown d3/de/d1e/d2e/d2f/f63 1561595 1 2024-09-16T09:46:12.951 INFO:tasks.workunit.client.0.smithi111.stdout:8/466: write d3/de/d1e/f87 [1019043,88158] 0 2024-09-16T09:46:12.952 INFO:tasks.workunit.client.0.smithi111.stdout:8/467: creat d3/de/d1e/d2e/f92 x:0 0 0 2024-09-16T09:46:12.952 INFO:tasks.workunit.client.0.smithi111.stdout:8/468: dread - d3/de/d1e/d2e/d74/f8c zero size 2024-09-16T09:46:12.952 INFO:tasks.workunit.client.0.smithi111.stdout:8/469: creat d3/de/d1e/d2e/d74/d83/f93 x:0 0 0 2024-09-16T09:46:12.960 INFO:tasks.workunit.client.0.smithi111.stdout:8/470: dread d3/f50 [0,4194304] 0 2024-09-16T09:46:13.012 INFO:tasks.workunit.client.0.smithi111.stdout:8/471: symlink d3/d26/l94 0 2024-09-16T09:46:13.043 INFO:tasks.workunit.client.0.smithi111.stdout:8/472: rename d3/de/d1e/d2e/d2f/l3a to d3/de/d1e/d2e/l95 0 2024-09-16T09:46:13.045 INFO:tasks.workunit.client.0.smithi111.stdout:8/473: rename d3/de/d1e/d2e/l65 to d3/de/d1e/d2e/d2f/l96 0 2024-09-16T09:46:13.048 INFO:tasks.workunit.client.0.smithi111.stdout:8/474: rmdir d3/de/d5c 39 2024-09-16T09:46:13.048 INFO:tasks.workunit.client.0.smithi111.stdout:8/475: fdatasync d3/de/d1e/d2e/d2f/f5e 0 2024-09-16T09:46:13.050 INFO:tasks.workunit.client.0.smithi111.stdout:8/476: rename d3/f11 to d3/d26/f97 0 2024-09-16T09:46:13.059 INFO:tasks.workunit.client.0.smithi111.stdout:8/477: rename d3/d26/f97 to d3/de/d1e/f98 0 2024-09-16T09:46:13.062 INFO:tasks.workunit.client.0.smithi111.stdout:8/478: rename d3/de/d34/c44 to d3/da/db/d59/c99 0 2024-09-16T09:46:13.062 INFO:tasks.workunit.client.0.smithi111.stdout:8/479: readlink d3/d26/d6d/l82 0 2024-09-16T09:46:13.062 INFO:tasks.workunit.client.0.smithi111.stdout:8/480: getdents d3/de/d1e/d27/d6b 0 2024-09-16T09:46:13.063 INFO:tasks.workunit.client.0.smithi111.stdout:8/481: rename d3/da/f66 to d3/de/d34/f9a 0 2024-09-16T09:46:13.079 INFO:tasks.workunit.client.0.smithi111.stdout:1/507: sync 2024-09-16T09:46:13.080 INFO:tasks.workunit.client.0.smithi111.stdout:8/482: dwrite d3/de/d1e/d2e/f68 [0,4194304] 0 2024-09-16T09:46:13.080 INFO:tasks.workunit.client.0.smithi111.stdout:1/508: creat d3/d10/fa9 x:0 0 0 2024-09-16T09:46:13.082 INFO:tasks.workunit.client.0.smithi111.stdout:8/483: creat d3/de/d1e/d2e/d2f/d4c/f9b x:0 0 0 2024-09-16T09:46:13.082 INFO:tasks.workunit.client.0.smithi111.stdout:8/484: fsync d3/de/d1e/f51 0 2024-09-16T09:46:13.084 INFO:tasks.workunit.client.0.smithi111.stdout:1/509: truncate d3/d10/d72/da1/f17 1278678 0 2024-09-16T09:46:13.086 INFO:tasks.workunit.client.0.smithi111.stdout:8/485: link d3/da/db/d59/c6c d3/de/d1e/d2e/d2f/c9c 0 2024-09-16T09:46:13.086 INFO:tasks.workunit.client.0.smithi111.stdout:8/486: write d3/f19 [3774407,70907] 0 2024-09-16T09:46:13.087 INFO:tasks.workunit.client.0.smithi111.stdout:1/510: creat d3/d10/d72/da1/d28/d36/faa x:0 0 0 2024-09-16T09:46:13.088 INFO:tasks.workunit.client.0.smithi111.stdout:1/511: write d3/d10/d23/f8b [848469,20914] 0 2024-09-16T09:46:13.090 INFO:tasks.workunit.client.0.smithi111.stdout:8/487: creat d3/de/d1e/d27/f9d x:0 0 0 2024-09-16T09:46:13.091 INFO:tasks.workunit.client.0.smithi111.stdout:1/512: symlink d3/d26/d63/lab 0 2024-09-16T09:46:13.093 INFO:tasks.workunit.client.0.smithi111.stdout:8/488: mkdir d3/da/df/d9e 0 2024-09-16T09:46:13.095 INFO:tasks.workunit.client.0.smithi111.stdout:1/513: getdents d3/d10/d72/da1/d28/d36 0 2024-09-16T09:46:13.095 INFO:tasks.workunit.client.0.smithi111.stdout:1/514: stat d3/f1a 0 2024-09-16T09:46:13.095 INFO:tasks.workunit.client.0.smithi111.stdout:1/515: fsync d3/d10/d1c/f25 0 2024-09-16T09:46:13.095 INFO:tasks.workunit.client.0.smithi111.stdout:1/516: fsync d3/d24/d3f/d89/fa6 0 2024-09-16T09:46:13.098 INFO:tasks.workunit.client.0.smithi111.stdout:1/517: creat d3/d10/d72/da1/d28/d36/d3d/d47/d5a/fac x:0 0 0 2024-09-16T09:46:13.100 INFO:tasks.workunit.client.0.smithi111.stdout:9/420: sync 2024-09-16T09:46:13.101 INFO:tasks.workunit.client.0.smithi111.stdout:1/518: link d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/l77 d3/d10/d72/da1/d28/d36/d3d/d47/d5a/lad 0 2024-09-16T09:46:13.102 INFO:tasks.workunit.client.0.smithi111.stdout:1/519: dread - d3/d10/d72/da1/d28/d36/fa5 zero size 2024-09-16T09:46:13.103 INFO:tasks.workunit.client.0.smithi111.stdout:9/421: creat d0/d6c/f8d x:0 0 0 2024-09-16T09:46:13.103 INFO:tasks.workunit.client.0.smithi111.stdout:9/422: write d0/d21/d22/d6e/d51/d76/f83 [716337,6733] 0 2024-09-16T09:46:13.104 INFO:tasks.workunit.client.0.smithi111.stdout:1/520: creat d3/d10/d72/da1/d28/d36/d3d/d47/d65/fae x:0 0 0 2024-09-16T09:46:13.104 INFO:tasks.workunit.client.0.smithi111.stdout:1/521: chown d3/d26/d63/f9b 2347158 1 2024-09-16T09:46:13.106 INFO:tasks.workunit.client.0.smithi111.stdout:9/423: mkdir d0/d6/d8/de/d56/d8e 0 2024-09-16T09:46:13.113 INFO:tasks.workunit.client.0.smithi111.stdout:1/522: read d3/d10/d1c/f33 [4126932,4594] 0 2024-09-16T09:46:13.113 INFO:tasks.workunit.client.0.smithi111.stdout:1/523: write d3/d10/f96 [5098859,50547] 0 2024-09-16T09:46:13.115 INFO:tasks.workunit.client.0.smithi111.stdout:8/489: dwrite d3/de/f14 [0,4194304] 0 2024-09-16T09:46:13.115 INFO:tasks.workunit.client.0.smithi111.stdout:1/524: rename d3/d24/d3f/d89 to d3/d10/d72/da1/d28/d36/d3d/d47/daf 0 2024-09-16T09:46:13.117 INFO:tasks.workunit.client.0.smithi111.stdout:8/490: symlink d3/de/d34/l9f 0 2024-09-16T09:46:13.120 INFO:tasks.workunit.client.0.smithi111.stdout:1/525: symlink d3/d26/d63/lb0 0 2024-09-16T09:46:13.121 INFO:tasks.workunit.client.0.smithi111.stdout:8/491: dread d3/f50 [0,4194304] 0 2024-09-16T09:46:13.123 INFO:tasks.workunit.client.0.smithi111.stdout:1/526: dread d3/d24/d62/f81 [0,4194304] 0 2024-09-16T09:46:13.124 INFO:tasks.workunit.client.0.smithi111.stdout:8/492: creat d3/fa0 x:0 0 0 2024-09-16T09:46:13.124 INFO:tasks.workunit.client.0.smithi111.stdout:9/424: dwrite d0/d6/d8/de/d56/f71 [0,4194304] 0 2024-09-16T09:46:13.125 INFO:tasks.workunit.client.0.smithi111.stdout:8/493: creat d3/de/d1e/d2e/d74/d83/fa1 x:0 0 0 2024-09-16T09:46:13.132 INFO:tasks.workunit.client.0.smithi111.stdout:9/425: getdents d0/d6/d30 0 2024-09-16T09:46:13.134 INFO:tasks.workunit.client.0.smithi111.stdout:8/494: mkdir d3/de/d1e/d2e/d74/d83/da2 0 2024-09-16T09:46:13.135 INFO:tasks.workunit.client.0.smithi111.stdout:8/495: dread d3/de/d1e/d2e/f37 [0,4194304] 0 2024-09-16T09:46:13.135 INFO:tasks.workunit.client.0.smithi111.stdout:8/496: chown d3/d26/d6d/f4f 8812 1 2024-09-16T09:46:13.135 INFO:tasks.workunit.client.0.smithi111.stdout:9/426: creat d0/d21/f8f x:0 0 0 2024-09-16T09:46:13.138 INFO:tasks.workunit.client.0.smithi111.stdout:1/527: dread d3/d10/d57/f68 [0,4194304] 0 2024-09-16T09:46:13.138 INFO:tasks.workunit.client.0.smithi111.stdout:1/528: write d3/d24/d4e/f52 [4498459,102111] 0 2024-09-16T09:46:13.138 INFO:tasks.workunit.client.0.smithi111.stdout:8/497: unlink d3/de/d1e/d27/f45 0 2024-09-16T09:46:13.140 INFO:tasks.workunit.client.0.smithi111.stdout:9/427: creat d0/d6/f90 x:0 0 0 2024-09-16T09:46:13.140 INFO:tasks.workunit.client.0.smithi111.stdout:9/428: dread - d0/d6/d30/d47/f52 zero size 2024-09-16T09:46:13.144 INFO:tasks.workunit.client.0.smithi111.stdout:1/529: mknod d3/d10/d72/da1/cb1 0 2024-09-16T09:46:13.145 INFO:tasks.workunit.client.0.smithi111.stdout:8/498: symlink d3/d26/d6d/la3 0 2024-09-16T09:46:13.146 INFO:tasks.workunit.client.0.smithi111.stdout:1/530: creat d3/d24/d29/fb2 x:0 0 0 2024-09-16T09:46:13.153 INFO:tasks.workunit.client.0.smithi111.stdout:8/499: creat d3/de/d1e/d27/fa4 x:0 0 0 2024-09-16T09:46:13.153 INFO:tasks.workunit.client.0.smithi111.stdout:8/500: write d3/de/d1e/d2e/d74/f86 [318004,84190] 0 2024-09-16T09:46:13.153 INFO:tasks.workunit.client.0.smithi111.stdout:8/501: truncate d3/d26/f75 158355 0 2024-09-16T09:46:13.153 INFO:tasks.workunit.client.0.smithi111.stdout:8/502: fsync d3/f8 0 2024-09-16T09:46:13.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/503: rmdir d3/da/db/d59 39 2024-09-16T09:46:13.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/504: chown d3/de/d1e/d27 1 1 2024-09-16T09:46:13.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/505: chown d3/f13 0 1 2024-09-16T09:46:13.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/506: fdatasync d3/da/df/f47 0 2024-09-16T09:46:13.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/507: mknod d3/da/df/ca5 0 2024-09-16T09:46:13.155 INFO:tasks.workunit.client.0.smithi111.stdout:8/508: creat d3/d26/d6d/fa6 x:0 0 0 2024-09-16T09:46:13.155 INFO:tasks.workunit.client.0.smithi111.stdout:8/509: dread - d3/de/d34/f8e zero size 2024-09-16T09:46:13.156 INFO:tasks.workunit.client.0.smithi111.stdout:8/510: creat d3/fa7 x:0 0 0 2024-09-16T09:46:13.161 INFO:tasks.workunit.client.0.smithi111.stdout:9/429: dwrite d0/d48/f80 [0,4194304] 0 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:3/539: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:0/493: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:7/359: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:4/445: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:3/540: dread - d5/da/db/f84 zero size 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:5/550: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:2/621: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:2/622: write d0/da/f57 [571213,51698] 0 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:6/417: sync 2024-09-16T09:46:13.162 INFO:tasks.workunit.client.0.smithi111.stdout:6/418: readlink d0/d57/d72/l4b 0 2024-09-16T09:46:13.165 INFO:tasks.workunit.client.0.smithi111.stdout:7/360: mkdir d1/d16/d17/d18/d1b/d79 0 2024-09-16T09:46:13.169 INFO:tasks.workunit.client.0.smithi111.stdout:3/541: mknod d5/da/db/d5a/d5d/d88/d91/caf 0 2024-09-16T09:46:13.171 INFO:tasks.workunit.client.0.smithi111.stdout:5/551: getdents d19/d1b/d27/d2e/d39/d6c 0 2024-09-16T09:46:13.171 INFO:tasks.workunit.client.0.smithi111.stdout:9/430: write d0/d6/d8/f36 [193417,126751] 0 2024-09-16T09:46:13.171 INFO:tasks.workunit.client.0.smithi111.stdout:9/431: fdatasync d0/d21/d22/f86 0 2024-09-16T09:46:13.174 INFO:tasks.workunit.client.0.smithi111.stdout:2/623: rename d0/d29/d80/ca5 to d0/d22/d98/dc9/cde 0 2024-09-16T09:46:13.175 INFO:tasks.workunit.client.0.smithi111.stdout:6/419: mknod d0/df/c8f 0 2024-09-16T09:46:13.177 INFO:tasks.workunit.client.0.smithi111.stdout:7/361: creat d1/d9/d43/f7a x:0 0 0 2024-09-16T09:46:13.178 INFO:tasks.workunit.client.0.smithi111.stdout:5/552: mkdir d19/d1b/d27/d2e/d39/dc6 0 2024-09-16T09:46:13.182 INFO:tasks.workunit.client.0.smithi111.stdout:9/432: rename d0/d6/c27 to d0/d6/d8/c91 0 2024-09-16T09:46:13.184 INFO:tasks.workunit.client.0.smithi111.stdout:6/420: mknod d0/df/d47/d52/c90 0 2024-09-16T09:46:13.185 INFO:tasks.workunit.client.0.smithi111.stdout:7/362: symlink d1/d16/l7b 0 2024-09-16T09:46:13.187 INFO:tasks.workunit.client.0.smithi111.stdout:5/553: creat d19/d1b/d27/d9d/fc7 x:0 0 0 2024-09-16T09:46:13.187 INFO:tasks.workunit.client.0.smithi111.stdout:6/421: truncate d0/df/d14/d20/d23/d33/f36 1144043 0 2024-09-16T09:46:13.187 INFO:tasks.workunit.client.0.smithi111.stdout:6/422: readlink d0/df/d49/d5b/l84 0 2024-09-16T09:46:13.188 INFO:tasks.workunit.client.0.smithi111.stdout:7/363: truncate d1/d9/f1f 2688782 0 2024-09-16T09:46:13.189 INFO:tasks.workunit.client.0.smithi111.stdout:8/511: dwrite d3/de/f14 [4194304,4194304] 0 2024-09-16T09:46:13.190 INFO:tasks.workunit.client.0.smithi111.stdout:5/554: mkdir d19/d1b/d1e/d21/d29/d32/d8f/dc8 0 2024-09-16T09:46:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:6/423: mknod d0/df/d49/d5b/c91 0 2024-09-16T09:46:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:5/555: truncate d19/d1b/d27/d2e/d4a/fbc 281857 0 2024-09-16T09:46:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:6/424: chown d0/df/d14/d20/d42/d4e/d62/d7b/c8c 204408943 1 2024-09-16T09:46:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:5/556: fdatasync d19/d1b/d1e/f76 0 2024-09-16T09:46:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:6/425: chown d0/df/d14/f74 8392 1 2024-09-16T09:46:13.191 INFO:tasks.workunit.client.0.smithi111.stdout:6/426: mknod d0/df/d49/d5b/c92 0 2024-09-16T09:46:13.192 INFO:tasks.workunit.client.0.smithi111.stdout:6/427: chown d0/df/c2a 15 1 2024-09-16T09:46:13.194 INFO:tasks.workunit.client.0.smithi111.stdout:6/428: mkdir d0/df/d49/d5b/d93 0 2024-09-16T09:46:13.195 INFO:tasks.workunit.client.0.smithi111.stdout:5/557: write d19/d1b/f97 [183587,106477] 0 2024-09-16T09:46:13.195 INFO:tasks.workunit.client.0.smithi111.stdout:4/446: dwrite d2/d6/dd/d1c/d2f/f7a [0,4194304] 0 2024-09-16T09:46:13.196 INFO:tasks.workunit.client.0.smithi111.stdout:0/494: dwrite d0/d1d/d67/d3a/fab [0,4194304] 0 2024-09-16T09:46:13.196 INFO:tasks.workunit.client.0.smithi111.stdout:0/495: write d0/d1d/d67/d3a/f8d [449024,128717] 0 2024-09-16T09:46:13.197 INFO:tasks.workunit.client.0.smithi111.stdout:6/429: mknod d0/df/d14/d20/d42/d4e/c94 0 2024-09-16T09:46:13.199 INFO:tasks.workunit.client.0.smithi111.stdout:5/558: mkdir d19/d1b/d27/d2e/d39/d54/d60/dc9 0 2024-09-16T09:46:13.202 INFO:tasks.workunit.client.0.smithi111.stdout:6/430: rename d0 to d0/d95 22 2024-09-16T09:46:13.202 INFO:tasks.workunit.client.0.smithi111.stdout:6/431: write d0/d57/d72/f8b [1036509,84441] 0 2024-09-16T09:46:13.202 INFO:tasks.workunit.client.0.smithi111.stdout:6/432: write d0/df/d14/d20/d23/d41/d4f/f51 [230836,80615] 0 2024-09-16T09:46:13.206 INFO:tasks.workunit.client.0.smithi111.stdout:5/559: creat d19/d1b/d27/d2e/d4a/d4b/dac/fca x:0 0 0 2024-09-16T09:46:13.211 INFO:tasks.workunit.client.0.smithi111.stdout:6/433: rename d0/d57/d72/c5e to d0/df/d14/d20/d23/d41/d4f/c96 0 2024-09-16T09:46:13.214 INFO:tasks.workunit.client.0.smithi111.stdout:7/364: dread d1/d9/f15 [0,4194304] 0 2024-09-16T09:46:13.214 INFO:tasks.workunit.client.0.smithi111.stdout:3/542: dwrite d5/da/db/de/f15 [0,4194304] 0 2024-09-16T09:46:13.215 INFO:tasks.workunit.client.0.smithi111.stdout:3/543: creat d5/da/db/de/fb0 x:0 0 0 2024-09-16T09:46:13.217 INFO:tasks.workunit.client.0.smithi111.stdout:3/544: rename d5/da/db/d3a/d59/caa to d5/da/db/d35/cb1 0 2024-09-16T09:46:13.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/624: dwrite d0/d22/f23 [4194304,4194304] 0 2024-09-16T09:46:13.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/625: truncate d0/d2/d59/d86/db1/fca 147695 0 2024-09-16T09:46:13.217 INFO:tasks.workunit.client.0.smithi111.stdout:2/626: chown d0/d21/c3c 30139 1 2024-09-16T09:46:13.218 INFO:tasks.workunit.client.0.smithi111.stdout:7/365: dread d1/d9/f35 [0,4194304] 0 2024-09-16T09:46:13.218 INFO:tasks.workunit.client.0.smithi111.stdout:7/366: write d1/d16/f72 [1010736,104074] 0 2024-09-16T09:46:13.218 INFO:tasks.workunit.client.0.smithi111.stdout:2/627: symlink d0/d22/d98/ldf 0 2024-09-16T09:46:13.219 INFO:tasks.workunit.client.0.smithi111.stdout:7/367: dread - d1/d3e/f70 zero size 2024-09-16T09:46:13.219 INFO:tasks.workunit.client.0.smithi111.stdout:7/368: write d1/d16/f1c [824139,129761] 0 2024-09-16T09:46:13.219 INFO:tasks.workunit.client.0.smithi111.stdout:7/369: readlink d1/d9/d43/l55 0 2024-09-16T09:46:13.219 INFO:tasks.workunit.client.0.smithi111.stdout:7/370: dread - d1/d16/d17/d18/d4f/d56/f57 zero size 2024-09-16T09:46:13.221 INFO:tasks.workunit.client.0.smithi111.stdout:4/447: dwrite d2/d6/dd/d1c/d2f/f58 [4194304,4194304] 0 2024-09-16T09:46:13.222 INFO:tasks.workunit.client.0.smithi111.stdout:8/512: dwrite d3/f13 [4194304,4194304] 0 2024-09-16T09:46:13.222 INFO:tasks.workunit.client.0.smithi111.stdout:0/496: dread d0/d1d/d67/d3a/d3d/f71 [0,4194304] 0 2024-09-16T09:46:13.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/628: rename d0/d2/c89 to d0/d22/d98/dc9/ce0 0 2024-09-16T09:46:13.223 INFO:tasks.workunit.client.0.smithi111.stdout:2/629: write d0/d2/d5a/f68 [557340,57295] 0 2024-09-16T09:46:13.223 INFO:tasks.workunit.client.0.smithi111.stdout:6/434: read d0/df/d14/f37 [3113713,52085] 0 2024-09-16T09:46:13.230 INFO:tasks.workunit.client.0.smithi111.stdout:4/448: mkdir d2/d6/dd/d88 0 2024-09-16T09:46:13.232 INFO:tasks.workunit.client.0.smithi111.stdout:8/513: mkdir d3/de/d1e/d2e/d2f/da8 0 2024-09-16T09:46:13.234 INFO:tasks.workunit.client.0.smithi111.stdout:0/497: creat d0/d1d/d58/d64/faf x:0 0 0 2024-09-16T09:46:13.235 INFO:tasks.workunit.client.0.smithi111.stdout:8/514: getdents d3/de/d34 0 2024-09-16T09:46:13.235 INFO:tasks.workunit.client.0.smithi111.stdout:8/515: fdatasync d3/de/f88 0 2024-09-16T09:46:13.236 INFO:tasks.workunit.client.0.smithi111.stdout:8/516: write d3/de/d1e/d27/f60 [996516,9653] 0 2024-09-16T09:46:13.236 INFO:tasks.workunit.client.0.smithi111.stdout:8/517: chown d3/de/d1e/d2e/d2f/f49 562692 1 2024-09-16T09:46:13.236 INFO:tasks.workunit.client.0.smithi111.stdout:8/518: chown d3/de/d1e/d2e/d2f/f5d 156367 1 2024-09-16T09:46:13.237 INFO:tasks.workunit.client.0.smithi111.stdout:0/498: unlink d0/d1d/d58/d83/f9f 0 2024-09-16T09:46:13.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/449: symlink d2/d6/l89 0 2024-09-16T09:46:13.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/519: rmdir d3 39 2024-09-16T09:46:13.239 INFO:tasks.workunit.client.0.smithi111.stdout:5/560: dwrite fa [0,4194304] 0 2024-09-16T09:46:13.239 INFO:tasks.workunit.client.0.smithi111.stdout:5/561: truncate d19/d1b/d27/d83/f3f 4891583 0 2024-09-16T09:46:13.240 INFO:tasks.workunit.client.0.smithi111.stdout:0/499: mknod d0/d1d/d58/d64/cb0 0 2024-09-16T09:46:13.242 INFO:tasks.workunit.client.0.smithi111.stdout:4/450: creat d2/d6/f8a x:0 0 0 2024-09-16T09:46:13.245 INFO:tasks.workunit.client.0.smithi111.stdout:8/520: link d3/da/db/d59/l90 d3/la9 0 2024-09-16T09:46:13.245 INFO:tasks.workunit.client.0.smithi111.stdout:8/521: chown d3/de/d34/l9f 6105835 1 2024-09-16T09:46:13.246 INFO:tasks.workunit.client.0.smithi111.stdout:8/522: truncate f0 4678584 0 2024-09-16T09:46:13.247 INFO:tasks.workunit.client.0.smithi111.stdout:5/562: rmdir d19/d1b/d27/d2e/d39/d54/d60 39 2024-09-16T09:46:13.247 INFO:tasks.workunit.client.0.smithi111.stdout:5/563: stat d19/d1b/d27/d83/d2a 0 2024-09-16T09:46:13.248 INFO:tasks.workunit.client.0.smithi111.stdout:8/523: symlink d3/de/d1e/d27/laa 0 2024-09-16T09:46:13.249 INFO:tasks.workunit.client.0.smithi111.stdout:3/545: dwrite d5/d18/f2a [0,4194304] 0 2024-09-16T09:46:13.251 INFO:tasks.workunit.client.0.smithi111.stdout:5/564: creat d19/d1b/d1e/d81/fcb x:0 0 0 2024-09-16T09:46:13.251 INFO:tasks.workunit.client.0.smithi111.stdout:5/565: write d19/d1b/d27/d2e/d4a/d4b/d9c/fa8 [998916,39502] 0 2024-09-16T09:46:13.252 INFO:tasks.workunit.client.0.smithi111.stdout:8/524: creat d3/de/d1e/d2e/d74/d83/da2/fab x:0 0 0 2024-09-16T09:46:13.252 INFO:tasks.workunit.client.0.smithi111.stdout:8/525: write f0 [4706866,127042] 0 2024-09-16T09:46:13.254 INFO:tasks.workunit.client.0.smithi111.stdout:3/546: unlink d5/da/c70 0 2024-09-16T09:46:13.254 INFO:tasks.workunit.client.0.smithi111.stdout:3/547: chown d5/da/db/d35/d41/da0 9 1 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/566: getdents d19 0 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/567: fsync f15 0 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/568: dread - d19/d1b/d27/d2e/d4a/d4b/dac/fca zero size 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/569: chown d19/d1b/d27/d2e/d4a/d4b/dac/l89 422 1 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/570: stat d19/d1b/d27/d83/d2a/f84 0 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/571: chown d19/d1b/d1e/d81 1 1 2024-09-16T09:46:13.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/572: truncate d19/fab 93407 0 2024-09-16T09:46:13.259 INFO:tasks.workunit.client.0.smithi111.stdout:4/451: dread d2/d6/dd/d1c/d2f/d4e/f59 [0,4194304] 0 2024-09-16T09:46:13.261 INFO:tasks.workunit.client.0.smithi111.stdout:8/526: symlink d3/de/lac 0 2024-09-16T09:46:13.261 INFO:tasks.workunit.client.0.smithi111.stdout:7/371: dwrite d1/d20/f42 [0,4194304] 0 2024-09-16T09:46:13.262 INFO:tasks.workunit.client.0.smithi111.stdout:5/573: symlink d19/d1b/d27/d2e/d39/lcc 0 2024-09-16T09:46:13.264 INFO:tasks.workunit.client.0.smithi111.stdout:4/452: creat d2/d30/d44/d69/f8b x:0 0 0 2024-09-16T09:46:13.266 INFO:tasks.workunit.client.0.smithi111.stdout:4/453: mknod d2/d6/d80/c8c 0 2024-09-16T09:46:13.266 INFO:tasks.workunit.client.0.smithi111.stdout:4/454: stat d2/d6/dd/d1b/d38/d64 0 2024-09-16T09:46:13.269 INFO:tasks.workunit.client.0.smithi111.stdout:4/455: mkdir d2/d6/dd/d1c/d2f/d8d 0 2024-09-16T09:46:13.273 INFO:tasks.workunit.client.0.smithi111.stdout:7/372: dread d1/d16/d27/f45 [0,4194304] 0 2024-09-16T09:46:13.273 INFO:tasks.workunit.client.0.smithi111.stdout:7/373: chown d1/d20/l22 26130437 1 2024-09-16T09:46:13.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/435: dwrite d0/d57/f75 [0,4194304] 0 2024-09-16T09:46:13.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/436: stat d0/l43 0 2024-09-16T09:46:13.276 INFO:tasks.workunit.client.0.smithi111.stdout:6/437: chown d0/df/d47/d52 31706730 1 2024-09-16T09:46:13.278 INFO:tasks.workunit.client.0.smithi111.stdout:2/630: dwrite d0/da/d4e/f9d [4194304,4194304] 0 2024-09-16T09:46:13.279 INFO:tasks.workunit.client.0.smithi111.stdout:6/438: truncate d0/f3a 2265457 0 2024-09-16T09:46:13.279 INFO:tasks.workunit.client.0.smithi111.stdout:7/374: dread d1/d16/f72 [0,4194304] 0 2024-09-16T09:46:13.280 INFO:tasks.workunit.client.0.smithi111.stdout:3/548: dwrite d5/da/db/d3a/d6d/fa8 [0,4194304] 0 2024-09-16T09:46:13.281 INFO:tasks.workunit.client.0.smithi111.stdout:0/500: dwrite d0/d1d/d67/d3a/d3d/f9d [0,4194304] 0 2024-09-16T09:46:13.281 INFO:tasks.workunit.client.0.smithi111.stdout:0/501: fdatasync d0/d1d/d67/d3a/f6f 0 2024-09-16T09:46:13.291 INFO:tasks.workunit.client.0.smithi111.stdout:5/574: dwrite d19/d1b/d27/d2e/d4a/fbc [0,4194304] 0 2024-09-16T09:46:13.291 INFO:tasks.workunit.client.0.smithi111.stdout:5/575: read d19/d1b/d1e/d21/d29/d32/f74 [9173,80670] 0 2024-09-16T09:46:13.292 INFO:tasks.workunit.client.0.smithi111.stdout:4/456: dwrite d2/f8 [4194304,4194304] 0 2024-09-16T09:46:13.294 INFO:tasks.workunit.client.0.smithi111.stdout:3/549: write d5/d18/f36 [3113290,115784] 0 2024-09-16T09:46:13.294 INFO:tasks.workunit.client.0.smithi111.stdout:3/550: dread - d5/da/db/d3a/f8c zero size 2024-09-16T09:46:13.296 INFO:tasks.workunit.client.0.smithi111.stdout:2/631: rename d0/d22/d98/dc9/ce0 to d0/d22/dac/ce1 0 2024-09-16T09:46:13.297 INFO:tasks.workunit.client.0.smithi111.stdout:6/439: creat d0/df/d47/d88/f97 x:0 0 0 2024-09-16T09:46:13.298 INFO:tasks.workunit.client.0.smithi111.stdout:7/375: creat d1/d20/f7c x:0 0 0 2024-09-16T09:46:13.299 INFO:tasks.workunit.client.0.smithi111.stdout:7/376: write d1/d16/d17/d18/d1b/f6d [248916,67468] 0 2024-09-16T09:46:13.302 INFO:tasks.workunit.client.0.smithi111.stdout:0/502: creat d0/d1d/d58/d64/fb1 x:0 0 0 2024-09-16T09:46:13.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/632: dread d0/d2/f1e [0,4194304] 0 2024-09-16T09:46:13.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/633: fdatasync d0/d45/d5c/d67/f8c 0 2024-09-16T09:46:13.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/503: dread d0/d1d/d67/d3a/f63 [0,4194304] 0 2024-09-16T09:46:13.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/504: chown d0/da4/l5b 19727 1 2024-09-16T09:46:13.310 INFO:tasks.workunit.client.0.smithi111.stdout:4/457: creat d2/d6/dd/d1b/d38/f8e x:0 0 0 2024-09-16T09:46:13.313 INFO:tasks.workunit.client.0.smithi111.stdout:3/551: creat d5/da/db/de/fb2 x:0 0 0 2024-09-16T09:46:13.313 INFO:tasks.workunit.client.0.smithi111.stdout:3/552: chown d5/l2c 76541 1 2024-09-16T09:46:13.313 INFO:tasks.workunit.client.0.smithi111.stdout:3/553: write d5/da/db/d5a/f7b [4841436,38690] 0 2024-09-16T09:46:13.313 INFO:tasks.workunit.client.0.smithi111.stdout:3/554: fdatasync d5/da/db/d3a/fa5 0 2024-09-16T09:46:13.315 INFO:tasks.workunit.client.0.smithi111.stdout:6/440: creat d0/df/d14/d20/d23/f98 x:0 0 0 2024-09-16T09:46:13.315 INFO:tasks.workunit.client.0.smithi111.stdout:7/377: mknod d1/d16/d17/d18/d1b/d79/c7d 0 2024-09-16T09:46:13.319 INFO:tasks.workunit.client.0.smithi111.stdout:4/458: mkdir d2/d6/dd/d1b/d6d/d8f 0 2024-09-16T09:46:13.320 INFO:tasks.workunit.client.0.smithi111.stdout:3/555: truncate d5/da/db/d35/d41/f53 4087596 0 2024-09-16T09:46:13.322 INFO:tasks.workunit.client.0.smithi111.stdout:6/441: truncate d0/f19 3049357 0 2024-09-16T09:46:13.323 INFO:tasks.workunit.client.0.smithi111.stdout:7/378: unlink d1/d20/c44 0 2024-09-16T09:46:13.326 INFO:tasks.workunit.client.0.smithi111.stdout:4/459: creat d2/d30/d44/f90 x:0 0 0 2024-09-16T09:46:13.326 INFO:tasks.workunit.client.0.smithi111.stdout:4/460: dread - d2/d6/dd/d1b/d6d/f78 zero size 2024-09-16T09:46:13.327 INFO:tasks.workunit.client.0.smithi111.stdout:4/461: dread d2/d6/dd/f76 [0,4194304] 0 2024-09-16T09:46:13.328 INFO:tasks.workunit.client.0.smithi111.stdout:4/462: dread d2/d6/dd/d1c/d2f/d4e/f59 [0,4194304] 0 2024-09-16T09:46:13.328 INFO:tasks.workunit.client.0.smithi111.stdout:4/463: truncate d2/d6/dd/d1b/d38/d64/f6b 665108 0 2024-09-16T09:46:13.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/556: rename d5/da/db/d35/d45/c66 to d5/da/db/d35/d45/da1/cb3 0 2024-09-16T09:46:13.331 INFO:tasks.workunit.client.0.smithi111.stdout:2/634: dwrite d0/d45/d5c/d67/d63/fb8 [0,4194304] 0 2024-09-16T09:46:13.331 INFO:tasks.workunit.client.0.smithi111.stdout:0/505: dwrite d0/d1d/d67/d3a/d3d/f71 [0,4194304] 0 2024-09-16T09:46:13.332 INFO:tasks.workunit.client.0.smithi111.stdout:6/442: unlink d0/df/d47/l83 0 2024-09-16T09:46:13.335 INFO:tasks.workunit.client.0.smithi111.stdout:2/635: dread d0/d29/f2b [0,4194304] 0 2024-09-16T09:46:13.335 INFO:tasks.workunit.client.0.smithi111.stdout:2/636: write d0/da/d4e/fc1 [679508,51775] 0 2024-09-16T09:46:13.335 INFO:tasks.workunit.client.0.smithi111.stdout:2/637: write d0/f7 [1211109,21537] 0 2024-09-16T09:46:13.335 INFO:tasks.workunit.client.0.smithi111.stdout:2/638: write d0/da/d4e/fbe [347957,78051] 0 2024-09-16T09:46:13.335 INFO:tasks.workunit.client.0.smithi111.stdout:0/506: write d0/d1d/d67/d3a/d80/f6d [537194,58607] 0 2024-09-16T09:46:13.336 INFO:tasks.workunit.client.0.smithi111.stdout:7/379: creat d1/d16/d17/d18/d1d/d2f/f7e x:0 0 0 2024-09-16T09:46:13.345 INFO:tasks.workunit.client.0.smithi111.stdout:0/507: rename d0/d1d/d67/l68 to d0/d1d/d67/d3a/d77/dad/lb2 0 2024-09-16T09:46:13.345 INFO:tasks.workunit.client.0.smithi111.stdout:0/508: chown d0/d26/l2e 35 1 2024-09-16T09:46:13.346 INFO:tasks.workunit.client.0.smithi111.stdout:6/443: dread d0/df/d14/d20/d23/d41/d4f/f60 [0,4194304] 0 2024-09-16T09:46:13.346 INFO:tasks.workunit.client.0.smithi111.stdout:6/444: truncate d0/df/d14/d20/d23/f6b 393981 0 2024-09-16T09:46:13.346 INFO:tasks.workunit.client.0.smithi111.stdout:6/445: chown d0/df/d49/d5b/l84 1977698906 1 2024-09-16T09:46:13.348 INFO:tasks.workunit.client.0.smithi111.stdout:6/446: creat d0/df/d14/d20/d23/f99 x:0 0 0 2024-09-16T09:46:13.348 INFO:tasks.workunit.client.0.smithi111.stdout:0/509: dread d0/d1d/d58/d64/f90 [0,4194304] 0 2024-09-16T09:46:13.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/447: link d0/df/d14/d20/d23/d41/d4f/c96 d0/df/d49/c9a 0 2024-09-16T09:46:13.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/448: chown d0/df/d14/c35 32885243 1 2024-09-16T09:46:13.351 INFO:tasks.workunit.client.0.smithi111.stdout:6/449: chown d0/df/d14/d20/d23/f98 2102 1 2024-09-16T09:46:13.351 INFO:tasks.workunit.client.0.smithi111.stdout:0/510: symlink d0/d1d/d67/d3a/d3d/d59/lb3 0 2024-09-16T09:46:13.352 INFO:tasks.workunit.client.0.smithi111.stdout:0/511: stat d0/d1d/d58/d64/cb0 0 2024-09-16T09:46:13.353 INFO:tasks.workunit.client.0.smithi111.stdout:6/450: mknod d0/df/d49/d5b/d93/c9b 0 2024-09-16T09:46:13.357 INFO:tasks.workunit.client.0.smithi111.stdout:5/576: truncate d19/d1b/d27/d2e/d4a/fbc 2220432 0 2024-09-16T09:46:13.357 INFO:tasks.workunit.client.0.smithi111.stdout:6/451: getdents d0/df/d14/d20/d42 0 2024-09-16T09:46:13.357 INFO:tasks.workunit.client.0.smithi111.stdout:5/577: symlink d19/d1b/d27/d2e/d39/dc6/lcd 0 2024-09-16T09:46:13.372 INFO:tasks.workunit.client.0.smithi111.stdout:6/452: write d0/d57/f75 [4171299,129856] 0 2024-09-16T09:46:13.373 INFO:tasks.workunit.client.0.smithi111.stdout:2/639: dwrite d0/da/f3a [0,4194304] 0 2024-09-16T09:46:13.374 INFO:tasks.workunit.client.0.smithi111.stdout:7/380: dwrite d1/d16/f5f [0,4194304] 0 2024-09-16T09:46:13.374 INFO:tasks.workunit.client.0.smithi111.stdout:6/453: creat d0/df/d14/d20/d42/f9c x:0 0 0 2024-09-16T09:46:13.377 INFO:tasks.workunit.client.0.smithi111.stdout:3/557: dwrite d5/da/db/de/fb0 [0,4194304] 0 2024-09-16T09:46:13.377 INFO:tasks.workunit.client.0.smithi111.stdout:4/464: dwrite d2/d6/dd/d1c/d2f/d4e/f74 [0,4194304] 0 2024-09-16T09:46:13.378 INFO:tasks.workunit.client.0.smithi111.stdout:0/512: dwrite d0/d1d/d67/d3a/f63 [0,4194304] 0 2024-09-16T09:46:13.380 INFO:tasks.workunit.client.0.smithi111.stdout:2/640: creat d0/d45/d5c/d67/d63/dd4/dc3/fe2 x:0 0 0 2024-09-16T09:46:13.385 INFO:tasks.workunit.client.0.smithi111.stdout:7/381: creat d1/d16/d17/d18/d1d/d2f/f7f x:0 0 0 2024-09-16T09:46:13.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/454: unlink d0/f17 0 2024-09-16T09:46:13.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/455: write d0/df/d14/d20/d23/f98 [736448,19802] 0 2024-09-16T09:46:13.389 INFO:tasks.workunit.client.0.smithi111.stdout:6/456: chown d0/df/d14/d20/d23/d33/l8a 1 1 2024-09-16T09:46:13.389 INFO:tasks.workunit.client.0.smithi111.stdout:3/558: dread d5/d18/d78/f82 [0,4194304] 0 2024-09-16T09:46:13.399 INFO:tasks.workunit.client.0.smithi111.stdout:2/641: mknod d0/d2/d59/d86/d96/ce3 0 2024-09-16T09:46:13.400 INFO:tasks.workunit.client.0.smithi111.stdout:7/382: truncate d1/d9/d43/f7a 93269 0 2024-09-16T09:46:13.403 INFO:tasks.workunit.client.0.smithi111.stdout:3/559: creat d5/da/db/d5a/d5d/d88/d91/fb4 x:0 0 0 2024-09-16T09:46:13.404 INFO:tasks.workunit.client.0.smithi111.stdout:0/513: dwrite d0/d1d/d58/d64/f90 [0,4194304] 0 2024-09-16T09:46:13.404 INFO:tasks.workunit.client.0.smithi111.stdout:4/465: dwrite d2/fb [4194304,4194304] 0 2024-09-16T09:46:13.405 INFO:tasks.workunit.client.0.smithi111.stdout:5/578: rename d19/d1b/d27/d2e/d4a/fbc to d19/d1b/d27/d2e/d98/fce 0 2024-09-16T09:46:13.406 INFO:tasks.workunit.client.0.smithi111.stdout:5/579: stat d19/d1b/d1e/d21/d29/d32/d46/c5a 0 2024-09-16T09:46:13.406 INFO:tasks.workunit.client.0.smithi111.stdout:2/642: symlink d0/d2/d44/le4 0 2024-09-16T09:46:13.410 INFO:tasks.workunit.client.0.smithi111.stdout:3/560: unlink d5/da/d42/f4e 0 2024-09-16T09:46:13.418 INFO:tasks.workunit.client.0.smithi111.stdout:3/561: dread d5/da/db/d35/d45/f7a [0,4194304] 0 2024-09-16T09:46:13.418 INFO:tasks.workunit.client.0.smithi111.stdout:0/514: rmdir d0/d1d/d58 39 2024-09-16T09:46:13.419 INFO:tasks.workunit.client.0.smithi111.stdout:0/515: read d0/d1d/f29 [280380,58039] 0 2024-09-16T09:46:13.419 INFO:tasks.workunit.client.0.smithi111.stdout:5/580: rmdir d19/d1b/d27/d2e/d39/d54/d60 39 2024-09-16T09:46:13.421 INFO:tasks.workunit.client.0.smithi111.stdout:3/562: link d5/da/db/c34 d5/da/db/d5a/d5d/d88/cb5 0 2024-09-16T09:46:13.423 INFO:tasks.workunit.client.0.smithi111.stdout:0/516: symlink d0/d1d/d67/d3a/lb4 0 2024-09-16T09:46:13.424 INFO:tasks.workunit.client.0.smithi111.stdout:3/563: truncate d5/da/db/d5a/f76 244630 0 2024-09-16T09:46:13.425 INFO:tasks.workunit.client.0.smithi111.stdout:7/383: dwrite d1/d20/f7c [0,4194304] 0 2024-09-16T09:46:13.427 INFO:tasks.workunit.client.0.smithi111.stdout:0/517: creat d0/d1d/d58/d64/d5e/fb5 x:0 0 0 2024-09-16T09:46:13.427 INFO:tasks.workunit.client.0.smithi111.stdout:0/518: chown d0/d1d/f3c 169 1 2024-09-16T09:46:13.427 INFO:tasks.workunit.client.0.smithi111.stdout:0/519: stat d0/da4/f82 0 2024-09-16T09:46:13.427 INFO:tasks.workunit.client.0.smithi111.stdout:3/564: dread d5/da/db/d35/f4f [0,4194304] 0 2024-09-16T09:46:13.427 INFO:tasks.workunit.client.0.smithi111.stdout:4/466: dwrite d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:13.430 INFO:tasks.workunit.client.0.smithi111.stdout:7/384: mknod d1/d59/c80 0 2024-09-16T09:46:13.434 INFO:tasks.workunit.client.0.smithi111.stdout:0/520: rename d0/d1d/d67/d3a/d80/c7d to d0/d1d/d67/d3a/d77/cb6 0 2024-09-16T09:46:13.435 INFO:tasks.workunit.client.0.smithi111.stdout:3/565: mkdir d5/da/db/d35/d41/db6 0 2024-09-16T09:46:13.437 INFO:tasks.workunit.client.0.smithi111.stdout:4/467: getdents d2/d6/dd/d1c 0 2024-09-16T09:46:13.437 INFO:tasks.workunit.client.0.smithi111.stdout:5/581: dwrite f15 [4194304,4194304] 0 2024-09-16T09:46:13.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/521: rename d0/d1d/d67/d3a/d80/l61 to d0/da4/lb7 0 2024-09-16T09:46:13.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/522: chown d0/d1d/d67/d3a/d77 115 1 2024-09-16T09:46:13.442 INFO:tasks.workunit.client.0.smithi111.stdout:3/566: creat d5/da/db/d5a/d5d/fb7 x:0 0 0 2024-09-16T09:46:13.442 INFO:tasks.workunit.client.0.smithi111.stdout:3/567: fdatasync d5/da/db/d5a/d5d/d88/d91/f9c 0 2024-09-16T09:46:13.443 INFO:tasks.workunit.client.0.smithi111.stdout:5/582: dread f12 [0,4194304] 0 2024-09-16T09:46:13.463 INFO:tasks.workunit.client.0.smithi111.stdout:4/468: dwrite d2/d6/dd/d1c/d2f/f7a [4194304,4194304] 0 2024-09-16T09:46:13.465 INFO:tasks.workunit.client.0.smithi111.stdout:4/469: symlink d2/d6/d80/l91 0 2024-09-16T09:46:13.466 INFO:tasks.workunit.client.0.smithi111.stdout:5/583: dwrite d19/d1b/d1e/d41/f8e [0,4194304] 0 2024-09-16T09:46:13.466 INFO:tasks.workunit.client.0.smithi111.stdout:5/584: write d19/f95 [16653,17760] 0 2024-09-16T09:46:13.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/470: mkdir d2/d6/dd/d1b/d38/d64/d92 0 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:3/568: dwrite d5/da/db/d5a/f89 [0,4194304] 0 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:3/569: read d5/d18/f29 [2696284,43206] 0 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:3/570: chown d5/da 633013 1 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:3/571: write d5/da/db/d5a/d5d/fb7 [377660,58056] 0 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:3/572: read - d5/da/db/de/fb2 zero size 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:5/585: symlink d19/d1b/d1e/d21/d29/lcf 0 2024-09-16T09:46:13.471 INFO:tasks.workunit.client.0.smithi111.stdout:5/586: write d19/d1b/d27/d9d/fc7 [487945,117929] 0 2024-09-16T09:46:13.472 INFO:tasks.workunit.client.0.smithi111.stdout:4/471: unlink d2/d6/f55 0 2024-09-16T09:46:13.475 INFO:tasks.workunit.client.0.smithi111.stdout:3/573: mkdir d5/da/db/d5a/d5d/d88/db8 0 2024-09-16T09:46:13.477 INFO:tasks.workunit.client.0.smithi111.stdout:5/587: creat d19/d1b/d1e/fd0 x:0 0 0 2024-09-16T09:46:13.477 INFO:tasks.workunit.client.0.smithi111.stdout:5/588: fdatasync d19/d1b/d27/d83/d2a/dc4/fa5 0 2024-09-16T09:46:13.477 INFO:tasks.workunit.client.0.smithi111.stdout:5/589: fdatasync d19/d1b/d27/d83/f75 0 2024-09-16T09:46:13.479 INFO:tasks.workunit.client.0.smithi111.stdout:4/472: rename d2/d30/d44/c77 to d2/d6/d80/c93 0 2024-09-16T09:46:13.479 INFO:tasks.workunit.client.0.smithi111.stdout:3/574: creat d5/da/d92/fb9 x:0 0 0 2024-09-16T09:46:13.480 INFO:tasks.workunit.client.0.smithi111.stdout:3/575: chown d5/d18/d78 2 1 2024-09-16T09:46:13.482 INFO:tasks.workunit.client.0.smithi111.stdout:5/590: unlink d19/d1b/d27/d2e/d4a/d4b/dac/l89 0 2024-09-16T09:46:13.482 INFO:tasks.workunit.client.0.smithi111.stdout:5/591: stat d19/d1b/d1e 0 2024-09-16T09:46:13.489 INFO:tasks.workunit.client.0.smithi111.stdout:5/592: write d19/d1b/d1e/d21/d29/f56 [2381216,127759] 0 2024-09-16T09:46:13.503 INFO:tasks.workunit.client.0.smithi111.stdout:3/576: dwrite d5/da/db/d5a/d5d/d88/d91/fb4 [0,4194304] 0 2024-09-16T09:46:13.503 INFO:tasks.workunit.client.0.smithi111.stdout:4/473: dwrite d2/d6/f20 [4194304,4194304] 0 2024-09-16T09:46:13.503 INFO:tasks.workunit.client.0.smithi111.stdout:4/474: chown d2/d6/dd/d1b/l3e 1356 1 2024-09-16T09:46:13.509 INFO:tasks.workunit.client.0.smithi111.stdout:3/577: symlink d5/da/d42/d74/da4/lba 0 2024-09-16T09:46:13.510 INFO:tasks.workunit.client.0.smithi111.stdout:3/578: read d5/da/db/d35/f81 [322511,39894] 0 2024-09-16T09:46:13.511 INFO:tasks.workunit.client.0.smithi111.stdout:4/475: mknod d2/c94 0 2024-09-16T09:46:13.513 INFO:tasks.workunit.client.0.smithi111.stdout:3/579: chown d5/da/db/d5a/d5d/l79 620 1 2024-09-16T09:46:13.514 INFO:tasks.workunit.client.0.smithi111.stdout:3/580: mkdir d5/da/db/d3a/dbb 0 2024-09-16T09:46:13.515 INFO:tasks.workunit.client.0.smithi111.stdout:3/581: truncate d5/da/db/fad 1559920 0 2024-09-16T09:46:13.533 INFO:tasks.workunit.client.0.smithi111.stdout:3/582: dwrite d5/da/db/de/f27 [0,4194304] 0 2024-09-16T09:46:13.549 INFO:tasks.workunit.client.0.smithi111.stdout:3/583: dwrite d5/da/db/d35/d45/f7a [0,4194304] 0 2024-09-16T09:46:13.552 INFO:tasks.workunit.client.0.smithi111.stdout:3/584: dread d5/da/db/d5a/d5d/d88/f9d [0,4194304] 0 2024-09-16T09:46:13.555 INFO:tasks.workunit.client.0.smithi111.stdout:3/585: mkdir d5/da/db/d35/d45/dbc 0 2024-09-16T09:46:13.555 INFO:tasks.workunit.client.0.smithi111.stdout:3/586: fsync d5/d18/f8b 0 2024-09-16T09:46:13.555 INFO:tasks.workunit.client.0.smithi111.stdout:3/587: chown d5/da/db/d5a/f7b 17708629 1 2024-09-16T09:46:13.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/588: dread d5/f86 [0,4194304] 0 2024-09-16T09:46:13.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/589: chown d5/da/db/d35/d41/f53 38629 1 2024-09-16T09:46:13.561 INFO:tasks.workunit.client.0.smithi111.stdout:3/590: rename d5/da/db/d5a/d5d/d88/f9d to d5/da/db/d35/d41/db6/fbd 0 2024-09-16T09:46:13.568 INFO:tasks.workunit.client.0.smithi111.stdout:3/591: dread d5/d18/f8b [0,4194304] 0 2024-09-16T09:46:13.568 INFO:tasks.workunit.client.0.smithi111.stdout:3/592: stat d5/da/db/d3a/d59/f61 0 2024-09-16T09:46:13.590 INFO:tasks.workunit.client.0.smithi111.stdout:3/593: dwrite d5/da/db/d5a/d5d/fb7 [0,4194304] 0 2024-09-16T09:46:13.604 INFO:tasks.workunit.client.0.smithi111.stdout:3/594: dread d5/da/db/d35/d45/f7a [0,4194304] 0 2024-09-16T09:46:13.604 INFO:tasks.workunit.client.0.smithi111.stdout:3/595: chown d5/f69 1422287190 1 2024-09-16T09:46:13.605 INFO:tasks.workunit.client.0.smithi111.stdout:3/596: mknod d5/da/d42/cbe 0 2024-09-16T09:46:13.617 INFO:tasks.workunit.client.0.smithi111.stdout:3/597: write d5/da/db/d35/d45/f60 [1357962,110271] 0 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:1/531: sync 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:1/532: readlink d3/d10/d72/da1/d28/d36/d3d/d47/d5a/lad 0 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:6/457: sync 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:9/433: sync 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:9/434: readlink d0/d6/d45/l87 0 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:8/527: sync 2024-09-16T09:46:13.648 INFO:tasks.workunit.client.0.smithi111.stdout:8/528: readlink d3/de/d1e/d27/l2a 0 2024-09-16T09:46:13.649 INFO:tasks.workunit.client.0.smithi111.stdout:3/598: write d5/da/d42/f6e [1268003,106953] 0 2024-09-16T09:46:13.650 INFO:tasks.workunit.client.0.smithi111.stdout:6/458: dread d0/df/d14/d20/d42/f56 [0,4194304] 0 2024-09-16T09:46:13.650 INFO:tasks.workunit.client.0.smithi111.stdout:6/459: chown d0/df/d14/c35 1923145326 1 2024-09-16T09:46:13.650 INFO:tasks.workunit.client.0.smithi111.stdout:1/533: mkdir d3/d24/d62/db3 0 2024-09-16T09:46:13.651 INFO:tasks.workunit.client.0.smithi111.stdout:9/435: unlink d0/d6/d8/de/cf 0 2024-09-16T09:46:13.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/529: mkdir d3/de/d1e/d2e/d74/dad 0 2024-09-16T09:46:13.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/530: readlink d3/da/db/d59/l90 0 2024-09-16T09:46:13.652 INFO:tasks.workunit.client.0.smithi111.stdout:8/531: dread - d3/de/d34/f8e zero size 2024-09-16T09:46:13.653 INFO:tasks.workunit.client.0.smithi111.stdout:8/532: chown d3/d26 141083684 1 2024-09-16T09:46:13.653 INFO:tasks.workunit.client.0.smithi111.stdout:8/533: write d3/d26/f40 [913427,17795] 0 2024-09-16T09:46:13.653 INFO:tasks.workunit.client.0.smithi111.stdout:6/460: creat d0/df/d14/d20/d23/d33/f9d x:0 0 0 2024-09-16T09:46:13.655 INFO:tasks.workunit.client.0.smithi111.stdout:1/534: rmdir d3/d10/d72/da1/d28/d36/d3d/d47/daf 39 2024-09-16T09:46:13.656 INFO:tasks.workunit.client.0.smithi111.stdout:9/436: write d0/d21/d22/d6e/d51/d76/f5c [1218832,116968] 0 2024-09-16T09:46:13.656 INFO:tasks.workunit.client.0.smithi111.stdout:9/437: dread - d0/d21/f66 zero size 2024-09-16T09:46:13.657 INFO:tasks.workunit.client.0.smithi111.stdout:9/438: write d0/d6/f90 [160217,84223] 0 2024-09-16T09:46:13.659 INFO:tasks.workunit.client.0.smithi111.stdout:3/599: dread d5/da/db/f14 [0,4194304] 0 2024-09-16T09:46:13.665 INFO:tasks.workunit.client.0.smithi111.stdout:8/534: mknod d3/da/df/cae 0 2024-09-16T09:46:13.665 INFO:tasks.workunit.client.0.smithi111.stdout:8/535: chown d3/de/d1e/d2e/d2f/d4c/f67 434 1 2024-09-16T09:46:13.665 INFO:tasks.workunit.client.0.smithi111.stdout:8/536: write d3/de/d1e/d2e/d2f/f8d [202149,69709] 0 2024-09-16T09:46:13.665 INFO:tasks.workunit.client.0.smithi111.stdout:8/537: chown d3/de/d1e/d27/laa 17194 1 2024-09-16T09:46:13.665 INFO:tasks.workunit.client.0.smithi111.stdout:6/461: link d0/d57/d72/f65 d0/df/d14/d20/d23/d41/f9e 0 2024-09-16T09:46:13.666 INFO:tasks.workunit.client.0.smithi111.stdout:6/462: dread - d0/df/d14/d20/d42/d4e/d62/d7b/d80/f81 zero size 2024-09-16T09:46:13.666 INFO:tasks.workunit.client.0.smithi111.stdout:6/463: dread - d0/d57/d72/f61 zero size 2024-09-16T09:46:13.666 INFO:tasks.workunit.client.0.smithi111.stdout:6/464: readlink d0/df/d14/d20/d42/l6d 0 2024-09-16T09:46:13.666 INFO:tasks.workunit.client.0.smithi111.stdout:8/538: write d3/f50 [4051124,10624] 0 2024-09-16T09:46:13.667 INFO:tasks.workunit.client.0.smithi111.stdout:6/465: creat d0/df/d14/d20/d42/d4e/d62/d7b/f9f x:0 0 0 2024-09-16T09:46:13.672 INFO:tasks.workunit.client.0.smithi111.stdout:8/539: rename d3/da/db/c4d to d3/de/d6e/d8f/caf 0 2024-09-16T09:46:13.672 INFO:tasks.workunit.client.0.smithi111.stdout:8/540: stat d3/da/db/f7b 0 2024-09-16T09:46:13.673 INFO:tasks.workunit.client.0.smithi111.stdout:6/466: rmdir d0/df/d47/d68 39 2024-09-16T09:46:13.673 INFO:tasks.workunit.client.0.smithi111.stdout:6/467: write d0/df/d47/d52/f82 [559352,29377] 0 2024-09-16T09:46:13.677 INFO:tasks.workunit.client.0.smithi111.stdout:8/541: rename d3/de/d1e/l62 to d3/de/d1e/d2e/d74/dad/lb0 0 2024-09-16T09:46:13.678 INFO:tasks.workunit.client.0.smithi111.stdout:8/542: truncate d3/de/d1e/d27/f56 542811 0 2024-09-16T09:46:13.678 INFO:tasks.workunit.client.0.smithi111.stdout:8/543: chown d3/de/d1e/f98 853 1 2024-09-16T09:46:13.678 INFO:tasks.workunit.client.0.smithi111.stdout:8/544: fsync d3/de/d1e/d2e/d2f/d4c/f67 0 2024-09-16T09:46:13.685 INFO:tasks.workunit.client.0.smithi111.stdout:9/439: dwrite d0/d6/d45/f69 [0,4194304] 0 2024-09-16T09:46:13.686 INFO:tasks.workunit.client.0.smithi111.stdout:9/440: unlink d0/l63 0 2024-09-16T09:46:13.688 INFO:tasks.workunit.client.0.smithi111.stdout:9/441: fsync d0/d6/f44 0 2024-09-16T09:46:13.689 INFO:tasks.workunit.client.0.smithi111.stdout:9/442: mkdir d0/d6/d8/de/d56/d4e/d92 0 2024-09-16T09:46:13.690 INFO:tasks.workunit.client.0.smithi111.stdout:9/443: creat d0/d6/d8/f93 x:0 0 0 2024-09-16T09:46:13.693 INFO:tasks.workunit.client.0.smithi111.stdout:8/545: dwrite d3/de/d1e/d27/fa4 [0,4194304] 0 2024-09-16T09:46:13.693 INFO:tasks.workunit.client.0.smithi111.stdout:3/600: dwrite d5/da/db/d5a/f89 [0,4194304] 0 2024-09-16T09:46:13.693 INFO:tasks.workunit.client.0.smithi111.stdout:8/546: write d3/de/f88 [863305,22187] 0 2024-09-16T09:46:13.701 INFO:tasks.workunit.client.0.smithi111.stdout:8/547: mknod d3/de/d1e/d2e/d74/d83/da2/cb1 0 2024-09-16T09:46:13.704 INFO:tasks.workunit.client.0.smithi111.stdout:8/548: rename d3/f1a to d3/de/d6e/d8f/fb2 0 2024-09-16T09:46:13.704 INFO:tasks.workunit.client.0.smithi111.stdout:8/549: readlink d3/de/d34/l9f 0 2024-09-16T09:46:13.719 INFO:tasks.workunit.client.0.smithi111.stdout:9/444: dwrite d0/d6/d45/f69 [0,4194304] 0 2024-09-16T09:46:13.719 INFO:tasks.workunit.client.0.smithi111.stdout:9/445: dread - d0/d21/f66 zero size 2024-09-16T09:46:13.720 INFO:tasks.workunit.client.0.smithi111.stdout:9/446: symlink d0/d6/d8/de/l94 0 2024-09-16T09:46:13.721 INFO:tasks.workunit.client.0.smithi111.stdout:9/447: creat d0/d6/d8/de/f95 x:0 0 0 2024-09-16T09:46:13.721 INFO:tasks.workunit.client.0.smithi111.stdout:9/448: chown d0/d6/d30/d47 46773 1 2024-09-16T09:46:13.722 INFO:tasks.workunit.client.0.smithi111.stdout:3/601: dwrite d5/da/db/d35/d45/fa7 [0,4194304] 0 2024-09-16T09:46:13.724 INFO:tasks.workunit.client.0.smithi111.stdout:8/550: dwrite d3/d26/f46 [0,4194304] 0 2024-09-16T09:46:13.724 INFO:tasks.workunit.client.0.smithi111.stdout:8/551: chown d3/f19 0 1 2024-09-16T09:46:13.725 INFO:tasks.workunit.client.0.smithi111.stdout:3/602: link d5/l71 d5/da/db/d5a/d5d/d88/db8/lbf 0 2024-09-16T09:46:13.730 INFO:tasks.workunit.client.0.smithi111.stdout:8/552: mknod d3/de/d5c/cb3 0 2024-09-16T09:46:13.730 INFO:tasks.workunit.client.0.smithi111.stdout:8/553: fdatasync d3/f43 0 2024-09-16T09:46:13.731 INFO:tasks.workunit.client.0.smithi111.stdout:3/603: symlink d5/da/d92/lc0 0 2024-09-16T09:46:13.733 INFO:tasks.workunit.client.0.smithi111.stdout:8/554: creat d3/de/d1e/d2e/d74/d83/fb4 x:0 0 0 2024-09-16T09:46:13.733 INFO:tasks.workunit.client.0.smithi111.stdout:8/555: chown d3/da/c64 69798 1 2024-09-16T09:46:13.733 INFO:tasks.workunit.client.0.smithi111.stdout:8/556: write d3/de/d34/f38 [1112352,91007] 0 2024-09-16T09:46:13.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/604: rmdir d5/da/db/d3a/d59 39 2024-09-16T09:46:13.734 INFO:tasks.workunit.client.0.smithi111.stdout:3/605: creat d5/d18/d78/dab/fc1 x:0 0 0 2024-09-16T09:46:13.736 INFO:tasks.workunit.client.0.smithi111.stdout:3/606: creat d5/da/db/d3a/d6d/fc2 x:0 0 0 2024-09-16T09:46:13.737 INFO:tasks.workunit.client.0.smithi111.stdout:8/557: dread d3/f8 [0,4194304] 0 2024-09-16T09:46:13.737 INFO:tasks.workunit.client.0.smithi111.stdout:8/558: truncate d3/de/d5c/f8a 838045 0 2024-09-16T09:46:13.737 INFO:tasks.workunit.client.0.smithi111.stdout:3/607: creat d5/d18/d78/dab/fc3 x:0 0 0 2024-09-16T09:46:13.739 INFO:tasks.workunit.client.0.smithi111.stdout:8/559: link d3/de/d1e/d2e/f3d d3/d26/d6d/fb5 0 2024-09-16T09:46:13.740 INFO:tasks.workunit.client.0.smithi111.stdout:8/560: mkdir d3/d26/d6d/db6 0 2024-09-16T09:46:13.742 INFO:tasks.workunit.client.0.smithi111.stdout:8/561: creat d3/da/fb7 x:0 0 0 2024-09-16T09:46:13.743 INFO:tasks.workunit.client.0.smithi111.stdout:8/562: rename d3/de/d1e/d2e/f3d to d3/de/d1e/d2e/fb8 0 2024-09-16T09:46:13.747 INFO:tasks.workunit.client.0.smithi111.stdout:3/608: dread d5/da/db/d5a/f89 [0,4194304] 0 2024-09-16T09:46:13.747 INFO:tasks.workunit.client.0.smithi111.stdout:3/609: truncate d5/da/db/de/f96 146809 0 2024-09-16T09:46:13.748 INFO:tasks.workunit.client.0.smithi111.stdout:3/610: getdents d5/da/db/d3a 0 2024-09-16T09:46:13.749 INFO:tasks.workunit.client.0.smithi111.stdout:3/611: rename d5/da/db/d3a/dbb to d5/da/dc4 0 2024-09-16T09:46:13.751 INFO:tasks.workunit.client.0.smithi111.stdout:3/612: creat d5/da/d42/d74/fc5 x:0 0 0 2024-09-16T09:46:13.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/613: truncate d5/da/db/d35/d41/f53 3457463 0 2024-09-16T09:46:13.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/614: chown d5/da/db/d5a/d5d/f83 480201216 1 2024-09-16T09:46:13.755 INFO:tasks.workunit.client.0.smithi111.stdout:3/615: rename d5/da/db/d35/cb1 to d5/da/db/d3a/cc6 0 2024-09-16T09:46:13.757 INFO:tasks.workunit.client.0.smithi111.stdout:3/616: link d5/da/db/d3a/fae d5/da/db/d5a/fc7 0 2024-09-16T09:46:13.758 INFO:tasks.workunit.client.0.smithi111.stdout:3/617: creat d5/da/db/d5a/d5d/d88/fc8 x:0 0 0 2024-09-16T09:46:13.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/618: mknod d5/da/db/d3a/d59/cc9 0 2024-09-16T09:46:13.760 INFO:tasks.workunit.client.0.smithi111.stdout:3/619: creat d5/da/d42/d74/da4/fca x:0 0 0 2024-09-16T09:46:13.760 INFO:tasks.workunit.client.0.smithi111.stdout:3/620: read d5/f86 [2294,24502] 0 2024-09-16T09:46:13.763 INFO:tasks.workunit.client.0.smithi111.stdout:8/563: dwrite d3/de/d1e/d2e/fb8 [0,4194304] 0 2024-09-16T09:46:13.766 INFO:tasks.workunit.client.0.smithi111.stdout:8/564: dread d3/f43 [0,4194304] 0 2024-09-16T09:46:13.766 INFO:tasks.workunit.client.0.smithi111.stdout:8/565: read - d3/de/f4a zero size 2024-09-16T09:46:13.773 INFO:tasks.workunit.client.0.smithi111.stdout:3/621: fsync d5/da/db/d5a/d5d/d88/fc8 0 2024-09-16T09:46:13.776 INFO:tasks.workunit.client.0.smithi111.stdout:3/622: unlink d5/da/db/d3a/cc6 0 2024-09-16T09:46:13.779 INFO:tasks.workunit.client.0.smithi111.stdout:3/623: creat d5/da/db/fcb x:0 0 0 2024-09-16T09:46:13.780 INFO:tasks.workunit.client.0.smithi111.stdout:3/624: mknod d5/da/db/d35/d45/ccc 0 2024-09-16T09:46:13.782 INFO:tasks.workunit.client.0.smithi111.stdout:3/625: mkdir d5/da/db/d35/d45/dbc/dcd 0 2024-09-16T09:46:13.782 INFO:tasks.workunit.client.0.smithi111.stdout:3/626: fdatasync d5/da/db/d5a/f76 0 2024-09-16T09:46:13.782 INFO:tasks.workunit.client.0.smithi111.stdout:3/627: fdatasync d5/da/db/d5a/f67 0 2024-09-16T09:46:13.782 INFO:tasks.workunit.client.0.smithi111.stdout:3/628: write d5/da/db/d5a/f76 [584736,107994] 0 2024-09-16T09:46:13.782 INFO:tasks.workunit.client.0.smithi111.stdout:3/629: dread - d5/da/d92/fb9 zero size 2024-09-16T09:46:13.787 INFO:tasks.workunit.client.0.smithi111.stdout:8/566: dwrite d3/de/d1e/d27/f9d [0,4194304] 0 2024-09-16T09:46:13.789 INFO:tasks.workunit.client.0.smithi111.stdout:8/567: dread d3/de/d34/f6f [0,4194304] 0 2024-09-16T09:46:13.791 INFO:tasks.workunit.client.0.smithi111.stdout:8/568: creat d3/d26/d6d/db6/fb9 x:0 0 0 2024-09-16T09:46:13.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/630: dread d5/d18/f2e [0,4194304] 0 2024-09-16T09:46:13.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/631: write d5/da/db/d35/f4f [1455083,90781] 0 2024-09-16T09:46:13.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/632: stat d5/da/db/d35/d45/da1/ca2 0 2024-09-16T09:46:13.798 INFO:tasks.workunit.client.0.smithi111.stdout:3/633: symlink d5/da/db/lce 0 2024-09-16T09:46:13.798 INFO:tasks.workunit.client.0.smithi111.stdout:3/634: dread - d5/d18/d78/dab/fc3 zero size 2024-09-16T09:46:13.798 INFO:tasks.workunit.client.0.smithi111.stdout:3/635: chown d5/da/db/lce 238 1 2024-09-16T09:46:13.799 INFO:tasks.workunit.client.0.smithi111.stdout:3/636: symlink d5/da/d42/d74/da4/lcf 0 2024-09-16T09:46:13.799 INFO:tasks.workunit.client.0.smithi111.stdout:3/637: stat d5/da/db/d5a/d5d/d88/d91/caf 0 2024-09-16T09:46:13.800 INFO:tasks.workunit.client.0.smithi111.stdout:3/638: write d5/da/d42/d74/da4/fca [808935,117788] 0 2024-09-16T09:46:13.800 INFO:tasks.workunit.client.0.smithi111.stdout:3/639: mknod d5/d18/d78/cd0 0 2024-09-16T09:46:13.802 INFO:tasks.workunit.client.0.smithi111.stdout:3/640: mkdir d5/da/db/d3a/d6d/dd1 0 2024-09-16T09:46:13.804 INFO:tasks.workunit.client.0.smithi111.stdout:3/641: unlink d5/da/db/d5a/d5d/d88/db8/lbf 0 2024-09-16T09:46:13.804 INFO:tasks.workunit.client.0.smithi111.stdout:3/642: write d5/f86 [41249,23012] 0 2024-09-16T09:46:13.804 INFO:tasks.workunit.client.0.smithi111.stdout:3/643: chown d5/da/db/d35/d41/db6 8115 1 2024-09-16T09:46:13.807 INFO:tasks.workunit.client.0.smithi111.stdout:3/644: link d5/da/db/d3a/d59/l5f d5/da/db/d5a/ld2 0 2024-09-16T09:46:13.809 INFO:tasks.workunit.client.0.smithi111.stdout:2/643: sync 2024-09-16T09:46:13.809 INFO:tasks.workunit.client.0.smithi111.stdout:2/644: write d0/d2/fd9 [286397,23433] 0 2024-09-16T09:46:13.809 INFO:tasks.workunit.client.0.smithi111.stdout:2/645: truncate d0/d45/d5c/d67/f8c 822120 0 2024-09-16T09:46:13.809 INFO:tasks.workunit.client.0.smithi111.stdout:2/646: read d0/d2/d5a/f62 [2120067,101561] 0 2024-09-16T09:46:13.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/647: dread d0/f36 [0,4194304] 0 2024-09-16T09:46:13.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/648: fsync d0/d2/d44/f5e 0 2024-09-16T09:46:13.815 INFO:tasks.workunit.client.0.smithi111.stdout:2/649: readlink d0/da/l43 0 2024-09-16T09:46:13.815 INFO:tasks.workunit.client.0.smithi111.stdout:8/569: dwrite d3/de/d1e/d2e/d2f/f63 [0,4194304] 0 2024-09-16T09:46:13.816 INFO:tasks.workunit.client.0.smithi111.stdout:3/645: write d5/da/db/de/f27 [2232141,55424] 0 2024-09-16T09:46:13.819 INFO:tasks.workunit.client.0.smithi111.stdout:8/570: mkdir d3/de/d1e/d2e/d74/dad/dba 0 2024-09-16T09:46:13.823 INFO:tasks.workunit.client.0.smithi111.stdout:3/646: rename d5/f8 to d5/da/db/d35/d45/da1/fd3 0 2024-09-16T09:46:13.824 INFO:tasks.workunit.client.0.smithi111.stdout:8/571: creat d3/de/d34/fbb x:0 0 0 2024-09-16T09:46:13.825 INFO:tasks.workunit.client.0.smithi111.stdout:8/572: write d3/de/d1e/d27/f28 [1480910,53225] 0 2024-09-16T09:46:13.828 INFO:tasks.workunit.client.0.smithi111.stdout:8/573: rename d3/de/d5c to d3/de/d1e/d2e/d2f/dbc 0 2024-09-16T09:46:13.828 INFO:tasks.workunit.client.0.smithi111.stdout:8/574: write d3/de/d1e/f87 [1142218,35625] 0 2024-09-16T09:46:13.828 INFO:tasks.workunit.client.0.smithi111.stdout:8/575: fsync d3/de/d1e/d2e/f37 0 2024-09-16T09:46:13.830 INFO:tasks.workunit.client.0.smithi111.stdout:3/647: mknod d5/da/db/d5a/d5d/cd4 0 2024-09-16T09:46:13.857 INFO:tasks.workunit.client.0.smithi111.stdout:2/650: dwrite d0/d45/f79 [0,4194304] 0 2024-09-16T09:46:13.860 INFO:tasks.workunit.client.0.smithi111.stdout:2/651: unlink d0/fc 0 2024-09-16T09:46:13.860 INFO:tasks.workunit.client.0.smithi111.stdout:2/652: fsync d0/d45/d5c/d67/f8f 0 2024-09-16T09:46:13.861 INFO:tasks.workunit.client.0.smithi111.stdout:3/648: dwrite d5/da/db/d35/f39 [0,4194304] 0 2024-09-16T09:46:13.861 INFO:tasks.workunit.client.0.smithi111.stdout:3/649: readlink d5/da/db/d5a/d5d/d88/l8e 0 2024-09-16T09:46:13.865 INFO:tasks.workunit.client.0.smithi111.stdout:3/650: creat d5/da/db/d5a/d5d/fd5 x:0 0 0 2024-09-16T09:46:13.867 INFO:tasks.workunit.client.0.smithi111.stdout:3/651: link d5/c7 d5/da/dc4/cd6 0 2024-09-16T09:46:13.867 INFO:tasks.workunit.client.0.smithi111.stdout:3/652: write d5/da/db/d35/d45/f60 [27163,698] 0 2024-09-16T09:46:13.867 INFO:tasks.workunit.client.0.smithi111.stdout:3/653: write d5/da/d92/fb9 [456843,104607] 0 2024-09-16T09:46:13.868 INFO:tasks.workunit.client.0.smithi111.stdout:3/654: creat d5/da/d42/d74/da4/fd7 x:0 0 0 2024-09-16T09:46:13.869 INFO:tasks.workunit.client.0.smithi111.stdout:3/655: symlink d5/da/db/d35/d45/da1/ld8 0 2024-09-16T09:46:13.870 INFO:tasks.workunit.client.0.smithi111.stdout:3/656: truncate d5/d18/d78/f82 4053123 0 2024-09-16T09:46:13.870 INFO:tasks.workunit.client.0.smithi111.stdout:3/657: fsync d5/da/db/d5a/d5d/d88/d91/f9c 0 2024-09-16T09:46:13.873 INFO:tasks.workunit.client.0.smithi111.stdout:3/658: rename d5/da/db/d5a/d5d/d88/d91 to d5/da/db/d35/d41/da0/dd9 0 2024-09-16T09:46:13.873 INFO:tasks.workunit.client.0.smithi111.stdout:3/659: dread - d5/d18/d78/dab/fc3 zero size 2024-09-16T09:46:13.873 INFO:tasks.workunit.client.0.smithi111.stdout:3/660: truncate d5/d18/d78/dab/fc3 57960 0 2024-09-16T09:46:13.873 INFO:tasks.workunit.client.0.smithi111.stdout:3/661: write d5/da/db/d5a/f7b [516912,116016] 0 2024-09-16T09:46:13.875 INFO:tasks.workunit.client.0.smithi111.stdout:3/662: creat d5/da/db/d35/d41/da0/fda x:0 0 0 2024-09-16T09:46:13.875 INFO:tasks.workunit.client.0.smithi111.stdout:2/653: dwrite d0/d2/d5a/f93 [0,4194304] 0 2024-09-16T09:46:13.875 INFO:tasks.workunit.client.0.smithi111.stdout:2/654: chown d0/d22/d98/dc9/cde 9098450 1 2024-09-16T09:46:13.875 INFO:tasks.workunit.client.0.smithi111.stdout:2/655: read - d0/d21/f46 zero size 2024-09-16T09:46:13.878 INFO:tasks.workunit.client.0.smithi111.stdout:3/663: unlink d5/da/db/c34 0 2024-09-16T09:46:13.894 INFO:tasks.workunit.client.0.smithi111.stdout:3/664: dwrite d5/da/db/d35/f43 [0,4194304] 0 2024-09-16T09:46:13.897 INFO:tasks.workunit.client.0.smithi111.stdout:3/665: unlink d5/da/db/d35/f43 0 2024-09-16T09:46:13.898 INFO:tasks.workunit.client.0.smithi111.stdout:3/666: dread - d5/da/db/de/fb2 zero size 2024-09-16T09:46:13.913 INFO:tasks.workunit.client.0.smithi111.stdout:3/667: dwrite d5/d18/d78/dab/fc1 [0,4194304] 0 2024-09-16T09:46:13.917 INFO:tasks.workunit.client.0.smithi111.stdout:3/668: rename d5/da/db/d35/d45/dbc to d5/da/db/de/ddb 0 2024-09-16T09:46:13.921 INFO:tasks.workunit.client.0.smithi111.stdout:3/669: write d5/da/db/d35/d45/f7a [858494,27216] 0 2024-09-16T09:46:13.922 INFO:tasks.workunit.client.0.smithi111.stdout:3/670: creat d5/d18/fdc x:0 0 0 2024-09-16T09:46:13.925 INFO:tasks.workunit.client.0.smithi111.stdout:3/671: rename d5/da/db/d35/d45/f7a to d5/da/db/d5a/d5d/d88/db8/fdd 0 2024-09-16T09:46:13.926 INFO:tasks.workunit.client.0.smithi111.stdout:3/672: symlink d5/da/d42/d74/da4/lde 0 2024-09-16T09:46:13.928 INFO:tasks.workunit.client.0.smithi111.stdout:3/673: mkdir d5/da/db/d35/d41/db6/ddf 0 2024-09-16T09:46:13.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/674: creat d5/da/d42/d74/da4/fe0 x:0 0 0 2024-09-16T09:46:13.929 INFO:tasks.workunit.client.0.smithi111.stdout:3/675: readlink d5/da/db/d5a/ld2 0 2024-09-16T09:46:13.931 INFO:tasks.workunit.client.0.smithi111.stdout:3/676: dread d5/d18/f24 [0,4194304] 0 2024-09-16T09:46:13.933 INFO:tasks.workunit.client.0.smithi111.stdout:3/677: unlink d5/da/db/d5a/f7b 0 2024-09-16T09:46:13.935 INFO:tasks.workunit.client.0.smithi111.stdout:3/678: mkdir d5/da/de1 0 2024-09-16T09:46:13.935 INFO:tasks.workunit.client.0.smithi111.stdout:3/679: readlink d5/da/db/d35/l49 0 2024-09-16T09:46:13.935 INFO:tasks.workunit.client.0.smithi111.stdout:3/680: fsync d5/d18/d78/dab/fc3 0 2024-09-16T09:46:13.937 INFO:tasks.workunit.client.0.smithi111.stdout:3/681: creat d5/da/db/d5a/d5d/d88/fe2 x:0 0 0 2024-09-16T09:46:13.937 INFO:tasks.workunit.client.0.smithi111.stdout:3/682: write d5/d18/f24 [1037400,22174] 0 2024-09-16T09:46:13.937 INFO:tasks.workunit.client.0.smithi111.stdout:3/683: chown d5/da/db/d3a/d59/f61 320458368 1 2024-09-16T09:46:13.937 INFO:tasks.workunit.client.0.smithi111.stdout:7/385: sync 2024-09-16T09:46:13.937 INFO:tasks.workunit.client.0.smithi111.stdout:7/386: dread - d1/d16/d17/d18/d1d/d2f/f71 zero size 2024-09-16T09:46:13.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/684: creat d5/da/d42/fe3 x:0 0 0 2024-09-16T09:46:13.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/685: fsync d5/d18/f36 0 2024-09-16T09:46:13.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/686: fdatasync d5/da/f9e 0 2024-09-16T09:46:13.941 INFO:tasks.workunit.client.0.smithi111.stdout:7/387: rename d1/d16/d27/c69 to d1/d16/d17/d18/d1b/c81 0 2024-09-16T09:46:13.942 INFO:tasks.workunit.client.0.smithi111.stdout:3/687: symlink d5/da/d42/d74/le4 0 2024-09-16T09:46:13.944 INFO:tasks.workunit.client.0.smithi111.stdout:3/688: mknod d5/da/d42/d74/ce5 0 2024-09-16T09:46:13.947 INFO:tasks.workunit.client.0.smithi111.stdout:3/689: symlink d5/da/db/de/le6 0 2024-09-16T09:46:13.949 INFO:tasks.workunit.client.0.smithi111.stdout:7/388: write d1/d16/d27/f2b [3301908,73192] 0 2024-09-16T09:46:13.950 INFO:tasks.workunit.client.0.smithi111.stdout:3/690: chown d5/da/db/d5a/d5d/d88/l8f 42522624 1 2024-09-16T09:46:13.952 INFO:tasks.workunit.client.0.smithi111.stdout:7/389: dread d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:13.952 INFO:tasks.workunit.client.0.smithi111.stdout:7/390: readlink d1/l36 0 2024-09-16T09:46:13.953 INFO:tasks.workunit.client.0.smithi111.stdout:7/391: mkdir d1/d9/d43/d82 0 2024-09-16T09:46:13.955 INFO:tasks.workunit.client.0.smithi111.stdout:7/392: creat d1/d16/d27/f83 x:0 0 0 2024-09-16T09:46:13.958 INFO:tasks.workunit.client.0.smithi111.stdout:3/691: read d5/da/db/de/f28 [1696113,90748] 0 2024-09-16T09:46:13.959 INFO:tasks.workunit.client.0.smithi111.stdout:3/692: chown d5/l2c 10506 1 2024-09-16T09:46:13.961 INFO:tasks.workunit.client.0.smithi111.stdout:3/693: rename d5/da/db/d5a/d5d to d5/da/db/d3a/d6d/de7 0 2024-09-16T09:46:13.961 INFO:tasks.workunit.client.0.smithi111.stdout:3/694: read d5/da/f6f [2250602,27084] 0 2024-09-16T09:46:13.961 INFO:tasks.workunit.client.0.smithi111.stdout:3/695: dread - d5/da/db/d3a/d6d/de7/fd5 zero size 2024-09-16T09:46:13.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/393: write d1/d16/d17/d18/d4f/d56/f5a [4069150,13814] 0 2024-09-16T09:46:13.980 INFO:tasks.workunit.client.0.smithi111.stdout:7/394: dwrite d1/d16/d17/d18/d1d/d2f/f5c [0,4194304] 0 2024-09-16T09:46:13.980 INFO:tasks.workunit.client.0.smithi111.stdout:7/395: dread - d1/d16/d17/d18/d4f/d56/f57 zero size 2024-09-16T09:46:13.984 INFO:tasks.workunit.client.0.smithi111.stdout:7/396: creat d1/d16/d17/d18/d4f/f84 x:0 0 0 2024-09-16T09:46:13.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/397: dread d1/d9/f35 [0,4194304] 0 2024-09-16T09:46:13.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/398: stat d1/d16/d17/d18/d4f/d56/c64 0 2024-09-16T09:46:13.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/399: chown d1/d9/d43/d82 221016 1 2024-09-16T09:46:13.986 INFO:tasks.workunit.client.0.smithi111.stdout:7/400: read d1/d16/d27/f2b [1824095,906] 0 2024-09-16T09:46:13.987 INFO:tasks.workunit.client.0.smithi111.stdout:7/401: symlink d1/d16/d17/d18/d1d/d2f/l85 0 2024-09-16T09:46:13.987 INFO:tasks.workunit.client.0.smithi111.stdout:7/402: fsync d1/d16/f29 0 2024-09-16T09:46:13.988 INFO:tasks.workunit.client.0.smithi111.stdout:7/403: mknod d1/d16/d17/d18/d1b/d79/c86 0 2024-09-16T09:46:13.991 INFO:tasks.workunit.client.0.smithi111.stdout:7/404: mknod d1/c87 0 2024-09-16T09:46:14.007 INFO:tasks.workunit.client.0.smithi111.stdout:7/405: dwrite d1/d16/d27/f76 [0,4194304] 0 2024-09-16T09:46:14.008 INFO:tasks.workunit.client.0.smithi111.stdout:7/406: mkdir d1/d16/d17/d18/d4f/d88 0 2024-09-16T09:46:14.010 INFO:tasks.workunit.client.0.smithi111.stdout:7/407: mknod d1/d16/c89 0 2024-09-16T09:46:14.010 INFO:tasks.workunit.client.0.smithi111.stdout:7/408: stat d1/d59/c80 0 2024-09-16T09:46:14.012 INFO:tasks.workunit.client.0.smithi111.stdout:7/409: truncate d1/d9/f34 2824945 0 2024-09-16T09:46:14.013 INFO:tasks.workunit.client.0.smithi111.stdout:7/410: creat d1/d9/d43/d82/f8a x:0 0 0 2024-09-16T09:46:14.015 INFO:tasks.workunit.client.0.smithi111.stdout:7/411: creat d1/d16/d17/d18/f8b x:0 0 0 2024-09-16T09:46:14.015 INFO:tasks.workunit.client.0.smithi111.stdout:7/412: chown d1/d3e/f74 23532317 1 2024-09-16T09:46:14.016 INFO:tasks.workunit.client.0.smithi111.stdout:7/413: chown d1/d9/l38 11191 1 2024-09-16T09:46:14.018 INFO:tasks.workunit.client.0.smithi111.stdout:7/414: mkdir d1/d16/d17/d18/d1b/d79/d8c 0 2024-09-16T09:46:14.018 INFO:tasks.workunit.client.0.smithi111.stdout:7/415: chown d1/d9 2 1 2024-09-16T09:46:14.019 INFO:tasks.workunit.client.0.smithi111.stdout:7/416: creat d1/d16/d27/f8d x:0 0 0 2024-09-16T09:46:14.037 INFO:tasks.workunit.client.0.smithi111.stdout:7/417: dwrite d1/d16/d27/f8d [0,4194304] 0 2024-09-16T09:46:14.039 INFO:tasks.workunit.client.0.smithi111.stdout:7/418: dread d1/d20/f42 [4194304,4194304] 0 2024-09-16T09:46:14.040 INFO:tasks.workunit.client.0.smithi111.stdout:7/419: readlink d1/d9/l12 0 2024-09-16T09:46:14.040 INFO:tasks.workunit.client.0.smithi111.stdout:7/420: read d1/d9/fa [173426,67943] 0 2024-09-16T09:46:14.040 INFO:tasks.workunit.client.0.smithi111.stdout:7/421: readlink d1/d9/d43/l55 0 2024-09-16T09:46:14.048 INFO:tasks.workunit.client.0.smithi111.stdout:7/422: dread d1/d16/f5f [0,4194304] 0 2024-09-16T09:46:14.053 INFO:tasks.workunit.client.0.smithi111.stdout:5/593: sync 2024-09-16T09:46:14.053 INFO:tasks.workunit.client.0.smithi111.stdout:0/523: sync 2024-09-16T09:46:14.055 INFO:tasks.workunit.client.0.smithi111.stdout:0/524: truncate d0/f44 690671 0 2024-09-16T09:46:14.057 INFO:tasks.workunit.client.0.smithi111.stdout:7/423: dread d1/d16/d17/d18/f62 [0,4194304] 0 2024-09-16T09:46:14.062 INFO:tasks.workunit.client.0.smithi111.stdout:5/594: write d19/d1b/d27/d2e/f53 [4187986,17307] 0 2024-09-16T09:46:14.066 INFO:tasks.workunit.client.0.smithi111.stdout:5/595: unlink d19/d1b/d27/d2e/d4a/d4b/d9c/la4 0 2024-09-16T09:46:14.066 INFO:tasks.workunit.client.0.smithi111.stdout:7/424: dread d1/d16/d27/f76 [0,4194304] 0 2024-09-16T09:46:14.066 INFO:tasks.workunit.client.0.smithi111.stdout:7/425: truncate d1/d16/d17/d18/d1d/d2f/f7f 887034 0 2024-09-16T09:46:14.067 INFO:tasks.workunit.client.0.smithi111.stdout:5/596: creat d19/fd1 x:0 0 0 2024-09-16T09:46:14.069 INFO:tasks.workunit.client.0.smithi111.stdout:7/426: rename d1/d16/d17/d18/c4d to d1/d16/d17/d18/d1b/c8e 0 2024-09-16T09:46:14.069 INFO:tasks.workunit.client.0.smithi111.stdout:7/427: chown d1/d16/d17/d18/d1d/d2f/f77 51 1 2024-09-16T09:46:14.070 INFO:tasks.workunit.client.0.smithi111.stdout:0/525: dwrite d0/f32 [0,4194304] 0 2024-09-16T09:46:14.072 INFO:tasks.workunit.client.0.smithi111.stdout:7/428: truncate d1/d9/f3c 1387653 0 2024-09-16T09:46:14.074 INFO:tasks.workunit.client.0.smithi111.stdout:7/429: creat d1/d16/d17/f8f x:0 0 0 2024-09-16T09:46:14.093 INFO:tasks.workunit.client.0.smithi111.stdout:5/597: dwrite d19/d1b/d27/d83/d2a/dc4/fa5 [0,4194304] 0 2024-09-16T09:46:14.093 INFO:tasks.workunit.client.0.smithi111.stdout:5/598: chown d19/fd1 147166990 1 2024-09-16T09:46:14.094 INFO:tasks.workunit.client.0.smithi111.stdout:0/526: dwrite d0/f18 [0,4194304] 0 2024-09-16T09:46:14.095 INFO:tasks.workunit.client.0.smithi111.stdout:7/430: dwrite d1/d16/d17/d18/d4f/f50 [4194304,4194304] 0 2024-09-16T09:46:14.095 INFO:tasks.workunit.client.0.smithi111.stdout:5/599: mkdir d19/d1b/d27/d2e/d4a/d4b/dac/dd2 0 2024-09-16T09:46:14.103 INFO:tasks.workunit.client.0.smithi111.stdout:7/431: truncate d1/d16/f72 598477 0 2024-09-16T09:46:14.103 INFO:tasks.workunit.client.0.smithi111.stdout:7/432: fsync d1/d16/d17/d18/d1d/d2f/f5c 0 2024-09-16T09:46:14.104 INFO:tasks.workunit.client.0.smithi111.stdout:0/527: write d0/f22 [10345222,84425] 0 2024-09-16T09:46:14.106 INFO:tasks.workunit.client.0.smithi111.stdout:5/600: unlink d19/d1b/d1e/d21/d29/f56 0 2024-09-16T09:46:14.106 INFO:tasks.workunit.client.0.smithi111.stdout:9/449: sync 2024-09-16T09:46:14.106 INFO:tasks.workunit.client.0.smithi111.stdout:4/476: sync 2024-09-16T09:46:14.106 INFO:tasks.workunit.client.0.smithi111.stdout:1/535: sync 2024-09-16T09:46:14.106 INFO:tasks.workunit.client.0.smithi111.stdout:6/468: sync 2024-09-16T09:46:14.109 INFO:tasks.workunit.client.0.smithi111.stdout:4/477: dread d2/d6/dd/d1b/d38/f68 [0,4194304] 0 2024-09-16T09:46:14.110 INFO:tasks.workunit.client.0.smithi111.stdout:7/433: dread d1/d16/f72 [0,4194304] 0 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:3/696: sync 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:2/656: sync 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/576: sync 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:2/657: dread - d0/d22/fb7 zero size 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/577: chown d3/d26/d6d/f4f 2 1 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/578: read - d3/d26/f52 zero size 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:2/658: chown d0/d22/d98/lb4 87755 1 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/579: chown d3/de/d1e/d2e/d74/d83 0 1 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:2/659: chown d0/d2/f17 48388299 1 2024-09-16T09:46:14.112 INFO:tasks.workunit.client.0.smithi111.stdout:8/580: write d3/de/d1e/d27/f2b [3695895,107128] 0 2024-09-16T09:46:14.113 INFO:tasks.workunit.client.0.smithi111.stdout:3/697: dread d5/f86 [0,4194304] 0 2024-09-16T09:46:14.113 INFO:tasks.workunit.client.0.smithi111.stdout:0/528: mknod d0/d1d/d67/d3a/d77/cb8 0 2024-09-16T09:46:14.113 INFO:tasks.workunit.client.0.smithi111.stdout:0/529: fdatasync d0/f17 0 2024-09-16T09:46:14.113 INFO:tasks.workunit.client.0.smithi111.stdout:0/530: chown d0/d1d/d67/d3a/d77/dad/lb2 42500035 1 2024-09-16T09:46:14.113 INFO:tasks.workunit.client.0.smithi111.stdout:0/531: truncate d0/d1d/d58/d64/d5e/fb5 666522 0 2024-09-16T09:46:14.115 INFO:tasks.workunit.client.0.smithi111.stdout:5/601: creat d19/d1b/d27/d2e/d39/fd3 x:0 0 0 2024-09-16T09:46:14.115 INFO:tasks.workunit.client.0.smithi111.stdout:5/602: truncate d19/d1b/d27/d83/d2a/f8d 855785 0 2024-09-16T09:46:14.118 INFO:tasks.workunit.client.0.smithi111.stdout:1/536: write d3/d10/d72/da1/d28/d36/f64 [3808680,114629] 0 2024-09-16T09:46:14.118 INFO:tasks.workunit.client.0.smithi111.stdout:1/537: chown d3/d10/d72/da1/d28/d36/d3d/d47/d65/l98 1668155 1 2024-09-16T09:46:14.118 INFO:tasks.workunit.client.0.smithi111.stdout:1/538: write d3/d10/d72/da1/f1b [7829794,31654] 0 2024-09-16T09:46:14.124 INFO:tasks.workunit.client.0.smithi111.stdout:6/469: creat d0/df/d47/d52/fa0 x:0 0 0 2024-09-16T09:46:14.125 INFO:tasks.workunit.client.0.smithi111.stdout:4/478: symlink d2/d30/l95 0 2024-09-16T09:46:14.126 INFO:tasks.workunit.client.0.smithi111.stdout:7/434: rename d1/d16/d17/f8f to d1/d16/d17/d18/f90 0 2024-09-16T09:46:14.127 INFO:tasks.workunit.client.0.smithi111.stdout:2/660: symlink d0/da/d4e/le5 0 2024-09-16T09:46:14.127 INFO:tasks.workunit.client.0.smithi111.stdout:2/661: stat d0/ce 0 2024-09-16T09:46:14.128 INFO:tasks.workunit.client.0.smithi111.stdout:3/698: getdents d5/da/db/d35 0 2024-09-16T09:46:14.128 INFO:tasks.workunit.client.0.smithi111.stdout:0/532: dwrite d0/d1d/d67/d3a/f63 [0,4194304] 0 2024-09-16T09:46:14.129 INFO:tasks.workunit.client.0.smithi111.stdout:5/603: unlink d19/d1b/d27/d83/d2a/dc4/cc2 0 2024-09-16T09:46:14.133 INFO:tasks.workunit.client.0.smithi111.stdout:1/539: symlink d3/d10/d57/d8f/lb4 0 2024-09-16T09:46:14.135 INFO:tasks.workunit.client.0.smithi111.stdout:9/450: creat d0/d48/f96 x:0 0 0 2024-09-16T09:46:14.137 INFO:tasks.workunit.client.0.smithi111.stdout:6/470: mkdir d0/df/d14/d20/d42/d4e/d62/d7b/d80/da1 0 2024-09-16T09:46:14.139 INFO:tasks.workunit.client.0.smithi111.stdout:4/479: mkdir d2/d30/d44/d96 0 2024-09-16T09:46:14.139 INFO:tasks.workunit.client.0.smithi111.stdout:4/480: write d2/d6/dd/d1b/d6d/f78 [346607,20579] 0 2024-09-16T09:46:14.140 INFO:tasks.workunit.client.0.smithi111.stdout:8/581: rename d3/da/f79 to d3/de/d1e/d2e/d74/d83/da2/fbd 0 2024-09-16T09:46:14.140 INFO:tasks.workunit.client.0.smithi111.stdout:2/662: mknod d0/d45/d5c/d67/d63/dd4/dc3/dc8/ce6 0 2024-09-16T09:46:14.141 INFO:tasks.workunit.client.0.smithi111.stdout:3/699: getdents d5/da/db 0 2024-09-16T09:46:14.143 INFO:tasks.workunit.client.0.smithi111.stdout:5/604: creat d19/d1b/d1e/d21/fd4 x:0 0 0 2024-09-16T09:46:14.143 INFO:tasks.workunit.client.0.smithi111.stdout:5/605: read d19/d1b/d27/d2e/f6d [4163396,104904] 0 2024-09-16T09:46:14.143 INFO:tasks.workunit.client.0.smithi111.stdout:5/606: write d19/d1b/d27/d2e/d4a/d4b/fa3 [2609704,121975] 0 2024-09-16T09:46:14.143 INFO:tasks.workunit.client.0.smithi111.stdout:5/607: readlink l9 0 2024-09-16T09:46:14.143 INFO:tasks.workunit.client.0.smithi111.stdout:5/608: chown d19/d1b/d1e/f40 1675 1 2024-09-16T09:46:14.143 INFO:tasks.workunit.client.0.smithi111.stdout:9/451: link d0/d21/f66 d0/d21/d22/d6e/f97 0 2024-09-16T09:46:14.144 INFO:tasks.workunit.client.0.smithi111.stdout:6/471: mknod d0/df/d47/ca2 0 2024-09-16T09:46:14.146 INFO:tasks.workunit.client.0.smithi111.stdout:8/582: unlink d3/d26/f52 0 2024-09-16T09:46:14.146 INFO:tasks.workunit.client.0.smithi111.stdout:2/663: mknod d0/d45/d5c/dc6/ce7 0 2024-09-16T09:46:14.148 INFO:tasks.workunit.client.0.smithi111.stdout:3/700: getdents d5/da/db/d3a/d6d 0 2024-09-16T09:46:14.148 INFO:tasks.workunit.client.0.smithi111.stdout:3/701: fdatasync d5/da/d42/d74/f98 0 2024-09-16T09:46:14.148 INFO:tasks.workunit.client.0.smithi111.stdout:3/702: dread - d5/da/db/d3a/d6d/de7/d88/fe2 zero size 2024-09-16T09:46:14.149 INFO:tasks.workunit.client.0.smithi111.stdout:9/452: creat d0/d21/d22/d6e/d51/d76/f98 x:0 0 0 2024-09-16T09:46:14.149 INFO:tasks.workunit.client.0.smithi111.stdout:9/453: readlink d0/d6/d8/de/l94 0 2024-09-16T09:46:14.150 INFO:tasks.workunit.client.0.smithi111.stdout:6/472: creat d0/df/d14/d20/d42/d4e/fa3 x:0 0 0 2024-09-16T09:46:14.151 INFO:tasks.workunit.client.0.smithi111.stdout:6/473: chown d0/df/d47/f7d 513 1 2024-09-16T09:46:14.152 INFO:tasks.workunit.client.0.smithi111.stdout:8/583: rename d3/de/d1e/d27 to d3/de/d1e/d2e/d2f/da8/dbe 0 2024-09-16T09:46:14.153 INFO:tasks.workunit.client.0.smithi111.stdout:3/703: stat d5/da/db/d35/d41/l57 0 2024-09-16T09:46:14.153 INFO:tasks.workunit.client.0.smithi111.stdout:3/704: write d5/f69 [356939,77837] 0 2024-09-16T09:46:14.155 INFO:tasks.workunit.client.0.smithi111.stdout:9/454: link d0/d6/d8/de/f95 d0/d21/d22/f99 0 2024-09-16T09:46:14.157 INFO:tasks.workunit.client.0.smithi111.stdout:2/664: rename d0/d22/dac/ce1 to d0/d22/d98/dc9/ce8 0 2024-09-16T09:46:14.158 INFO:tasks.workunit.client.0.smithi111.stdout:9/455: mkdir d0/d21/d22/d6e/d7d/d9a 0 2024-09-16T09:46:14.159 INFO:tasks.workunit.client.0.smithi111.stdout:2/665: symlink d0/d45/d81/le9 0 2024-09-16T09:46:14.161 INFO:tasks.workunit.client.0.smithi111.stdout:3/705: mknod d5/da/db/d3a/d6d/de7/ce8 0 2024-09-16T09:46:14.161 INFO:tasks.workunit.client.0.smithi111.stdout:2/666: mkdir d0/da6/dea 0 2024-09-16T09:46:14.162 INFO:tasks.workunit.client.0.smithi111.stdout:3/706: truncate d5/da/d42/f48 3729420 0 2024-09-16T09:46:14.163 INFO:tasks.workunit.client.0.smithi111.stdout:2/667: symlink d0/d45/d5c/d67/d63/leb 0 2024-09-16T09:46:14.164 INFO:tasks.workunit.client.0.smithi111.stdout:3/707: creat d5/da/db/d3a/d6d/de7/d88/fe9 x:0 0 0 2024-09-16T09:46:14.164 INFO:tasks.workunit.client.0.smithi111.stdout:3/708: write d5/da/db/de/f27 [5198411,58453] 0 2024-09-16T09:46:14.166 INFO:tasks.workunit.client.0.smithi111.stdout:2/668: rename d0/d21/c3c to d0/d2/d61/d9f/cec 0 2024-09-16T09:46:14.167 INFO:tasks.workunit.client.0.smithi111.stdout:2/669: rmdir d0/d2/d59/d86 39 2024-09-16T09:46:14.168 INFO:tasks.workunit.client.0.smithi111.stdout:2/670: creat d0/da/d4e/da8/fed x:0 0 0 2024-09-16T09:46:14.174 INFO:tasks.workunit.client.0.smithi111.stdout:2/671: unlink d0/d22/f40 0 2024-09-16T09:46:14.179 INFO:tasks.workunit.client.0.smithi111.stdout:0/533: dwrite d0/d1d/d67/d3a/fab [0,4194304] 0 2024-09-16T09:46:14.180 INFO:tasks.workunit.client.0.smithi111.stdout:0/534: symlink d0/d1d/d67/d3a/lb9 0 2024-09-16T09:46:14.180 INFO:tasks.workunit.client.0.smithi111.stdout:0/535: write d0/d1d/f3c [3855848,8404] 0 2024-09-16T09:46:14.181 INFO:tasks.workunit.client.0.smithi111.stdout:0/536: stat d0/d1d/d67/d3a/d3d/l69 0 2024-09-16T09:46:14.181 INFO:tasks.workunit.client.0.smithi111.stdout:0/537: truncate d0/f6e 1299221 0 2024-09-16T09:46:14.181 INFO:tasks.workunit.client.0.smithi111.stdout:0/538: symlink d0/d1d/d67/d3a/d3d/lba 0 2024-09-16T09:46:14.195 INFO:tasks.workunit.client.0.smithi111.stdout:7/435: dwrite d1/d16/d17/d18/d1d/d2f/f77 [0,4194304] 0 2024-09-16T09:46:14.195 INFO:tasks.workunit.client.0.smithi111.stdout:1/540: dwrite d3/d10/d72/da1/ff [0,4194304] 0 2024-09-16T09:46:14.195 INFO:tasks.workunit.client.0.smithi111.stdout:7/436: write d1/d16/d27/f2b [4990985,95034] 0 2024-09-16T09:46:14.196 INFO:tasks.workunit.client.0.smithi111.stdout:1/541: write d3/d10/f4d [1007803,91992] 0 2024-09-16T09:46:14.196 INFO:tasks.workunit.client.0.smithi111.stdout:1/542: truncate d3/f1a 1329926 0 2024-09-16T09:46:14.196 INFO:tasks.workunit.client.0.smithi111.stdout:1/543: readlink d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/l77 0 2024-09-16T09:46:14.196 INFO:tasks.workunit.client.0.smithi111.stdout:7/437: dread d1/d16/d17/d18/d1d/d2f/f7f [0,4194304] 0 2024-09-16T09:46:14.198 INFO:tasks.workunit.client.0.smithi111.stdout:1/544: rename d3/d10/d72/da1/cb1 to d3/d10/d57/d95/cb5 0 2024-09-16T09:46:14.199 INFO:tasks.workunit.client.0.smithi111.stdout:7/438: mknod d1/d16/d17/c91 0 2024-09-16T09:46:14.200 INFO:tasks.workunit.client.0.smithi111.stdout:1/545: rmdir d3/d10/d72/da1 39 2024-09-16T09:46:14.200 INFO:tasks.workunit.client.0.smithi111.stdout:1/546: readlink d3/d24/d3f/la8 0 2024-09-16T09:46:14.200 INFO:tasks.workunit.client.0.smithi111.stdout:1/547: truncate d3/d10/d1c/f7c 176853 0 2024-09-16T09:46:14.200 INFO:tasks.workunit.client.0.smithi111.stdout:7/439: mknod d1/d16/d17/d18/c92 0 2024-09-16T09:46:14.201 INFO:tasks.workunit.client.0.smithi111.stdout:1/548: mkdir d3/d24/d62/db6 0 2024-09-16T09:46:14.202 INFO:tasks.workunit.client.0.smithi111.stdout:7/440: creat d1/d16/d17/d18/d1d/d2f/d73/f93 x:0 0 0 2024-09-16T09:46:14.202 INFO:tasks.workunit.client.0.smithi111.stdout:7/441: truncate d1/d9/f34 3257164 0 2024-09-16T09:46:14.202 INFO:tasks.workunit.client.0.smithi111.stdout:7/442: fsync d1/d16/f5f 0 2024-09-16T09:46:14.202 INFO:tasks.workunit.client.0.smithi111.stdout:1/549: rmdir d3/d10/d72/da1/d28 39 2024-09-16T09:46:14.203 INFO:tasks.workunit.client.0.smithi111.stdout:7/443: rename d1/c87 to d1/d16/d17/d18/d1b/d79/c94 0 2024-09-16T09:46:14.203 INFO:tasks.workunit.client.0.smithi111.stdout:1/550: rmdir d3/d10/d72/da1/d28/d36/d3d/d47/d65 39 2024-09-16T09:46:14.204 INFO:tasks.workunit.client.0.smithi111.stdout:1/551: chown d3/d10/d72/da1/d28/d36/d3d/d47/d5a/lad 63978958 1 2024-09-16T09:46:14.204 INFO:tasks.workunit.client.0.smithi111.stdout:7/444: creat d1/d16/d17/d18/d4f/d88/f95 x:0 0 0 2024-09-16T09:46:14.205 INFO:tasks.workunit.client.0.smithi111.stdout:1/552: creat d3/d10/d57/fb7 x:0 0 0 2024-09-16T09:46:14.206 INFO:tasks.workunit.client.0.smithi111.stdout:7/445: mknod d1/d16/d17/d18/d4f/c96 0 2024-09-16T09:46:14.209 INFO:tasks.workunit.client.0.smithi111.stdout:7/446: creat d1/d16/d17/d18/d4f/f97 x:0 0 0 2024-09-16T09:46:14.210 INFO:tasks.workunit.client.0.smithi111.stdout:7/447: mkdir d1/d16/d17/d18/d1b/d79/d8c/d98 0 2024-09-16T09:46:14.211 INFO:tasks.workunit.client.0.smithi111.stdout:7/448: symlink d1/d16/d17/d18/d1d/l99 0 2024-09-16T09:46:14.211 INFO:tasks.workunit.client.0.smithi111.stdout:7/449: write d1/d16/d17/d18/d4f/d56/f5a [2787416,36666] 0 2024-09-16T09:46:14.212 INFO:tasks.workunit.client.0.smithi111.stdout:7/450: rmdir d1/d59 39 2024-09-16T09:46:14.215 INFO:tasks.workunit.client.0.smithi111.stdout:7/451: rename d1/d9/cd to d1/d16/d17/d18/d1b/d79/d8c/c9a 0 2024-09-16T09:46:14.215 INFO:tasks.workunit.client.0.smithi111.stdout:7/452: write d1/d16/f72 [1532862,119059] 0 2024-09-16T09:46:14.215 INFO:tasks.workunit.client.0.smithi111.stdout:7/453: truncate d1/f1a 3182922 0 2024-09-16T09:46:14.217 INFO:tasks.workunit.client.0.smithi111.stdout:7/454: creat d1/d16/d17/f9b x:0 0 0 2024-09-16T09:46:14.219 INFO:tasks.workunit.client.0.smithi111.stdout:7/455: symlink d1/d16/d17/d18/d1b/d79/d8c/l9c 0 2024-09-16T09:46:14.220 INFO:tasks.workunit.client.0.smithi111.stdout:4/481: dwrite d2/d30/d44/f82 [0,4194304] 0 2024-09-16T09:46:14.221 INFO:tasks.workunit.client.0.smithi111.stdout:7/456: mknod d1/d9/c9d 0 2024-09-16T09:46:14.221 INFO:tasks.workunit.client.0.smithi111.stdout:6/474: dwrite d0/df/d14/d20/d23/f7e [0,4194304] 0 2024-09-16T09:46:14.221 INFO:tasks.workunit.client.0.smithi111.stdout:6/475: readlink d0/df/d47/l87 0 2024-09-16T09:46:14.222 INFO:tasks.workunit.client.0.smithi111.stdout:6/476: write d0/df/d14/d20/d42/d4e/d62/f6c [474242,5217] 0 2024-09-16T09:46:14.223 INFO:tasks.workunit.client.0.smithi111.stdout:5/609: dwrite d19/d1b/d27/d2e/d39/f62 [0,4194304] 0 2024-09-16T09:46:14.224 INFO:tasks.workunit.client.0.smithi111.stdout:4/482: link d2/d6/d80/c8c d2/d6/dd/d1b/c97 0 2024-09-16T09:46:14.224 INFO:tasks.workunit.client.0.smithi111.stdout:4/483: dread - d2/d6/f8a zero size 2024-09-16T09:46:14.225 INFO:tasks.workunit.client.0.smithi111.stdout:8/584: dwrite f0 [0,4194304] 0 2024-09-16T09:46:14.225 INFO:tasks.workunit.client.0.smithi111.stdout:3/709: dwrite d5/d18/f2e [0,4194304] 0 2024-09-16T09:46:14.225 INFO:tasks.workunit.client.0.smithi111.stdout:0/539: dwrite d0/d1d/d67/d3a/d92/f97 [0,4194304] 0 2024-09-16T09:46:14.225 INFO:tasks.workunit.client.0.smithi111.stdout:9/456: dwrite d0/d6/d8/de/d56/f5e [0,4194304] 0 2024-09-16T09:46:14.227 INFO:tasks.workunit.client.0.smithi111.stdout:6/477: rmdir d0 39 2024-09-16T09:46:14.232 INFO:tasks.workunit.client.0.smithi111.stdout:5/610: mkdir d19/d1b/d27/d2e/d39/d54/d60/dd5 0 2024-09-16T09:46:14.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/484: unlink d2/d6/d80/c93 0 2024-09-16T09:46:14.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/485: chown d2/d30 172978 1 2024-09-16T09:46:14.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/486: chown d2/d6/dd/d1c/d2f 3332 1 2024-09-16T09:46:14.237 INFO:tasks.workunit.client.0.smithi111.stdout:8/585: rmdir d3/d26 39 2024-09-16T09:46:14.240 INFO:tasks.workunit.client.0.smithi111.stdout:3/710: write d5/da/db/d35/d41/da0/dd9/fb4 [582056,68046] 0 2024-09-16T09:46:14.249 INFO:tasks.workunit.client.0.smithi111.stdout:0/540: link d0/d1d/d67/d3a/d3d/lba d0/d26/d35/d86/lbb 0 2024-09-16T09:46:14.266 INFO:tasks.workunit.client.0.smithi111.stdout:4/487: mkdir d2/d6/d80/d98 0 2024-09-16T09:46:14.266 INFO:tasks.workunit.client.0.smithi111.stdout:4/488: readlink d2/d6/l89 0 2024-09-16T09:46:14.267 INFO:tasks.workunit.client.0.smithi111.stdout:4/489: write d2/d6/dd/d1c/d2f/f4d [827056,40892] 0 2024-09-16T09:46:14.268 INFO:tasks.workunit.client.0.smithi111.stdout:3/711: symlink d5/da/db/de/ddb/lea 0 2024-09-16T09:46:14.269 INFO:tasks.workunit.client.0.smithi111.stdout:0/541: creat d0/d26/d35/d86/fbc x:0 0 0 2024-09-16T09:46:14.271 INFO:tasks.workunit.client.0.smithi111.stdout:9/457: mknod d0/d7b/c9b 0 2024-09-16T09:46:14.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/712: getdents d5/da/db/d35/d45/da1 0 2024-09-16T09:46:14.274 INFO:tasks.workunit.client.0.smithi111.stdout:0/542: link d0/d1d/d67/d3a/d80/f56 d0/d1d/d58/d83/fbd 0 2024-09-16T09:46:14.276 INFO:tasks.workunit.client.0.smithi111.stdout:4/490: mknod d2/d6/c99 0 2024-09-16T09:46:14.276 INFO:tasks.workunit.client.0.smithi111.stdout:4/491: write d2/d30/f61 [372982,20101] 0 2024-09-16T09:46:14.279 INFO:tasks.workunit.client.0.smithi111.stdout:0/543: creat d0/d26/d35/fbe x:0 0 0 2024-09-16T09:46:14.280 INFO:tasks.workunit.client.0.smithi111.stdout:0/544: creat d0/d1d/d67/d3a/d3d/fbf x:0 0 0 2024-09-16T09:46:14.280 INFO:tasks.workunit.client.0.smithi111.stdout:8/586: dwrite d3/de/d1e/d2e/d2f/d4c/f9b [0,4194304] 0 2024-09-16T09:46:14.281 INFO:tasks.workunit.client.0.smithi111.stdout:7/457: dwrite d1/d16/d17/d18/f62 [0,4194304] 0 2024-09-16T09:46:14.282 INFO:tasks.workunit.client.0.smithi111.stdout:0/545: unlink d0/f11 0 2024-09-16T09:46:14.283 INFO:tasks.workunit.client.0.smithi111.stdout:4/492: write d2/d6/dd/d1c/f62 [4187882,14945] 0 2024-09-16T09:46:14.286 INFO:tasks.workunit.client.0.smithi111.stdout:8/587: creat d3/de/d1e/fbf x:0 0 0 2024-09-16T09:46:14.290 INFO:tasks.workunit.client.0.smithi111.stdout:5/611: dwrite f7 [4194304,4194304] 0 2024-09-16T09:46:14.290 INFO:tasks.workunit.client.0.smithi111.stdout:6/478: dwrite d0/df/d47/d68/d6a/f8d [0,4194304] 0 2024-09-16T09:46:14.290 INFO:tasks.workunit.client.0.smithi111.stdout:2/672: dwrite d0/d2/f14 [0,4194304] 0 2024-09-16T09:46:14.292 INFO:tasks.workunit.client.0.smithi111.stdout:0/546: truncate d0/d1d/d67/d3a/d80/f78 1146972 0 2024-09-16T09:46:14.293 INFO:tasks.workunit.client.0.smithi111.stdout:0/547: readlink d0/l1b 0 2024-09-16T09:46:14.299 INFO:tasks.workunit.client.0.smithi111.stdout:6/479: creat d0/df/d49/d5b/fa4 x:0 0 0 2024-09-16T09:46:14.301 INFO:tasks.workunit.client.0.smithi111.stdout:7/458: mkdir d1/d3e/d9e 0 2024-09-16T09:46:14.301 INFO:tasks.workunit.client.0.smithi111.stdout:7/459: stat d1/d20/f42 0 2024-09-16T09:46:14.305 INFO:tasks.workunit.client.0.smithi111.stdout:6/480: link d0/df/d14/d20/c45 d0/ca5 0 2024-09-16T09:46:14.305 INFO:tasks.workunit.client.0.smithi111.stdout:6/481: write d0/df/d14/d20/d42/d4e/fa3 [206979,4178] 0 2024-09-16T09:46:14.309 INFO:tasks.workunit.client.0.smithi111.stdout:2/673: dread d0/f53 [4194304,4194304] 0 2024-09-16T09:46:14.309 INFO:tasks.workunit.client.0.smithi111.stdout:2/674: truncate d0/d2/d44/f5e 236309 0 2024-09-16T09:46:14.309 INFO:tasks.workunit.client.0.smithi111.stdout:6/482: rename d0/df/d14/d20/d23 to d0/df/d14/d20/d42/d4e/d64/da6 0 2024-09-16T09:46:14.310 INFO:tasks.workunit.client.0.smithi111.stdout:2/675: mkdir d0/da6/dea/dee 0 2024-09-16T09:46:14.312 INFO:tasks.workunit.client.0.smithi111.stdout:3/713: dwrite d5/da/db/de/f27 [0,4194304] 0 2024-09-16T09:46:14.313 INFO:tasks.workunit.client.0.smithi111.stdout:2/676: symlink d0/da6/lef 0 2024-09-16T09:46:14.314 INFO:tasks.workunit.client.0.smithi111.stdout:9/458: dwrite d0/d21/d22/d6e/d51/d76/f98 [0,4194304] 0 2024-09-16T09:46:14.316 INFO:tasks.workunit.client.0.smithi111.stdout:2/677: mkdir d0/d22/dac/df0 0 2024-09-16T09:46:14.319 INFO:tasks.workunit.client.0.smithi111.stdout:9/459: getdents d0/d21/d22/d6e/d7d 0 2024-09-16T09:46:14.321 INFO:tasks.workunit.client.0.smithi111.stdout:2/678: rmdir d0/d45/d5c 39 2024-09-16T09:46:14.321 INFO:tasks.workunit.client.0.smithi111.stdout:2/679: dread - d0/d22/fb7 zero size 2024-09-16T09:46:14.323 INFO:tasks.workunit.client.0.smithi111.stdout:2/680: mknod d0/dd8/cf1 0 2024-09-16T09:46:14.323 INFO:tasks.workunit.client.0.smithi111.stdout:6/483: write d0/df/d14/d20/d42/d4e/d64/da6/f2e [4488003,76236] 0 2024-09-16T09:46:14.324 INFO:tasks.workunit.client.0.smithi111.stdout:9/460: rename d0/l7a to d0/d6/d8/l9c 0 2024-09-16T09:46:14.326 INFO:tasks.workunit.client.0.smithi111.stdout:6/484: unlink d0/df/d49/f4c 0 2024-09-16T09:46:14.329 INFO:tasks.workunit.client.0.smithi111.stdout:2/681: rename d0/d22/c4d to d0/d2/d59/d86/cf2 0 2024-09-16T09:46:14.329 INFO:tasks.workunit.client.0.smithi111.stdout:2/682: fdatasync d0/d2/f1e 0 2024-09-16T09:46:14.330 INFO:tasks.workunit.client.0.smithi111.stdout:9/461: mkdir d0/d48/d9d 0 2024-09-16T09:46:14.330 INFO:tasks.workunit.client.0.smithi111.stdout:4/493: dwrite d2/f8 [0,4194304] 0 2024-09-16T09:46:14.331 INFO:tasks.workunit.client.0.smithi111.stdout:2/683: rmdir d0/d2/d59/dd5 0 2024-09-16T09:46:14.334 INFO:tasks.workunit.client.0.smithi111.stdout:9/462: mknod d0/d6/d30/c9e 0 2024-09-16T09:46:14.334 INFO:tasks.workunit.client.0.smithi111.stdout:8/588: dwrite d3/d26/d6d/fa6 [0,4194304] 0 2024-09-16T09:46:14.337 INFO:tasks.workunit.client.0.smithi111.stdout:5/612: dwrite d19/d1b/d1e/f40 [4194304,4194304] 0 2024-09-16T09:46:14.337 INFO:tasks.workunit.client.0.smithi111.stdout:5/613: dread - d19/d1b/d27/d2e/d39/d6c/f7e zero size 2024-09-16T09:46:14.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/614: dread d19/d1b/d1e/d81/faf [0,4194304] 0 2024-09-16T09:46:14.339 INFO:tasks.workunit.client.0.smithi111.stdout:0/548: dwrite d0/d1d/d58/d64/d5e/fb5 [0,4194304] 0 2024-09-16T09:46:14.339 INFO:tasks.workunit.client.0.smithi111.stdout:0/549: write d0/d1d/d67/d3a/f6f [358813,80087] 0 2024-09-16T09:46:14.340 INFO:tasks.workunit.client.0.smithi111.stdout:7/460: dwrite d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:14.340 INFO:tasks.workunit.client.0.smithi111.stdout:7/461: chown d1/d16/d17/d18/d1b/l68 118067 1 2024-09-16T09:46:14.340 INFO:tasks.workunit.client.0.smithi111.stdout:3/714: dwrite d5/da/db/d3a/d6d/de7/f83 [0,4194304] 0 2024-09-16T09:46:14.341 INFO:tasks.workunit.client.0.smithi111.stdout:2/684: mknod d0/d2/d59/d86/d96/dd1/cf3 0 2024-09-16T09:46:14.349 INFO:tasks.workunit.client.0.smithi111.stdout:9/463: symlink d0/d7b/l9f 0 2024-09-16T09:46:14.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/464: fdatasync d0/d21/d22/d6e/d51/d76/f83 0 2024-09-16T09:46:14.350 INFO:tasks.workunit.client.0.smithi111.stdout:9/465: chown d0/d6/d8/c91 1004148 1 2024-09-16T09:46:14.351 INFO:tasks.workunit.client.0.smithi111.stdout:8/589: symlink d3/de/d34/lc0 0 2024-09-16T09:46:14.359 INFO:tasks.workunit.client.0.smithi111.stdout:5/615: creat d19/d1b/d27/d83/d2a/dc4/dc0/db1/fd6 x:0 0 0 2024-09-16T09:46:14.360 INFO:tasks.workunit.client.0.smithi111.stdout:5/616: stat d19/d1b/d1e/d21/d29/d32 0 2024-09-16T09:46:14.363 INFO:tasks.workunit.client.0.smithi111.stdout:4/494: dwrite d2/d6/f14 [0,4194304] 0 2024-09-16T09:46:14.364 INFO:tasks.workunit.client.0.smithi111.stdout:0/550: dwrite d0/f17 [4194304,4194304] 0 2024-09-16T09:46:14.378 INFO:tasks.workunit.client.0.smithi111.stdout:4/495: dwrite d2/d30/d44/f90 [0,4194304] 0 2024-09-16T09:46:14.378 INFO:tasks.workunit.client.0.smithi111.stdout:3/715: creat d5/da/db/d35/d41/da0/feb x:0 0 0 2024-09-16T09:46:14.378 INFO:tasks.workunit.client.0.smithi111.stdout:3/716: chown d5/da/db/d35/d41/da0/dd9/fb4 67400265 1 2024-09-16T09:46:14.379 INFO:tasks.workunit.client.0.smithi111.stdout:2/685: creat d0/d2/d59/d86/d96/ff4 x:0 0 0 2024-09-16T09:46:14.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:14 smithi111 ceph-mon[27997]: pgmap v260: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 96 MiB/s rd, 119 MiB/s wr, 470 op/s 2024-09-16T09:46:14.383 INFO:tasks.workunit.client.0.smithi111.stdout:9/466: rename d0/d6/d30/d81/l8b to d0/d6/d30/d47/la0 0 2024-09-16T09:46:14.384 INFO:tasks.workunit.client.0.smithi111.stdout:8/590: getdents d3/de/d34 0 2024-09-16T09:46:14.386 INFO:tasks.workunit.client.0.smithi111.stdout:0/551: unlink d0/d1d/d67/d3a/d92/c9e 0 2024-09-16T09:46:14.388 INFO:tasks.workunit.client.0.smithi111.stdout:7/462: mkdir d1/d3e/d9f 0 2024-09-16T09:46:14.388 INFO:tasks.workunit.client.0.smithi111.stdout:3/717: dread d5/da/db/d3a/d6d/de7/f83 [0,4194304] 0 2024-09-16T09:46:14.390 INFO:tasks.workunit.client.0.smithi111.stdout:4/496: rmdir d2/d6/dd/d1b 39 2024-09-16T09:46:14.392 INFO:tasks.workunit.client.0.smithi111.stdout:2/686: unlink d0/d29/d80/f85 0 2024-09-16T09:46:14.392 INFO:tasks.workunit.client.0.smithi111.stdout:2/687: write d0/d22/fb7 [412088,74577] 0 2024-09-16T09:46:14.395 INFO:tasks.workunit.client.0.smithi111.stdout:5/617: rename d19/d1b/d1e/d21/d29/d32/d8f/dc8 to d19/d1b/d27/d2e/d4a/d4b/dd7 0 2024-09-16T09:46:14.395 INFO:tasks.workunit.client.0.smithi111.stdout:5/618: chown d19/d1b/d27/d9d/fc7 48023748 1 2024-09-16T09:46:14.397 INFO:tasks.workunit.client.0.smithi111.stdout:9/467: fsync d0/f3f 0 2024-09-16T09:46:14.398 INFO:tasks.workunit.client.0.smithi111.stdout:8/591: mknod d3/de/d1e/d2e/d2f/d4c/cc1 0 2024-09-16T09:46:14.400 INFO:tasks.workunit.client.0.smithi111.stdout:0/552: creat d0/fc0 x:0 0 0 2024-09-16T09:46:14.401 INFO:tasks.workunit.client.0.smithi111.stdout:7/463: mknod d1/d16/d17/d18/d4f/d88/ca0 0 2024-09-16T09:46:14.404 INFO:tasks.workunit.client.0.smithi111.stdout:3/718: creat d5/da/d42/d74/da4/fec x:0 0 0 2024-09-16T09:46:14.404 INFO:tasks.workunit.client.0.smithi111.stdout:4/497: rmdir d2/d6/dd/d1c 39 2024-09-16T09:46:14.404 INFO:tasks.workunit.client.0.smithi111.stdout:4/498: stat d2/d6/dd/d1c/f54 0 2024-09-16T09:46:14.405 INFO:tasks.workunit.client.0.smithi111.stdout:4/499: write d2/d30/d44/f47 [2722847,126926] 0 2024-09-16T09:46:14.409 INFO:tasks.workunit.client.0.smithi111.stdout:7/464: dread d1/d16/d27/f8d [0,4194304] 0 2024-09-16T09:46:14.410 INFO:tasks.workunit.client.0.smithi111.stdout:9/468: rename d0/d21/d22/f99 to d0/d48/fa1 0 2024-09-16T09:46:14.410 INFO:tasks.workunit.client.0.smithi111.stdout:9/469: stat d0/d7b 0 2024-09-16T09:46:14.412 INFO:tasks.workunit.client.0.smithi111.stdout:8/592: truncate d3/de/d1e/d2e/d2f/da8/dbe/f69 805023 0 2024-09-16T09:46:14.414 INFO:tasks.workunit.client.0.smithi111.stdout:4/500: rmdir d2/d30/d44 39 2024-09-16T09:46:14.414 INFO:tasks.workunit.client.0.smithi111.stdout:4/501: chown d2/d6/dd/d1b/d38/d64/f6b 2133658959 1 2024-09-16T09:46:14.415 INFO:tasks.workunit.client.0.smithi111.stdout:7/465: creat d1/d16/d17/d18/d4f/d56/fa1 x:0 0 0 2024-09-16T09:46:14.415 INFO:tasks.workunit.client.0.smithi111.stdout:7/466: write d1/d16/d17/d18/d1d/d2f/f75 [296405,109799] 0 2024-09-16T09:46:14.415 INFO:tasks.workunit.client.0.smithi111.stdout:2/688: dwrite d0/f55 [0,4194304] 0 2024-09-16T09:46:14.416 INFO:tasks.workunit.client.0.smithi111.stdout:2/689: write d0/da/f5f [5831,117440] 0 2024-09-16T09:46:14.416 INFO:tasks.workunit.client.0.smithi111.stdout:2/690: readlink d0/d2/d44/le4 0 2024-09-16T09:46:14.416 INFO:tasks.workunit.client.0.smithi111.stdout:9/470: mkdir d0/d6/d8/da2 0 2024-09-16T09:46:14.416 INFO:tasks.workunit.client.0.smithi111.stdout:9/471: write d0/d6/f90 [431608,99505] 0 2024-09-16T09:46:14.417 INFO:tasks.workunit.client.0.smithi111.stdout:8/593: creat d3/de/fc2 x:0 0 0 2024-09-16T09:46:14.418 INFO:tasks.workunit.client.0.smithi111.stdout:0/553: mkdir d0/dc1 0 2024-09-16T09:46:14.419 INFO:tasks.workunit.client.0.smithi111.stdout:4/502: creat d2/d6/dd/d1b/d6d/d8f/f9a x:0 0 0 2024-09-16T09:46:14.420 INFO:tasks.workunit.client.0.smithi111.stdout:7/467: truncate d1/d16/d17/d18/d1b/f6d 130111 0 2024-09-16T09:46:14.421 INFO:tasks.workunit.client.0.smithi111.stdout:4/503: dread d2/d6/dd/d1b/d38/d64/d65/f70 [0,4194304] 0 2024-09-16T09:46:14.421 INFO:tasks.workunit.client.0.smithi111.stdout:4/504: chown d2/d6/dd/d1c/c75 5 1 2024-09-16T09:46:14.424 INFO:tasks.workunit.client.0.smithi111.stdout:2/691: link d0/d45/d5c/f6b d0/d45/d5c/d67/d63/dd4/dc3/ff5 0 2024-09-16T09:46:14.425 INFO:tasks.workunit.client.0.smithi111.stdout:9/472: write d0/d6/d30/f39 [178844,44810] 0 2024-09-16T09:46:14.425 INFO:tasks.workunit.client.0.smithi111.stdout:9/473: write d0/d6/d8/f72 [1777478,81343] 0 2024-09-16T09:46:14.426 INFO:tasks.workunit.client.0.smithi111.stdout:8/594: mkdir d3/dc3 0 2024-09-16T09:46:14.427 INFO:tasks.workunit.client.0.smithi111.stdout:0/554: symlink d0/d1d/lc2 0 2024-09-16T09:46:14.429 INFO:tasks.workunit.client.0.smithi111.stdout:7/468: unlink d1/d16/d17/d18/f4a 0 2024-09-16T09:46:14.429 INFO:tasks.workunit.client.0.smithi111.stdout:4/505: symlink d2/d6/dd/d1b/d38/d64/d92/l9b 0 2024-09-16T09:46:14.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/692: creat d0/d2/d59/d86/d96/dc7/ff6 x:0 0 0 2024-09-16T09:46:14.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/693: write d0/d2/d61/f84 [795136,16876] 0 2024-09-16T09:46:14.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/694: chown d0/d45/d5c/dc6 0 1 2024-09-16T09:46:14.433 INFO:tasks.workunit.client.0.smithi111.stdout:9/474: creat d0/d48/d9d/fa3 x:0 0 0 2024-09-16T09:46:14.436 INFO:tasks.workunit.client.0.smithi111.stdout:4/506: dread d2/d6/fe [0,4194304] 0 2024-09-16T09:46:14.436 INFO:tasks.workunit.client.0.smithi111.stdout:8/595: getdents d3/da/df 0 2024-09-16T09:46:14.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:14 smithi114 ceph-mon[35635]: pgmap v260: 65 pgs: 65 active+clean; 1.1 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 96 MiB/s rd, 119 MiB/s wr, 470 op/s 2024-09-16T09:46:14.438 INFO:tasks.workunit.client.0.smithi111.stdout:0/555: symlink d0/d1d/d58/d83/lc3 0 2024-09-16T09:46:14.440 INFO:tasks.workunit.client.0.smithi111.stdout:7/469: symlink d1/d3e/d9e/la2 0 2024-09-16T09:46:14.443 INFO:tasks.workunit.client.0.smithi111.stdout:4/507: unlink d2/d6/l89 0 2024-09-16T09:46:14.443 INFO:tasks.workunit.client.0.smithi111.stdout:4/508: readlink d2/d6/dd/l24 0 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:8/596: symlink d3/dc3/lc4 0 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:8/597: dread - d3/de/d1e/fbf zero size 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:8/598: write d3/de/d6e/d8f/fb2 [3291196,32416] 0 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:8/599: chown d3/da/ld 3 1 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:8/600: fsync d3/de/d34/f4e 0 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:8/601: read d3/de/d1e/d2e/d2f/f5e [2189462,109567] 0 2024-09-16T09:46:14.445 INFO:tasks.workunit.client.0.smithi111.stdout:4/509: dread d2/d6/dd/f76 [0,4194304] 0 2024-09-16T09:46:14.447 INFO:tasks.workunit.client.0.smithi111.stdout:2/695: dwrite d0/d2/f17 [4194304,4194304] 0 2024-09-16T09:46:14.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/556: creat d0/d1d/d67/fc4 x:0 0 0 2024-09-16T09:46:14.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/557: dread - d0/d1d/d67/d3a/d3d/d59/f94 zero size 2024-09-16T09:46:14.450 INFO:tasks.workunit.client.0.smithi111.stdout:7/470: mkdir d1/d20/da3 0 2024-09-16T09:46:14.450 INFO:tasks.workunit.client.0.smithi111.stdout:7/471: stat d1/d16/d17/d18/d1d/d2f/f77 0 2024-09-16T09:46:14.476 INFO:tasks.workunit.client.0.smithi111.stdout:8/602: dwrite d3/da/df/f25 [0,4194304] 0 2024-09-16T09:46:14.478 INFO:tasks.workunit.client.0.smithi111.stdout:0/558: dwrite d0/d1d/d67/d3a/d92/f97 [0,4194304] 0 2024-09-16T09:46:14.478 INFO:tasks.workunit.client.0.smithi111.stdout:0/559: fdatasync d0/d1d/d67/d3a/d3d/fbf 0 2024-09-16T09:46:14.478 INFO:tasks.workunit.client.0.smithi111.stdout:0/560: stat d0/d1d/d67/d3a/d80/ca8 0 2024-09-16T09:46:14.495 INFO:tasks.workunit.client.0.smithi111.stdout:0/561: dwrite d0/f13 [0,4194304] 0 2024-09-16T09:46:14.516 INFO:tasks.workunit.client.0.smithi111.stdout:9/475: rename d0/d6/d45/f84 to d0/d6c/d70/fa4 0 2024-09-16T09:46:14.523 INFO:tasks.workunit.client.0.smithi111.stdout:4/510: readlink d2/d6/l31 0 2024-09-16T09:46:14.523 INFO:tasks.workunit.client.0.smithi111.stdout:4/511: dread - d2/f42 zero size 2024-09-16T09:46:14.523 INFO:tasks.workunit.client.0.smithi111.stdout:4/512: fdatasync d2/d6/dd/d1c/d2f/d4e/f59 0 2024-09-16T09:46:14.529 INFO:tasks.workunit.client.0.smithi111.stdout:2/696: creat d0/d22/ff7 x:0 0 0 2024-09-16T09:46:14.529 INFO:tasks.workunit.client.0.smithi111.stdout:7/472: symlink d1/d16/d17/d18/d1d/la4 0 2024-09-16T09:46:14.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/603: getdents d3/d26/d6d/db6 0 2024-09-16T09:46:14.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/604: read - d3/fa7 zero size 2024-09-16T09:46:14.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/605: chown d3/d26/l94 20634 1 2024-09-16T09:46:14.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/606: dread - d3/de/d6e/f81 zero size 2024-09-16T09:46:14.533 INFO:tasks.workunit.client.0.smithi111.stdout:8/607: getdents d3/d26/d6d/db6 0 2024-09-16T09:46:14.534 INFO:tasks.workunit.client.0.smithi111.stdout:8/608: fsync d3/d26/d6d/db6/fb9 0 2024-09-16T09:46:14.534 INFO:tasks.workunit.client.0.smithi111.stdout:8/609: chown d3/d26/f40 153499 1 2024-09-16T09:46:14.534 INFO:tasks.workunit.client.0.smithi111.stdout:9/476: dwrite d0/d6/d8/de/d56/d4e/f73 [0,4194304] 0 2024-09-16T09:46:14.534 INFO:tasks.workunit.client.0.smithi111.stdout:0/562: symlink d0/d1d/d67/lc5 0 2024-09-16T09:46:14.543 INFO:tasks.workunit.client.0.smithi111.stdout:4/513: mkdir d2/d6/dd/d1c/d2f/d6c/d9c 0 2024-09-16T09:46:14.544 INFO:tasks.workunit.client.0.smithi111.stdout:2/697: link d0/d45/d5c/d67/d63/dd4/dc3/dc8/ce6 d0/d45/d5c/cf8 0 2024-09-16T09:46:14.545 INFO:tasks.workunit.client.0.smithi111.stdout:7/473: mkdir d1/d16/d17/d18/d1b/d79/da5 0 2024-09-16T09:46:14.549 INFO:tasks.workunit.client.0.smithi111.stdout:8/610: symlink d3/lc5 0 2024-09-16T09:46:14.549 INFO:tasks.workunit.client.0.smithi111.stdout:8/611: chown d3/de/d1e/d2e/d2f/dbc 1 1 2024-09-16T09:46:14.552 INFO:tasks.workunit.client.0.smithi111.stdout:4/514: dread d2/d6/dd/d1c/d2f/f58 [0,4194304] 0 2024-09-16T09:46:14.552 INFO:tasks.workunit.client.0.smithi111.stdout:4/515: fsync d2/f32 0 2024-09-16T09:46:14.553 INFO:tasks.workunit.client.0.smithi111.stdout:9/477: creat d0/d7b/fa5 x:0 0 0 2024-09-16T09:46:14.554 INFO:tasks.workunit.client.0.smithi111.stdout:0/563: unlink d0/d1d/d67/d3a/d80/ca8 0 2024-09-16T09:46:14.560 INFO:tasks.workunit.client.0.smithi111.stdout:9/478: dread d0/d21/d22/d6e/d51/d76/f98 [0,4194304] 0 2024-09-16T09:46:14.560 INFO:tasks.workunit.client.0.smithi111.stdout:9/479: stat d0/d6/d30/d47 0 2024-09-16T09:46:14.560 INFO:tasks.workunit.client.0.smithi111.stdout:8/612: link d3/de/d1e/d2e/d74/d83/da2/fab d3/d26/d6d/db6/fc6 0 2024-09-16T09:46:14.561 INFO:tasks.workunit.client.0.smithi111.stdout:4/516: creat d2/d6/dd/f9d x:0 0 0 2024-09-16T09:46:14.561 INFO:tasks.workunit.client.0.smithi111.stdout:4/517: readlink d2/d6/l31 0 2024-09-16T09:46:14.562 INFO:tasks.workunit.client.0.smithi111.stdout:7/474: symlink d1/d16/d17/d18/d4f/d56/la6 0 2024-09-16T09:46:14.563 INFO:tasks.workunit.client.0.smithi111.stdout:9/480: creat d0/d21/d22/fa6 x:0 0 0 2024-09-16T09:46:14.565 INFO:tasks.workunit.client.0.smithi111.stdout:0/564: write d0/d1d/d58/d64/d5e/fb5 [806498,52440] 0 2024-09-16T09:46:14.566 INFO:tasks.workunit.client.0.smithi111.stdout:8/613: creat d3/de/d1e/d2e/d2f/da8/dbe/fc7 x:0 0 0 2024-09-16T09:46:14.567 INFO:tasks.workunit.client.0.smithi111.stdout:8/614: write d3/de/d1e/d2e/d74/f86 [196966,73971] 0 2024-09-16T09:46:14.567 INFO:tasks.workunit.client.0.smithi111.stdout:4/518: mkdir d2/d6/dd/d1c/d2f/d9e 0 2024-09-16T09:46:14.569 INFO:tasks.workunit.client.0.smithi111.stdout:7/475: mkdir d1/d16/d27/da7 0 2024-09-16T09:46:14.571 INFO:tasks.workunit.client.0.smithi111.stdout:9/481: rename d0/d48/l77 to d0/d21/d22/d6e/d51/la7 0 2024-09-16T09:46:14.572 INFO:tasks.workunit.client.0.smithi111.stdout:8/615: creat d3/da/db/fc8 x:0 0 0 2024-09-16T09:46:14.573 INFO:tasks.workunit.client.0.smithi111.stdout:8/616: stat d3/de/d1e/d2e/d74/dad 0 2024-09-16T09:46:14.573 INFO:tasks.workunit.client.0.smithi111.stdout:4/519: symlink d2/d6/dd/d1b/d38/d64/l9f 0 2024-09-16T09:46:14.574 INFO:tasks.workunit.client.0.smithi111.stdout:7/476: mkdir d1/d16/d27/da7/da8 0 2024-09-16T09:46:14.576 INFO:tasks.workunit.client.0.smithi111.stdout:9/482: creat d0/d6/d30/d81/fa8 x:0 0 0 2024-09-16T09:46:14.577 INFO:tasks.workunit.client.0.smithi111.stdout:8/617: mknod d3/de/d6e/d8f/cc9 0 2024-09-16T09:46:14.577 INFO:tasks.workunit.client.0.smithi111.stdout:8/618: chown d3/de/d1e/d2e/d74/d83/da2 242501784 1 2024-09-16T09:46:14.578 INFO:tasks.workunit.client.0.smithi111.stdout:7/477: creat d1/d3e/fa9 x:0 0 0 2024-09-16T09:46:14.579 INFO:tasks.workunit.client.0.smithi111.stdout:9/483: mkdir d0/d6/d75/da9 0 2024-09-16T09:46:14.580 INFO:tasks.workunit.client.0.smithi111.stdout:9/484: write d0/d6/d45/f4c [3692973,97608] 0 2024-09-16T09:46:14.580 INFO:tasks.workunit.client.0.smithi111.stdout:9/485: chown d0/d6/d8/l9c 76276061 1 2024-09-16T09:46:14.585 INFO:tasks.workunit.client.0.smithi111.stdout:8/619: creat d3/de/d1e/d2e/d74/dad/dba/fca x:0 0 0 2024-09-16T09:46:14.585 INFO:tasks.workunit.client.0.smithi111.stdout:7/478: write d1/d9/f15 [5407817,59967] 0 2024-09-16T09:46:14.585 INFO:tasks.workunit.client.0.smithi111.stdout:8/620: mknod d3/de/d1e/d2e/d74/ccb 0 2024-09-16T09:46:14.586 INFO:tasks.workunit.client.0.smithi111.stdout:8/621: mkdir d3/da/df/dcc 0 2024-09-16T09:46:14.587 INFO:tasks.workunit.client.0.smithi111.stdout:8/622: fdatasync d3/de/d1e/d2e/d74/d83/fb4 0 2024-09-16T09:46:14.587 INFO:tasks.workunit.client.0.smithi111.stdout:8/623: dread - d3/de/d1e/d2e/f92 zero size 2024-09-16T09:46:14.587 INFO:tasks.workunit.client.0.smithi111.stdout:2/698: getdents d0/d45/d5c 0 2024-09-16T09:46:14.587 INFO:tasks.workunit.client.0.smithi111.stdout:2/699: write d0/da/d4e/f74 [1780222,80376] 0 2024-09-16T09:46:14.588 INFO:tasks.workunit.client.0.smithi111.stdout:8/624: mkdir d3/dcd 0 2024-09-16T09:46:14.590 INFO:tasks.workunit.client.0.smithi111.stdout:2/700: rename d0/d2/c9a to d0/d2/cf9 0 2024-09-16T09:46:14.590 INFO:tasks.workunit.client.0.smithi111.stdout:8/625: getdents d3/de/d1e/d2e/d74/d83 0 2024-09-16T09:46:14.593 INFO:tasks.workunit.client.0.smithi111.stdout:2/701: mkdir d0/d29/dfa 0 2024-09-16T09:46:14.593 INFO:tasks.workunit.client.0.smithi111.stdout:2/702: truncate d0/d29/f31 8779744 0 2024-09-16T09:46:14.593 INFO:tasks.workunit.client.0.smithi111.stdout:2/703: chown d0/d45/d5c/d67/f70 3658 1 2024-09-16T09:46:14.593 INFO:tasks.workunit.client.0.smithi111.stdout:8/626: mkdir d3/de/d1e/d2e/dce 0 2024-09-16T09:46:14.594 INFO:tasks.workunit.client.0.smithi111.stdout:9/486: write d0/d6/d45/f4c [4589179,36935] 0 2024-09-16T09:46:14.595 INFO:tasks.workunit.client.0.smithi111.stdout:8/627: link d3/da/db/c72 d3/de/d1e/d2e/d2f/da8/dbe/ccf 0 2024-09-16T09:46:14.596 INFO:tasks.workunit.client.0.smithi111.stdout:9/487: rmdir d0/d6/d8/de 39 2024-09-16T09:46:14.597 INFO:tasks.workunit.client.0.smithi111.stdout:8/628: rmdir d3/dcd 0 2024-09-16T09:46:14.598 INFO:tasks.workunit.client.0.smithi111.stdout:9/488: creat d0/d7b/faa x:0 0 0 2024-09-16T09:46:14.599 INFO:tasks.workunit.client.0.smithi111.stdout:8/629: symlink d3/d26/d6d/ld0 0 2024-09-16T09:46:14.599 INFO:tasks.workunit.client.0.smithi111.stdout:4/520: dwrite d2/f7d [0,4194304] 0 2024-09-16T09:46:14.600 INFO:tasks.workunit.client.0.smithi111.stdout:9/489: mkdir d0/d21/d22/d6e/dab 0 2024-09-16T09:46:14.600 INFO:tasks.workunit.client.0.smithi111.stdout:9/490: dread - d0/d21/d22/fa6 zero size 2024-09-16T09:46:14.604 INFO:tasks.workunit.client.0.smithi111.stdout:4/521: mkdir d2/d6/dd/d1b/d38/d64/d92/da0 0 2024-09-16T09:46:14.604 INFO:tasks.workunit.client.0.smithi111.stdout:2/704: dread d0/d22/f24 [0,4194304] 0 2024-09-16T09:46:14.604 INFO:tasks.workunit.client.0.smithi111.stdout:0/565: dwrite d0/d26/f2c [4194304,4194304] 0 2024-09-16T09:46:14.604 INFO:tasks.workunit.client.0.smithi111.stdout:2/705: stat d0/d2/d59/d86/d96/ff4 0 2024-09-16T09:46:14.605 INFO:tasks.workunit.client.0.smithi111.stdout:9/491: mkdir d0/d7b/dac 0 2024-09-16T09:46:14.605 INFO:tasks.workunit.client.0.smithi111.stdout:9/492: write d0/d21/f66 [622845,102993] 0 2024-09-16T09:46:14.605 INFO:tasks.workunit.client.0.smithi111.stdout:9/493: readlink d0/d6/d8/de/d56/d4e/l79 0 2024-09-16T09:46:14.611 INFO:tasks.workunit.client.0.smithi111.stdout:4/522: dread d2/d6/dd/d1c/d2f/f46 [0,4194304] 0 2024-09-16T09:46:14.611 INFO:tasks.workunit.client.0.smithi111.stdout:0/566: rmdir d0/d1d 39 2024-09-16T09:46:14.614 INFO:tasks.workunit.client.0.smithi111.stdout:4/523: mkdir d2/d30/da1 0 2024-09-16T09:46:14.614 INFO:tasks.workunit.client.0.smithi111.stdout:2/706: dread d0/d22/fcc [0,4194304] 0 2024-09-16T09:46:14.615 INFO:tasks.workunit.client.0.smithi111.stdout:0/567: creat d0/dc1/fc6 x:0 0 0 2024-09-16T09:46:14.616 INFO:tasks.workunit.client.0.smithi111.stdout:4/524: symlink d2/d6/dd/d1c/d2f/d8d/la2 0 2024-09-16T09:46:14.617 INFO:tasks.workunit.client.0.smithi111.stdout:9/494: write d0/d48/f80 [2027453,81735] 0 2024-09-16T09:46:14.617 INFO:tasks.workunit.client.0.smithi111.stdout:2/707: creat d0/d45/d5c/ffb x:0 0 0 2024-09-16T09:46:14.618 INFO:tasks.workunit.client.0.smithi111.stdout:0/568: rename d0/d1d/d67/d3a/d3d/lba to d0/d1d/d67/d3a/d3d/lc7 0 2024-09-16T09:46:14.618 INFO:tasks.workunit.client.0.smithi111.stdout:0/569: chown d0/d1d/d67/d3a/d80/f6d 2073729 1 2024-09-16T09:46:14.619 INFO:tasks.workunit.client.0.smithi111.stdout:4/525: rename d2/d6/dd/d1c/d2f/f58 to d2/d6/dd/d1c/d2f/fa3 0 2024-09-16T09:46:14.619 INFO:tasks.workunit.client.0.smithi111.stdout:4/526: truncate d2/d6/dd/d1b/d38/f68 1342594 0 2024-09-16T09:46:14.619 INFO:tasks.workunit.client.0.smithi111.stdout:8/630: dwrite d3/de/d1e/d2e/d74/f86 [0,4194304] 0 2024-09-16T09:46:14.620 INFO:tasks.workunit.client.0.smithi111.stdout:0/570: creat d0/d1d/d67/d3a/d3d/d59/fc8 x:0 0 0 2024-09-16T09:46:14.620 INFO:tasks.workunit.client.0.smithi111.stdout:0/571: write d0/da4/f82 [486250,77222] 0 2024-09-16T09:46:14.620 INFO:tasks.workunit.client.0.smithi111.stdout:0/572: stat d0/c1 0 2024-09-16T09:46:14.621 INFO:tasks.workunit.client.0.smithi111.stdout:9/495: read d0/f3f [249215,32163] 0 2024-09-16T09:46:14.622 INFO:tasks.workunit.client.0.smithi111.stdout:8/631: creat d3/d26/d6d/fd1 x:0 0 0 2024-09-16T09:46:14.622 INFO:tasks.workunit.client.0.smithi111.stdout:8/632: fsync d3/da/df/f47 0 2024-09-16T09:46:14.625 INFO:tasks.workunit.client.0.smithi111.stdout:8/633: creat d3/de/fd2 x:0 0 0 2024-09-16T09:46:14.630 INFO:tasks.workunit.client.0.smithi111.stdout:8/634: creat d3/de/d1e/d2e/d74/fd3 x:0 0 0 2024-09-16T09:46:14.632 INFO:tasks.workunit.client.0.smithi111.stdout:0/573: read d0/d1d/d67/d3a/d3d/f46 [2540343,12368] 0 2024-09-16T09:46:14.632 INFO:tasks.workunit.client.0.smithi111.stdout:0/574: dread - d0/d1d/d67/f65 zero size 2024-09-16T09:46:14.632 INFO:tasks.workunit.client.0.smithi111.stdout:8/635: unlink d3/de/d1e/d2e/d2f/da8/dbe/fa4 0 2024-09-16T09:46:14.636 INFO:tasks.workunit.client.0.smithi111.stdout:4/527: dread d2/d6/dd/d1c/d2f/f36 [0,4194304] 0 2024-09-16T09:46:14.637 INFO:tasks.workunit.client.0.smithi111.stdout:4/528: readlink d2/d6/dd/d1b/d38/d64/d92/l9b 0 2024-09-16T09:46:14.637 INFO:tasks.workunit.client.0.smithi111.stdout:2/708: dwrite d0/d45/d5c/ffb [0,4194304] 0 2024-09-16T09:46:14.640 INFO:tasks.workunit.client.0.smithi111.stdout:8/636: mknod d3/de/d1e/d2e/d2f/cd4 0 2024-09-16T09:46:14.640 INFO:tasks.workunit.client.0.smithi111.stdout:8/637: write d3/de/d6e/d8f/fb2 [3158888,69909] 0 2024-09-16T09:46:14.644 INFO:tasks.workunit.client.0.smithi111.stdout:4/529: unlink d2/d6/dd/d1b/f29 0 2024-09-16T09:46:14.644 INFO:tasks.workunit.client.0.smithi111.stdout:4/530: dread - d2/d6/dd/d1b/f5d zero size 2024-09-16T09:46:14.647 INFO:tasks.workunit.client.0.smithi111.stdout:7/479: rename d1/d16/d27 to d1/d16/d17/d18/d1b/d79/daa 0 2024-09-16T09:46:14.648 INFO:tasks.workunit.client.0.smithi111.stdout:0/575: dwrite d0/f32 [0,4194304] 0 2024-09-16T09:46:14.661 INFO:tasks.workunit.client.0.smithi111.stdout:4/531: dwrite d2/f8 [0,4194304] 0 2024-09-16T09:46:14.661 INFO:tasks.workunit.client.0.smithi111.stdout:4/532: write d2/d6/dd/f9d [686110,115037] 0 2024-09-16T09:46:14.661 INFO:tasks.workunit.client.0.smithi111.stdout:4/533: stat d2/d6/dd/d1c/f43 0 2024-09-16T09:46:14.661 INFO:tasks.workunit.client.0.smithi111.stdout:2/709: rename d0/d2/d44/c6d to d0/d45/d81/cfc 0 2024-09-16T09:46:14.661 INFO:tasks.workunit.client.0.smithi111.stdout:0/576: write d0/d1d/d67/d3a/fac [3143132,127110] 0 2024-09-16T09:46:14.661 INFO:tasks.workunit.client.0.smithi111.stdout:7/480: mknod d1/d16/d17/d18/d1b/d79/daa/cab 0 2024-09-16T09:46:14.665 INFO:tasks.workunit.client.0.smithi111.stdout:4/534: truncate d2/d6/dd/d1c/d2f/fa3 4775080 0 2024-09-16T09:46:14.666 INFO:tasks.workunit.client.0.smithi111.stdout:8/638: rename d3/c7e to d3/de/d1e/d2e/d2f/da8/dbe/d6b/cd5 0 2024-09-16T09:46:14.668 INFO:tasks.workunit.client.0.smithi111.stdout:7/481: mkdir d1/d3e/d9e/dac 0 2024-09-16T09:46:14.669 INFO:tasks.workunit.client.0.smithi111.stdout:8/639: mknod d3/de/d6e/d8f/cd6 0 2024-09-16T09:46:14.669 INFO:tasks.workunit.client.0.smithi111.stdout:8/640: write d3/f43 [370524,65313] 0 2024-09-16T09:46:14.672 INFO:tasks.workunit.client.0.smithi111.stdout:8/641: rename d3/da/df to d3/da/db/d59/dd7 0 2024-09-16T09:46:14.674 INFO:tasks.workunit.client.0.smithi111.stdout:4/535: write d2/d6/dd/d1c/d2f/f46 [1056237,5773] 0 2024-09-16T09:46:14.674 INFO:tasks.workunit.client.0.smithi111.stdout:4/536: fdatasync d2/d6/dd/d1c/d2f/f36 0 2024-09-16T09:46:14.677 INFO:tasks.workunit.client.0.smithi111.stdout:4/537: truncate d2/d6/dd/d1c/d2f/d4e/f74 3082556 0 2024-09-16T09:46:14.680 INFO:tasks.workunit.client.0.smithi111.stdout:0/577: dread d0/d1d/d58/d64/d4f/f7f [0,4194304] 0 2024-09-16T09:46:14.682 INFO:tasks.workunit.client.0.smithi111.stdout:0/578: write d0/d1d/f30 [724015,79946] 0 2024-09-16T09:46:14.683 INFO:tasks.workunit.client.0.smithi111.stdout:2/710: dwrite d0/da/f3f [0,4194304] 0 2024-09-16T09:46:14.688 INFO:tasks.workunit.client.0.smithi111.stdout:8/642: write d3/de/d1e/d2e/d2f/da8/dbe/f9d [4046889,105940] 0 2024-09-16T09:46:14.688 INFO:tasks.workunit.client.0.smithi111.stdout:8/643: chown d3/de/d1e/d2e/d2f/f8d 26 1 2024-09-16T09:46:14.689 INFO:tasks.workunit.client.0.smithi111.stdout:8/644: fsync d3/de/d1e/d2e/d74/dad/dba/fca 0 2024-09-16T09:46:14.690 INFO:tasks.workunit.client.0.smithi111.stdout:2/711: rename d0/d45/d81/f97 to d0/d2/d59/d86/d96/ffd 0 2024-09-16T09:46:14.691 INFO:tasks.workunit.client.0.smithi111.stdout:2/712: dread d0/d45/d5c/d67/f8c [0,4194304] 0 2024-09-16T09:46:14.691 INFO:tasks.workunit.client.0.smithi111.stdout:2/713: chown d0 70 1 2024-09-16T09:46:14.691 INFO:tasks.workunit.client.0.smithi111.stdout:2/714: chown d0/f4 6844 1 2024-09-16T09:46:14.693 INFO:tasks.workunit.client.0.smithi111.stdout:0/579: dread d0/d1d/f3c [0,4194304] 0 2024-09-16T09:46:14.693 INFO:tasks.workunit.client.0.smithi111.stdout:0/580: readlink d0/d1d/d67/d3a/d3d/d59/lb3 0 2024-09-16T09:46:14.693 INFO:tasks.workunit.client.0.smithi111.stdout:0/581: chown d0/d1d/d67 45615705 1 2024-09-16T09:46:14.695 INFO:tasks.workunit.client.0.smithi111.stdout:0/582: creat d0/d1d/d67/d3a/d77/dad/fc9 x:0 0 0 2024-09-16T09:46:14.696 INFO:tasks.workunit.client.0.smithi111.stdout:0/583: rename d0/d1d/d67/d3a/l47 to d0/d1d/d58/d83/lca 0 2024-09-16T09:46:14.700 INFO:tasks.workunit.client.0.smithi111.stdout:7/482: dwrite d1/d9/f3c [0,4194304] 0 2024-09-16T09:46:14.701 INFO:tasks.workunit.client.0.smithi111.stdout:0/584: mknod d0/d1d/d58/d64/d4f/ccb 0 2024-09-16T09:46:14.701 INFO:tasks.workunit.client.0.smithi111.stdout:8/645: write d3/de/d1e/f98 [2789166,130813] 0 2024-09-16T09:46:14.708 INFO:tasks.workunit.client.0.smithi111.stdout:8/646: rename d3/de/d34 to d3/da/db/d59/dd7/d9e/dd8 0 2024-09-16T09:46:14.711 INFO:tasks.workunit.client.0.smithi111.stdout:7/483: creat d1/d16/d17/d18/d4f/d88/fad x:0 0 0 2024-09-16T09:46:14.711 INFO:tasks.workunit.client.0.smithi111.stdout:7/484: write d1/d9/fa [4809460,3246] 0 2024-09-16T09:46:14.713 INFO:tasks.workunit.client.0.smithi111.stdout:0/585: symlink d0/d26/d35/lcc 0 2024-09-16T09:46:14.715 INFO:tasks.workunit.client.0.smithi111.stdout:8/647: rename d3/de/d1e/d2e/d2f/f5d to d3/d26/fd9 0 2024-09-16T09:46:14.716 INFO:tasks.workunit.client.0.smithi111.stdout:8/648: fdatasync d3/de/d1e/d2e/d2f/f80 0 2024-09-16T09:46:14.718 INFO:tasks.workunit.client.0.smithi111.stdout:2/715: dwrite d0/da/f3b [0,4194304] 0 2024-09-16T09:46:14.718 INFO:tasks.workunit.client.0.smithi111.stdout:2/716: fsync d0/d2/d5a/f68 0 2024-09-16T09:46:14.718 INFO:tasks.workunit.client.0.smithi111.stdout:0/586: rename d0/d26/f2c to d0/d26/d35/d86/fcd 0 2024-09-16T09:46:14.718 INFO:tasks.workunit.client.0.smithi111.stdout:0/587: chown d0/d26/d35/la6 9 1 2024-09-16T09:46:14.719 INFO:tasks.workunit.client.0.smithi111.stdout:8/649: stat d3/de/d1e/d2e/l95 0 2024-09-16T09:46:14.722 INFO:tasks.workunit.client.0.smithi111.stdout:0/588: getdents d0/d1d/d67/d3a/d80 0 2024-09-16T09:46:14.724 INFO:tasks.workunit.client.0.smithi111.stdout:8/650: mknod d3/d26/d6d/cda 0 2024-09-16T09:46:14.725 INFO:tasks.workunit.client.0.smithi111.stdout:8/651: creat d3/de/d6e/fdb x:0 0 0 2024-09-16T09:46:14.727 INFO:tasks.workunit.client.0.smithi111.stdout:8/652: dread d3/da/db/f7b [0,4194304] 0 2024-09-16T09:46:14.727 INFO:tasks.workunit.client.0.smithi111.stdout:8/653: read - d3/de/d1e/fbf zero size 2024-09-16T09:46:14.727 INFO:tasks.workunit.client.0.smithi111.stdout:8/654: fsync d3/f43 0 2024-09-16T09:46:14.729 INFO:tasks.workunit.client.0.smithi111.stdout:7/485: dread d1/d16/d17/d18/d1d/d2f/f77 [0,4194304] 0 2024-09-16T09:46:14.738 INFO:tasks.workunit.client.0.smithi111.stdout:0/589: dread d0/d1d/d67/d3a/d3d/f71 [0,4194304] 0 2024-09-16T09:46:14.743 INFO:tasks.workunit.client.0.smithi111.stdout:6/485: sync 2024-09-16T09:46:14.743 INFO:tasks.workunit.client.0.smithi111.stdout:1/553: sync 2024-09-16T09:46:14.746 INFO:tasks.workunit.client.0.smithi111.stdout:6/486: link d0/df/d49/l6e d0/df/d47/la7 0 2024-09-16T09:46:14.751 INFO:tasks.workunit.client.0.smithi111.stdout:5/619: sync 2024-09-16T09:46:14.752 INFO:tasks.workunit.client.0.smithi111.stdout:3/719: sync 2024-09-16T09:46:14.754 INFO:tasks.workunit.client.0.smithi111.stdout:8/655: dwrite d3/da/db/d59/dd7/d9e/dd8/fbb [0,4194304] 0 2024-09-16T09:46:14.756 INFO:tasks.workunit.client.0.smithi111.stdout:5/620: rename d19/d1b/d1e/fb3 to d19/d1b/d1e/d21/d29/d32/d8f/fd8 0 2024-09-16T09:46:14.757 INFO:tasks.workunit.client.0.smithi111.stdout:6/487: dread d0/df/d14/d20/d42/d4e/d64/da6/d33/f34 [0,4194304] 0 2024-09-16T09:46:14.758 INFO:tasks.workunit.client.0.smithi111.stdout:2/717: dwrite d0/da/d4e/f7c [0,4194304] 0 2024-09-16T09:46:14.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/720: rename d5/c26 to d5/da/db/d35/d45/da1/ced 0 2024-09-16T09:46:14.762 INFO:tasks.workunit.client.0.smithi111.stdout:5/621: symlink d19/d1b/d1e/d21/d29/d32/d8f/ld9 0 2024-09-16T09:46:14.762 INFO:tasks.workunit.client.0.smithi111.stdout:5/622: chown d19/d1b/d27/d2e/d4a/d4b/dac 0 1 2024-09-16T09:46:14.763 INFO:tasks.workunit.client.0.smithi111.stdout:3/721: rmdir d5/da/db/d3a/d6d 39 2024-09-16T09:46:14.766 INFO:tasks.workunit.client.0.smithi111.stdout:5/623: mkdir d19/d1b/d27/d2e/d39/d54/d60/dc9/dda 0 2024-09-16T09:46:14.766 INFO:tasks.workunit.client.0.smithi111.stdout:5/624: chown d19/d1b/d27/d83/d2a/dc4/dc0/db1/fd6 8 1 2024-09-16T09:46:14.767 INFO:tasks.workunit.client.0.smithi111.stdout:3/722: creat d5/da/db/d3a/d6d/de7/d88/fee x:0 0 0 2024-09-16T09:46:14.768 INFO:tasks.workunit.client.0.smithi111.stdout:1/554: dwrite d3/f9 [0,4194304] 0 2024-09-16T09:46:14.770 INFO:tasks.workunit.client.0.smithi111.stdout:5/625: creat d19/d1b/d27/d2e/d39/d54/d60/fdb x:0 0 0 2024-09-16T09:46:14.770 INFO:tasks.workunit.client.0.smithi111.stdout:0/590: dwrite d0/d1d/d67/d3a/d3d/d59/f6a [0,4194304] 0 2024-09-16T09:46:14.774 INFO:tasks.workunit.client.0.smithi111.stdout:1/555: getdents d3/d10/d23 0 2024-09-16T09:46:14.775 INFO:tasks.workunit.client.0.smithi111.stdout:5/626: symlink d19/d1b/d27/d2e/d39/d54/d60/ldc 0 2024-09-16T09:46:14.777 INFO:tasks.workunit.client.0.smithi111.stdout:3/723: mkdir d5/da/def 0 2024-09-16T09:46:14.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/591: dread - d0/d26/f79 zero size 2024-09-16T09:46:14.781 INFO:tasks.workunit.client.0.smithi111.stdout:8/656: dwrite d3/de/d1e/f51 [0,4194304] 0 2024-09-16T09:46:14.783 INFO:tasks.workunit.client.0.smithi111.stdout:5/627: rmdir d19/d1b/d1e/d21/d29 39 2024-09-16T09:46:14.790 INFO:tasks.workunit.client.0.smithi111.stdout:0/592: mkdir d0/d1d/dce 0 2024-09-16T09:46:14.790 INFO:tasks.workunit.client.0.smithi111.stdout:8/657: creat d3/da/fdc x:0 0 0 2024-09-16T09:46:14.790 INFO:tasks.workunit.client.0.smithi111.stdout:8/658: truncate d3/de/d1e/d2e/d2f/f7c 628249 0 2024-09-16T09:46:14.790 INFO:tasks.workunit.client.0.smithi111.stdout:8/659: chown d3/da/db/d59/dd7/d9e/dd8/f9a 36524186 1 2024-09-16T09:46:14.790 INFO:tasks.workunit.client.0.smithi111.stdout:8/660: fsync d3/d26/d6d/f4f 0 2024-09-16T09:46:14.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/724: mknod d5/da/cf0 0 2024-09-16T09:46:14.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/725: readlink d5/da/db/d35/d41/l57 0 2024-09-16T09:46:14.792 INFO:tasks.workunit.client.0.smithi111.stdout:3/726: readlink d5/da/db/d5a/ld2 0 2024-09-16T09:46:14.794 INFO:tasks.workunit.client.0.smithi111.stdout:8/661: link d3/de/d1e/d2e/d2f/c36 d3/da/db/d59/dd7/dcc/cdd 0 2024-09-16T09:46:14.794 INFO:tasks.workunit.client.0.smithi111.stdout:8/662: fdatasync d3/f19 0 2024-09-16T09:46:14.795 INFO:tasks.workunit.client.0.smithi111.stdout:6/488: dwrite d0/df/d14/d20/d42/d4e/d62/f70 [0,4194304] 0 2024-09-16T09:46:14.796 INFO:tasks.workunit.client.0.smithi111.stdout:6/489: chown d0/d57/d72/l4b 2629855 1 2024-09-16T09:46:14.799 INFO:tasks.workunit.client.0.smithi111.stdout:3/727: creat d5/da/db/d35/d41/db6/ff1 x:0 0 0 2024-09-16T09:46:14.801 INFO:tasks.workunit.client.0.smithi111.stdout:8/663: getdents d3/de/d1e/d2e/d2f/da8/dbe 0 2024-09-16T09:46:14.801 INFO:tasks.workunit.client.0.smithi111.stdout:8/664: write d3/de/d1e/d2e/d74/d83/da2/fbd [708959,34914] 0 2024-09-16T09:46:14.802 INFO:tasks.workunit.client.0.smithi111.stdout:8/665: stat d3/da/db/d59/dd7/d9e/dd8/f4e 0 2024-09-16T09:46:14.802 INFO:tasks.workunit.client.0.smithi111.stdout:8/666: chown d3/de/d1e/d2e/d2f/da8/dbe/d6b/c78 26107 1 2024-09-16T09:46:14.803 INFO:tasks.workunit.client.0.smithi111.stdout:6/490: unlink d0/df/d47/d52/c90 0 2024-09-16T09:46:14.803 INFO:tasks.workunit.client.0.smithi111.stdout:6/491: stat d0/f13 0 2024-09-16T09:46:14.807 INFO:tasks.workunit.client.0.smithi111.stdout:8/667: mknod d3/d26/d6d/cde 0 2024-09-16T09:46:14.808 INFO:tasks.workunit.client.0.smithi111.stdout:5/628: dwrite d19/d1b/d27/d83/f2b [0,4194304] 0 2024-09-16T09:46:14.809 INFO:tasks.workunit.client.0.smithi111.stdout:6/492: link d0/df/d14/d20/d42/f9c d0/df/d47/fa8 0 2024-09-16T09:46:14.810 INFO:tasks.workunit.client.0.smithi111.stdout:0/593: dwrite d0/fd [0,4194304] 0 2024-09-16T09:46:14.811 INFO:tasks.workunit.client.0.smithi111.stdout:3/728: write d5/d18/d78/dab/fc1 [2392078,2398] 0 2024-09-16T09:46:14.811 INFO:tasks.workunit.client.0.smithi111.stdout:3/729: truncate d5/da/d42/fe3 72005 0 2024-09-16T09:46:14.811 INFO:tasks.workunit.client.0.smithi111.stdout:8/668: creat d3/de/d1e/d2e/d2f/da8/fdf x:0 0 0 2024-09-16T09:46:14.812 INFO:tasks.workunit.client.0.smithi111.stdout:5/629: getdents d19/d1b/d27/d2e 0 2024-09-16T09:46:14.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/630: readlink d19/d1b/d27/d83/d2a/lbf 0 2024-09-16T09:46:14.813 INFO:tasks.workunit.client.0.smithi111.stdout:6/493: readlink d0/lb 0 2024-09-16T09:46:14.815 INFO:tasks.workunit.client.0.smithi111.stdout:6/494: read d0/d57/d72/f8b [774467,43400] 0 2024-09-16T09:46:14.816 INFO:tasks.workunit.client.0.smithi111.stdout:5/631: symlink d19/d1b/d1e/d21/d29/d32/d46/ldd 0 2024-09-16T09:46:14.817 INFO:tasks.workunit.client.0.smithi111.stdout:3/730: mknod d5/da/cf2 0 2024-09-16T09:46:14.818 INFO:tasks.workunit.client.0.smithi111.stdout:6/495: mkdir d0/df/d47/d88/da9 0 2024-09-16T09:46:14.818 INFO:tasks.workunit.client.0.smithi111.stdout:6/496: write d0/df/f4a [3257579,123925] 0 2024-09-16T09:46:14.819 INFO:tasks.workunit.client.0.smithi111.stdout:0/594: dread d0/d1d/d67/d3a/fac [0,4194304] 0 2024-09-16T09:46:14.820 INFO:tasks.workunit.client.0.smithi111.stdout:5/632: link d19/d1b/d27/d2e/d39/d54/d60/f86 d19/d1b/d27/d83/d2a/fde 0 2024-09-16T09:46:14.821 INFO:tasks.workunit.client.0.smithi111.stdout:3/731: link d5/da/db/de/f27 d5/da/db/d3a/d59/ff3 0 2024-09-16T09:46:14.823 INFO:tasks.workunit.client.0.smithi111.stdout:6/497: creat d0/df/faa x:0 0 0 2024-09-16T09:46:14.824 INFO:tasks.workunit.client.0.smithi111.stdout:5/633: mknod d19/d1b/d27/d83/cdf 0 2024-09-16T09:46:14.824 INFO:tasks.workunit.client.0.smithi111.stdout:5/634: fsync f7 0 2024-09-16T09:46:14.825 INFO:tasks.workunit.client.0.smithi111.stdout:3/732: creat d5/da/db/d5a/ff4 x:0 0 0 2024-09-16T09:46:14.826 INFO:tasks.workunit.client.0.smithi111.stdout:6/498: symlink d0/df/d14/d20/d42/d4e/d64/lab 0 2024-09-16T09:46:14.827 INFO:tasks.workunit.client.0.smithi111.stdout:5/635: creat d19/d1b/d27/d2e/d4a/d4b/dac/fe0 x:0 0 0 2024-09-16T09:46:14.829 INFO:tasks.workunit.client.0.smithi111.stdout:6/499: creat d0/df/d47/fac x:0 0 0 2024-09-16T09:46:14.829 INFO:tasks.workunit.client.0.smithi111.stdout:3/733: dread d5/da/db/d5a/f76 [0,4194304] 0 2024-09-16T09:46:14.831 INFO:tasks.workunit.client.0.smithi111.stdout:8/669: dwrite d3/de/d1e/d2e/d74/fd3 [0,4194304] 0 2024-09-16T09:46:14.832 INFO:tasks.workunit.client.0.smithi111.stdout:6/500: rename d0/df/d14/f1b to d0/df/d47/fad 0 2024-09-16T09:46:14.838 INFO:tasks.workunit.client.0.smithi111.stdout:8/670: rename d3/de/d6e/f81 to d3/dc3/fe0 0 2024-09-16T09:46:14.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/501: mknod d0/df/d47/d52/cae 0 2024-09-16T09:46:14.839 INFO:tasks.workunit.client.0.smithi111.stdout:6/502: readlink d0/df/l59 0 2024-09-16T09:46:14.841 INFO:tasks.workunit.client.0.smithi111.stdout:8/671: link d3/de/d1e/d2e/d2f/da8/dbe/fc7 d3/de/d1e/d2e/d2f/fe1 0 2024-09-16T09:46:14.843 INFO:tasks.workunit.client.0.smithi111.stdout:5/636: dwrite d19/d1b/d1e/d21/d29/d32/fb4 [0,4194304] 0 2024-09-16T09:46:14.845 INFO:tasks.workunit.client.0.smithi111.stdout:6/503: mkdir d0/daf 0 2024-09-16T09:46:14.845 INFO:tasks.workunit.client.0.smithi111.stdout:6/504: write d0/df/d14/d20/d42/d4e/d64/da6/d41/f9e [1144272,4114] 0 2024-09-16T09:46:14.846 INFO:tasks.workunit.client.0.smithi111.stdout:6/505: dread d0/df/d14/d20/d42/d4e/d64/da6/f6b [0,4194304] 0 2024-09-16T09:46:14.849 INFO:tasks.workunit.client.0.smithi111.stdout:5/637: mknod d19/d1b/d27/d2e/d39/d54/d60/dd5/ce1 0 2024-09-16T09:46:14.854 INFO:tasks.workunit.client.0.smithi111.stdout:3/734: dwrite d5/da/db/d35/d41/da0/feb [0,4194304] 0 2024-09-16T09:46:14.855 INFO:tasks.workunit.client.0.smithi111.stdout:3/735: dread d5/f86 [0,4194304] 0 2024-09-16T09:46:14.857 INFO:tasks.workunit.client.0.smithi111.stdout:3/736: mknod d5/da/db/d5a/cf5 0 2024-09-16T09:46:14.864 INFO:tasks.workunit.client.0.smithi111.stdout:3/737: dread d5/d18/f36 [0,4194304] 0 2024-09-16T09:46:14.881 INFO:tasks.workunit.client.0.smithi111.stdout:8/672: dwrite d3/da/db/fc8 [0,4194304] 0 2024-09-16T09:46:14.881 INFO:tasks.workunit.client.0.smithi111.stdout:3/738: read d5/d18/f2a [2889561,28676] 0 2024-09-16T09:46:14.882 INFO:tasks.workunit.client.0.smithi111.stdout:8/673: rmdir d3/da/db/d59/dd7/d9e/dd8 39 2024-09-16T09:46:14.883 INFO:tasks.workunit.client.0.smithi111.stdout:3/739: mkdir d5/d18/df6 0 2024-09-16T09:46:14.885 INFO:tasks.workunit.client.0.smithi111.stdout:8/674: dread d3/f43 [0,4194304] 0 2024-09-16T09:46:14.885 INFO:tasks.workunit.client.0.smithi111.stdout:3/740: rename d5/da/db/de/l1e to d5/da/db/d3a/d6d/de7/lf7 0 2024-09-16T09:46:14.885 INFO:tasks.workunit.client.0.smithi111.stdout:5/638: dwrite f7 [4194304,4194304] 0 2024-09-16T09:46:14.886 INFO:tasks.workunit.client.0.smithi111.stdout:6/506: dwrite d0/df/d14/d20/d42/d4e/d62/d7b/f9f [0,4194304] 0 2024-09-16T09:46:14.886 INFO:tasks.workunit.client.0.smithi111.stdout:3/741: mkdir d5/da/db/d5a/df8 0 2024-09-16T09:46:14.887 INFO:tasks.workunit.client.0.smithi111.stdout:3/742: write d5/da/db/de/f96 [557317,5596] 0 2024-09-16T09:46:14.887 INFO:tasks.workunit.client.0.smithi111.stdout:3/743: readlink d5/da/d42/d74/da4/lcf 0 2024-09-16T09:46:14.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/639: dread d19/d1b/f97 [0,4194304] 0 2024-09-16T09:46:14.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/640: write d19/d1b/d27/d2e/f91 [1073714,113535] 0 2024-09-16T09:46:14.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/641: fsync d19/d1b/d27/d83/f63 0 2024-09-16T09:46:14.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/675: write d3/de/f14 [2932527,26853] 0 2024-09-16T09:46:14.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/676: chown d3/de/d1e/fbf 1275825 1 2024-09-16T09:46:14.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/677: fdatasync d3/de/d1e/d2e/d2f/dbc/f8a 0 2024-09-16T09:46:14.898 INFO:tasks.workunit.client.0.smithi111.stdout:6/507: rmdir d0/df/d14 39 2024-09-16T09:46:14.899 INFO:tasks.workunit.client.0.smithi111.stdout:8/678: dread d3/de/d1e/d2e/d2f/da8/dbe/f9d [0,4194304] 0 2024-09-16T09:46:14.901 INFO:tasks.workunit.client.0.smithi111.stdout:3/744: creat d5/da/d42/ff9 x:0 0 0 2024-09-16T09:46:14.904 INFO:tasks.workunit.client.0.smithi111.stdout:6/508: rename d0/df to d0/d57/db0 0 2024-09-16T09:46:14.908 INFO:tasks.workunit.client.0.smithi111.stdout:5/642: dwrite d19/d1b/d1e/f85 [0,4194304] 0 2024-09-16T09:46:14.909 INFO:tasks.workunit.client.0.smithi111.stdout:6/509: getdents d0/d57/db0/d14/d20/d42/d4e/d64/da6/d41/d4f 0 2024-09-16T09:46:14.913 INFO:tasks.workunit.client.0.smithi111.stdout:6/510: rename d0/lb to d0/d57/db0/d14/d20/d42/d4e/d62/lb1 0 2024-09-16T09:46:14.913 INFO:tasks.workunit.client.0.smithi111.stdout:6/511: write d0/d57/db0/d47/d88/f8e [76748,106373] 0 2024-09-16T09:46:14.913 INFO:tasks.workunit.client.0.smithi111.stdout:6/512: chown d0/d57/db0/d49/c9a 8196853 1 2024-09-16T09:46:14.916 INFO:tasks.workunit.client.0.smithi111.stdout:9/496: sync 2024-09-16T09:46:14.916 INFO:tasks.workunit.client.0.smithi111.stdout:4/538: sync 2024-09-16T09:46:14.916 INFO:tasks.workunit.client.0.smithi111.stdout:9/497: write d0/d6/f44 [998875,12879] 0 2024-09-16T09:46:14.916 INFO:tasks.workunit.client.0.smithi111.stdout:9/498: fsync d0/d21/d22/d6e/f97 0 2024-09-16T09:46:14.916 INFO:tasks.workunit.client.0.smithi111.stdout:9/499: getdents d0/d6/d75/da9 0 2024-09-16T09:46:14.916 INFO:tasks.workunit.client.0.smithi111.stdout:9/500: chown d0/d7b/faa 159 1 2024-09-16T09:46:14.917 INFO:tasks.workunit.client.0.smithi111.stdout:6/513: mkdir d0/d57/d72/db2 0 2024-09-16T09:46:14.917 INFO:tasks.workunit.client.0.smithi111.stdout:6/514: fsync d0/d57/db0/d47/d68/f7f 0 2024-09-16T09:46:14.919 INFO:tasks.workunit.client.0.smithi111.stdout:4/539: rename d2/d6/dd/d1b/l3e to d2/d6/dd/d1b/d38/la4 0 2024-09-16T09:46:14.919 INFO:tasks.workunit.client.0.smithi111.stdout:4/540: truncate d2/d6/dd/d1b/f5d 572859 0 2024-09-16T09:46:14.920 INFO:tasks.workunit.client.0.smithi111.stdout:9/501: creat d0/d6/fad x:0 0 0 2024-09-16T09:46:14.922 INFO:tasks.workunit.client.0.smithi111.stdout:6/515: mkdir d0/d57/db0/d47/d52/db3 0 2024-09-16T09:46:14.923 INFO:tasks.workunit.client.0.smithi111.stdout:4/541: unlink d2/d6/dd/d1b/d38/d64/d65/c7b 0 2024-09-16T09:46:14.923 INFO:tasks.workunit.client.0.smithi111.stdout:9/502: rmdir d0/d21/d59 39 2024-09-16T09:46:14.923 INFO:tasks.workunit.client.0.smithi111.stdout:9/503: fdatasync d0/d6/d30/d81/fa8 0 2024-09-16T09:46:14.924 INFO:tasks.workunit.client.0.smithi111.stdout:6/516: symlink d0/d57/db0/d47/d68/lb4 0 2024-09-16T09:46:14.930 INFO:tasks.workunit.client.0.smithi111.stdout:3/745: dwrite d5/da/db/fad [0,4194304] 0 2024-09-16T09:46:14.930 INFO:tasks.workunit.client.0.smithi111.stdout:8/679: dwrite d3/de/d1e/d2e/d74/d83/fa1 [0,4194304] 0 2024-09-16T09:46:14.930 INFO:tasks.workunit.client.0.smithi111.stdout:8/680: write d3/de/d1e/d2e/d74/dad/dba/fca [144003,84334] 0 2024-09-16T09:46:14.935 INFO:tasks.workunit.client.0.smithi111.stdout:4/542: write d2/d6/f14 [3732559,28580] 0 2024-09-16T09:46:14.935 INFO:tasks.workunit.client.0.smithi111.stdout:3/746: mknod d5/da/db/d3a/d6d/de7/d75/cfa 0 2024-09-16T09:46:14.935 INFO:tasks.workunit.client.0.smithi111.stdout:3/747: fsync d5/da/db/d35/d41/da0/dd9/f9c 0 2024-09-16T09:46:14.937 INFO:tasks.workunit.client.0.smithi111.stdout:3/748: getdents d5/d18/d78/dab 0 2024-09-16T09:46:14.937 INFO:tasks.workunit.client.0.smithi111.stdout:3/749: fdatasync d5/d18/d78/f82 0 2024-09-16T09:46:14.938 INFO:tasks.workunit.client.0.smithi111.stdout:6/517: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/f81 [0,4194304] 0 2024-09-16T09:46:14.939 INFO:tasks.workunit.client.0.smithi111.stdout:3/750: rename d5/da/f11 to d5/da/db/d3a/d6d/ffb 0 2024-09-16T09:46:14.943 INFO:tasks.workunit.client.0.smithi111.stdout:6/518: rmdir d0/d57/db0/d47/d88 39 2024-09-16T09:46:14.945 INFO:tasks.workunit.client.0.smithi111.stdout:3/751: creat d5/da/def/ffc x:0 0 0 2024-09-16T09:46:14.952 INFO:tasks.workunit.client.0.smithi111.stdout:8/681: dwrite d3/de/d1e/d2e/d74/d83/f93 [0,4194304] 0 2024-09-16T09:46:14.956 INFO:tasks.workunit.client.0.smithi111.stdout:3/752: write d5/da/db/d35/f39 [3207213,21727] 0 2024-09-16T09:46:14.956 INFO:tasks.workunit.client.0.smithi111.stdout:8/682: mknod d3/da/db/d59/dd7/dcc/ce2 0 2024-09-16T09:46:14.957 INFO:tasks.workunit.client.0.smithi111.stdout:8/683: dread d3/da/db/d59/dd7/d9e/dd8/f6f [0,4194304] 0 2024-09-16T09:46:14.959 INFO:tasks.workunit.client.0.smithi111.stdout:4/543: dwrite d2/d6/dd/d1c/f54 [0,4194304] 0 2024-09-16T09:46:14.960 INFO:tasks.workunit.client.0.smithi111.stdout:6/519: dwrite d0/d57/db0/d14/f74 [0,4194304] 0 2024-09-16T09:46:14.960 INFO:tasks.workunit.client.0.smithi111.stdout:6/520: fdatasync d0/d57/db0/d47/fac 0 2024-09-16T09:46:14.960 INFO:tasks.workunit.client.0.smithi111.stdout:3/753: rename d5/da/db/d35/d41 to d5/d18/d78/dfd 0 2024-09-16T09:46:14.962 INFO:tasks.workunit.client.0.smithi111.stdout:8/684: mkdir d3/d26/d6d/db6/de3 0 2024-09-16T09:46:14.962 INFO:tasks.workunit.client.0.smithi111.stdout:8/685: truncate d3/de/d1e/d2e/f37 841552 0 2024-09-16T09:46:14.962 INFO:tasks.workunit.client.0.smithi111.stdout:8/686: truncate d3/de/d1e/d2e/d2f/da8/fdf 51024 0 2024-09-16T09:46:14.962 INFO:tasks.workunit.client.0.smithi111.stdout:8/687: chown d3/f19 1354189222 1 2024-09-16T09:46:14.965 INFO:tasks.workunit.client.0.smithi111.stdout:4/544: symlink d2/d30/d44/d69/la5 0 2024-09-16T09:46:14.967 INFO:tasks.workunit.client.0.smithi111.stdout:3/754: mknod d5/da/db/d35/cfe 0 2024-09-16T09:46:14.968 INFO:tasks.workunit.client.0.smithi111.stdout:6/521: write d0/d57/db0/d14/d20/d42/d4e/d62/f70 [2696471,83660] 0 2024-09-16T09:46:14.968 INFO:tasks.workunit.client.0.smithi111.stdout:6/522: write d0/d57/db0/d47/d52/f82 [1517449,88852] 0 2024-09-16T09:46:14.968 INFO:tasks.workunit.client.0.smithi111.stdout:6/523: stat d0/d57/db0/f4a 0 2024-09-16T09:46:14.969 INFO:tasks.workunit.client.0.smithi111.stdout:8/688: rename d3/de/d1e/l7d to d3/da/le4 0 2024-09-16T09:46:14.969 INFO:tasks.workunit.client.0.smithi111.stdout:8/689: chown d3/de/d1e/d2e/l61 2 1 2024-09-16T09:46:14.969 INFO:tasks.workunit.client.0.smithi111.stdout:4/545: truncate d2/d30/d44/f90 3614914 0 2024-09-16T09:46:14.969 INFO:tasks.workunit.client.0.smithi111.stdout:4/546: stat d2/d6/dd/f28 0 2024-09-16T09:46:14.969 INFO:tasks.workunit.client.0.smithi111.stdout:4/547: truncate d2/d6/dd/d1c/d2f/f7a 9342837 0 2024-09-16T09:46:14.971 INFO:tasks.workunit.client.0.smithi111.stdout:3/755: unlink d5/da/db/c62 0 2024-09-16T09:46:14.971 INFO:tasks.workunit.client.0.smithi111.stdout:3/756: chown d5/d18/df6 14 1 2024-09-16T09:46:14.971 INFO:tasks.workunit.client.0.smithi111.stdout:3/757: fsync d5/da/db/d3a/d6d/de7/fb7 0 2024-09-16T09:46:14.971 INFO:tasks.workunit.client.0.smithi111.stdout:3/758: read - d5/da/db/d3a/d6d/fc2 zero size 2024-09-16T09:46:14.972 INFO:tasks.workunit.client.0.smithi111.stdout:8/690: truncate d3/de/d1e/d2e/d2f/d4c/f9b 1219603 0 2024-09-16T09:46:14.974 INFO:tasks.workunit.client.0.smithi111.stdout:4/548: creat d2/d30/da1/fa6 x:0 0 0 2024-09-16T09:46:14.976 INFO:tasks.workunit.client.0.smithi111.stdout:3/759: creat d5/d18/d78/dfd/db6/fff x:0 0 0 2024-09-16T09:46:14.977 INFO:tasks.workunit.client.0.smithi111.stdout:4/549: stat d2/d6/cf 0 2024-09-16T09:46:14.977 INFO:tasks.workunit.client.0.smithi111.stdout:4/550: fsync d2/f8 0 2024-09-16T09:46:14.980 INFO:tasks.workunit.client.0.smithi111.stdout:3/760: creat d5/d18/df6/f100 x:0 0 0 2024-09-16T09:46:14.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/551: rmdir d2/d6/dd/d1c/d2f/d8d 39 2024-09-16T09:46:14.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/552: readlink d2/d6/dd/d1c/d2f/l79 0 2024-09-16T09:46:14.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/553: write d2/d6/dd/f76 [504132,22976] 0 2024-09-16T09:46:14.981 INFO:tasks.workunit.client.0.smithi111.stdout:4/554: dread - d2/d30/d44/d69/f8b zero size 2024-09-16T09:46:14.983 INFO:tasks.workunit.client.0.smithi111.stdout:6/524: dwrite d0/d57/db0/d14/d20/d42/d4e/fa3 [0,4194304] 0 2024-09-16T09:46:14.983 INFO:tasks.workunit.client.0.smithi111.stdout:3/761: symlink d5/da/d42/d74/l101 0 2024-09-16T09:46:14.984 INFO:tasks.workunit.client.0.smithi111.stdout:4/555: creat d2/d6/dd/d1c/d2f/d6c/fa7 x:0 0 0 2024-09-16T09:46:14.984 INFO:tasks.workunit.client.0.smithi111.stdout:4/556: dread - d2/d6/dd/d1c/d2f/d6c/f87 zero size 2024-09-16T09:46:14.991 INFO:tasks.workunit.client.0.smithi111.stdout:6/525: creat d0/d57/db0/fb5 x:0 0 0 2024-09-16T09:46:14.991 INFO:tasks.workunit.client.0.smithi111.stdout:6/526: fdatasync d0/d57/db0/d14/d20/d42/f5c 0 2024-09-16T09:46:14.993 INFO:tasks.workunit.client.0.smithi111.stdout:8/691: dwrite d3/de/d1e/d2e/d74/d83/da2/fbd [0,4194304] 0 2024-09-16T09:46:14.993 INFO:tasks.workunit.client.0.smithi111.stdout:3/762: rmdir d5/d18/d78/dfd/da0/dd9 39 2024-09-16T09:46:14.995 INFO:tasks.workunit.client.0.smithi111.stdout:4/557: unlink d2/d6/cf 0 2024-09-16T09:46:14.995 INFO:tasks.workunit.client.0.smithi111.stdout:4/558: fdatasync d2/d6/dd/d1c/d2f/f7a 0 2024-09-16T09:46:15.005 INFO:tasks.workunit.client.0.smithi111.stdout:8/692: dread d3/d26/d6d/fa6 [0,4194304] 0 2024-09-16T09:46:15.006 INFO:tasks.workunit.client.0.smithi111.stdout:8/693: mkdir d3/da/db/d59/de5 0 2024-09-16T09:46:15.008 INFO:tasks.workunit.client.0.smithi111.stdout:8/694: creat d3/da/db/d59/de5/fe6 x:0 0 0 2024-09-16T09:46:15.008 INFO:tasks.workunit.client.0.smithi111.stdout:3/763: dread d5/da/db/d3a/d6d/de7/f83 [0,4194304] 0 2024-09-16T09:46:15.010 INFO:tasks.workunit.client.0.smithi111.stdout:8/695: rename f0 to d3/d26/d6d/db6/fe7 0 2024-09-16T09:46:15.011 INFO:tasks.workunit.client.0.smithi111.stdout:6/527: dread d0/d57/db0/d47/d68/f7f [0,4194304] 0 2024-09-16T09:46:15.011 INFO:tasks.workunit.client.0.smithi111.stdout:6/528: write d0/d57/d72/f65 [1507119,90423] 0 2024-09-16T09:46:15.034 INFO:tasks.workunit.client.0.smithi111.stdout:8/696: dwrite d3/f8 [0,4194304] 0 2024-09-16T09:46:15.035 INFO:tasks.workunit.client.0.smithi111.stdout:3/764: dwrite d5/da/f9e [0,4194304] 0 2024-09-16T09:46:15.042 INFO:tasks.workunit.client.0.smithi111.stdout:6/529: creat d0/d57/db0/d47/d52/db3/fb6 x:0 0 0 2024-09-16T09:46:15.044 INFO:tasks.workunit.client.0.smithi111.stdout:6/530: write d0/d57/db0/d14/d20/d42/d4e/d64/da6/f98 [135771,110007] 0 2024-09-16T09:46:15.045 INFO:tasks.workunit.client.0.smithi111.stdout:8/697: unlink d3/da/fb7 0 2024-09-16T09:46:15.132 INFO:tasks.workunit.client.0.smithi111.stdout:3/765: mknod d5/da/d92/c102 0 2024-09-16T09:46:15.214 INFO:tasks.workunit.client.0.smithi111.stdout:8/698: unlink d3/da/fdc 0 2024-09-16T09:46:15.214 INFO:tasks.workunit.client.0.smithi111.stdout:3/766: symlink d5/da/db/d3a/d6d/de7/d88/db8/l103 0 2024-09-16T09:46:15.218 INFO:tasks.workunit.client.0.smithi111.stdout:8/699: creat d3/da/db/d59/dd7/fe8 x:0 0 0 2024-09-16T09:46:15.219 INFO:tasks.workunit.client.0.smithi111.stdout:3/767: rename d5/c1c to d5/da/db/de/ddb/c104 0 2024-09-16T09:46:15.221 INFO:tasks.workunit.client.0.smithi111.stdout:8/700: unlink d3/de/d1e/d2e/d74/ccb 0 2024-09-16T09:46:15.223 INFO:tasks.workunit.client.0.smithi111.stdout:3/768: creat d5/d18/d78/f105 x:0 0 0 2024-09-16T09:46:15.223 INFO:tasks.workunit.client.0.smithi111.stdout:8/701: dread d3/da/db/f53 [0,4194304] 0 2024-09-16T09:46:15.225 INFO:tasks.workunit.client.0.smithi111.stdout:8/702: rename d3/de/d1e/d2e/d2f/da8/dbe/f2b to d3/da/fe9 0 2024-09-16T09:46:15.226 INFO:tasks.workunit.client.0.smithi111.stdout:3/769: creat d5/da/db/d3a/d6d/de7/d75/f106 x:0 0 0 2024-09-16T09:46:15.226 INFO:tasks.workunit.client.0.smithi111.stdout:3/770: dread - d5/da/d42/d74/da4/fe0 zero size 2024-09-16T09:46:15.226 INFO:tasks.workunit.client.0.smithi111.stdout:3/771: readlink d5/da/db/d3a/d6d/de7/d88/l8f 0 2024-09-16T09:46:15.237 INFO:tasks.workunit.client.0.smithi111.stdout:3/772: dread d5/da/db/d3a/d6d/de7/d88/f94 [0,4194304] 0 2024-09-16T09:46:15.237 INFO:tasks.workunit.client.0.smithi111.stdout:3/773: truncate d5/da/d42/d74/f98 616860 0 2024-09-16T09:46:15.237 INFO:tasks.workunit.client.0.smithi111.stdout:3/774: chown d5/l2c 1 1 2024-09-16T09:46:15.240 INFO:tasks.workunit.client.0.smithi111.stdout:6/531: creat d0/d57/db0/d14/fb7 x:0 0 0 2024-09-16T09:46:15.240 INFO:tasks.workunit.client.0.smithi111.stdout:6/532: fsync d0/d57/db0/d14/d20/d42/d4e/d64/da6/f98 0 2024-09-16T09:46:15.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/533: link d0/d57/db0/d49/d5b/l79 d0/d57/d72/db2/lb8 0 2024-09-16T09:46:15.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/534: write d0/d57/db0/d14/fb7 [952082,56417] 0 2024-09-16T09:46:15.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/535: dread - d0/d57/db0/d47/f7d zero size 2024-09-16T09:46:15.242 INFO:tasks.workunit.client.0.smithi111.stdout:6/536: mkdir d0/d57/db0/d14/d20/d42/d4e/d64/da6/d41/d4f/db9 0 2024-09-16T09:46:15.243 INFO:tasks.workunit.client.0.smithi111.stdout:6/537: rmdir d0/d57/db0/d14/d20/d42 39 2024-09-16T09:46:15.244 INFO:tasks.workunit.client.0.smithi111.stdout:7/486: sync 2024-09-16T09:46:15.245 INFO:tasks.workunit.client.0.smithi111.stdout:7/487: read - d1/d9/d43/d82/f8a zero size 2024-09-16T09:46:15.246 INFO:tasks.workunit.client.0.smithi111.stdout:7/488: creat d1/d16/d17/d18/d1d/fae x:0 0 0 2024-09-16T09:46:15.247 INFO:tasks.workunit.client.0.smithi111.stdout:7/489: mknod d1/caf 0 2024-09-16T09:46:15.252 INFO:tasks.workunit.client.0.smithi111.stdout:3/775: getdents d5/da/db/d3a/d6d/de7/d88/db8 0 2024-09-16T09:46:15.252 INFO:tasks.workunit.client.0.smithi111.stdout:3/776: dread - d5/da/db/d35/f5c zero size 2024-09-16T09:46:15.275 INFO:tasks.workunit.client.0.smithi111.stdout:2/718: sync 2024-09-16T09:46:15.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/538: dwrite d0/d57/db0/d47/fa8 [0,4194304] 0 2024-09-16T09:46:15.275 INFO:tasks.workunit.client.0.smithi111.stdout:7/490: dwrite d1/d16/d17/d18/f6f [0,4194304] 0 2024-09-16T09:46:15.276 INFO:tasks.workunit.client.0.smithi111.stdout:2/719: getdents d0/d29 0 2024-09-16T09:46:15.280 INFO:tasks.workunit.client.0.smithi111.stdout:6/539: link d0/d57/d72/l3c d0/d57/db0/d47/d68/lba 0 2024-09-16T09:46:15.280 INFO:tasks.workunit.client.0.smithi111.stdout:6/540: fdatasync d0/f3a 0 2024-09-16T09:46:15.280 INFO:tasks.workunit.client.0.smithi111.stdout:3/777: dwrite d5/da/d92/fb9 [0,4194304] 0 2024-09-16T09:46:15.284 INFO:tasks.workunit.client.0.smithi111.stdout:7/491: creat d1/d16/d17/d18/d1b/d79/d8c/fb0 x:0 0 0 2024-09-16T09:46:15.285 INFO:tasks.workunit.client.0.smithi111.stdout:7/492: write d1/d16/d17/f9b [899845,101402] 0 2024-09-16T09:46:15.285 INFO:tasks.workunit.client.0.smithi111.stdout:2/720: link d0/c20 d0/d45/d5c/d67/d63/dd4/cfe 0 2024-09-16T09:46:15.290 INFO:tasks.workunit.client.0.smithi111.stdout:6/541: mknod d0/d57/db0/d14/d20/d42/d4e/d64/da6/d41/d4f/db9/cbb 0 2024-09-16T09:46:15.293 INFO:tasks.workunit.client.0.smithi111.stdout:7/493: mknod d1/d20/cb1 0 2024-09-16T09:46:15.293 INFO:tasks.workunit.client.0.smithi111.stdout:7/494: truncate d1/d16/d17/d18/d1b/d79/daa/f83 1038927 0 2024-09-16T09:46:15.294 INFO:tasks.workunit.client.0.smithi111.stdout:7/495: truncate d1/d9/f35 1275677 0 2024-09-16T09:46:15.296 INFO:tasks.workunit.client.0.smithi111.stdout:2/721: creat d0/d2/d59/d86/d96/fff x:0 0 0 2024-09-16T09:46:15.297 INFO:tasks.workunit.client.0.smithi111.stdout:6/542: symlink d0/d57/d72/db2/lbc 0 2024-09-16T09:46:15.299 INFO:tasks.workunit.client.0.smithi111.stdout:6/543: write d0/d57/db0/d14/d20/d42/d4e/d62/f6c [51596,49977] 0 2024-09-16T09:46:15.301 INFO:tasks.workunit.client.0.smithi111.stdout:7/496: truncate d1/f32 5483520 0 2024-09-16T09:46:15.301 INFO:tasks.workunit.client.0.smithi111.stdout:7/497: write d1/d16/d17/d18/d1d/fae [1001413,53964] 0 2024-09-16T09:46:15.302 INFO:tasks.workunit.client.0.smithi111.stdout:7/498: chown d1/d20/l66 3527 1 2024-09-16T09:46:15.304 INFO:tasks.workunit.client.0.smithi111.stdout:7/499: mkdir d1/d16/d17/d18/d1b/d79/da5/db2 0 2024-09-16T09:46:15.304 INFO:tasks.workunit.client.0.smithi111.stdout:7/500: write d1/d16/d17/d18/d1b/f5e [1028660,82182] 0 2024-09-16T09:46:15.304 INFO:tasks.workunit.client.0.smithi111.stdout:7/501: rename d1/d16/d17/d18/d1b to d1/d16/d17/d18/d1b/d79/daa/da7/da8/db3 22 2024-09-16T09:46:15.304 INFO:tasks.workunit.client.0.smithi111.stdout:7/502: dread - d1/d16/d17/d18/d1d/f5d zero size 2024-09-16T09:46:15.305 INFO:tasks.workunit.client.0.smithi111.stdout:3/778: dwrite d5/da/d42/d74/da4/fe0 [0,4194304] 0 2024-09-16T09:46:15.306 INFO:tasks.workunit.client.0.smithi111.stdout:3/779: fsync d5/da/d42/d74/fc5 0 2024-09-16T09:46:15.310 INFO:tasks.workunit.client.0.smithi111.stdout:6/544: read d0/d57/db0/d14/d20/d42/f55 [1428740,100231] 0 2024-09-16T09:46:15.310 INFO:tasks.workunit.client.0.smithi111.stdout:6/545: write d0/d57/f75 [3148736,97355] 0 2024-09-16T09:46:15.310 INFO:tasks.workunit.client.0.smithi111.stdout:6/546: chown d0/d57/d72/db2/lb8 856 1 2024-09-16T09:46:15.314 INFO:tasks.workunit.client.0.smithi111.stdout:3/780: unlink d5/da/db/d35/c95 0 2024-09-16T09:46:15.315 INFO:tasks.workunit.client.0.smithi111.stdout:3/781: mkdir d5/da/db/d35/d45/d107 0 2024-09-16T09:46:15.315 INFO:tasks.workunit.client.0.smithi111.stdout:3/782: stat d5/da/db/d3a/d59/f5b 0 2024-09-16T09:46:15.317 INFO:tasks.workunit.client.0.smithi111.stdout:3/783: unlink d5/d18/f2a 0 2024-09-16T09:46:15.321 INFO:tasks.workunit.client.0.smithi111.stdout:2/722: dwrite d0/d2/f2c [0,4194304] 0 2024-09-16T09:46:15.322 INFO:tasks.workunit.client.0.smithi111.stdout:7/503: dwrite d1/d16/f5f [0,4194304] 0 2024-09-16T09:46:15.327 INFO:tasks.workunit.client.0.smithi111.stdout:2/723: unlink d0/d2/d59/d86/d96/fff 0 2024-09-16T09:46:15.335 INFO:tasks.workunit.client.0.smithi111.stdout:7/504: dread d1/d20/f42 [0,4194304] 0 2024-09-16T09:46:15.339 INFO:tasks.workunit.client.0.smithi111.stdout:2/724: dread d0/da/d4e/f9d [0,4194304] 0 2024-09-16T09:46:15.339 INFO:tasks.workunit.client.0.smithi111.stdout:3/784: dwrite d5/da/db/d35/f5c [0,4194304] 0 2024-09-16T09:46:15.341 INFO:tasks.workunit.client.0.smithi111.stdout:7/505: creat d1/d9/fb4 x:0 0 0 2024-09-16T09:46:15.341 INFO:tasks.workunit.client.0.smithi111.stdout:7/506: dread - d1/d16/d17/d18/d4f/d56/f57 zero size 2024-09-16T09:46:15.341 INFO:tasks.workunit.client.0.smithi111.stdout:7/507: dread - d1/d16/d17/d18/d1d/f5d zero size 2024-09-16T09:46:15.345 INFO:tasks.workunit.client.0.smithi111.stdout:3/785: creat d5/da/dc4/f108 x:0 0 0 2024-09-16T09:46:15.345 INFO:tasks.workunit.client.0.smithi111.stdout:3/786: write d5/da/d42/d74/fc5 [449173,83023] 0 2024-09-16T09:46:15.349 INFO:tasks.workunit.client.0.smithi111.stdout:7/508: readlink d1/d9/d53/l6c 0 2024-09-16T09:46:15.349 INFO:tasks.workunit.client.0.smithi111.stdout:7/509: stat d1/d16/c41 0 2024-09-16T09:46:15.351 INFO:tasks.workunit.client.0.smithi111.stdout:3/787: write d5/da/db/de/f15 [713351,81130] 0 2024-09-16T09:46:15.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/510: mkdir d1/d3e/db5 0 2024-09-16T09:46:15.352 INFO:tasks.workunit.client.0.smithi111.stdout:7/511: write d1/d16/d17/d18/d1b/d79/daa/f8d [4217888,45107] 0 2024-09-16T09:46:15.353 INFO:tasks.workunit.client.0.smithi111.stdout:3/788: truncate d5/da/db/d3a/d6d/ffb 4955457 0 2024-09-16T09:46:15.354 INFO:tasks.workunit.client.0.smithi111.stdout:2/725: dwrite d0/fa7 [0,4194304] 0 2024-09-16T09:46:15.355 INFO:tasks.workunit.client.0.smithi111.stdout:7/512: rmdir d1/d3e/db5 0 2024-09-16T09:46:15.356 INFO:tasks.workunit.client.0.smithi111.stdout:3/789: getdents d5/da/db/d35/d45/da1 0 2024-09-16T09:46:15.359 INFO:tasks.workunit.client.0.smithi111.stdout:3/790: rename d5/da/db/d35/cfe to d5/da/db/d5a/c109 0 2024-09-16T09:46:15.359 INFO:tasks.workunit.client.0.smithi111.stdout:3/791: readlink d5/da/db/d3a/l73 0 2024-09-16T09:46:15.363 INFO:tasks.workunit.client.0.smithi111.stdout:3/792: link d5/da/f6f d5/da/f10a 0 2024-09-16T09:46:15.364 INFO:tasks.workunit.client.0.smithi111.stdout:7/513: dread d1/d16/d17/d18/d1b/d79/daa/f8d [0,4194304] 0 2024-09-16T09:46:15.365 INFO:tasks.workunit.client.0.smithi111.stdout:7/514: chown d1/d16/d17/d18/d1b/d79/daa/l49 4467 1 2024-09-16T09:46:15.365 INFO:tasks.workunit.client.0.smithi111.stdout:3/793: symlink d5/da/db/d3a/d6d/l10b 0 2024-09-16T09:46:15.365 INFO:tasks.workunit.client.0.smithi111.stdout:7/515: dread d1/d16/d17/d18/d1b/d79/daa/f83 [0,4194304] 0 2024-09-16T09:46:15.366 INFO:tasks.workunit.client.0.smithi111.stdout:3/794: truncate d5/da/d42/d74/da4/fe0 1713051 0 2024-09-16T09:46:15.367 INFO:tasks.workunit.client.0.smithi111.stdout:7/516: mkdir d1/d16/db6 0 2024-09-16T09:46:15.370 INFO:tasks.workunit.client.0.smithi111.stdout:7/517: creat d1/d16/d17/d18/d1b/d79/d8c/d98/fb7 x:0 0 0 2024-09-16T09:46:15.370 INFO:tasks.workunit.client.0.smithi111.stdout:7/518: stat d1/d20/c65 0 2024-09-16T09:46:15.370 INFO:tasks.workunit.client.0.smithi111.stdout:7/519: write d1/d16/d17/f9b [2024026,96328] 0 2024-09-16T09:46:15.371 INFO:tasks.workunit.client.0.smithi111.stdout:2/726: dwrite d0/da/f3a [0,4194304] 0 2024-09-16T09:46:15.371 INFO:tasks.workunit.client.0.smithi111.stdout:7/520: creat d1/d16/d17/d18/d1b/d79/daa/fb8 x:0 0 0 2024-09-16T09:46:15.371 INFO:tasks.workunit.client.0.smithi111.stdout:7/521: dread d1/d3e/f74 [0,4194304] 0 2024-09-16T09:46:15.375 INFO:tasks.workunit.client.0.smithi111.stdout:2/727: creat d0/d2/f100 x:0 0 0 2024-09-16T09:46:15.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/728: unlink d0/f7 0 2024-09-16T09:46:15.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/729: readlink d0/d2/d59/l87 0 2024-09-16T09:46:15.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/730: chown d0/da/d4e/fa9 29716289 1 2024-09-16T09:46:15.379 INFO:tasks.workunit.client.0.smithi111.stdout:2/731: creat d0/d2/d59/d86/d96/f101 x:0 0 0 2024-09-16T09:46:15.382 INFO:tasks.workunit.client.0.smithi111.stdout:7/522: dread d1/d16/f1c [0,4194304] 0 2024-09-16T09:46:15.382 INFO:tasks.workunit.client.0.smithi111.stdout:7/523: getdents d1/d16/d17/d18/d1b/d79/d8c 0 2024-09-16T09:46:15.383 INFO:tasks.workunit.client.0.smithi111.stdout:7/524: fsync d1/d16/d17/d18/d1b/f5e 0 2024-09-16T09:46:15.383 INFO:tasks.workunit.client.0.smithi111.stdout:7/525: getdents d1/d59 0 2024-09-16T09:46:15.384 INFO:tasks.workunit.client.0.smithi111.stdout:7/526: creat d1/d9/fb9 x:0 0 0 2024-09-16T09:46:15.390 INFO:tasks.workunit.client.0.smithi111.stdout:2/732: read d0/d22/f23 [3942888,1973] 0 2024-09-16T09:46:15.390 INFO:tasks.workunit.client.0.smithi111.stdout:3/795: read d5/da/d42/d74/da4/fe0 [788688,39599] 0 2024-09-16T09:46:15.392 INFO:tasks.workunit.client.0.smithi111.stdout:2/733: rename d0/d2/fad to d0/d45/d5c/d67/d63/dd4/dc3/dc8/f102 0 2024-09-16T09:46:15.393 INFO:tasks.workunit.client.0.smithi111.stdout:7/527: write d1/d16/d17/d18/f6f [1313435,47436] 0 2024-09-16T09:46:15.396 INFO:tasks.workunit.client.0.smithi111.stdout:3/796: rename d5/da/dc4 to d5/da/db/d3a/d6d/dd1/d10c 0 2024-09-16T09:46:15.402 INFO:tasks.workunit.client.0.smithi111.stdout:3/797: link d5/da/d42/d74/da4/fd7 d5/da/db/de/ddb/dcd/f10d 0 2024-09-16T09:46:15.402 INFO:tasks.workunit.client.0.smithi111.stdout:7/528: link d1/d9/f1f d1/d9/d43/d82/fba 0 2024-09-16T09:46:15.402 INFO:tasks.workunit.client.0.smithi111.stdout:7/529: write d1/d16/d17/d18/f6f [280009,127201] 0 2024-09-16T09:46:15.403 INFO:tasks.workunit.client.0.smithi111.stdout:3/798: mkdir d5/d18/d78/dfd/da0/d10e 0 2024-09-16T09:46:15.404 INFO:tasks.workunit.client.0.smithi111.stdout:7/530: creat d1/d16/d17/d18/d1b/d79/da5/db2/fbb x:0 0 0 2024-09-16T09:46:15.404 INFO:tasks.workunit.client.0.smithi111.stdout:7/531: readlink d1/d16/d17/d18/d1b/l68 0 2024-09-16T09:46:15.406 INFO:tasks.workunit.client.0.smithi111.stdout:7/532: mknod d1/d16/d17/d18/d1d/cbc 0 2024-09-16T09:46:15.407 INFO:tasks.workunit.client.0.smithi111.stdout:7/533: write d1/d16/d17/d18/d1b/f5e [481441,103627] 0 2024-09-16T09:46:15.407 INFO:tasks.workunit.client.0.smithi111.stdout:3/799: symlink d5/da/l10f 0 2024-09-16T09:46:15.408 INFO:tasks.workunit.client.0.smithi111.stdout:3/800: getdents d5/da/db/d3a/d6d/dd1/d10c 0 2024-09-16T09:46:15.410 INFO:tasks.workunit.client.0.smithi111.stdout:3/801: symlink d5/d18/d78/dfd/da0/l110 0 2024-09-16T09:46:15.419 INFO:tasks.workunit.client.0.smithi111.stdout:1/556: sync 2024-09-16T09:46:15.421 INFO:tasks.workunit.client.0.smithi111.stdout:1/557: link d3/d24/f75 d3/d10/d23/d8e/fb8 0 2024-09-16T09:46:15.421 INFO:tasks.workunit.client.0.smithi111.stdout:1/558: write d3/d10/d72/f9e [243523,3370] 0 2024-09-16T09:46:15.421 INFO:tasks.workunit.client.0.smithi111.stdout:3/802: dread d5/d18/d78/dfd/f53 [0,4194304] 0 2024-09-16T09:46:15.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/534: dwrite d1/d16/d17/d18/d1d/d2f/f7e [0,4194304] 0 2024-09-16T09:46:15.429 INFO:tasks.workunit.client.0.smithi111.stdout:7/535: dread d1/d16/d17/d18/d1d/d2f/f75 [0,4194304] 0 2024-09-16T09:46:15.432 INFO:tasks.workunit.client.0.smithi111.stdout:7/536: unlink d1/f1a 0 2024-09-16T09:46:15.432 INFO:tasks.workunit.client.0.smithi111.stdout:7/537: write d1/d16/d17/d18/d4f/d56/fa1 [13638,45245] 0 2024-09-16T09:46:15.432 INFO:tasks.workunit.client.0.smithi111.stdout:7/538: write d1/d16/d17/d18/d4f/d56/f5a [1368766,16345] 0 2024-09-16T09:46:15.433 INFO:tasks.workunit.client.0.smithi111.stdout:7/539: rmdir d1/d16/d17/d18/d1b/d79/da5/db2 39 2024-09-16T09:46:15.434 INFO:tasks.workunit.client.0.smithi111.stdout:7/540: creat d1/d3e/d9f/fbd x:0 0 0 2024-09-16T09:46:15.435 INFO:tasks.workunit.client.0.smithi111.stdout:7/541: symlink d1/d16/d17/d18/d1d/lbe 0 2024-09-16T09:46:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:7/542: symlink d1/d3e/d9f/lbf 0 2024-09-16T09:46:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:7/543: dread - d1/d16/d17/d18/d1b/d79/daa/fb8 zero size 2024-09-16T09:46:15.438 INFO:tasks.workunit.client.0.smithi111.stdout:7/544: stat d1/d16/d17/d18/d1d 0 2024-09-16T09:46:15.443 INFO:tasks.workunit.client.0.smithi111.stdout:7/545: write d1/d20/f42 [3320145,35058] 0 2024-09-16T09:46:15.444 INFO:tasks.workunit.client.0.smithi111.stdout:1/559: dwrite d3/d10/d72/da1/d28/d36/fa5 [0,4194304] 0 2024-09-16T09:46:15.444 INFO:tasks.workunit.client.0.smithi111.stdout:1/560: fdatasync d3/d10/d23/f8b 0 2024-09-16T09:46:15.444 INFO:tasks.workunit.client.0.smithi111.stdout:1/561: readlink d3/d10/d72/da1/d28/d36/d3d/d47/d65/d85/l9d 0 2024-09-16T09:46:15.445 INFO:tasks.workunit.client.0.smithi111.stdout:3/803: dwrite d5/da/db/d3a/d6d/f9a [0,4194304] 0 2024-09-16T09:46:15.480 INFO:tasks.workunit.client.0.smithi111.stdout:1/562: dwrite d3/f7 [4194304,4194304] 0 2024-09-16T09:46:15.480 INFO:tasks.workunit.client.0.smithi111.stdout:7/546: dwrite d1/d16/d17/d18/d1d/d2f/f7f [0,4194304] 0 2024-09-16T09:46:15.480 INFO:tasks.workunit.client.0.smithi111.stdout:7/547: write d1/d16/d17/d18/d1b/f6d [972140,23080] 0 2024-09-16T09:46:15.480 INFO:tasks.workunit.client.0.smithi111.stdout:7/548: write d1/d16/d17/d18/d1b/f5e [1577437,17686] 0 2024-09-16T09:46:15.480 INFO:tasks.workunit.client.0.smithi111.stdout:3/804: dwrite d5/d18/d78/dfd/da0/fda [0,4194304] 0 2024-09-16T09:46:15.481 INFO:tasks.workunit.client.0.smithi111.stdout:1/563: truncate d3/d24/d62/f81 20705 0 2024-09-16T09:46:15.485 INFO:tasks.workunit.client.0.smithi111.stdout:3/805: mkdir d5/da/d111 0 2024-09-16T09:46:15.488 INFO:tasks.workunit.client.0.smithi111.stdout:3/806: mkdir d5/da/db/d3a/d6d/de7/d88/db8/d112 0 2024-09-16T09:46:15.489 INFO:tasks.workunit.client.0.smithi111.stdout:3/807: creat d5/da/db/d3a/d6d/dd1/d10c/f113 x:0 0 0 2024-09-16T09:46:15.492 INFO:tasks.workunit.client.0.smithi111.stdout:3/808: creat d5/da/db/de/ddb/f114 x:0 0 0 2024-09-16T09:46:15.497 INFO:tasks.workunit.client.0.smithi111.stdout:3/809: dread d5/da/db/f14 [0,4194304] 0 2024-09-16T09:46:15.498 INFO:tasks.workunit.client.0.smithi111.stdout:3/810: write d5/d18/f24 [1753048,2300] 0 2024-09-16T09:46:15.512 INFO:tasks.workunit.client.0.smithi111.stdout:3/811: dwrite d5/da/db/d3a/d6d/de7/d75/f106 [0,4194304] 0 2024-09-16T09:46:15.515 INFO:tasks.workunit.client.0.smithi111.stdout:3/812: rename d5/da/db/de/fb0 to d5/da/d42/f115 0 2024-09-16T09:46:15.515 INFO:tasks.workunit.client.0.smithi111.stdout:3/813: stat d5/da/cf0 0 2024-09-16T09:46:15.515 INFO:tasks.workunit.client.0.smithi111.stdout:3/814: readlink d5/l71 0 2024-09-16T09:46:15.518 INFO:tasks.workunit.client.0.smithi111.stdout:3/815: rename d5/da/db/de/f28 to d5/da/db/d5a/f116 0 2024-09-16T09:46:15.521 INFO:tasks.workunit.client.0.smithi111.stdout:3/816: creat d5/d18/d78/dfd/f117 x:0 0 0 2024-09-16T09:46:15.527 INFO:tasks.workunit.client.0.smithi111.stdout:3/817: mknod d5/da/db/d5a/df8/c118 0 2024-09-16T09:46:15.527 INFO:tasks.workunit.client.0.smithi111.stdout:3/818: fsync d5/da/d92/fb9 0 2024-09-16T09:46:15.527 INFO:tasks.workunit.client.0.smithi111.stdout:3/819: readlink d5/da/d42/l6b 0 2024-09-16T09:46:15.529 INFO:tasks.workunit.client.0.smithi111.stdout:3/820: rmdir d5/da/db 39 2024-09-16T09:46:15.531 INFO:tasks.workunit.client.0.smithi111.stdout:3/821: creat d5/f119 x:0 0 0 2024-09-16T09:46:15.541 INFO:tasks.workunit.client.0.smithi111.stdout:3/822: dread d5/da/d42/f115 [0,4194304] 0 2024-09-16T09:46:15.541 INFO:tasks.workunit.client.0.smithi111.stdout:3/823: dread - d5/d18/d78/f105 zero size 2024-09-16T09:46:15.541 INFO:tasks.workunit.client.0.smithi111.stdout:3/824: readlink d5/d18/d78/dfd/da0/l110 0 2024-09-16T09:46:15.541 INFO:tasks.workunit.client.0.smithi111.stdout:3/825: read d5/da/db/d35/f81 [76005,59790] 0 2024-09-16T09:46:15.551 INFO:tasks.workunit.client.0.smithi111.stdout:3/826: dread d5/da/db/d3a/d6d/de7/d75/f106 [0,4194304] 0 2024-09-16T09:46:15.555 INFO:tasks.workunit.client.0.smithi111.stdout:3/827: creat d5/da/db/d5a/df8/f11a x:0 0 0 2024-09-16T09:46:15.567 INFO:tasks.workunit.client.0.smithi111.stdout:3/828: dread d5/da/db/d3a/d6d/de7/fb7 [0,4194304] 0 2024-09-16T09:46:15.567 INFO:tasks.workunit.client.0.smithi111.stdout:3/829: fsync d5/da/db/d3a/d6d/de7/d88/fee 0 2024-09-16T09:46:15.568 INFO:tasks.workunit.client.0.smithi111.stdout:3/830: truncate d5/d18/d78/dfd/da0/dd9/fb4 2211203 0 2024-09-16T09:46:15.578 INFO:tasks.workunit.client.0.smithi111.stdout:3/831: read d5/d18/d78/dfd/da0/dd9/fb4 [1141101,29496] 0 2024-09-16T09:46:15.594 INFO:tasks.workunit.client.0.smithi111.stdout:8/703: sync 2024-09-16T09:46:15.594 INFO:tasks.workunit.client.0.smithi111.stdout:5/643: sync 2024-09-16T09:46:15.594 INFO:tasks.workunit.client.0.smithi111.stdout:0/595: sync 2024-09-16T09:46:15.594 INFO:tasks.workunit.client.0.smithi111.stdout:9/504: sync 2024-09-16T09:46:15.594 INFO:tasks.workunit.client.0.smithi111.stdout:4/559: sync 2024-09-16T09:46:15.594 INFO:tasks.workunit.client.0.smithi111.stdout:5/644: chown d19/d1b/d27/d2e/d98 129805 1 2024-09-16T09:46:15.595 INFO:tasks.workunit.client.0.smithi111.stdout:8/704: creat d3/de/d1e/d2e/d2f/da8/fea x:0 0 0 2024-09-16T09:46:15.595 INFO:tasks.workunit.client.0.smithi111.stdout:8/705: read d3/da/db/f53 [283369,119105] 0 2024-09-16T09:46:15.597 INFO:tasks.workunit.client.0.smithi111.stdout:9/505: creat d0/d6/d75/fae x:0 0 0 2024-09-16T09:46:15.598 INFO:tasks.workunit.client.0.smithi111.stdout:4/560: mknod d2/d6/dd/d1b/d6d/ca8 0 2024-09-16T09:46:15.599 INFO:tasks.workunit.client.0.smithi111.stdout:5/645: rmdir d19/d1b/d27/d83/d2a/dc4 39 2024-09-16T09:46:15.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/596: rename d0/cb to d0/ccf 0 2024-09-16T09:46:15.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/597: truncate d0/d26/d35/fbe 226503 0 2024-09-16T09:46:15.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/598: chown d0/d1d/d67/d3a/fa5 0 1 2024-09-16T09:46:15.603 INFO:tasks.workunit.client.0.smithi111.stdout:9/506: symlink d0/d21/d22/d6e/d51/laf 0 2024-09-16T09:46:15.604 INFO:tasks.workunit.client.0.smithi111.stdout:0/599: symlink d0/d1d/ld0 0 2024-09-16T09:46:15.604 INFO:tasks.workunit.client.0.smithi111.stdout:0/600: fsync d0/d1d/f2d 0 2024-09-16T09:46:15.606 INFO:tasks.workunit.client.0.smithi111.stdout:9/507: mkdir d0/d6/d45/db0 0 2024-09-16T09:46:15.607 INFO:tasks.workunit.client.0.smithi111.stdout:0/601: unlink d0/d26/d35/lcc 0 2024-09-16T09:46:15.609 INFO:tasks.workunit.client.0.smithi111.stdout:9/508: rmdir d0/d6c 39 2024-09-16T09:46:15.610 INFO:tasks.workunit.client.0.smithi111.stdout:0/602: getdents d0/dc1 0 2024-09-16T09:46:15.611 INFO:tasks.workunit.client.0.smithi111.stdout:0/603: creat d0/d1d/d67/d3a/d92/fd1 x:0 0 0 2024-09-16T09:46:15.611 INFO:tasks.workunit.client.0.smithi111.stdout:4/561: dread d2/d6/dd/d1c/d2f/fa3 [0,4194304] 0 2024-09-16T09:46:15.612 INFO:tasks.workunit.client.0.smithi111.stdout:4/562: chown d2/d6/dd/f28 115955308 1 2024-09-16T09:46:15.612 INFO:tasks.workunit.client.0.smithi111.stdout:5/646: dread d19/d1b/d27/d2e/f6d [0,4194304] 0 2024-09-16T09:46:15.612 INFO:tasks.workunit.client.0.smithi111.stdout:5/647: readlink d19/d1b/d1e/d21/lbb 0 2024-09-16T09:46:15.614 INFO:tasks.workunit.client.0.smithi111.stdout:4/563: creat d2/d6/dd/d1b/d6d/d8f/fa9 x:0 0 0 2024-09-16T09:46:15.616 INFO:tasks.workunit.client.0.smithi111.stdout:5/648: rename d19/d1b/d27/d2e/d39/d54/d60/dd5 to d19/d1b/d27/d83/d2a/de2 0 2024-09-16T09:46:15.617 INFO:tasks.workunit.client.0.smithi111.stdout:4/564: creat d2/d6/faa x:0 0 0 2024-09-16T09:46:15.617 INFO:tasks.workunit.client.0.smithi111.stdout:4/565: dread - d2/d30/d44/d69/f8b zero size 2024-09-16T09:46:15.618 INFO:tasks.workunit.client.0.smithi111.stdout:5/649: creat d19/d1b/d27/d2e/d39/d54/d60/dc9/dda/fe3 x:0 0 0 2024-09-16T09:46:15.619 INFO:tasks.workunit.client.0.smithi111.stdout:8/706: dwrite d3/d26/d6d/f57 [0,4194304] 0 2024-09-16T09:46:15.619 INFO:tasks.workunit.client.0.smithi111.stdout:5/650: symlink d19/d1b/d1e/le4 0 2024-09-16T09:46:15.620 INFO:tasks.workunit.client.0.smithi111.stdout:5/651: write d19/d1b/d27/d83/d2a/f71 [5046973,30860] 0 2024-09-16T09:46:15.622 INFO:tasks.workunit.client.0.smithi111.stdout:4/566: rename d2/d6/c10 to d2/d6/dd/d1c/d2f/d6c/d9c/cab 0 2024-09-16T09:46:15.622 INFO:tasks.workunit.client.0.smithi111.stdout:4/567: write d2/d6/dd/d1b/d6d/d8f/fa9 [494988,91138] 0 2024-09-16T09:46:15.625 INFO:tasks.workunit.client.0.smithi111.stdout:9/509: dread d0/d6/d8/de/d56/f71 [0,4194304] 0 2024-09-16T09:46:15.625 INFO:tasks.workunit.client.0.smithi111.stdout:8/707: mknod d3/da/db/d59/dd7/d9e/ceb 0 2024-09-16T09:46:15.629 INFO:tasks.workunit.client.0.smithi111.stdout:4/568: mkdir d2/d6/dd/d1b/d38/d64/dac 0 2024-09-16T09:46:15.629 INFO:tasks.workunit.client.0.smithi111.stdout:5/652: dread d19/f48 [0,4194304] 0 2024-09-16T09:46:15.631 INFO:tasks.workunit.client.0.smithi111.stdout:9/510: creat d0/d6/d30/fb1 x:0 0 0 2024-09-16T09:46:15.631 INFO:tasks.workunit.client.0.smithi111.stdout:9/511: stat d0/d6/d45/l49 0 2024-09-16T09:46:15.632 INFO:tasks.workunit.client.0.smithi111.stdout:8/708: rmdir d3/de/d1e/d2e/d74/d83 39 2024-09-16T09:46:15.634 INFO:tasks.workunit.client.0.smithi111.stdout:4/569: creat d2/d6/dd/d1c/d2f/d4e/fad x:0 0 0 2024-09-16T09:46:15.636 INFO:tasks.workunit.client.0.smithi111.stdout:8/709: symlink d3/da/db/d59/dd7/lec 0 2024-09-16T09:46:15.636 INFO:tasks.workunit.client.0.smithi111.stdout:8/710: readlink d3/d26/d6d/ld0 0 2024-09-16T09:46:15.636 INFO:tasks.workunit.client.0.smithi111.stdout:0/604: dwrite d0/d1d/d58/d64/d4f/f75 [4194304,4194304] 0 2024-09-16T09:46:15.638 INFO:tasks.workunit.client.0.smithi111.stdout:8/711: mknod d3/de/d1e/d2e/dce/ced 0 2024-09-16T09:46:15.638 INFO:tasks.workunit.client.0.smithi111.stdout:8/712: chown d3/d26/d6d/db6/fc6 1718 1 2024-09-16T09:46:15.641 INFO:tasks.workunit.client.0.smithi111.stdout:9/512: dread d0/d6/d8/f26 [0,4194304] 0 2024-09-16T09:46:15.641 INFO:tasks.workunit.client.0.smithi111.stdout:9/513: chown d0/d6/d8/c3a 42396 1 2024-09-16T09:46:15.642 INFO:tasks.workunit.client.0.smithi111.stdout:5/653: dread d19/d1b/d1e/f55 [0,4194304] 0 2024-09-16T09:46:15.642 INFO:tasks.workunit.client.0.smithi111.stdout:5/654: truncate d19/d1b/d27/d83/d2a/fde 4307132 0 2024-09-16T09:46:15.643 INFO:tasks.workunit.client.0.smithi111.stdout:0/605: symlink d0/d1d/d67/d3a/d77/ld2 0 2024-09-16T09:46:15.645 INFO:tasks.workunit.client.0.smithi111.stdout:5/655: creat d19/d1b/d27/d2e/d4a/d4b/dac/fe5 x:0 0 0 2024-09-16T09:46:15.648 INFO:tasks.workunit.client.0.smithi111.stdout:0/606: creat d0/d1d/d58/d64/d5e/fd3 x:0 0 0 2024-09-16T09:46:15.648 INFO:tasks.workunit.client.0.smithi111.stdout:0/607: write d0/d1d/d67/d3a/d92/fd1 [493172,97521] 0 2024-09-16T09:46:15.650 INFO:tasks.workunit.client.0.smithi111.stdout:0/608: link d0/d1d/d67/d3a/d77/c89 d0/d26/cd4 0 2024-09-16T09:46:15.651 INFO:tasks.workunit.client.0.smithi111.stdout:0/609: rmdir d0/da4 39 2024-09-16T09:46:15.652 INFO:tasks.workunit.client.0.smithi111.stdout:0/610: creat d0/d26/d35/d86/fd5 x:0 0 0 2024-09-16T09:46:15.653 INFO:tasks.workunit.client.0.smithi111.stdout:0/611: mkdir d0/d1d/d58/d64/dd6 0 2024-09-16T09:46:15.663 INFO:tasks.workunit.client.0.smithi111.stdout:8/713: dwrite d3/de/fd2 [0,4194304] 0 2024-09-16T09:46:15.663 INFO:tasks.workunit.client.0.smithi111.stdout:8/714: write d3/da/db/d59/dd7/f85 [546685,129894] 0 2024-09-16T09:46:15.664 INFO:tasks.workunit.client.0.smithi111.stdout:0/612: dread d0/f1c [0,4194304] 0 2024-09-16T09:46:15.664 INFO:tasks.workunit.client.0.smithi111.stdout:8/715: fsync d3/d26/f55 0 2024-09-16T09:46:15.664 INFO:tasks.workunit.client.0.smithi111.stdout:0/613: dread - d0/d1d/d58/d64/d5e/fd3 zero size 2024-09-16T09:46:15.664 INFO:tasks.workunit.client.0.smithi111.stdout:8/716: truncate d3/de/d6e/fdb 675769 0 2024-09-16T09:46:15.669 INFO:tasks.workunit.client.0.smithi111.stdout:8/717: truncate d3/da/db/f7b 48403 0 2024-09-16T09:46:15.671 INFO:tasks.workunit.client.0.smithi111.stdout:8/718: creat d3/da/db/d59/dd7/d9e/dd8/fee x:0 0 0 2024-09-16T09:46:15.675 INFO:tasks.workunit.client.0.smithi111.stdout:5/656: dwrite d19/d1b/d27/d83/d2a/f7c [0,4194304] 0 2024-09-16T09:46:15.676 INFO:tasks.workunit.client.0.smithi111.stdout:9/514: dwrite d0/d6/d8/de/d56/f71 [0,4194304] 0 2024-09-16T09:46:15.681 INFO:tasks.workunit.client.0.smithi111.stdout:5/657: creat d19/d1b/d27/d2e/d39/dc6/fe6 x:0 0 0 2024-09-16T09:46:15.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/515: truncate d0/d6/d8/de/f11 28085 0 2024-09-16T09:46:15.681 INFO:tasks.workunit.client.0.smithi111.stdout:9/516: dread - d0/d48/d9d/fa3 zero size 2024-09-16T09:46:15.684 INFO:tasks.workunit.client.0.smithi111.stdout:5/658: creat d19/d1b/d1e/d21/fe7 x:0 0 0 2024-09-16T09:46:15.684 INFO:tasks.workunit.client.0.smithi111.stdout:5/659: write d19/d1b/d27/d83/f2b [4348966,64805] 0 2024-09-16T09:46:15.685 INFO:tasks.workunit.client.0.smithi111.stdout:5/660: chown d19/d1b/d1e/d41/l4f 1197 1 2024-09-16T09:46:15.685 INFO:tasks.workunit.client.0.smithi111.stdout:5/661: fsync d19/d1b/d1e/d81/fcb 0 2024-09-16T09:46:15.686 INFO:tasks.workunit.client.0.smithi111.stdout:9/517: rename d0/d6/ca to d0/d21/d22/d6e/d7d/cb2 0 2024-09-16T09:46:15.689 INFO:tasks.workunit.client.0.smithi111.stdout:5/662: link d19/d1b/d1e/d21/d29/d32/d8f/c96 d19/d1b/d27/d2e/d4a/d4b/dd7/ce8 0 2024-09-16T09:46:15.693 INFO:tasks.workunit.client.0.smithi111.stdout:5/663: dread d19/d1b/d27/d9d/fc7 [0,4194304] 0 2024-09-16T09:46:15.696 INFO:tasks.workunit.client.0.smithi111.stdout:0/614: dwrite d0/f17 [0,4194304] 0 2024-09-16T09:46:15.696 INFO:tasks.workunit.client.0.smithi111.stdout:5/664: symlink d19/d1b/d1e/d21/d29/d32/d8f/le9 0 2024-09-16T09:46:15.696 INFO:tasks.workunit.client.0.smithi111.stdout:8/719: dwrite d3/dc3/fe0 [0,4194304] 0 2024-09-16T09:46:15.698 INFO:tasks.workunit.client.0.smithi111.stdout:5/665: creat d19/d1b/d27/d83/fea x:0 0 0 2024-09-16T09:46:15.700 INFO:tasks.workunit.client.0.smithi111.stdout:0/615: write d0/d1d/d67/d3a/d80/f78 [356826,6285] 0 2024-09-16T09:46:15.701 INFO:tasks.workunit.client.0.smithi111.stdout:0/616: fdatasync d0/d1d/d58/d64/faf 0 2024-09-16T09:46:15.701 INFO:tasks.workunit.client.0.smithi111.stdout:0/617: write d0/d1d/f30 [1839569,81079] 0 2024-09-16T09:46:15.705 INFO:tasks.workunit.client.0.smithi111.stdout:9/518: dwrite d0/d6/d8/f36 [0,4194304] 0 2024-09-16T09:46:15.714 INFO:tasks.workunit.client.0.smithi111.stdout:8/720: creat d3/da/db/d59/de5/fef x:0 0 0 2024-09-16T09:46:15.714 INFO:tasks.workunit.client.0.smithi111.stdout:8/721: truncate d3/da/db/d59/de5/fef 613500 0 2024-09-16T09:46:15.714 INFO:tasks.workunit.client.0.smithi111.stdout:8/722: fsync d3/de/d1e/d2e/d2f/da8/dbe/f69 0 2024-09-16T09:46:15.718 INFO:tasks.workunit.client.0.smithi111.stdout:5/666: rename d19/d1b/d27/d2e/d39/d54/d60/dc9/dda to d19/d1b/d9f/deb 0 2024-09-16T09:46:15.723 INFO:tasks.workunit.client.0.smithi111.stdout:0/618: creat d0/d1d/d58/d64/fd7 x:0 0 0 2024-09-16T09:46:15.727 INFO:tasks.workunit.client.0.smithi111.stdout:8/723: link d3/da/db/d59/dd7/dcc/cdd d3/de/d1e/d2e/d2f/da8/dbe/cf0 0 2024-09-16T09:46:15.732 INFO:tasks.workunit.client.0.smithi111.stdout:9/519: rename d0/d48/f6b to d0/d6/d8/de/d56/d4e/d92/fb3 0 2024-09-16T09:46:15.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/667: mkdir d19/d1b/d1e/d81/dec 0 2024-09-16T09:46:15.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/668: readlink d19/d1b/d1e/d21/d29/l2f 0 2024-09-16T09:46:15.737 INFO:tasks.workunit.client.0.smithi111.stdout:0/619: dwrite d0/f31 [0,4194304] 0 2024-09-16T09:46:15.746 INFO:tasks.workunit.client.0.smithi111.stdout:8/724: dwrite d3/de/d6e/fdb [0,4194304] 0 2024-09-16T09:46:15.756 INFO:tasks.workunit.client.0.smithi111.stdout:0/620: dwrite d0/d1d/d67/d3a/d80/f56 [4194304,4194304] 0 2024-09-16T09:46:15.758 INFO:tasks.workunit.client.0.smithi111.stdout:8/725: dread d3/da/db/d59/dd7/f85 [0,4194304] 0 2024-09-16T09:46:15.781 INFO:tasks.workunit.client.0.smithi111.stdout:0/621: dwrite d0/d26/d35/d86/fa3 [0,4194304] 0 2024-09-16T09:46:15.781 INFO:tasks.workunit.client.0.smithi111.stdout:8/726: dwrite d3/da/db/d59/dd7/f47 [0,4194304] 0 2024-09-16T09:46:15.786 INFO:tasks.workunit.client.0.smithi111.stdout:8/727: dread d3/de/d1e/d2e/d2f/d4c/f9b [0,4194304] 0 2024-09-16T09:46:15.796 INFO:tasks.workunit.client.0.smithi111.stdout:8/728: write d3/de/d1e/d2e/d74/d83/da2/fbd [1155349,111744] 0 2024-09-16T09:46:15.801 INFO:tasks.workunit.client.0.smithi111.stdout:0/622: dwrite d0/da4/f7c [0,4194304] 0 2024-09-16T09:46:15.801 INFO:tasks.workunit.client.0.smithi111.stdout:0/623: stat d0/d26/d35/d86 0 2024-09-16T09:46:15.814 INFO:tasks.workunit.client.0.smithi111.stdout:9/520: unlink d0/d6/d8/de/d56/f71 0 2024-09-16T09:46:15.815 INFO:tasks.workunit.client.0.smithi111.stdout:5/669: symlink d19/d1b/d27/d83/d2a/dc4/dc0/db1/led 0 2024-09-16T09:46:15.830 INFO:tasks.workunit.client.0.smithi111.stdout:8/729: link d3/c84 d3/de/d1e/d2e/dce/cf1 0 2024-09-16T09:46:15.831 INFO:tasks.workunit.client.0.smithi111.stdout:5/670: dwrite d19/d1b/d27/d2e/d39/d54/d60/fdb [0,4194304] 0 2024-09-16T09:46:15.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/624: mknod d0/d1d/d58/cd8 0 2024-09-16T09:46:15.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/625: chown d0/d1d/d58/d83/lca 293123 1 2024-09-16T09:46:15.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/626: dread - d0/d1d/d67/d3a/d3d/d59/f85 zero size 2024-09-16T09:46:15.838 INFO:tasks.workunit.client.0.smithi111.stdout:9/521: link d0/d6/d30/l5b d0/d21/d22/d6e/d7d/lb4 0 2024-09-16T09:46:15.838 INFO:tasks.workunit.client.0.smithi111.stdout:9/522: dread - d0/d7b/fa5 zero size 2024-09-16T09:46:15.839 INFO:tasks.workunit.client.0.smithi111.stdout:9/523: read d0/d21/d22/f3e [900932,51734] 0 2024-09-16T09:46:15.839 INFO:tasks.workunit.client.0.smithi111.stdout:9/524: write d0/d21/d22/d6e/f97 [1586226,79704] 0 2024-09-16T09:46:15.839 INFO:tasks.workunit.client.0.smithi111.stdout:8/730: rename d3/dc3/lc4 to d3/da/db/d59/de5/lf2 0 2024-09-16T09:46:15.839 INFO:tasks.workunit.client.0.smithi111.stdout:8/731: write d3/de/d1e/d2e/f92 [484345,125161] 0 2024-09-16T09:46:15.842 INFO:tasks.workunit.client.0.smithi111.stdout:5/671: mkdir d19/d1b/d1e/d21/d29/d32/dee 0 2024-09-16T09:46:15.844 INFO:tasks.workunit.client.0.smithi111.stdout:9/525: dread d0/d21/f66 [0,4194304] 0 2024-09-16T09:46:15.844 INFO:tasks.workunit.client.0.smithi111.stdout:0/627: mkdir d0/d1d/d58/d83/d9a/dd9 0 2024-09-16T09:46:15.846 INFO:tasks.workunit.client.0.smithi111.stdout:8/732: rename d3/de/d1e/d2e/dce/ced to d3/da/db/d59/cf3 0 2024-09-16T09:46:15.846 INFO:tasks.workunit.client.0.smithi111.stdout:8/733: stat d3/da/db/d59 0 2024-09-16T09:46:15.847 INFO:tasks.workunit.client.0.smithi111.stdout:0/628: creat d0/d1d/d67/fda x:0 0 0 2024-09-16T09:46:15.848 INFO:tasks.workunit.client.0.smithi111.stdout:8/734: unlink d3/d26/fd9 0 2024-09-16T09:46:15.850 INFO:tasks.workunit.client.0.smithi111.stdout:0/629: creat d0/d1d/d67/fdb x:0 0 0 2024-09-16T09:46:15.850 INFO:tasks.workunit.client.0.smithi111.stdout:8/735: truncate d3/d26/f40 1196552 0 2024-09-16T09:46:15.852 INFO:tasks.workunit.client.0.smithi111.stdout:0/630: creat d0/d1d/d58/d83/fdc x:0 0 0 2024-09-16T09:46:15.855 INFO:tasks.workunit.client.0.smithi111.stdout:0/631: rename d0/d1d/d58/d64/d5e to d0/da4/ddd 0 2024-09-16T09:46:15.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/632: rmdir d0/d1d/d67/d3a/d3d/d59 39 2024-09-16T09:46:15.857 INFO:tasks.workunit.client.0.smithi111.stdout:0/633: chown d0/d1d/d67/fa7 48784 1 2024-09-16T09:46:15.859 INFO:tasks.workunit.client.0.smithi111.stdout:6/547: sync 2024-09-16T09:46:15.859 INFO:tasks.workunit.client.0.smithi111.stdout:6/548: stat d0/d57/db0/d47/d88 0 2024-09-16T09:46:15.859 INFO:tasks.workunit.client.0.smithi111.stdout:2/734: sync 2024-09-16T09:46:15.859 INFO:tasks.workunit.client.0.smithi111.stdout:0/634: symlink d0/d1d/d67/d3a/d3d/d59/lde 0 2024-09-16T09:46:15.860 INFO:tasks.workunit.client.0.smithi111.stdout:2/735: chown d0/d29/f42 2461 1 2024-09-16T09:46:15.860 INFO:tasks.workunit.client.0.smithi111.stdout:2/736: write d0/d45/fdc [42165,29144] 0 2024-09-16T09:46:15.860 INFO:tasks.workunit.client.0.smithi111.stdout:0/635: write d0/d1d/d67/d3a/f8d [1457722,118579] 0 2024-09-16T09:46:15.860 INFO:tasks.workunit.client.0.smithi111.stdout:2/737: write d0/fb9 [833841,125262] 0 2024-09-16T09:46:15.861 INFO:tasks.workunit.client.0.smithi111.stdout:6/549: mkdir d0/d57/db0/d14/d20/d42/dbd 0 2024-09-16T09:46:15.861 INFO:tasks.workunit.client.0.smithi111.stdout:6/550: dread - d0/d57/db0/d14/d20/d42/f5c zero size 2024-09-16T09:46:15.862 INFO:tasks.workunit.client.0.smithi111.stdout:0/636: mkdir d0/d1d/d58/d64/dd6/ddf 0 2024-09-16T09:46:15.862 INFO:tasks.workunit.client.0.smithi111.stdout:0/637: write d0/d1d/d58/d64/d4f/faa [425947,64320] 0 2024-09-16T09:46:15.863 INFO:tasks.workunit.client.0.smithi111.stdout:2/738: dread d0/da/f5f [0,4194304] 0 2024-09-16T09:46:15.864 INFO:tasks.workunit.client.0.smithi111.stdout:2/739: stat d0/d45/l7d 0 2024-09-16T09:46:15.865 INFO:tasks.workunit.client.0.smithi111.stdout:5/672: dwrite d19/d1b/d27/d2e/f91 [0,4194304] 0 2024-09-16T09:46:15.868 INFO:tasks.workunit.client.0.smithi111.stdout:0/638: rename d0/d26/l3f to d0/d1d/d58/d64/le0 0 2024-09-16T09:46:15.869 INFO:tasks.workunit.client.0.smithi111.stdout:0/639: stat d0/d1d/d67/fc4 0 2024-09-16T09:46:15.869 INFO:tasks.workunit.client.0.smithi111.stdout:0/640: dread - d0/d1d/d67/d3a/d77/dad/fc9 zero size 2024-09-16T09:46:15.872 INFO:tasks.workunit.client.0.smithi111.stdout:9/526: dwrite d0/f3f [0,4194304] 0 2024-09-16T09:46:15.872 INFO:tasks.workunit.client.0.smithi111.stdout:8/736: dwrite d3/f50 [0,4194304] 0 2024-09-16T09:46:15.877 INFO:tasks.workunit.client.0.smithi111.stdout:2/740: write d0/d21/f4f [1282025,129693] 0 2024-09-16T09:46:15.877 INFO:tasks.workunit.client.0.smithi111.stdout:2/741: chown d0/da/d4e/lc0 143831930 1 2024-09-16T09:46:15.881 INFO:tasks.workunit.client.0.smithi111.stdout:0/641: link d0/d1d/d67/d3a/d3d/d59/lde d0/d1d/d67/d3a/d80/le1 0 2024-09-16T09:46:15.883 INFO:tasks.workunit.client.0.smithi111.stdout:8/737: dread d3/da/db/fc8 [0,4194304] 0 2024-09-16T09:46:15.886 INFO:tasks.workunit.client.0.smithi111.stdout:2/742: creat d0/da6/f103 x:0 0 0 2024-09-16T09:46:15.887 INFO:tasks.workunit.client.0.smithi111.stdout:0/642: creat d0/d26/d35/fe2 x:0 0 0 2024-09-16T09:46:15.888 INFO:tasks.workunit.client.0.smithi111.stdout:8/738: symlink d3/de/d1e/d2e/d2f/d4c/lf4 0 2024-09-16T09:46:15.890 INFO:tasks.workunit.client.0.smithi111.stdout:0/643: mkdir d0/de3 0 2024-09-16T09:46:15.891 INFO:tasks.workunit.client.0.smithi111.stdout:0/644: creat d0/de3/fe4 x:0 0 0 2024-09-16T09:46:15.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/645: chown d0/da4/c8e 42558168 1 2024-09-16T09:46:15.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/646: truncate d0/d1d/d67/d3a/fac 4637083 0 2024-09-16T09:46:15.892 INFO:tasks.workunit.client.0.smithi111.stdout:0/647: chown d0/d1d/d67/f43 464 1 2024-09-16T09:46:15.893 INFO:tasks.workunit.client.0.smithi111.stdout:8/739: dread d3/de/f88 [0,4194304] 0 2024-09-16T09:46:15.893 INFO:tasks.workunit.client.0.smithi111.stdout:8/740: stat d3/de/fd2 0 2024-09-16T09:46:15.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/648: mkdir d0/d26/d35/d86/de5 0 2024-09-16T09:46:15.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/649: chown d0/d26/d35/d86/fcd 1711184 1 2024-09-16T09:46:15.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/650: write d0/f1c [4755955,117291] 0 2024-09-16T09:46:15.894 INFO:tasks.workunit.client.0.smithi111.stdout:0/651: readlink d0/d26/d35/d86/l9b 0 2024-09-16T09:46:15.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/741: creat d3/de/d1e/d2e/d74/ff5 x:0 0 0 2024-09-16T09:46:15.894 INFO:tasks.workunit.client.0.smithi111.stdout:8/742: readlink d3/da/db/d59/dd7/lec 0 2024-09-16T09:46:15.894 INFO:tasks.workunit.client.0.smithi111.stdout:0/652: mknod d0/dc1/ce6 0 2024-09-16T09:46:15.895 INFO:tasks.workunit.client.0.smithi111.stdout:5/673: dwrite d19/fab [0,4194304] 0 2024-09-16T09:46:15.896 INFO:tasks.workunit.client.0.smithi111.stdout:8/743: creat d3/da/db/d59/ff6 x:0 0 0 2024-09-16T09:46:15.896 INFO:tasks.workunit.client.0.smithi111.stdout:8/744: chown d3/de/d1e/d2e/d2f/da8/dbe/f60 6 1 2024-09-16T09:46:15.897 INFO:tasks.workunit.client.0.smithi111.stdout:9/527: dwrite d0/d21/f8f [0,4194304] 0 2024-09-16T09:46:15.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/674: creat d19/d1b/d27/d83/d2a/dc4/dc0/fef x:0 0 0 2024-09-16T09:46:15.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/675: write d19/d1b/d27/d2e/d4a/d4b/dac/fca [549310,8950] 0 2024-09-16T09:46:15.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/676: chown d19/d1b/d27/d83/d2a/dc4/dc0/db1 2317322 1 2024-09-16T09:46:15.901 INFO:tasks.workunit.client.0.smithi111.stdout:8/745: symlink d3/de/d1e/d2e/d2f/d4c/lf7 0 2024-09-16T09:46:15.903 INFO:tasks.workunit.client.0.smithi111.stdout:9/528: mknod d0/d6/d45/cb5 0 2024-09-16T09:46:15.904 INFO:tasks.workunit.client.0.smithi111.stdout:5/677: getdents d19/d1b/d27/d2e/d4a/d4b 0 2024-09-16T09:46:15.905 INFO:tasks.workunit.client.0.smithi111.stdout:8/746: creat d3/d26/ff8 x:0 0 0 2024-09-16T09:46:15.906 INFO:tasks.workunit.client.0.smithi111.stdout:9/529: creat d0/d6/d30/d81/fb6 x:0 0 0 2024-09-16T09:46:15.906 INFO:tasks.workunit.client.0.smithi111.stdout:9/530: write d0/d6c/d70/fa4 [1070078,91689] 0 2024-09-16T09:46:15.906 INFO:tasks.workunit.client.0.smithi111.stdout:9/531: dread - d0/d6/d30/d81/fa8 zero size 2024-09-16T09:46:15.908 INFO:tasks.workunit.client.0.smithi111.stdout:5/678: symlink d19/d1b/d27/d2e/d98/lf0 0 2024-09-16T09:46:15.908 INFO:tasks.workunit.client.0.smithi111.stdout:5/679: chown d19/c23 51522931 1 2024-09-16T09:46:15.908 INFO:tasks.workunit.client.0.smithi111.stdout:5/680: chown d19/la7 0 1 2024-09-16T09:46:15.910 INFO:tasks.workunit.client.0.smithi111.stdout:5/681: link d19/d1b/d27/d2e/d4a/d4b/d9c/fa8 d19/d1b/d27/d83/d2a/de2/ff1 0 2024-09-16T09:46:15.910 INFO:tasks.workunit.client.0.smithi111.stdout:2/743: dwrite d0/d22/fb3 [0,4194304] 0 2024-09-16T09:46:15.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/747: write d3/d26/d6d/fa6 [825225,63933] 0 2024-09-16T09:46:15.911 INFO:tasks.workunit.client.0.smithi111.stdout:5/682: unlink d19/d1b/d27/d83/fea 0 2024-09-16T09:46:15.912 INFO:tasks.workunit.client.0.smithi111.stdout:0/653: dwrite d0/da4/ddd/fd3 [0,4194304] 0 2024-09-16T09:46:15.913 INFO:tasks.workunit.client.0.smithi111.stdout:5/683: dread d19/f43 [0,4194304] 0 2024-09-16T09:46:15.913 INFO:tasks.workunit.client.0.smithi111.stdout:5/684: stat d19/d1b/d27/d83/d2a/dc4/dc0/db1/fd6 0 2024-09-16T09:46:15.914 INFO:tasks.workunit.client.0.smithi111.stdout:2/744: mknod d0/d45/d5c/d67/d63/dd4/dc3/dc8/c104 0 2024-09-16T09:46:15.917 INFO:tasks.workunit.client.0.smithi111.stdout:8/748: link d3/d26/d6d/fb5 d3/de/d1e/d2e/d74/dad/ff9 0 2024-09-16T09:46:15.917 INFO:tasks.workunit.client.0.smithi111.stdout:7/549: sync 2024-09-16T09:46:15.921 INFO:tasks.workunit.client.0.smithi111.stdout:0/654: symlink d0/de3/le7 0 2024-09-16T09:46:15.925 INFO:tasks.workunit.client.0.smithi111.stdout:5/685: mknod d19/d1b/d27/d83/d2a/dc4/dc0/cf2 0 2024-09-16T09:46:15.927 INFO:tasks.workunit.client.0.smithi111.stdout:2/745: symlink d0/d2/d59/d86/db1/l105 0 2024-09-16T09:46:15.927 INFO:tasks.workunit.client.0.smithi111.stdout:2/746: truncate d0/d22/fcc 4841079 0 2024-09-16T09:46:15.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/686: read d19/d1b/d27/d2e/d4a/d4b/dac/fca [136905,76634] 0 2024-09-16T09:46:15.931 INFO:tasks.workunit.client.0.smithi111.stdout:8/749: mknod d3/da/db/d59/de5/cfa 0 2024-09-16T09:46:15.935 INFO:tasks.workunit.client.0.smithi111.stdout:5/687: mkdir d19/d1b/d27/d2e/df3 0 2024-09-16T09:46:15.940 INFO:tasks.workunit.client.0.smithi111.stdout:8/750: creat d3/de/d1e/ffb x:0 0 0 2024-09-16T09:46:15.941 INFO:tasks.workunit.client.0.smithi111.stdout:5/688: mknod d19/d1b/d27/d2e/d39/d6c/cf4 0 2024-09-16T09:46:15.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/532: dwrite d0/d6/d45/f69 [0,4194304] 0 2024-09-16T09:46:15.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/533: fsync d0/d6c/d70/fa4 0 2024-09-16T09:46:15.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/534: readlink d0/d7b/l9f 0 2024-09-16T09:46:15.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/535: chown d0/d21/d22/d6e/dab 1902493 1 2024-09-16T09:46:15.942 INFO:tasks.workunit.client.0.smithi111.stdout:9/536: chown d0/d21/d22/d6e/d51/c54 582741 1 2024-09-16T09:46:15.943 INFO:tasks.workunit.client.0.smithi111.stdout:8/751: symlink d3/de/lfc 0 2024-09-16T09:46:15.943 INFO:tasks.workunit.client.0.smithi111.stdout:8/752: read - d3/de/d1e/fbf zero size 2024-09-16T09:46:15.943 INFO:tasks.workunit.client.0.smithi111.stdout:8/753: write d3/da/db/f7b [588281,75121] 0 2024-09-16T09:46:15.944 INFO:tasks.workunit.client.0.smithi111.stdout:5/689: mknod d19/d1b/d1e/d21/d29/d32/dee/cf5 0 2024-09-16T09:46:15.945 INFO:tasks.workunit.client.0.smithi111.stdout:9/537: creat d0/d21/d22/d6e/d51/fb7 x:0 0 0 2024-09-16T09:46:15.947 INFO:tasks.workunit.client.0.smithi111.stdout:8/754: symlink d3/d26/d6d/db6/de3/lfd 0 2024-09-16T09:46:15.947 INFO:tasks.workunit.client.0.smithi111.stdout:8/755: chown d3/d26/d6d/ld0 2 1 2024-09-16T09:46:15.949 INFO:tasks.workunit.client.0.smithi111.stdout:5/690: unlink d19/d1b/d27/d83/f66 0 2024-09-16T09:46:15.950 INFO:tasks.workunit.client.0.smithi111.stdout:5/691: getdents d19/d1b/d1e/d21/d29 0 2024-09-16T09:46:15.951 INFO:tasks.workunit.client.0.smithi111.stdout:5/692: mknod d19/d1b/d1e/d21/cf6 0 2024-09-16T09:46:15.958 INFO:tasks.workunit.client.0.smithi111.stdout:8/756: dread d3/de/d1e/f51 [0,4194304] 0 2024-09-16T09:46:15.958 INFO:tasks.workunit.client.0.smithi111.stdout:8/757: chown d3/l6 193613250 1 2024-09-16T09:46:15.959 INFO:tasks.workunit.client.0.smithi111.stdout:8/758: mknod d3/cfe 0 2024-09-16T09:46:15.960 INFO:tasks.workunit.client.0.smithi111.stdout:8/759: mkdir d3/dc3/dff 0 2024-09-16T09:46:15.960 INFO:tasks.workunit.client.0.smithi111.stdout:8/760: fsync d3/da/db/d59/dd7/d9e/dd8/f4e 0 2024-09-16T09:46:15.961 INFO:tasks.workunit.client.0.smithi111.stdout:0/655: dwrite d0/d1d/d67/fdb [0,4194304] 0 2024-09-16T09:46:15.961 INFO:tasks.workunit.client.0.smithi111.stdout:8/761: write d3/da/db/d59/dd7/d9e/dd8/f4e [34511,26729] 0 2024-09-16T09:46:15.965 INFO:tasks.workunit.client.0.smithi111.stdout:0/656: write d0/f1c [1608255,11874] 0 2024-09-16T09:46:15.967 INFO:tasks.workunit.client.0.smithi111.stdout:0/657: creat d0/de3/fe8 x:0 0 0 2024-09-16T09:46:15.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/658: mkdir d0/d1d/d58/d83/d9a/dd9/de9 0 2024-09-16T09:46:15.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/659: dread - d0/d1d/d67/d3a/d77/dad/fc9 zero size 2024-09-16T09:46:15.969 INFO:tasks.workunit.client.0.smithi111.stdout:0/660: fsync d0/dc1/fc6 0 2024-09-16T09:46:15.972 INFO:tasks.workunit.client.0.smithi111.stdout:0/661: unlink d0/d1d/d67/d3a/d3d/d59/f85 0 2024-09-16T09:46:15.973 INFO:tasks.workunit.client.0.smithi111.stdout:0/662: symlink d0/d1d/lea 0 2024-09-16T09:46:15.976 INFO:tasks.workunit.client.0.smithi111.stdout:2/747: dwrite d0/fa7 [0,4194304] 0 2024-09-16T09:46:15.976 INFO:tasks.workunit.client.0.smithi111.stdout:7/550: dwrite d1/d16/d17/d18/d4f/d56/f5a [0,4194304] 0 2024-09-16T09:46:15.977 INFO:tasks.workunit.client.0.smithi111.stdout:9/538: dwrite d0/d48/d9d/fa3 [0,4194304] 0 2024-09-16T09:46:15.977 INFO:tasks.workunit.client.0.smithi111.stdout:9/539: readlink d0/d6/l89 0 2024-09-16T09:46:15.977 INFO:tasks.workunit.client.0.smithi111.stdout:5/693: dwrite d19/d1b/d1e/d81/faf [0,4194304] 0 2024-09-16T09:46:15.977 INFO:tasks.workunit.client.0.smithi111.stdout:9/540: truncate d0/d21/d22/d6e/d51/d76/f98 4783409 0 2024-09-16T09:46:15.977 INFO:tasks.workunit.client.0.smithi111.stdout:9/541: dread - d0/d6/d8/de/d56/d4e/d92/fb3 zero size 2024-09-16T09:46:15.978 INFO:tasks.workunit.client.0.smithi111.stdout:2/748: getdents d0/d45/d5c/dc6 0 2024-09-16T09:46:15.987 INFO:tasks.workunit.client.0.smithi111.stdout:7/551: dread d1/d16/d17/d18/f4c [0,4194304] 0 2024-09-16T09:46:15.990 INFO:tasks.workunit.client.0.smithi111.stdout:9/542: getdents d0 0 2024-09-16T09:46:15.992 INFO:tasks.workunit.client.0.smithi111.stdout:2/749: mknod d0/d2/d5a/c106 0 2024-09-16T09:46:15.994 INFO:tasks.workunit.client.0.smithi111.stdout:5/694: dwrite d19/d1b/d27/d2e/d39/fbe [0,4194304] 0 2024-09-16T09:46:15.994 INFO:tasks.workunit.client.0.smithi111.stdout:9/543: link d0/d21/c3d d0/d21/d22/d6e/dab/cb8 0 2024-09-16T09:46:15.995 INFO:tasks.workunit.client.0.smithi111.stdout:9/544: dread - d0/d6c/f8d zero size 2024-09-16T09:46:15.996 INFO:tasks.workunit.client.0.smithi111.stdout:2/750: truncate d0/d45/d5c/d67/f70 2688503 0 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:7/552: dread d1/d9/d43/d82/fba [0,4194304] 0 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:7/553: dread - d1/d16/d17/d18/d1b/d79/daa/fb8 zero size 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:7/554: stat d1/d16/d17/d18/d1b/d79/da5/db2 0 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:7/555: write d1/d16/d17/d18/d4f/d56/fa1 [24379,35711] 0 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/695: dread d19/f43 [0,4194304] 0 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/696: dread - d19/d1b/d1e/d21/fd4 zero size 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/697: stat d19/d1b/d27/d83/d2a/de2/ff1 0 2024-09-16T09:46:15.998 INFO:tasks.workunit.client.0.smithi111.stdout:5/698: write d19/f43 [227781,25196] 0 2024-09-16T09:46:16.004 INFO:tasks.workunit.client.0.smithi111.stdout:7/556: dread d1/d20/f42 [0,4194304] 0 2024-09-16T09:46:16.004 INFO:tasks.workunit.client.0.smithi111.stdout:7/557: chown d1/d16/d17/d18/d1b/c81 2856369 1 2024-09-16T09:46:16.004 INFO:tasks.workunit.client.0.smithi111.stdout:7/558: fsync d1/d9/f34 0 2024-09-16T09:46:16.004 INFO:tasks.workunit.client.0.smithi111.stdout:7/559: chown d1/d16/d17/d18/d1d/d2f/f7f 4567 1 2024-09-16T09:46:16.007 INFO:tasks.workunit.client.0.smithi111.stdout:9/545: creat d0/d6/fb9 x:0 0 0 2024-09-16T09:46:16.007 INFO:tasks.workunit.client.0.smithi111.stdout:9/546: write d0/d6/d45/f4c [8045829,101249] 0 2024-09-16T09:46:16.008 INFO:tasks.workunit.client.0.smithi111.stdout:2/751: symlink d0/d2/d44/l107 0 2024-09-16T09:46:16.008 INFO:tasks.workunit.client.0.smithi111.stdout:2/752: chown d0/dd8/cf1 2154 1 2024-09-16T09:46:16.008 INFO:tasks.workunit.client.0.smithi111.stdout:2/753: fdatasync d0/d2/d59/d86/d96/f101 0 2024-09-16T09:46:16.017 INFO:tasks.workunit.client.0.smithi111.stdout:9/547: symlink d0/d7b/dac/lba 0 2024-09-16T09:46:16.017 INFO:tasks.workunit.client.0.smithi111.stdout:5/699: dwrite d19/d1b/d1e/d81/faf [0,4194304] 0 2024-09-16T09:46:16.017 INFO:tasks.workunit.client.0.smithi111.stdout:1/564: sync 2024-09-16T09:46:16.017 INFO:tasks.workunit.client.0.smithi111.stdout:3/832: sync 2024-09-16T09:46:16.018 INFO:tasks.workunit.client.0.smithi111.stdout:1/565: stat d3/d10/d1c/l7f 0 2024-09-16T09:46:16.019 INFO:tasks.workunit.client.0.smithi111.stdout:9/548: rename d0/d6c/f8a to d0/d6/d8/de/d56/fbb 0 2024-09-16T09:46:16.028 INFO:tasks.workunit.client.0.smithi111.stdout:1/566: read d3/d10/d72/da1/f1b [9865530,99356] 0 2024-09-16T09:46:16.029 INFO:tasks.workunit.client.0.smithi111.stdout:1/567: link d3/d10/d23/d8e/fa3 d3/d10/d72/da1/d28/d36/d3d/d47/d5a/fb9 0 2024-09-16T09:46:16.030 INFO:tasks.workunit.client.0.smithi111.stdout:1/568: creat d3/d10/d72/da1/d28/d36/d3d/d47/daf/fba x:0 0 0 2024-09-16T09:46:16.031 INFO:tasks.workunit.client.0.smithi111.stdout:1/569: mkdir d3/d24/d62/db3/dbb 0 2024-09-16T09:46:16.032 INFO:tasks.workunit.client.0.smithi111.stdout:1/570: mkdir d3/d10/d72/da1/d28/d36/d3d/d47/daf/dbc 0 2024-09-16T09:46:16.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/754: dwrite d0/d45/d5c/d67/f8c [0,4194304] 0 2024-09-16T09:46:16.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/755: chown d0/d45/d81 80677890 1 2024-09-16T09:46:16.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/756: write d0/da/d4e/f77 [607840,30521] 0 2024-09-16T09:46:16.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/757: readlink d0/d22/l35 0 2024-09-16T09:46:16.049 INFO:tasks.workunit.client.0.smithi111.stdout:2/758: chown d0/da/d4e/fbe 270614 1 2024-09-16T09:46:16.052 INFO:tasks.workunit.client.0.smithi111.stdout:2/759: rename d0/da6/lef to d0/d22/d98/dc9/l108 0 2024-09-16T09:46:16.052 INFO:tasks.workunit.client.0.smithi111.stdout:2/760: stat d0/d45/d5c/cbb 0 2024-09-16T09:46:16.053 INFO:tasks.workunit.client.0.smithi111.stdout:2/761: getdents d0/da/d4e 0 2024-09-16T09:46:16.064 INFO:tasks.workunit.client.0.smithi111.stdout:5/700: dwrite d19/d1b/d27/d2e/d39/fd3 [0,4194304] 0 2024-09-16T09:46:16.065 INFO:tasks.workunit.client.0.smithi111.stdout:5/701: readlink d19/d1b/d27/d2e/d98/lb2 0 2024-09-16T09:46:16.065 INFO:tasks.workunit.client.0.smithi111.stdout:7/560: dwrite d1/d16/d17/d18/d4f/d88/fad [0,4194304] 0 2024-09-16T09:46:16.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/702: symlink d19/d1b/d9f/deb/lf7 0 2024-09-16T09:46:16.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/703: truncate d19/d1b/d1e/d21/fd4 481930 0 2024-09-16T09:46:16.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/704: dread - d19/d1b/d27/d83/d2a/f69 zero size 2024-09-16T09:46:16.069 INFO:tasks.workunit.client.0.smithi111.stdout:3/833: dwrite d5/d18/d78/dfd/db6/fbd [0,4194304] 0 2024-09-16T09:46:16.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/571: dwrite d3/d10/d23/d8e/fb8 [0,4194304] 0 2024-09-16T09:46:16.069 INFO:tasks.workunit.client.0.smithi111.stdout:1/572: readlink d3/d10/d72/da1/l19 0 2024-09-16T09:46:16.069 INFO:tasks.workunit.client.0.smithi111.stdout:9/549: dwrite d0/f3f [0,4194304] 0 2024-09-16T09:46:16.069 INFO:tasks.workunit.client.0.smithi111.stdout:2/762: dwrite d0/d2/fb0 [0,4194304] 0 2024-09-16T09:46:16.071 INFO:tasks.workunit.client.0.smithi111.stdout:5/705: creat d19/d1b/d27/d2e/d39/d54/d60/ff8 x:0 0 0 2024-09-16T09:46:16.074 INFO:tasks.workunit.client.0.smithi111.stdout:3/834: rmdir d5/da/def 39 2024-09-16T09:46:16.075 INFO:tasks.workunit.client.0.smithi111.stdout:2/763: write d0/d2/f15 [1686186,31513] 0 2024-09-16T09:46:16.077 INFO:tasks.workunit.client.0.smithi111.stdout:1/573: creat d3/d10/d57/d95/fbd x:0 0 0 2024-09-16T09:46:16.081 INFO:tasks.workunit.client.0.smithi111.stdout:5/706: dread d19/d1b/d27/d83/f3f [0,4194304] 0 2024-09-16T09:46:16.083 INFO:tasks.workunit.client.0.smithi111.stdout:9/550: mknod d0/d6c/cbc 0 2024-09-16T09:46:16.083 INFO:tasks.workunit.client.0.smithi111.stdout:9/551: fdatasync d0/d6c/f8d 0 2024-09-16T09:46:16.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/552: chown d0/d6/d30/f39 49 1 2024-09-16T09:46:16.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/553: dread - d0/d21/d22/fa6 zero size 2024-09-16T09:46:16.088 INFO:tasks.workunit.client.0.smithi111.stdout:3/835: creat d5/da/db/d3a/d6d/de7/d75/f11b x:0 0 0 2024-09-16T09:46:16.088 INFO:tasks.workunit.client.0.smithi111.stdout:3/836: chown d5/da/d42/d74/l101 4 1 2024-09-16T09:46:16.088 INFO:tasks.workunit.client.0.smithi111.stdout:1/574: truncate d3/d10/d72/f9e 9747 0 2024-09-16T09:46:16.089 INFO:tasks.workunit.client.0.smithi111.stdout:1/575: readlink d3/d10/d72/da1/d28/l9f 0 2024-09-16T09:46:16.091 INFO:tasks.workunit.client.0.smithi111.stdout:5/707: creat d19/d1b/d27/d83/ff9 x:0 0 0 2024-09-16T09:46:16.093 INFO:tasks.workunit.client.0.smithi111.stdout:5/708: mknod d19/d1b/d1e/d41/cfa 0 2024-09-16T09:46:16.093 INFO:tasks.workunit.client.0.smithi111.stdout:5/709: readlink d19/d1b/d1e/d21/d29/d32/d8f/le9 0 2024-09-16T09:46:16.095 INFO:tasks.workunit.client.0.smithi111.stdout:3/837: symlink d5/da/db/d3a/d6d/de7/l11c 0 2024-09-16T09:46:16.096 INFO:tasks.workunit.client.0.smithi111.stdout:5/710: symlink d19/d1b/d9f/deb/lfb 0 2024-09-16T09:46:16.097 INFO:tasks.workunit.client.0.smithi111.stdout:5/711: getdents d19/d1b/d27/d2e/d4a 0 2024-09-16T09:46:16.099 INFO:tasks.workunit.client.0.smithi111.stdout:1/576: dread d3/f6 [0,4194304] 0 2024-09-16T09:46:16.099 INFO:tasks.workunit.client.0.smithi111.stdout:1/577: stat d3/d10/d57/d8f 0 2024-09-16T09:46:16.100 INFO:tasks.workunit.client.0.smithi111.stdout:5/712: creat d19/d1b/d27/d2e/d4a/d4b/dd7/ffc x:0 0 0 2024-09-16T09:46:16.102 INFO:tasks.workunit.client.0.smithi111.stdout:1/578: creat d3/d10/d23/fbe x:0 0 0 2024-09-16T09:46:16.104 INFO:tasks.workunit.client.0.smithi111.stdout:5/713: dread f12 [0,4194304] 0 2024-09-16T09:46:16.115 INFO:tasks.workunit.client.0.smithi111.stdout:3/838: dread d5/da/db/f7e [0,4194304] 0 2024-09-16T09:46:16.116 INFO:tasks.workunit.client.0.smithi111.stdout:3/839: mknod d5/da/c11d 0 2024-09-16T09:46:16.117 INFO:tasks.workunit.client.0.smithi111.stdout:3/840: mknod d5/d18/d78/dfd/da0/d10e/c11e 0 2024-09-16T09:46:16.117 INFO:tasks.workunit.client.0.smithi111.stdout:3/841: write d5/da/db/d3a/d6d/de7/d88/db8/fdd [533985,105717] 0 2024-09-16T09:46:16.117 INFO:tasks.workunit.client.0.smithi111.stdout:3/842: chown d5/l71 4366 1 2024-09-16T09:46:16.121 INFO:tasks.workunit.client.0.smithi111.stdout:9/554: dwrite d0/f1e [4194304,4194304] 0 2024-09-16T09:46:16.121 INFO:tasks.workunit.client.0.smithi111.stdout:1/579: dread d3/d24/d3f/f55 [0,4194304] 0 2024-09-16T09:46:16.122 INFO:tasks.workunit.client.0.smithi111.stdout:5/714: dread d19/d1b/d27/d2e/f42 [0,4194304] 0 2024-09-16T09:46:16.122 INFO:tasks.workunit.client.0.smithi111.stdout:5/715: chown d19/d1b/d27/d83/d2a/f84 3999861 1 2024-09-16T09:46:16.123 INFO:tasks.workunit.client.0.smithi111.stdout:5/716: chown d19/d1b/d27/l38 144853 1 2024-09-16T09:46:16.123 INFO:tasks.workunit.client.0.smithi111.stdout:5/717: stat d19/d1b/d27/d2e/d4a/d4b/dd7/ffc 0 2024-09-16T09:46:16.123 INFO:tasks.workunit.client.0.smithi111.stdout:5/718: fdatasync d19/d1b/d27/d2e/d4a/d4b/dac/fe5 0 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:9/555: dwrite d0/d21/d22/fa6 [0,4194304] 0 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:9/556: fsync d0/d6/d75/fae 0 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:5/719: dwrite d19/d1b/d1e/d21/f5e [0,4194304] 0 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:5/720: readlink d19/d1b/d1e/d21/d29/d32/d8f/le9 0 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:5/721: chown d19/d1b/d1e/d21/d29/d32/d46/fa2 432686053 1 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:5/722: readlink d19/d1b/d27/d83/l30 0 2024-09-16T09:46:16.147 INFO:tasks.workunit.client.0.smithi111.stdout:5/723: chown d19/d1b/d27/d2e/d39/dc6/fe6 95 1 2024-09-16T09:46:16.233 INFO:tasks.workunit.client.0.smithi111.stdout:9/557: unlink d0/d21/d22/l55 0 2024-09-16T09:46:16.236 INFO:tasks.workunit.client.0.smithi111.stdout:5/724: unlink d19/fab 0 2024-09-16T09:46:16.236 INFO:tasks.workunit.client.0.smithi111.stdout:5/725: chown d19/d1b/d27/d2e/d39/d54/fc5 31 1 2024-09-16T09:46:16.236 INFO:tasks.workunit.client.0.smithi111.stdout:5/726: truncate d19/d1b/d1e/d41/fb5 690649 0 2024-09-16T09:46:16.242 INFO:tasks.workunit.client.0.smithi111.stdout:9/558: mkdir d0/d6/d30/d47/dbd 0 2024-09-16T09:46:16.243 INFO:tasks.workunit.client.0.smithi111.stdout:5/727: getdents d19/d1b/d27/d83 0 2024-09-16T09:46:16.243 INFO:tasks.workunit.client.0.smithi111.stdout:5/728: stat d19/d1b/d27/d2e/d4a/d4b/dac 0 2024-09-16T09:46:16.245 INFO:tasks.workunit.client.0.smithi111.stdout:9/559: creat d0/d48/d9d/fbe x:0 0 0 2024-09-16T09:46:16.247 INFO:tasks.workunit.client.0.smithi111.stdout:5/729: creat d19/d1b/d1e/d21/d29/d32/d46/ffd x:0 0 0 2024-09-16T09:46:16.247 INFO:tasks.workunit.client.0.smithi111.stdout:5/730: read d19/f95 [3414,79781] 0 2024-09-16T09:46:16.247 INFO:tasks.workunit.client.0.smithi111.stdout:5/731: fsync d19/d1b/f97 0 2024-09-16T09:46:16.248 INFO:tasks.workunit.client.0.smithi111.stdout:9/560: rmdir d0/d6/d75 39 2024-09-16T09:46:16.250 INFO:tasks.workunit.client.0.smithi111.stdout:9/561: rename d0/d21/d22/d6e/c62 to d0/d6/d75/cbf 0 2024-09-16T09:46:16.255 INFO:tasks.workunit.client.0.smithi111.stdout:5/732: dread d19/d1b/d27/d2e/d39/f4e [0,4194304] 0 2024-09-16T09:46:16.255 INFO:tasks.workunit.client.0.smithi111.stdout:5/733: readlink d19/d1b/d27/d2e/d39/d6c/l8b 0 2024-09-16T09:46:16.256 INFO:tasks.workunit.client.0.smithi111.stdout:5/734: truncate d19/d1b/d1e/f55 2763346 0 2024-09-16T09:46:16.256 INFO:tasks.workunit.client.0.smithi111.stdout:5/735: chown d19/d1b/d1e/d21/fd4 112450881 1 2024-09-16T09:46:16.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/736: truncate d19/d1b/d27/d83/d2a/fde 541806 0 2024-09-16T09:46:16.257 INFO:tasks.workunit.client.0.smithi111.stdout:5/737: stat d19/d1b/d1e/d21/d29/d32/dee/cf5 0 2024-09-16T09:46:16.258 INFO:tasks.workunit.client.0.smithi111.stdout:5/738: creat d19/d1b/d27/d2e/df3/ffe x:0 0 0 2024-09-16T09:46:16.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/739: creat d19/d1b/d27/d2e/d4a/d4b/d9c/fff x:0 0 0 2024-09-16T09:46:16.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/740: stat d19/d1b/d27/d2e/d39/fd3 0 2024-09-16T09:46:16.259 INFO:tasks.workunit.client.0.smithi111.stdout:5/741: rmdir d19/d1b/d27/d2e/d39/d54 39 2024-09-16T09:46:16.285 INFO:tasks.workunit.client.0.smithi111.stdout:5/742: dwrite d19/d1b/d27/d83/d2a/dc4/fa5 [0,4194304] 0 2024-09-16T09:46:16.286 INFO:tasks.workunit.client.0.smithi111.stdout:5/743: mkdir d19/d1b/d27/d2e/df3/d100 0 2024-09-16T09:46:16.299 INFO:tasks.workunit.client.0.smithi111.stdout:4/570: sync 2024-09-16T09:46:16.299 INFO:tasks.workunit.client.0.smithi111.stdout:6/551: sync 2024-09-16T09:46:16.300 INFO:tasks.workunit.client.0.smithi111.stdout:4/571: symlink d2/d6/dd/d1b/d6d/lae 0 2024-09-16T09:46:16.302 INFO:tasks.workunit.client.0.smithi111.stdout:4/572: link d2/d30/d44/d69/l6a d2/d6/dd/d1b/d6d/laf 0 2024-09-16T09:46:16.303 INFO:tasks.workunit.client.0.smithi111.stdout:6/552: dread d0/d57/db0/d14/d20/d42/d4e/d64/da6/d41/d4f/f60 [0,4194304] 0 2024-09-16T09:46:16.303 INFO:tasks.workunit.client.0.smithi111.stdout:6/553: chown d0/d57/c7a 24134584 1 2024-09-16T09:46:16.304 INFO:tasks.workunit.client.0.smithi111.stdout:4/573: rename d2/d6/dd/d1c to d2/d6/dd/d1b/d38/db0 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/744: dwrite d19/f43 [0,4194304] 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/745: write d19/d1b/d27/d83/d2a/fde [1305362,124056] 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/746: fdatasync fc 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/747: write d19/d1b/d27/d2e/f6d [3687812,86725] 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/748: chown d19/d1b/d27/d2e/d39/cc1 207418 1 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:4/574: dread d2/d6/dd/d1b/d6d/f78 [0,4194304] 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:4/575: truncate d2/f17 2211229 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:5/749: write d19/d1b/d1e/d21/d29/d32/d46/f78 [191678,72839] 0 2024-09-16T09:46:16.308 INFO:tasks.workunit.client.0.smithi111.stdout:4/576: fsync d2/f32 0 2024-09-16T09:46:16.309 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:15 smithi114 ceph-mon[35635]: pgmap v261: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 110 MiB/s rd, 143 MiB/s wr, 419 op/s 2024-09-16T09:46:16.309 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.309 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.309 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.309 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:15 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.314 INFO:tasks.workunit.client.0.smithi111.stdout:5/750: symlink d19/d1b/d27/d2e/d4a/d4b/d9c/l101 0 2024-09-16T09:46:16.315 INFO:tasks.workunit.client.0.smithi111.stdout:4/577: getdents d2/d6/d80 0 2024-09-16T09:46:16.316 INFO:tasks.workunit.client.0.smithi111.stdout:4/578: write d2/d6/dd/d1b/d38/db0/d2f/f36 [2541264,6077] 0 2024-09-16T09:46:16.316 INFO:tasks.workunit.client.0.smithi111.stdout:4/579: write d2/d30/d44/f47 [8458257,67053] 0 2024-09-16T09:46:16.316 INFO:tasks.workunit.client.0.smithi111.stdout:4/580: write d2/f42 [923393,79065] 0 2024-09-16T09:46:16.316 INFO:tasks.workunit.client.0.smithi111.stdout:4/581: fdatasync d2/d30/d44/f82 0 2024-09-16T09:46:16.316 INFO:tasks.workunit.client.0.smithi111.stdout:4/582: chown d2/d6/dd/d1b/d38/db0/d2f/fa3 770214 1 2024-09-16T09:46:16.323 INFO:tasks.workunit.client.0.smithi111.stdout:6/554: dwrite d0/d57/db0/d14/d20/d42/f5c [0,4194304] 0 2024-09-16T09:46:16.326 INFO:tasks.workunit.client.0.smithi111.stdout:6/555: mknod d0/d57/db0/d14/d20/d42/d4e/d62/cbe 0 2024-09-16T09:46:16.328 INFO:tasks.workunit.client.0.smithi111.stdout:6/556: link d0/d57/db0/d47/fad d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/fbf 0 2024-09-16T09:46:16.328 INFO:tasks.workunit.client.0.smithi111.stdout:6/557: truncate d0/d57/db0/d49/f71 358027 0 2024-09-16T09:46:16.329 INFO:tasks.workunit.client.0.smithi111.stdout:4/583: write d2/fb [6312312,109048] 0 2024-09-16T09:46:16.331 INFO:tasks.workunit.client.0.smithi111.stdout:4/584: mknod d2/d30/d44/d69/cb1 0 2024-09-16T09:46:16.331 INFO:tasks.workunit.client.0.smithi111.stdout:5/751: dwrite d19/d1b/d1e/d21/fd4 [0,4194304] 0 2024-09-16T09:46:16.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/752: dread d19/d1b/d27/d2e/d4a/d4b/d9c/fa8 [0,4194304] 0 2024-09-16T09:46:16.335 INFO:tasks.workunit.client.0.smithi111.stdout:5/753: truncate d19/d1b/d27/d2e/df3/ffe 556948 0 2024-09-16T09:46:16.336 INFO:tasks.workunit.client.0.smithi111.stdout:5/754: symlink d19/d1b/d1e/l102 0 2024-09-16T09:46:16.339 INFO:tasks.workunit.client.0.smithi111.stdout:4/585: write d2/d30/d44/f90 [2792550,24563] 0 2024-09-16T09:46:16.343 INFO:tasks.workunit.client.0.smithi111.stdout:6/558: dwrite d0/d57/db0/d14/d20/d42/f9c [4194304,4194304] 0 2024-09-16T09:46:16.343 INFO:tasks.workunit.client.0.smithi111.stdout:6/559: fdatasync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/f9f 0 2024-09-16T09:46:16.345 INFO:tasks.workunit.client.0.smithi111.stdout:6/560: mknod d0/d57/db0/d49/cc0 0 2024-09-16T09:46:16.345 INFO:tasks.workunit.client.0.smithi111.stdout:4/586: read d2/d6/dd/d1b/d38/d64/f6b [57546,121385] 0 2024-09-16T09:46:16.347 INFO:tasks.workunit.client.0.smithi111.stdout:4/587: mknod d2/d30/d44/d96/cb2 0 2024-09-16T09:46:16.349 INFO:tasks.workunit.client.0.smithi111.stdout:4/588: creat d2/d6/dd/d1b/d38/db0/d2f/d6c/fb3 x:0 0 0 2024-09-16T09:46:16.351 INFO:tasks.workunit.client.0.smithi111.stdout:4/589: creat d2/d30/da1/fb4 x:0 0 0 2024-09-16T09:46:16.353 INFO:tasks.workunit.client.0.smithi111.stdout:4/590: rmdir d2/d6/dd/d88 0 2024-09-16T09:46:16.354 INFO:tasks.workunit.client.0.smithi111.stdout:4/591: mkdir d2/d6/dd/d1b/d38/d64/d92/da0/db5 0 2024-09-16T09:46:16.364 INFO:tasks.workunit.client.0.smithi111.stdout:5/755: dwrite d19/d1b/d27/d2e/d4a/d4b/dac/fe5 [0,4194304] 0 2024-09-16T09:46:16.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/592: dread d2/f56 [0,4194304] 0 2024-09-16T09:46:16.369 INFO:tasks.workunit.client.0.smithi111.stdout:6/561: dwrite d0/d57/db0/d47/d52/f82 [0,4194304] 0 2024-09-16T09:46:16.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/593: chown d2/l51 3517 1 2024-09-16T09:46:16.369 INFO:tasks.workunit.client.0.smithi111.stdout:6/562: chown d0/d57/db0/d47/d68/d6a/f8d 33157242 1 2024-09-16T09:46:16.369 INFO:tasks.workunit.client.0.smithi111.stdout:4/594: getdents d2/d6/d80 0 2024-09-16T09:46:16.372 INFO:tasks.workunit.client.0.smithi111.stdout:6/563: rename d0/d57/db0/d14/d20/d42/d4e/d64/da6/d41/d4f/c96 to d0/d57/db0/d14/d20/d42/d4e/cc1 0 2024-09-16T09:46:16.375 INFO:tasks.workunit.client.0.smithi111.stdout:6/564: symlink d0/d57/db0/d47/d52/lc2 0 2024-09-16T09:46:16.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:15 smithi111 ceph-mon[27997]: pgmap v261: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 110 MiB/s rd, 143 MiB/s wr, 419 op/s 2024-09-16T09:46:16.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:15 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:16.384 INFO:tasks.workunit.client.0.smithi111.stdout:6/565: dread d0/d57/db0/d14/d20/d42/d4e/d62/f70 [0,4194304] 0 2024-09-16T09:46:16.386 INFO:tasks.workunit.client.0.smithi111.stdout:4/595: dwrite d2/d6/dd/f9d [0,4194304] 0 2024-09-16T09:46:16.389 INFO:tasks.workunit.client.0.smithi111.stdout:4/596: rename d2/d30/c37 to d2/d6/cb6 0 2024-09-16T09:46:16.396 INFO:tasks.workunit.client.0.smithi111.stdout:4/597: write d2/f8 [4793066,19940] 0 2024-09-16T09:46:16.396 INFO:tasks.workunit.client.0.smithi111.stdout:4/598: dread - d2/d6/dd/d1b/d38/db0/d2f/f81 zero size 2024-09-16T09:46:16.397 INFO:tasks.workunit.client.0.smithi111.stdout:4/599: mknod d2/d30/cb7 0 2024-09-16T09:46:16.397 INFO:tasks.workunit.client.0.smithi111.stdout:4/600: chown d2/d6/dd/d1b/d38/c39 873432 1 2024-09-16T09:46:16.398 INFO:tasks.workunit.client.0.smithi111.stdout:4/601: mknod d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/cb8 0 2024-09-16T09:46:16.399 INFO:tasks.workunit.client.0.smithi111.stdout:4/602: creat d2/d30/d44/d96/fb9 x:0 0 0 2024-09-16T09:46:16.401 INFO:tasks.workunit.client.0.smithi111.stdout:4/603: creat d2/d6/fba x:0 0 0 2024-09-16T09:46:16.401 INFO:tasks.workunit.client.0.smithi111.stdout:6/566: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/f9f [0,4194304] 0 2024-09-16T09:46:16.402 INFO:tasks.workunit.client.0.smithi111.stdout:6/567: symlink d0/d57/lc3 0 2024-09-16T09:46:16.403 INFO:tasks.workunit.client.0.smithi111.stdout:6/568: creat d0/d57/db0/d14/d20/d42/d4e/d64/da6/d41/fc4 x:0 0 0 2024-09-16T09:46:16.406 INFO:tasks.workunit.client.0.smithi111.stdout:6/569: creat d0/d57/db0/d47/d88/fc5 x:0 0 0 2024-09-16T09:46:16.406 INFO:tasks.workunit.client.0.smithi111.stdout:6/570: mknod d0/d57/db0/d49/cc6 0 2024-09-16T09:46:16.407 INFO:tasks.workunit.client.0.smithi111.stdout:4/604: dread d2/d6/dd/d1b/d38/db0/d2f/f36 [0,4194304] 0 2024-09-16T09:46:16.408 INFO:tasks.workunit.client.0.smithi111.stdout:6/571: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/lc7 0 2024-09-16T09:46:16.409 INFO:tasks.workunit.client.0.smithi111.stdout:4/605: chown d2/d6/c1a 67 1 2024-09-16T09:46:16.411 INFO:tasks.workunit.client.0.smithi111.stdout:4/606: symlink d2/d30/da1/lbb 0 2024-09-16T09:46:16.411 INFO:tasks.workunit.client.0.smithi111.stdout:4/607: fdatasync d2/d30/d44/f90 0 2024-09-16T09:46:16.416 INFO:tasks.workunit.client.0.smithi111.stdout:8/762: sync 2024-09-16T09:46:16.420 INFO:tasks.workunit.client.0.smithi111.stdout:6/572: rename d0/d57/db0/d14/d20/d42/d4e/d64/da6 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8 0 2024-09-16T09:46:16.425 INFO:tasks.workunit.client.0.smithi111.stdout:4/608: dwrite d2/d30/f61 [0,4194304] 0 2024-09-16T09:46:16.429 INFO:tasks.workunit.client.0.smithi111.stdout:4/609: chown d2/d6/dd/d1b/d38/db0/l6f 10741507 1 2024-09-16T09:46:16.429 INFO:tasks.workunit.client.0.smithi111.stdout:4/610: symlink d2/d6/dd/d1b/d38/d64/d65/lbc 0 2024-09-16T09:46:16.430 INFO:tasks.workunit.client.0.smithi111.stdout:4/611: unlink d2/f32 0 2024-09-16T09:46:16.437 INFO:tasks.workunit.client.0.smithi111.stdout:6/573: dwrite d0/d57/d72/f61 [0,4194304] 0 2024-09-16T09:46:16.438 INFO:tasks.workunit.client.0.smithi111.stdout:6/574: write d0/d57/db0/d14/fb7 [542268,52597] 0 2024-09-16T09:46:16.440 INFO:tasks.workunit.client.0.smithi111.stdout:6/575: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/dc9 0 2024-09-16T09:46:16.440 INFO:tasks.workunit.client.0.smithi111.stdout:6/576: fsync d0/d57/db0/d14/d20/d42/d4e/d64/f69 0 2024-09-16T09:46:16.442 INFO:tasks.workunit.client.0.smithi111.stdout:6/577: rmdir d0/d57/db0/d47 39 2024-09-16T09:46:16.444 INFO:tasks.workunit.client.0.smithi111.stdout:6/578: creat d0/d57/db0/d47/d88/fca x:0 0 0 2024-09-16T09:46:16.444 INFO:tasks.workunit.client.0.smithi111.stdout:6/579: write d0/d57/db0/d47/d52/db3/fb6 [755558,46840] 0 2024-09-16T09:46:16.461 INFO:tasks.workunit.client.0.smithi111.stdout:6/580: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f54 [0,4194304] 0 2024-09-16T09:46:16.479 INFO:tasks.workunit.client.0.smithi111.stdout:6/581: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/fbf [0,4194304] 0 2024-09-16T09:46:16.479 INFO:tasks.workunit.client.0.smithi111.stdout:6/582: truncate d0/f3a 264700 0 2024-09-16T09:46:16.480 INFO:tasks.workunit.client.0.smithi111.stdout:6/583: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f6b [0,4194304] 0 2024-09-16T09:46:16.481 INFO:tasks.workunit.client.0.smithi111.stdout:6/584: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/fcb x:0 0 0 2024-09-16T09:46:16.486 INFO:tasks.workunit.client.0.smithi111.stdout:6/585: dread d0/d57/db0/d14/d20/d42/f55 [0,4194304] 0 2024-09-16T09:46:16.489 INFO:tasks.workunit.client.0.smithi111.stdout:6/586: rmdir d0/d57/db0/d47/d88 39 2024-09-16T09:46:16.490 INFO:tasks.workunit.client.0.smithi111.stdout:6/587: mkdir d0/d57/db0/d14/d20/d42/d4e/d64/dcc 0 2024-09-16T09:46:16.494 INFO:tasks.workunit.client.0.smithi111.stdout:2/764: sync 2024-09-16T09:46:16.494 INFO:tasks.workunit.client.0.smithi111.stdout:0/663: sync 2024-09-16T09:46:16.494 INFO:tasks.workunit.client.0.smithi111.stdout:7/561: sync 2024-09-16T09:46:16.494 INFO:tasks.workunit.client.0.smithi111.stdout:2/765: write d0/d29/f31 [8439458,111457] 0 2024-09-16T09:46:16.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/562: mkdir d1/d9/d53/dc0 0 2024-09-16T09:46:16.496 INFO:tasks.workunit.client.0.smithi111.stdout:2/766: mkdir d0/da6/dea/d109 0 2024-09-16T09:46:16.498 INFO:tasks.workunit.client.0.smithi111.stdout:0/664: mknod d0/d1d/d58/d64/d4f/ceb 0 2024-09-16T09:46:16.499 INFO:tasks.workunit.client.0.smithi111.stdout:2/767: rmdir d0/d2/d61/d9f 39 2024-09-16T09:46:16.500 INFO:tasks.workunit.client.0.smithi111.stdout:7/563: rename d1/d16/d17/d18/d4f/d56/f57 to d1/d3e/fc1 0 2024-09-16T09:46:16.505 INFO:tasks.workunit.client.0.smithi111.stdout:7/564: creat d1/d16/d17/d18/d1b/fc2 x:0 0 0 2024-09-16T09:46:16.505 INFO:tasks.workunit.client.0.smithi111.stdout:7/565: dread - d1/d9/d43/f67 zero size 2024-09-16T09:46:16.507 INFO:tasks.workunit.client.0.smithi111.stdout:0/665: dread d0/fd [0,4194304] 0 2024-09-16T09:46:16.508 INFO:tasks.workunit.client.0.smithi111.stdout:7/566: creat d1/fc3 x:0 0 0 2024-09-16T09:46:16.509 INFO:tasks.workunit.client.0.smithi111.stdout:7/567: chown d1/d9/f35 488613 1 2024-09-16T09:46:16.511 INFO:tasks.workunit.client.0.smithi111.stdout:7/568: mknod d1/d3e/d9f/cc4 0 2024-09-16T09:46:16.511 INFO:tasks.workunit.client.0.smithi111.stdout:7/569: chown d1/d16/d17/d18/d1b/d79/daa 85 1 2024-09-16T09:46:16.511 INFO:tasks.workunit.client.0.smithi111.stdout:6/588: dwrite d0/d57/db0/f4a [0,4194304] 0 2024-09-16T09:46:16.512 INFO:tasks.workunit.client.0.smithi111.stdout:6/589: readlink d0/d57/db0/l66 0 2024-09-16T09:46:16.512 INFO:tasks.workunit.client.0.smithi111.stdout:6/590: dread - d0/d57/d72/f6f zero size 2024-09-16T09:46:16.512 INFO:tasks.workunit.client.0.smithi111.stdout:0/666: mkdir d0/d26/dec 0 2024-09-16T09:46:16.513 INFO:tasks.workunit.client.0.smithi111.stdout:6/591: truncate d0/d57/db0/d14/d20/d42/f9c 3358889 0 2024-09-16T09:46:16.513 INFO:tasks.workunit.client.0.smithi111.stdout:0/667: symlink d0/d1d/d58/d64/led 0 2024-09-16T09:46:16.513 INFO:tasks.workunit.client.0.smithi111.stdout:0/668: stat d0 0 2024-09-16T09:46:16.514 INFO:tasks.workunit.client.0.smithi111.stdout:6/592: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/lcd 0 2024-09-16T09:46:16.514 INFO:tasks.workunit.client.0.smithi111.stdout:0/669: rmdir d0/dc1 39 2024-09-16T09:46:16.515 INFO:tasks.workunit.client.0.smithi111.stdout:6/593: creat d0/d57/db0/d47/d68/fce x:0 0 0 2024-09-16T09:46:16.518 INFO:tasks.workunit.client.0.smithi111.stdout:2/768: dwrite d0/d45/d5c/d67/d63/dd4/fd3 [0,4194304] 0 2024-09-16T09:46:16.518 INFO:tasks.workunit.client.0.smithi111.stdout:2/769: dread - d0/d45/f90 zero size 2024-09-16T09:46:16.518 INFO:tasks.workunit.client.0.smithi111.stdout:2/770: write d0/d2/f15 [3371518,52832] 0 2024-09-16T09:46:16.520 INFO:tasks.workunit.client.0.smithi111.stdout:0/670: dread d0/d26/d35/f76 [0,4194304] 0 2024-09-16T09:46:16.523 INFO:tasks.workunit.client.0.smithi111.stdout:2/771: link d0/d2/d59/d86/d96/lb2 d0/d45/d5c/l10a 0 2024-09-16T09:46:16.524 INFO:tasks.workunit.client.0.smithi111.stdout:0/671: mkdir d0/d1d/d67/d3a/d80/dee 0 2024-09-16T09:46:16.526 INFO:tasks.workunit.client.0.smithi111.stdout:2/772: creat d0/d22/dac/df0/f10b x:0 0 0 2024-09-16T09:46:16.528 INFO:tasks.workunit.client.0.smithi111.stdout:0/672: rename d0/d26/l2e to d0/dc1/lef 0 2024-09-16T09:46:16.530 INFO:tasks.workunit.client.0.smithi111.stdout:2/773: dread d0/d21/f7f [0,4194304] 0 2024-09-16T09:46:16.530 INFO:tasks.workunit.client.0.smithi111.stdout:0/673: creat d0/d1d/d58/d83/d9a/ff0 x:0 0 0 2024-09-16T09:46:16.532 INFO:tasks.workunit.client.0.smithi111.stdout:7/570: dwrite d1/d16/d17/d18/d1b/d79/d8c/fb0 [0,4194304] 0 2024-09-16T09:46:16.534 INFO:tasks.workunit.client.0.smithi111.stdout:6/594: dwrite d0/d57/db0/d47/f7d [0,4194304] 0 2024-09-16T09:46:16.534 INFO:tasks.workunit.client.0.smithi111.stdout:6/595: write d0/d57/db0/d47/fac [729739,109324] 0 2024-09-16T09:46:16.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/774: mknod d0/da/d4e/c10c 0 2024-09-16T09:46:16.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/775: write d0/da/f5f [377074,12538] 0 2024-09-16T09:46:16.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/776: dread - d0/d2/d59/d86/d96/ffd zero size 2024-09-16T09:46:16.539 INFO:tasks.workunit.client.0.smithi111.stdout:0/674: symlink d0/d1d/d67/d3a/d80/dee/lf1 0 2024-09-16T09:46:16.541 INFO:tasks.workunit.client.0.smithi111.stdout:7/571: mknod d1/d9/d53/dc0/cc5 0 2024-09-16T09:46:16.542 INFO:tasks.workunit.client.0.smithi111.stdout:7/572: read d1/d9/fa [4241765,54563] 0 2024-09-16T09:46:16.542 INFO:tasks.workunit.client.0.smithi111.stdout:6/596: write d0/d57/db0/d47/f7d [143472,37737] 0 2024-09-16T09:46:16.545 INFO:tasks.workunit.client.0.smithi111.stdout:2/777: mknod d0/d2/d5a/c10d 0 2024-09-16T09:46:16.545 INFO:tasks.workunit.client.0.smithi111.stdout:6/597: stat d0/l1d 0 2024-09-16T09:46:16.548 INFO:tasks.workunit.client.0.smithi111.stdout:7/573: mkdir d1/d20/dc6 0 2024-09-16T09:46:16.549 INFO:tasks.workunit.client.0.smithi111.stdout:2/778: mknod d0/d2/d5a/c10e 0 2024-09-16T09:46:16.553 INFO:tasks.workunit.client.0.smithi111.stdout:6/598: truncate d0/f3a 220095 0 2024-09-16T09:46:16.554 INFO:tasks.workunit.client.0.smithi111.stdout:2/779: creat d0/d22/d98/dc9/f10f x:0 0 0 2024-09-16T09:46:16.556 INFO:tasks.workunit.client.0.smithi111.stdout:6/599: creat d0/d57/db0/d14/fcf x:0 0 0 2024-09-16T09:46:16.556 INFO:tasks.workunit.client.0.smithi111.stdout:2/780: rmdir d0/d22/d98/dc9 39 2024-09-16T09:46:16.558 INFO:tasks.workunit.client.0.smithi111.stdout:0/675: dwrite d0/d26/d35/fe2 [0,4194304] 0 2024-09-16T09:46:16.565 INFO:tasks.workunit.client.0.smithi111.stdout:0/676: creat d0/d1d/d58/ff2 x:0 0 0 2024-09-16T09:46:16.566 INFO:tasks.workunit.client.0.smithi111.stdout:2/781: dread d0/d22/fb3 [0,4194304] 0 2024-09-16T09:46:16.567 INFO:tasks.workunit.client.0.smithi111.stdout:2/782: mknod d0/dd8/c110 0 2024-09-16T09:46:16.573 INFO:tasks.workunit.client.0.smithi111.stdout:6/600: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f36 [0,4194304] 0 2024-09-16T09:46:16.576 INFO:tasks.workunit.client.0.smithi111.stdout:6/601: creat d0/d57/db0/d47/d52/db3/fd0 x:0 0 0 2024-09-16T09:46:16.578 INFO:tasks.workunit.client.0.smithi111.stdout:6/602: creat d0/d57/db0/d47/d88/fd1 x:0 0 0 2024-09-16T09:46:16.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/603: truncate d0/d57/db0/d47/d52/db3/fb6 1629494 0 2024-09-16T09:46:16.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/604: fdatasync d0/d57/db0/d14/fcf 0 2024-09-16T09:46:16.579 INFO:tasks.workunit.client.0.smithi111.stdout:6/605: read - d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/fc4 zero size 2024-09-16T09:46:16.579 INFO:tasks.workunit.client.0.smithi111.stdout:0/677: write d0/d1d/d58/d83/fbd [5981952,44468] 0 2024-09-16T09:46:16.580 INFO:tasks.workunit.client.0.smithi111.stdout:6/606: creat d0/d57/db0/d47/d88/da9/fd2 x:0 0 0 2024-09-16T09:46:16.581 INFO:tasks.workunit.client.0.smithi111.stdout:0/678: getdents d0/d1d/d58/d64/dd6 0 2024-09-16T09:46:16.581 INFO:tasks.workunit.client.0.smithi111.stdout:0/679: fsync d0/d1d/d67/f41 0 2024-09-16T09:46:16.582 INFO:tasks.workunit.client.0.smithi111.stdout:6/607: symlink d0/d57/db0/ld3 0 2024-09-16T09:46:16.582 INFO:tasks.workunit.client.0.smithi111.stdout:6/608: dread - d0/d57/db0/d47/d88/f97 zero size 2024-09-16T09:46:16.583 INFO:tasks.workunit.client.0.smithi111.stdout:0/680: mkdir d0/d1d/d58/d64/dd6/ddf/df3 0 2024-09-16T09:46:16.583 INFO:tasks.workunit.client.0.smithi111.stdout:6/609: symlink d0/d57/ld4 0 2024-09-16T09:46:16.584 INFO:tasks.workunit.client.0.smithi111.stdout:0/681: mknod d0/d26/d35/cf4 0 2024-09-16T09:46:16.586 INFO:tasks.workunit.client.0.smithi111.stdout:6/610: link d0/d57/db0/d49/cc6 d0/d57/db0/d14/cd5 0 2024-09-16T09:46:16.587 INFO:tasks.workunit.client.0.smithi111.stdout:0/682: link d0/fd d0/d1d/d67/d3a/d92/ff5 0 2024-09-16T09:46:16.589 INFO:tasks.workunit.client.0.smithi111.stdout:2/783: dwrite d0/d2/f41 [0,4194304] 0 2024-09-16T09:46:16.589 INFO:tasks.workunit.client.0.smithi111.stdout:2/784: chown d0/fa7 724855 1 2024-09-16T09:46:16.589 INFO:tasks.workunit.client.0.smithi111.stdout:2/785: write d0/d2/d59/d86/d96/f101 [596439,31249] 0 2024-09-16T09:46:16.589 INFO:tasks.workunit.client.0.smithi111.stdout:6/611: link d0/d57/db0/d14/d20/d42/d4e/cc1 d0/d57/db0/d49/d5b/cd6 0 2024-09-16T09:46:16.589 INFO:tasks.workunit.client.0.smithi111.stdout:6/612: stat d0/d57/db0/d14/d20/d42/d4e/d62/d7b 0 2024-09-16T09:46:16.589 INFO:tasks.workunit.client.0.smithi111.stdout:6/613: chown d0/d57/d72/f61 1351777 1 2024-09-16T09:46:16.590 INFO:tasks.workunit.client.0.smithi111.stdout:0/683: creat d0/d1d/d67/d3a/d3d/ff6 x:0 0 0 2024-09-16T09:46:16.592 INFO:tasks.workunit.client.0.smithi111.stdout:2/786: rename d0/d2/c92 to d0/d45/d5c/c111 0 2024-09-16T09:46:16.594 INFO:tasks.workunit.client.0.smithi111.stdout:6/614: truncate d0/d57/db0/d14/d20/d42/f55 2788443 0 2024-09-16T09:46:16.594 INFO:tasks.workunit.client.0.smithi111.stdout:6/615: readlink d0/d57/db0/d49/d5b/l84 0 2024-09-16T09:46:16.594 INFO:tasks.workunit.client.0.smithi111.stdout:0/684: mknod d0/de3/cf7 0 2024-09-16T09:46:16.594 INFO:tasks.workunit.client.0.smithi111.stdout:0/685: fdatasync d0/fd 0 2024-09-16T09:46:16.597 INFO:tasks.workunit.client.0.smithi111.stdout:2/787: rename d0/d21/f46 to d0/da6/f112 0 2024-09-16T09:46:16.598 INFO:tasks.workunit.client.0.smithi111.stdout:6/616: rmdir d0/d57/db0/d47/d68 39 2024-09-16T09:46:16.598 INFO:tasks.workunit.client.0.smithi111.stdout:6/617: dread - d0/d57/db0/d49/d5b/fa4 zero size 2024-09-16T09:46:16.598 INFO:tasks.workunit.client.0.smithi111.stdout:6/618: dread - d0/d57/db0/d47/d88/fd1 zero size 2024-09-16T09:46:16.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/686: truncate d0/d1d/d67/d3a/d3d/f48 2247391 0 2024-09-16T09:46:16.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/687: fdatasync d0/d1d/d58/d64/d4f/faa 0 2024-09-16T09:46:16.605 INFO:tasks.workunit.client.0.smithi111.stdout:0/688: creat d0/de3/ff8 x:0 0 0 2024-09-16T09:46:16.607 INFO:tasks.workunit.client.0.smithi111.stdout:0/689: rename d0/d1d/l1e to d0/da4/ddd/lf9 0 2024-09-16T09:46:16.609 INFO:tasks.workunit.client.0.smithi111.stdout:0/690: creat d0/d1d/d67/d3a/d77/ffa x:0 0 0 2024-09-16T09:46:16.613 INFO:tasks.workunit.client.0.smithi111.stdout:0/691: mkdir d0/dfb 0 2024-09-16T09:46:16.616 INFO:tasks.workunit.client.0.smithi111.stdout:0/692: creat d0/d1d/d67/d3a/d3d/ffc x:0 0 0 2024-09-16T09:46:16.618 INFO:tasks.workunit.client.0.smithi111.stdout:0/693: mkdir d0/de3/dfd 0 2024-09-16T09:46:16.618 INFO:tasks.workunit.client.0.smithi111.stdout:0/694: fdatasync d0/f22 0 2024-09-16T09:46:16.633 INFO:tasks.workunit.client.0.smithi111.stdout:0/695: dwrite d0/fa0 [0,4194304] 0 2024-09-16T09:46:16.635 INFO:tasks.workunit.client.0.smithi111.stdout:0/696: rmdir d0/de3/dfd 0 2024-09-16T09:46:16.648 INFO:tasks.workunit.client.0.smithi111.stdout:0/697: dwrite d0/de3/fe4 [0,4194304] 0 2024-09-16T09:46:16.651 INFO:tasks.workunit.client.0.smithi111.stdout:0/698: link d0/da4/c9c d0/d1d/d67/d3a/cfe 0 2024-09-16T09:46:16.651 INFO:tasks.workunit.client.0.smithi111.stdout:0/699: write d0/d26/d35/d86/fd5 [924161,53324] 0 2024-09-16T09:46:16.651 INFO:tasks.workunit.client.0.smithi111.stdout:0/700: stat d0/f22 0 2024-09-16T09:46:16.659 INFO:tasks.workunit.client.0.smithi111.stdout:0/701: dread d0/d1d/d58/d83/fbd [0,4194304] 0 2024-09-16T09:46:16.660 INFO:tasks.workunit.client.0.smithi111.stdout:0/702: creat d0/d1d/d67/d3a/d80/fff x:0 0 0 2024-09-16T09:46:16.669 INFO:tasks.workunit.client.0.smithi111.stdout:0/703: dread d0/f42 [0,4194304] 0 2024-09-16T09:46:16.676 INFO:tasks.workunit.client.0.smithi111.stdout:0/704: getdents d0/d1d/d67/d3a/d80 0 2024-09-16T09:46:16.677 INFO:tasks.workunit.client.0.smithi111.stdout:0/705: creat d0/d1d/d58/d83/d9a/dd9/f100 x:0 0 0 2024-09-16T09:46:16.693 INFO:tasks.workunit.client.0.smithi111.stdout:0/706: dwrite d0/d1d/d58/d64/f88 [0,4194304] 0 2024-09-16T09:46:16.696 INFO:tasks.workunit.client.0.smithi111.stdout:0/707: creat d0/d26/d35/f101 x:0 0 0 2024-09-16T09:46:16.698 INFO:tasks.workunit.client.0.smithi111.stdout:0/708: symlink d0/l102 0 2024-09-16T09:46:16.699 INFO:tasks.workunit.client.0.smithi111.stdout:0/709: symlink d0/d1d/l103 0 2024-09-16T09:46:16.700 INFO:tasks.workunit.client.0.smithi111.stdout:0/710: link d0/d1d/f3c d0/d1d/d58/d64/f104 0 2024-09-16T09:46:16.700 INFO:tasks.workunit.client.0.smithi111.stdout:0/711: rmdir d0/d1d/d58/d64/d4f 39 2024-09-16T09:46:16.701 INFO:tasks.workunit.client.0.smithi111.stdout:0/712: mknod d0/d1d/dce/c105 0 2024-09-16T09:46:16.708 INFO:tasks.workunit.client.0.smithi111.stdout:0/713: write d0/d1d/d67/d3a/f8c [926633,27825] 0 2024-09-16T09:46:16.710 INFO:tasks.workunit.client.0.smithi111.stdout:0/714: rename d0/d26/dec to d0/d1d/d67/d3a/d77/dad/d106 0 2024-09-16T09:46:16.730 INFO:tasks.workunit.client.0.smithi111.stdout:0/715: dwrite d0/d26/d35/d86/fbc [0,4194304] 0 2024-09-16T09:46:16.731 INFO:tasks.workunit.client.0.smithi111.stdout:0/716: creat d0/d1d/d58/d64/dd6/f107 x:0 0 0 2024-09-16T09:46:16.731 INFO:tasks.workunit.client.0.smithi111.stdout:0/717: write d0/da4/fa2 [114318,67503] 0 2024-09-16T09:46:16.732 INFO:tasks.workunit.client.0.smithi111.stdout:0/718: getdents d0 0 2024-09-16T09:46:16.733 INFO:tasks.workunit.client.0.smithi111.stdout:0/719: rmdir d0/d1d/d58/d64 39 2024-09-16T09:46:16.735 INFO:tasks.workunit.client.0.smithi111.stdout:0/720: rename d0/l5 to d0/d1d/d58/d83/d9a/l108 0 2024-09-16T09:46:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:1/580: sync 2024-09-16T09:46:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/843: sync 2024-09-16T09:46:16.759 INFO:tasks.workunit.client.0.smithi111.stdout:3/844: truncate d5/da/db/d3a/d6d/dd1/d10c/f108 213237 0 2024-09-16T09:46:16.760 INFO:tasks.workunit.client.0.smithi111.stdout:0/721: dwrite d0/d1d/d67/fa7 [0,4194304] 0 2024-09-16T09:46:16.760 INFO:tasks.workunit.client.0.smithi111.stdout:3/845: mkdir d5/da/db/d5a/df8/d11f 0 2024-09-16T09:46:16.760 INFO:tasks.workunit.client.0.smithi111.stdout:3/846: dread - d5/da/db/d3a/d6d/fc2 zero size 2024-09-16T09:46:16.763 INFO:tasks.workunit.client.0.smithi111.stdout:0/722: link d0/d1d/d67/d3a/d3d/d59/fc8 d0/d1d/d58/d64/f109 0 2024-09-16T09:46:16.763 INFO:tasks.workunit.client.0.smithi111.stdout:0/723: read - d0/d1d/d67/f65 zero size 2024-09-16T09:46:16.763 INFO:tasks.workunit.client.0.smithi111.stdout:0/724: chown d0/d1d/d67/d3a/d77/ffa 1 1 2024-09-16T09:46:16.763 INFO:tasks.workunit.client.0.smithi111.stdout:0/725: stat d0/d1d/d67/d3a/d3d/d59/f94 0 2024-09-16T09:46:16.764 INFO:tasks.workunit.client.0.smithi111.stdout:3/847: getdents d5/da/d92 0 2024-09-16T09:46:16.765 INFO:tasks.workunit.client.0.smithi111.stdout:0/726: mknod d0/da4/ddd/c10a 0 2024-09-16T09:46:16.766 INFO:tasks.workunit.client.0.smithi111.stdout:3/848: mkdir d5/da/de1/d120 0 2024-09-16T09:46:16.769 INFO:tasks.workunit.client.0.smithi111.stdout:0/727: creat d0/d1d/d58/d64/f10b x:0 0 0 2024-09-16T09:46:16.769 INFO:tasks.workunit.client.0.smithi111.stdout:0/728: truncate d0/d1d/d67/d3a/d80/f78 1399043 0 2024-09-16T09:46:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/849: creat d5/da/f121 x:0 0 0 2024-09-16T09:46:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/850: write d5/f56 [606030,51743] 0 2024-09-16T09:46:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/851: dread - d5/d18/fdc zero size 2024-09-16T09:46:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/852: chown d5/d18/d78/dfd/da0/fda 42 1 2024-09-16T09:46:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:3/853: readlink d5/l7c 0 2024-09-16T09:46:16.771 INFO:tasks.workunit.client.0.smithi111.stdout:1/581: read d3/d10/d72/da1/ff [1169147,57148] 0 2024-09-16T09:46:16.773 INFO:tasks.workunit.client.0.smithi111.stdout:0/729: creat d0/d1d/d67/d3a/d77/dad/f10c x:0 0 0 2024-09-16T09:46:16.773 INFO:tasks.workunit.client.0.smithi111.stdout:0/730: readlink d0/d1d/d67/d3a/d3d/d59/lde 0 2024-09-16T09:46:16.775 INFO:tasks.workunit.client.0.smithi111.stdout:0/731: creat d0/d26/f10d x:0 0 0 2024-09-16T09:46:16.781 INFO:tasks.workunit.client.0.smithi111.stdout:1/582: read d3/d10/d72/da1/d28/d36/fa5 [4128451,80719] 0 2024-09-16T09:46:16.782 INFO:tasks.workunit.client.0.smithi111.stdout:1/583: mkdir d3/d10/d72/da1/d28/d36/d3d/d47/d65/dbf 0 2024-09-16T09:46:16.796 INFO:tasks.workunit.client.0.smithi111.stdout:0/732: dwrite d0/d1d/d67/d3a/d3d/d59/fc8 [0,4194304] 0 2024-09-16T09:46:16.799 INFO:tasks.workunit.client.0.smithi111.stdout:1/584: write d3/d24/d29/f39 [3715729,86583] 0 2024-09-16T09:46:16.800 INFO:tasks.workunit.client.0.smithi111.stdout:0/733: symlink d0/d26/d35/d86/l10e 0 2024-09-16T09:46:16.802 INFO:tasks.workunit.client.0.smithi111.stdout:0/734: mkdir d0/d1d/d58/d64/d4f/d10f 0 2024-09-16T09:46:16.803 INFO:tasks.workunit.client.0.smithi111.stdout:0/735: getdents d0/d1d/d67/d3a/d77 0 2024-09-16T09:46:16.808 INFO:tasks.workunit.client.0.smithi111.stdout:1/585: dread d3/d10/d72/da1/f35 [8388608,4194304] 0 2024-09-16T09:46:16.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/736: dwrite d0/d1d/d58/d83/d9a/dd9/f100 [0,4194304] 0 2024-09-16T09:46:16.834 INFO:tasks.workunit.client.0.smithi111.stdout:0/737: write d0/d1d/d67/d3a/d3d/ff6 [430978,12536] 0 2024-09-16T09:46:16.834 INFO:tasks.workunit.client.0.smithi111.stdout:1/586: dwrite d3/d10/d72/da1/f17 [0,4194304] 0 2024-09-16T09:46:16.836 INFO:tasks.workunit.client.0.smithi111.stdout:0/738: truncate d0/d26/d35/f76 706501 0 2024-09-16T09:46:16.836 INFO:tasks.workunit.client.0.smithi111.stdout:0/739: write d0/d1d/d67/d3a/f8c [4370517,65872] 0 2024-09-16T09:46:16.853 INFO:tasks.workunit.client.0.smithi111.stdout:1/587: dwrite d3/d24/d62/f81 [0,4194304] 0 2024-09-16T09:46:16.853 INFO:tasks.workunit.client.0.smithi111.stdout:1/588: chown d3/d10/d72/da1/d28/d36/d3d/d47/d5a/fac 3 1 2024-09-16T09:46:16.854 INFO:tasks.workunit.client.0.smithi111.stdout:1/589: fsync d3/d10/f96 0 2024-09-16T09:46:16.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/740: dwrite d0/d1d/d67/d3a/f8d [0,4194304] 0 2024-09-16T09:46:16.856 INFO:tasks.workunit.client.0.smithi111.stdout:0/741: readlink d0/d1d/d67/d3a/lb9 0 2024-09-16T09:46:16.857 INFO:tasks.workunit.client.0.smithi111.stdout:0/742: rmdir d0/d1d/d58/d64/dd6 39 2024-09-16T09:46:16.870 INFO:tasks.workunit.client.0.smithi111.stdout:1/590: dwrite d3/f7 [0,4194304] 0 2024-09-16T09:46:16.871 INFO:tasks.workunit.client.0.smithi111.stdout:1/591: getdents d3/d24/d62/db3 0 2024-09-16T09:46:16.871 INFO:tasks.workunit.client.0.smithi111.stdout:1/592: dread - d3/d10/d72/da1/d28/d36/d3d/d47/daf/f91 zero size 2024-09-16T09:46:16.872 INFO:tasks.workunit.client.0.smithi111.stdout:1/593: rename d3/d10/d72/da1/d28/d36/d3d/d47/d5a/fb9 to d3/fc0 0 2024-09-16T09:46:16.879 INFO:tasks.workunit.client.0.smithi111.stdout:1/594: truncate d3/d10/d72/da1/f17 1440735 0 2024-09-16T09:46:16.889 INFO:tasks.workunit.client.0.smithi111.stdout:1/595: dread d3/d10/f96 [0,4194304] 0 2024-09-16T09:46:16.889 INFO:tasks.workunit.client.0.smithi111.stdout:1/596: chown d3/d10/d57/fb7 45787 1 2024-09-16T09:46:16.889 INFO:tasks.workunit.client.0.smithi111.stdout:1/597: write d3/d26/f34 [1337938,113422] 0 2024-09-16T09:46:16.890 INFO:tasks.workunit.client.0.smithi111.stdout:1/598: truncate d3/d24/d4e/f52 163943 0 2024-09-16T09:46:16.900 INFO:tasks.workunit.client.0.smithi111.stdout:1/599: dread d3/f7 [0,4194304] 0 2024-09-16T09:46:16.900 INFO:tasks.workunit.client.0.smithi111.stdout:1/600: chown d3/d10/d72/f9e 7056 1 2024-09-16T09:46:16.901 INFO:tasks.workunit.client.0.smithi111.stdout:1/601: unlink d3/d10/d72/da1/d28/d36/d3d/d47/d65/l98 0 2024-09-16T09:46:16.902 INFO:tasks.workunit.client.0.smithi111.stdout:1/602: mknod d3/d26/d63/cc1 0 2024-09-16T09:46:16.903 INFO:tasks.workunit.client.0.smithi111.stdout:1/603: getdents d3/d10/d57/d95 0 2024-09-16T09:46:16.905 INFO:tasks.workunit.client.0.smithi111.stdout:1/604: mknod d3/d24/d62/cc2 0 2024-09-16T09:46:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:1/605: dread d3/d24/d29/f37 [0,4194304] 0 2024-09-16T09:46:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:1/606: fsync d3/d24/d4e/f5b 0 2024-09-16T09:46:16.910 INFO:tasks.workunit.client.0.smithi111.stdout:1/607: stat d3/d10/d72/da1/d28/d36/d3d/d47/d65/d85 0 2024-09-16T09:46:16.932 INFO:tasks.workunit.client.0.smithi111.stdout:1/608: dwrite d3/d10/d1c/f33 [0,4194304] 0 2024-09-16T09:46:16.937 INFO:tasks.workunit.client.0.smithi111.stdout:1/609: dread d3/d10/d1c/f94 [0,4194304] 0 2024-09-16T09:46:16.937 INFO:tasks.workunit.client.0.smithi111.stdout:1/610: fdatasync d3/f1a 0 2024-09-16T09:46:16.937 INFO:tasks.workunit.client.0.smithi111.stdout:1/611: write d3/d26/d63/f9b [304520,105490] 0 2024-09-16T09:46:16.960 INFO:tasks.workunit.client.0.smithi111.stdout:1/612: dwrite d3/d10/d72/da1/d28/d36/fa5 [4194304,4194304] 0 2024-09-16T09:46:16.962 INFO:tasks.workunit.client.0.smithi111.stdout:1/613: rmdir d3/d24/d62/db6 0 2024-09-16T09:46:16.979 INFO:tasks.workunit.client.0.smithi111.stdout:1/614: dwrite d3/d10/d1c/f54 [0,4194304] 0 2024-09-16T09:46:17.082 INFO:tasks.workunit.client.0.smithi111.stdout:1/615: creat d3/d10/d72/da1/d28/d36/d3d/d47/d65/dbf/fc3 x:0 0 0 2024-09-16T09:46:17.088 INFO:tasks.workunit.client.0.smithi111.stdout:1/616: creat d3/d24/d3f/fc4 x:0 0 0 2024-09-16T09:46:17.093 INFO:tasks.workunit.client.0.smithi111.stdout:1/617: symlink d3/lc5 0 2024-09-16T09:46:17.093 INFO:tasks.workunit.client.0.smithi111.stdout:1/618: chown d3/d10/d72/da1/d28/d36/d3d/d47/daf/f91 48632 1 2024-09-16T09:46:17.093 INFO:tasks.workunit.client.0.smithi111.stdout:1/619: read - d3/d10/d1c/f76 zero size 2024-09-16T09:46:17.097 INFO:tasks.workunit.client.0.smithi111.stdout:9/562: sync 2024-09-16T09:46:17.097 INFO:tasks.workunit.client.0.smithi111.stdout:9/563: write d0/d21/d22/f86 [878272,114271] 0 2024-09-16T09:46:17.098 INFO:tasks.workunit.client.0.smithi111.stdout:9/564: mkdir d0/d21/d22/d6e/d51/d76/dc0 0 2024-09-16T09:46:17.110 INFO:tasks.workunit.client.0.smithi111.stdout:1/620: dwrite d3/d24/f75 [0,4194304] 0 2024-09-16T09:46:17.116 INFO:tasks.workunit.client.0.smithi111.stdout:1/621: creat d3/d24/d62/db3/fc6 x:0 0 0 2024-09-16T09:46:17.116 INFO:tasks.workunit.client.0.smithi111.stdout:1/622: write d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f7e [13599,36959] 0 2024-09-16T09:46:17.122 INFO:tasks.workunit.client.0.smithi111.stdout:1/623: creat d3/d10/d72/da1/d28/d36/d3d/d47/daf/dbc/fc7 x:0 0 0 2024-09-16T09:46:17.124 INFO:tasks.workunit.client.0.smithi111.stdout:1/624: mkdir d3/d24/d29/dc8 0 2024-09-16T09:46:17.124 INFO:tasks.workunit.client.0.smithi111.stdout:1/625: fdatasync d3/d10/d57/d95/fbd 0 2024-09-16T09:46:17.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/626: creat d3/d10/d72/da1/fc9 x:0 0 0 2024-09-16T09:46:17.129 INFO:tasks.workunit.client.0.smithi111.stdout:1/627: creat d3/d10/d57/d8f/fca x:0 0 0 2024-09-16T09:46:17.150 INFO:tasks.workunit.client.0.smithi111.stdout:1/628: dwrite d3/f1a [0,4194304] 0 2024-09-16T09:46:17.159 INFO:tasks.workunit.client.0.smithi111.stdout:1/629: read d3/d10/d1c/f54 [3948514,76643] 0 2024-09-16T09:46:17.174 INFO:tasks.workunit.client.0.smithi111.stdout:1/630: dwrite d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f87 [0,4194304] 0 2024-09-16T09:46:17.174 INFO:tasks.workunit.client.0.smithi111.stdout:1/631: chown d3/d24/d62 31 1 2024-09-16T09:46:17.175 INFO:tasks.workunit.client.0.smithi111.stdout:1/632: write d3/d10/d72/da1/d28/d36/d3d/d47/daf/f91 [823340,109730] 0 2024-09-16T09:46:17.195 INFO:tasks.workunit.client.0.smithi111.stdout:1/633: dwrite d3/f1a [0,4194304] 0 2024-09-16T09:46:17.197 INFO:tasks.workunit.client.0.smithi111.stdout:1/634: rename d3/d10/d1c/f94 to d3/d10/d72/fcb 0 2024-09-16T09:46:17.198 INFO:tasks.workunit.client.0.smithi111.stdout:1/635: dread - d3/d24/d62/db3/fc6 zero size 2024-09-16T09:46:17.198 INFO:tasks.workunit.client.0.smithi111.stdout:1/636: chown d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f7e 786062 1 2024-09-16T09:46:17.215 INFO:tasks.workunit.client.0.smithi111.stdout:1/637: dwrite d3/d10/d1c/f76 [0,4194304] 0 2024-09-16T09:46:17.220 INFO:tasks.workunit.client.0.smithi111.stdout:1/638: mkdir d3/d10/d57/dcc 0 2024-09-16T09:46:17.221 INFO:tasks.workunit.client.0.smithi111.stdout:1/639: unlink d3/f14 0 2024-09-16T09:46:17.226 INFO:tasks.workunit.client.0.smithi111.stdout:1/640: getdents d3/d10/d57 0 2024-09-16T09:46:17.226 INFO:tasks.workunit.client.0.smithi111.stdout:5/756: sync 2024-09-16T09:46:17.227 INFO:tasks.workunit.client.0.smithi111.stdout:1/641: mknod d3/d10/d23/ccd 0 2024-09-16T09:46:17.229 INFO:tasks.workunit.client.0.smithi111.stdout:5/757: mknod d19/d1b/d1e/d21/d29/d32/d46/c103 0 2024-09-16T09:46:17.230 INFO:tasks.workunit.client.0.smithi111.stdout:1/642: rename d3/d10/d72/da1/d28/d36/d3d/d47/d65/dbf/fc3 to d3/d10/d72/da1/d28/d36/fce 0 2024-09-16T09:46:17.231 INFO:tasks.workunit.client.0.smithi111.stdout:5/758: symlink d19/d1b/l104 0 2024-09-16T09:46:17.232 INFO:tasks.workunit.client.0.smithi111.stdout:5/759: chown d19/d1b/d27/d83/f36 111364 1 2024-09-16T09:46:17.233 INFO:tasks.workunit.client.0.smithi111.stdout:5/760: truncate d19/d1b/d27/d83/d2a/f7c 2022287 0 2024-09-16T09:46:17.234 INFO:tasks.workunit.client.0.smithi111.stdout:5/761: write d19/d1b/d27/d9d/fc7 [1431207,102302] 0 2024-09-16T09:46:17.234 INFO:tasks.workunit.client.0.smithi111.stdout:5/762: creat d19/d1b/d27/d2e/df3/d100/f105 x:0 0 0 2024-09-16T09:46:17.238 INFO:tasks.workunit.client.0.smithi111.stdout:5/763: mkdir d19/d1b/d27/d2e/d4a/d106 0 2024-09-16T09:46:17.238 INFO:tasks.workunit.client.0.smithi111.stdout:5/764: dread - d19/d1b/d27/d2e/d4a/f8c zero size 2024-09-16T09:46:17.238 INFO:tasks.workunit.client.0.smithi111.stdout:5/765: readlink d19/d1b/d1e/d21/lbb 0 2024-09-16T09:46:17.240 INFO:tasks.workunit.client.0.smithi111.stdout:5/766: mkdir d19/d1b/d27/d2e/d39/d54/d60/d107 0 2024-09-16T09:46:17.245 INFO:tasks.workunit.client.0.smithi111.stdout:5/767: link d19/d1b/f4d d19/d1b/d27/d2e/d39/d54/d60/dc9/f108 0 2024-09-16T09:46:17.248 INFO:tasks.workunit.client.0.smithi111.stdout:5/768: stat d19/d1b/d27/d2e/f6d 0 2024-09-16T09:46:17.249 INFO:tasks.workunit.client.0.smithi111.stdout:5/769: rename d19/cb6 to d19/d1b/d1e/d21/d29/d32/d46/c109 0 2024-09-16T09:46:17.249 INFO:tasks.workunit.client.0.smithi111.stdout:5/770: fsync d19/d1b/d27/d2e/d4a/d4b/dac/fe5 0 2024-09-16T09:46:17.249 INFO:tasks.workunit.client.0.smithi111.stdout:1/643: dwrite d3/d24/d62/f81 [0,4194304] 0 2024-09-16T09:46:17.251 INFO:tasks.workunit.client.0.smithi111.stdout:1/644: mknod d3/d24/d62/ccf 0 2024-09-16T09:46:17.252 INFO:tasks.workunit.client.0.smithi111.stdout:1/645: mkdir d3/d10/dd0 0 2024-09-16T09:46:17.253 INFO:tasks.workunit.client.0.smithi111.stdout:1/646: mkdir d3/d26/d63/d84/dd1 0 2024-09-16T09:46:17.261 INFO:tasks.workunit.client.0.smithi111.stdout:1/647: dread d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f80 [0,4194304] 0 2024-09-16T09:46:17.267 INFO:tasks.workunit.client.0.smithi111.stdout:5/771: dwrite d19/d1b/d27/d2e/d4a/d4b/d9c/fa8 [0,4194304] 0 2024-09-16T09:46:17.267 INFO:tasks.workunit.client.0.smithi111.stdout:5/772: chown f15 4925437 1 2024-09-16T09:46:17.270 INFO:tasks.workunit.client.0.smithi111.stdout:5/773: rmdir d19/d1b/d27/d9d 39 2024-09-16T09:46:17.271 INFO:tasks.workunit.client.0.smithi111.stdout:5/774: creat d19/d1b/d27/d2e/d98/f10a x:0 0 0 2024-09-16T09:46:17.271 INFO:tasks.workunit.client.0.smithi111.stdout:5/775: mkdir d19/d1b/d27/d2e/df3/d100/d10b 0 2024-09-16T09:46:17.274 INFO:tasks.workunit.client.0.smithi111.stdout:5/776: dread d19/d1b/d27/d2e/d4a/d4b/dac/fca [0,4194304] 0 2024-09-16T09:46:17.276 INFO:tasks.workunit.client.0.smithi111.stdout:5/777: creat d19/d1b/d27/d2e/d4a/d4b/dd7/f10c x:0 0 0 2024-09-16T09:46:17.277 INFO:tasks.workunit.client.0.smithi111.stdout:5/778: truncate d19/d1b/d27/d83/f2b 3836259 0 2024-09-16T09:46:17.278 INFO:tasks.workunit.client.0.smithi111.stdout:5/779: getdents d19/d1b/d1e/d21/d29/d32/dee 0 2024-09-16T09:46:17.279 INFO:tasks.workunit.client.0.smithi111.stdout:1/648: dwrite d3/d10/d72/da1/d28/d36/fce [0,4194304] 0 2024-09-16T09:46:17.279 INFO:tasks.workunit.client.0.smithi111.stdout:1/649: write d3/d10/d72/da1/d28/d36/fa5 [2614078,63575] 0 2024-09-16T09:46:17.280 INFO:tasks.workunit.client.0.smithi111.stdout:5/780: rmdir d19/d1b/d27/d2e/d98 39 2024-09-16T09:46:17.282 INFO:tasks.workunit.client.0.smithi111.stdout:4/612: sync 2024-09-16T09:46:17.283 INFO:tasks.workunit.client.0.smithi111.stdout:7/574: sync 2024-09-16T09:46:17.283 INFO:tasks.workunit.client.0.smithi111.stdout:8/763: sync 2024-09-16T09:46:17.283 INFO:tasks.workunit.client.0.smithi111.stdout:8/764: chown d3/de/d1e/d2e/d2f/f49 719564 1 2024-09-16T09:46:17.283 INFO:tasks.workunit.client.0.smithi111.stdout:1/650: dread d3/d10/d72/da1/ff [0,4194304] 0 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:1/651: chown d3/d24/d29/f37 656759853 1 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:9/565: sync 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:0/743: sync 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:6/619: sync 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:3/854: sync 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:2/788: sync 2024-09-16T09:46:17.284 INFO:tasks.workunit.client.0.smithi111.stdout:3/855: chown d5/da/d42/d74/da4/fd7 21315 1 2024-09-16T09:46:17.285 INFO:tasks.workunit.client.0.smithi111.stdout:2/789: dread - d0/d45/d5c/d67/d63/dd4/dc3/ff5 zero size 2024-09-16T09:46:17.285 INFO:tasks.workunit.client.0.smithi111.stdout:6/620: write d0/d57/db0/d14/d20/d42/d4e/fa3 [5064647,45679] 0 2024-09-16T09:46:17.288 INFO:tasks.workunit.client.0.smithi111.stdout:4/613: rmdir d2/d30/d44/d69 39 2024-09-16T09:46:17.288 INFO:tasks.workunit.client.0.smithi111.stdout:4/614: readlink d2/d6/dd/d1b/d38/db0/l6f 0 2024-09-16T09:46:17.289 INFO:tasks.workunit.client.0.smithi111.stdout:5/781: dread f15 [4194304,4194304] 0 2024-09-16T09:46:17.289 INFO:tasks.workunit.client.0.smithi111.stdout:5/782: read f15 [2322318,62360] 0 2024-09-16T09:46:17.291 INFO:tasks.workunit.client.0.smithi111.stdout:8/765: rename d3/de/d1e/d2e/d2f/d4c to d3/da/db/d59/dd7/dcc/d100 0 2024-09-16T09:46:17.291 INFO:tasks.workunit.client.0.smithi111.stdout:8/766: write d3/da/db/d59/de5/fef [1282217,28572] 0 2024-09-16T09:46:17.293 INFO:tasks.workunit.client.0.smithi111.stdout:1/652: creat d3/d24/d29/fd2 x:0 0 0 2024-09-16T09:46:17.293 INFO:tasks.workunit.client.0.smithi111.stdout:1/653: chown d3/d10/d72/da1/d28/d36/c58 937 1 2024-09-16T09:46:17.294 INFO:tasks.workunit.client.0.smithi111.stdout:0/744: creat d0/d1d/f110 x:0 0 0 2024-09-16T09:46:17.296 INFO:tasks.workunit.client.0.smithi111.stdout:9/566: mkdir d0/d6/dc1 0 2024-09-16T09:46:17.296 INFO:tasks.workunit.client.0.smithi111.stdout:2/790: getdents d0/da6/dea 0 2024-09-16T09:46:17.296 INFO:tasks.workunit.client.0.smithi111.stdout:2/791: fdatasync d0/d45/d5c/d67/f70 0 2024-09-16T09:46:17.297 INFO:tasks.workunit.client.0.smithi111.stdout:2/792: chown d0/d45/d5c/dc6 2852 1 2024-09-16T09:46:17.297 INFO:tasks.workunit.client.0.smithi111.stdout:2/793: chown d0/d2/d5a/c10e 7855 1 2024-09-16T09:46:17.298 INFO:tasks.workunit.client.0.smithi111.stdout:7/575: mkdir d1/dc7 0 2024-09-16T09:46:17.298 INFO:tasks.workunit.client.0.smithi111.stdout:7/576: write d1/d9/d43/f7a [850286,20372] 0 2024-09-16T09:46:17.298 INFO:tasks.workunit.client.0.smithi111.stdout:4/615: symlink d2/d6/dd/d1b/d6d/d8f/lbd 0 2024-09-16T09:46:17.299 INFO:tasks.workunit.client.0.smithi111.stdout:5/783: symlink d19/d1b/d27/d2e/l10d 0 2024-09-16T09:46:17.301 INFO:tasks.workunit.client.0.smithi111.stdout:3/856: rename d5/c3f to d5/da/de1/c122 0 2024-09-16T09:46:17.302 INFO:tasks.workunit.client.0.smithi111.stdout:8/767: creat d3/da/db/d59/dd7/dcc/f101 x:0 0 0 2024-09-16T09:46:17.303 INFO:tasks.workunit.client.0.smithi111.stdout:1/654: write d3/d10/d1c/f76 [2545383,36021] 0 2024-09-16T09:46:17.303 INFO:tasks.workunit.client.0.smithi111.stdout:4/616: read d2/d6/dd/f76 [404367,19213] 0 2024-09-16T09:46:17.303 INFO:tasks.workunit.client.0.smithi111.stdout:8/768: read d3/de/d1e/d2e/d2f/f8d [127832,88815] 0 2024-09-16T09:46:17.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/745: mkdir d0/d1d/d58/d83/d111 0 2024-09-16T09:46:17.305 INFO:tasks.workunit.client.0.smithi111.stdout:0/746: truncate d0/d1d/d67/d3a/f6f 450586 0 2024-09-16T09:46:17.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/567: truncate d0/d21/d22/d6e/f97 1466039 0 2024-09-16T09:46:17.308 INFO:tasks.workunit.client.0.smithi111.stdout:9/568: write d0/d6/d30/fb1 [768581,61586] 0 2024-09-16T09:46:17.310 INFO:tasks.workunit.client.0.smithi111.stdout:2/794: symlink d0/da/l113 0 2024-09-16T09:46:17.310 INFO:tasks.workunit.client.0.smithi111.stdout:2/795: stat d0/da6 0 2024-09-16T09:46:17.311 INFO:tasks.workunit.client.0.smithi111.stdout:5/784: mkdir d19/d1b/d10e 0 2024-09-16T09:46:17.314 INFO:tasks.workunit.client.0.smithi111.stdout:6/621: rename d0/d57/db0/d14/f37 to d0/d57/db0/d49/fd7 0 2024-09-16T09:46:17.316 INFO:tasks.workunit.client.0.smithi111.stdout:1/655: mkdir d3/d24/d62/dd3 0 2024-09-16T09:46:17.320 INFO:tasks.workunit.client.0.smithi111.stdout:0/747: mknod d0/c112 0 2024-09-16T09:46:17.324 INFO:tasks.workunit.client.0.smithi111.stdout:5/785: link d19/c3c d19/d1b/d1e/d21/c10f 0 2024-09-16T09:46:17.328 INFO:tasks.workunit.client.0.smithi111.stdout:9/569: rename d0/d6c/f8d to d0/d21/d22/d6e/d51/d76/dc0/fc2 0 2024-09-16T09:46:17.329 INFO:tasks.workunit.client.0.smithi111.stdout:9/570: chown d0/d6/d30/d81/fb6 0 1 2024-09-16T09:46:17.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/857: dwrite d5/d18/d78/dfd/db6/ff1 [0,4194304] 0 2024-09-16T09:46:17.329 INFO:tasks.workunit.client.0.smithi111.stdout:3/858: chown d5/d18/f8b 120491969 1 2024-09-16T09:46:17.330 INFO:tasks.workunit.client.0.smithi111.stdout:6/622: truncate d0/f19 474246 0 2024-09-16T09:46:17.331 INFO:tasks.workunit.client.0.smithi111.stdout:8/769: dwrite d3/f8 [0,4194304] 0 2024-09-16T09:46:17.333 INFO:tasks.workunit.client.0.smithi111.stdout:1/656: creat d3/d10/d57/dcc/fd4 x:0 0 0 2024-09-16T09:46:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:2/796: rename d0/d2/d61 to d0/d22/d98/d114 0 2024-09-16T09:46:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:2/797: fdatasync d0/d29/f42 0 2024-09-16T09:46:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:2/798: write d0/d22/f24 [3074025,109894] 0 2024-09-16T09:46:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/786: dread d19/f43 [0,4194304] 0 2024-09-16T09:46:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/787: readlink d19/d1b/d27/d2e/d39/lcc 0 2024-09-16T09:46:17.338 INFO:tasks.workunit.client.0.smithi111.stdout:5/788: fdatasync d19/d1b/d1e/f40 0 2024-09-16T09:46:17.339 INFO:tasks.workunit.client.0.smithi111.stdout:9/571: rmdir d0 39 2024-09-16T09:46:17.340 INFO:tasks.workunit.client.0.smithi111.stdout:9/572: dread - d0/d6/fad zero size 2024-09-16T09:46:17.340 INFO:tasks.workunit.client.0.smithi111.stdout:9/573: write d0/d21/d22/f3e [201835,102827] 0 2024-09-16T09:46:17.344 INFO:tasks.workunit.client.0.smithi111.stdout:1/657: read d3/d10/d1c/f33 [2042850,81323] 0 2024-09-16T09:46:17.345 INFO:tasks.workunit.client.0.smithi111.stdout:1/658: chown d3/d26/f34 163 1 2024-09-16T09:46:17.345 INFO:tasks.workunit.client.0.smithi111.stdout:1/659: fsync d3/d10/d72/da1/f35 0 2024-09-16T09:46:17.345 INFO:tasks.workunit.client.0.smithi111.stdout:8/770: dread d3/de/d1e/d2e/d2f/f5e [0,4194304] 0 2024-09-16T09:46:17.345 INFO:tasks.workunit.client.0.smithi111.stdout:3/859: mknod d5/da/d111/c123 0 2024-09-16T09:46:17.347 INFO:tasks.workunit.client.0.smithi111.stdout:6/623: link d0/d57/db0/faa d0/d57/fd8 0 2024-09-16T09:46:17.348 INFO:tasks.workunit.client.0.smithi111.stdout:0/748: dwrite d0/d1d/d67/d3a/d92/f97 [0,4194304] 0 2024-09-16T09:46:17.350 INFO:tasks.workunit.client.0.smithi111.stdout:2/799: symlink d0/d22/dac/l115 0 2024-09-16T09:46:17.351 INFO:tasks.workunit.client.0.smithi111.stdout:9/574: mkdir d0/d21/dc3 0 2024-09-16T09:46:17.355 INFO:tasks.workunit.client.0.smithi111.stdout:1/660: creat d3/d10/d72/da1/d28/d36/d3d/fd5 x:0 0 0 2024-09-16T09:46:17.358 INFO:tasks.workunit.client.0.smithi111.stdout:8/771: rename d3/de/d1e/d2e/d74/dad/lb0 to d3/da/db/d59/dd7/l102 0 2024-09-16T09:46:17.360 INFO:tasks.workunit.client.0.smithi111.stdout:3/860: unlink d5/da/db/d3a/c54 0 2024-09-16T09:46:17.361 INFO:tasks.workunit.client.0.smithi111.stdout:6/624: symlink d0/d57/ld9 0 2024-09-16T09:46:17.362 INFO:tasks.workunit.client.0.smithi111.stdout:0/749: creat d0/d1d/d67/f113 x:0 0 0 2024-09-16T09:46:17.363 INFO:tasks.workunit.client.0.smithi111.stdout:1/661: creat d3/d24/d4e/fd6 x:0 0 0 2024-09-16T09:46:17.364 INFO:tasks.workunit.client.0.smithi111.stdout:9/575: rename d0/d6/d30/c7c to d0/d21/d22/d6e/d7d/cc4 0 2024-09-16T09:46:17.365 INFO:tasks.workunit.client.0.smithi111.stdout:8/772: creat d3/de/d1e/d2e/d74/dad/f103 x:0 0 0 2024-09-16T09:46:17.366 INFO:tasks.workunit.client.0.smithi111.stdout:8/773: chown d3/de/d1e/d2e/d74/f8c 325637730 1 2024-09-16T09:46:17.366 INFO:tasks.workunit.client.0.smithi111.stdout:3/861: getdents d5/da/d42/d74/da4 0 2024-09-16T09:46:17.366 INFO:tasks.workunit.client.0.smithi111.stdout:3/862: chown d5/da/db/c32 39868 1 2024-09-16T09:46:17.367 INFO:tasks.workunit.client.0.smithi111.stdout:3/863: dread d5/d18/d78/dfd/da0/dd9/f9c [0,4194304] 0 2024-09-16T09:46:17.368 INFO:tasks.workunit.client.0.smithi111.stdout:6/625: unlink d0/d57/db0/d47/d88/fca 0 2024-09-16T09:46:17.369 INFO:tasks.workunit.client.0.smithi111.stdout:6/626: fsync d0/d57/db0/d47/d68/f7f 0 2024-09-16T09:46:17.369 INFO:tasks.workunit.client.0.smithi111.stdout:1/662: truncate d3/d10/d72/da1/d28/d36/f64 1799593 0 2024-09-16T09:46:17.370 INFO:tasks.workunit.client.0.smithi111.stdout:8/774: creat d3/dc3/f104 x:0 0 0 2024-09-16T09:46:17.371 INFO:tasks.workunit.client.0.smithi111.stdout:6/627: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/dda 0 2024-09-16T09:46:17.372 INFO:tasks.workunit.client.0.smithi111.stdout:1/663: rename d3/d26/d63/lab to d3/d10/dd0/ld7 0 2024-09-16T09:46:17.373 INFO:tasks.workunit.client.0.smithi111.stdout:1/664: read - d3/d10/d72/da1/d28/d36/d3d/d47/daf/fba zero size 2024-09-16T09:46:17.374 INFO:tasks.workunit.client.0.smithi111.stdout:8/775: mknod d3/de/d1e/d2e/d2f/c105 0 2024-09-16T09:46:17.374 INFO:tasks.workunit.client.0.smithi111.stdout:3/864: dread d5/da/db/d3a/d59/f61 [0,4194304] 0 2024-09-16T09:46:17.374 INFO:tasks.workunit.client.0.smithi111.stdout:5/789: dwrite d19/d1b/d27/d2e/d4a/d4b/dd7/f10c [0,4194304] 0 2024-09-16T09:46:17.375 INFO:tasks.workunit.client.0.smithi111.stdout:6/628: creat d0/d57/d72/db2/fdb x:0 0 0 2024-09-16T09:46:17.375 INFO:tasks.workunit.client.0.smithi111.stdout:6/629: readlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/l63 0 2024-09-16T09:46:17.375 INFO:tasks.workunit.client.0.smithi111.stdout:6/630: fsync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/f81 0 2024-09-16T09:46:17.375 INFO:tasks.workunit.client.0.smithi111.stdout:1/665: creat d3/d10/d23/fd8 x:0 0 0 2024-09-16T09:46:17.376 INFO:tasks.workunit.client.0.smithi111.stdout:8/776: rename d3/de/d1e/d2e/d74/d83/da2 to d3/de/d1e/d2e/dce/d106 0 2024-09-16T09:46:17.376 INFO:tasks.workunit.client.0.smithi111.stdout:4/617: dwrite d2/f17 [0,4194304] 0 2024-09-16T09:46:17.377 INFO:tasks.workunit.client.0.smithi111.stdout:3/865: creat d5/da/db/d5a/df8/d11f/f124 x:0 0 0 2024-09-16T09:46:17.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/800: dwrite d0/d45/d5c/d67/d63/fb8 [4194304,4194304] 0 2024-09-16T09:46:17.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/801: truncate d0/d45/d5c/d67/d63/dd4/dc3/ff5 894742 0 2024-09-16T09:46:17.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/802: write d0/da/f3a [4282734,2295] 0 2024-09-16T09:46:17.379 INFO:tasks.workunit.client.0.smithi111.stdout:2/803: write d0/d2/d59/d86/d96/ff4 [202832,61714] 0 2024-09-16T09:46:17.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/790: symlink d19/d1b/d9f/deb/l110 0 2024-09-16T09:46:17.381 INFO:tasks.workunit.client.0.smithi111.stdout:6/631: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/fdc x:0 0 0 2024-09-16T09:46:17.381 INFO:tasks.workunit.client.0.smithi111.stdout:6/632: fdatasync d0/d57/db0/d14/fb7 0 2024-09-16T09:46:17.382 INFO:tasks.workunit.client.0.smithi111.stdout:1/666: mknod d3/d10/d57/d8f/cd9 0 2024-09-16T09:46:17.388 INFO:tasks.workunit.client.0.smithi111.stdout:8/777: dread d3/d26/d6d/f57 [0,4194304] 0 2024-09-16T09:46:17.388 INFO:tasks.workunit.client.0.smithi111.stdout:8/778: chown d3/de/d1e/d2e/d74/f8c 46273529 1 2024-09-16T09:46:17.388 INFO:tasks.workunit.client.0.smithi111.stdout:8/779: write d3/de/d1e/d2e/d2f/f8d [1181708,62118] 0 2024-09-16T09:46:17.388 INFO:tasks.workunit.client.0.smithi111.stdout:8/780: dread - d3/de/d1e/d2e/d2f/da8/fea zero size 2024-09-16T09:46:17.389 INFO:tasks.workunit.client.0.smithi111.stdout:8/781: chown d3/da/db/d59/dd7/l102 249 1 2024-09-16T09:46:17.389 INFO:tasks.workunit.client.0.smithi111.stdout:4/618: link d2/d6/dd/l24 d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/lbe 0 2024-09-16T09:46:17.392 INFO:tasks.workunit.client.0.smithi111.stdout:9/576: dwrite d0/d6/d8/de/d56/d4e/d92/fb3 [0,4194304] 0 2024-09-16T09:46:17.395 INFO:tasks.workunit.client.0.smithi111.stdout:3/866: mkdir d5/da/db/d3a/d6d/d125 0 2024-09-16T09:46:17.396 INFO:tasks.workunit.client.0.smithi111.stdout:2/804: dread d0/da/f3f [0,4194304] 0 2024-09-16T09:46:17.396 INFO:tasks.workunit.client.0.smithi111.stdout:2/805: fdatasync d0/d2/d44/f4b 0 2024-09-16T09:46:17.396 INFO:tasks.workunit.client.0.smithi111.stdout:2/806: write d0/d2/d44/f5e [1025252,4417] 0 2024-09-16T09:46:17.396 INFO:tasks.workunit.client.0.smithi111.stdout:2/807: truncate d0/d2/d44/f5e 1143931 0 2024-09-16T09:46:17.396 INFO:tasks.workunit.client.0.smithi111.stdout:2/808: write d0/d2/d59/d86/d96/dc7/ff6 [21696,57001] 0 2024-09-16T09:46:17.397 INFO:tasks.workunit.client.0.smithi111.stdout:2/809: stat d0/d2/d5a/l7b 0 2024-09-16T09:46:17.398 INFO:tasks.workunit.client.0.smithi111.stdout:5/791: getdents d19/d1b/d1e/d21/d29/d32/d8f 0 2024-09-16T09:46:17.398 INFO:tasks.workunit.client.0.smithi111.stdout:5/792: fdatasync d19/d1b/d9f/deb/fe3 0 2024-09-16T09:46:17.398 INFO:tasks.workunit.client.0.smithi111.stdout:6/633: mknod d0/d57/db0/d47/d68/d6a/cdd 0 2024-09-16T09:46:17.400 INFO:tasks.workunit.client.0.smithi111.stdout:1/667: dwrite d3/d10/d72/da1/f1b [12582912,4194304] 0 2024-09-16T09:46:17.403 INFO:tasks.workunit.client.0.smithi111.stdout:8/782: link d3/d26/d6d/f57 d3/da/db/d59/dd7/f107 0 2024-09-16T09:46:17.404 INFO:tasks.workunit.client.0.smithi111.stdout:8/783: readlink d3/da/db/d59/dd7/dcc/d100/lf7 0 2024-09-16T09:46:17.405 INFO:tasks.workunit.client.0.smithi111.stdout:4/619: mkdir d2/d6/dd/d1b/d38/d64/d92/dbf 0 2024-09-16T09:46:17.406 INFO:tasks.workunit.client.0.smithi111.stdout:3/867: dread d5/da/db/de/f27 [0,4194304] 0 2024-09-16T09:46:17.413 INFO:tasks.workunit.client.0.smithi111.stdout:9/577: mkdir d0/d6/d8/de/d56/d4e/dc5 0 2024-09-16T09:46:17.415 INFO:tasks.workunit.client.0.smithi111.stdout:2/810: creat d0/d45/f116 x:0 0 0 2024-09-16T09:46:17.415 INFO:tasks.workunit.client.0.smithi111.stdout:2/811: chown d0/d2/d44/c56 966121 1 2024-09-16T09:46:17.418 INFO:tasks.workunit.client.0.smithi111.stdout:5/793: truncate d19/d1b/d27/d2e/d4a/d4b/fa3 1292670 0 2024-09-16T09:46:17.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/634: rmdir d0/d57/db0/d14/d20 39 2024-09-16T09:46:17.418 INFO:tasks.workunit.client.0.smithi111.stdout:6/635: read d0/f1a [2804515,74085] 0 2024-09-16T09:46:17.425 INFO:tasks.workunit.client.0.smithi111.stdout:9/578: read d0/d6/d8/f1c [7949116,107265] 0 2024-09-16T09:46:17.427 INFO:tasks.workunit.client.0.smithi111.stdout:2/812: dread d0/d2/f17 [4194304,4194304] 0 2024-09-16T09:46:17.427 INFO:tasks.workunit.client.0.smithi111.stdout:3/868: dwrite d5/da/db/d5a/f67 [0,4194304] 0 2024-09-16T09:46:17.427 INFO:tasks.workunit.client.0.smithi111.stdout:1/668: dwrite d3/d10/d72/fcb [4194304,4194304] 0 2024-09-16T09:46:17.430 INFO:tasks.workunit.client.0.smithi111.stdout:4/620: symlink d2/d6/dd/d1b/d38/d64/lc0 0 2024-09-16T09:46:17.430 INFO:tasks.workunit.client.0.smithi111.stdout:4/621: read d2/f8 [6484692,51507] 0 2024-09-16T09:46:17.430 INFO:tasks.workunit.client.0.smithi111.stdout:4/622: chown d2/d6/dd/f16 437275504 1 2024-09-16T09:46:17.431 INFO:tasks.workunit.client.0.smithi111.stdout:5/794: rmdir d19/d1b/d27/d2e/d39/d54/d60/d107 0 2024-09-16T09:46:17.432 INFO:tasks.workunit.client.0.smithi111.stdout:9/579: creat d0/d21/d22/d6e/d51/d76/dc0/fc6 x:0 0 0 2024-09-16T09:46:17.433 INFO:tasks.workunit.client.0.smithi111.stdout:2/813: creat d0/d2/d59/d86/f117 x:0 0 0 2024-09-16T09:46:17.433 INFO:tasks.workunit.client.0.smithi111.stdout:2/814: stat d0/d2/d59 0 2024-09-16T09:46:17.434 INFO:tasks.workunit.client.0.smithi111.stdout:2/815: fsync d0/fb9 0 2024-09-16T09:46:17.436 INFO:tasks.workunit.client.0.smithi111.stdout:6/636: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f34 [0,4194304] 0 2024-09-16T09:46:17.439 INFO:tasks.workunit.client.0.smithi111.stdout:3/869: creat d5/da/db/d3a/d6d/de7/d88/f126 x:0 0 0 2024-09-16T09:46:17.441 INFO:tasks.workunit.client.0.smithi111.stdout:4/623: mknod d2/d6/dd/d1b/d38/d64/d92/da0/db5/cc1 0 2024-09-16T09:46:17.441 INFO:tasks.workunit.client.0.smithi111.stdout:4/624: readlink d2/d6/dd/d1b/d38/db0/l83 0 2024-09-16T09:46:17.441 INFO:tasks.workunit.client.0.smithi111.stdout:4/625: write d2/d6/dd/d1b/d38/db0/d2f/f46 [2598044,15244] 0 2024-09-16T09:46:17.442 INFO:tasks.workunit.client.0.smithi111.stdout:4/626: write d2/d6/dd/f76 [153334,38166] 0 2024-09-16T09:46:17.442 INFO:tasks.workunit.client.0.smithi111.stdout:9/580: symlink d0/d6/lc7 0 2024-09-16T09:46:17.445 INFO:tasks.workunit.client.0.smithi111.stdout:6/637: unlink d0/d57/db0/fb5 0 2024-09-16T09:46:17.446 INFO:tasks.workunit.client.0.smithi111.stdout:4/627: dread d2/d6/dd/d1b/d6d/d8f/fa9 [0,4194304] 0 2024-09-16T09:46:17.448 INFO:tasks.workunit.client.0.smithi111.stdout:9/581: link d0/d6/d30/d81/fb6 d0/d6/d30/d47/dbd/fc8 0 2024-09-16T09:46:17.452 INFO:tasks.workunit.client.0.smithi111.stdout:4/628: truncate d2/d6/dd/d1b/d38/db0/d2f/fa3 2759179 0 2024-09-16T09:46:17.453 INFO:tasks.workunit.client.0.smithi111.stdout:9/582: mknod d0/d21/d22/d6e/d7d/d9a/cc9 0 2024-09-16T09:46:17.453 INFO:tasks.workunit.client.0.smithi111.stdout:6/638: read d0/d57/db0/d47/fad [2438945,76243] 0 2024-09-16T09:46:17.454 INFO:tasks.workunit.client.0.smithi111.stdout:4/629: mknod d2/d6/dd/d1b/d38/db0/d2f/d6c/cc2 0 2024-09-16T09:46:17.457 INFO:tasks.workunit.client.0.smithi111.stdout:3/870: write d5/da/db/d5a/f89 [448261,33308] 0 2024-09-16T09:46:17.457 INFO:tasks.workunit.client.0.smithi111.stdout:9/583: rename d0/d21/d59 to d0/d6/d8/de/dca 0 2024-09-16T09:46:17.458 INFO:tasks.workunit.client.0.smithi111.stdout:6/639: rmdir d0 39 2024-09-16T09:46:17.459 INFO:tasks.workunit.client.0.smithi111.stdout:3/871: stat d5/d18/c1d 0 2024-09-16T09:46:17.460 INFO:tasks.workunit.client.0.smithi111.stdout:3/872: dread - d5/da/db/d3a/fae zero size 2024-09-16T09:46:17.464 INFO:tasks.workunit.client.0.smithi111.stdout:4/630: rename d2/d6/dd/d1b/d6d/laf to d2/d6/d80/lc3 0 2024-09-16T09:46:17.464 INFO:tasks.workunit.client.0.smithi111.stdout:4/631: readlink d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/lbe 0 2024-09-16T09:46:17.464 INFO:tasks.workunit.client.0.smithi111.stdout:4/632: readlink d2/d6/dd/d1b/d38/d64/l9f 0 2024-09-16T09:46:17.464 INFO:tasks.workunit.client.0.smithi111.stdout:1/669: dwrite d3/d10/d23/fbe [0,4194304] 0 2024-09-16T09:46:17.464 INFO:tasks.workunit.client.0.smithi111.stdout:5/795: dwrite f12 [0,4194304] 0 2024-09-16T09:46:17.464 INFO:tasks.workunit.client.0.smithi111.stdout:5/796: chown d19/d1b/d27/d2e/d4a/d4b/c7b 233 1 2024-09-16T09:46:17.465 INFO:tasks.workunit.client.0.smithi111.stdout:9/584: mkdir d0/d6/d45/db0/dcb 0 2024-09-16T09:46:17.465 INFO:tasks.workunit.client.0.smithi111.stdout:9/585: truncate d0/d6c/d70/fa4 1211374 0 2024-09-16T09:46:17.465 INFO:tasks.workunit.client.0.smithi111.stdout:9/586: dread - d0/d6/fb9 zero size 2024-09-16T09:46:17.465 INFO:tasks.workunit.client.0.smithi111.stdout:9/587: chown d0/d21/d22/d6e/d51/d76/f5c 37891605 1 2024-09-16T09:46:17.465 INFO:tasks.workunit.client.0.smithi111.stdout:2/816: dwrite d0/f53 [4194304,4194304] 0 2024-09-16T09:46:17.465 INFO:tasks.workunit.client.0.smithi111.stdout:2/817: stat d0/d2/d44/f5e 0 2024-09-16T09:46:17.466 INFO:tasks.workunit.client.0.smithi111.stdout:6/640: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde 0 2024-09-16T09:46:17.467 INFO:tasks.workunit.client.0.smithi111.stdout:6/641: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f9e [77098,89688] 0 2024-09-16T09:46:17.467 INFO:tasks.workunit.client.0.smithi111.stdout:6/642: write d0/d57/db0/d47/d68/fce [492962,90108] 0 2024-09-16T09:46:17.468 INFO:tasks.workunit.client.0.smithi111.stdout:4/633: creat d2/d30/d44/fc4 x:0 0 0 2024-09-16T09:46:17.468 INFO:tasks.workunit.client.0.smithi111.stdout:6/643: dread d0/f19 [0,4194304] 0 2024-09-16T09:46:17.472 INFO:tasks.workunit.client.0.smithi111.stdout:1/670: symlink d3/d10/dd0/lda 0 2024-09-16T09:46:17.475 INFO:tasks.workunit.client.0.smithi111.stdout:5/797: creat d19/d1b/d27/d2e/d4a/d4b/dac/dd2/f111 x:0 0 0 2024-09-16T09:46:17.475 INFO:tasks.workunit.client.0.smithi111.stdout:5/798: chown d19/d1b/d27/d2e/d4a/d4b 113686 1 2024-09-16T09:46:17.476 INFO:tasks.workunit.client.0.smithi111.stdout:9/588: dread d0/d6/d8/de/d56/f5e [0,4194304] 0 2024-09-16T09:46:17.476 INFO:tasks.workunit.client.0.smithi111.stdout:9/589: getdents d0/d6/d8/de/d56/d8e 0 2024-09-16T09:46:17.478 INFO:tasks.workunit.client.0.smithi111.stdout:2/818: link d0/d22/d98/dc9/cde d0/d2/d59/d86/c118 0 2024-09-16T09:46:17.482 INFO:tasks.workunit.client.0.smithi111.stdout:4/634: creat d2/d6/dd/d1b/d38/db0/d2f/fc5 x:0 0 0 2024-09-16T09:46:17.483 INFO:tasks.workunit.client.0.smithi111.stdout:6/644: getdents d0/d57/db0/d49 0 2024-09-16T09:46:17.487 INFO:tasks.workunit.client.0.smithi111.stdout:2/819: dread d0/d45/f65 [0,4194304] 0 2024-09-16T09:46:17.488 INFO:tasks.workunit.client.0.smithi111.stdout:6/645: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/db9/fdf x:0 0 0 2024-09-16T09:46:17.490 INFO:tasks.workunit.client.0.smithi111.stdout:4/635: symlink d2/d6/lc6 0 2024-09-16T09:46:17.492 INFO:tasks.workunit.client.0.smithi111.stdout:2/820: creat d0/da/d4e/f119 x:0 0 0 2024-09-16T09:46:17.492 INFO:tasks.workunit.client.0.smithi111.stdout:2/821: chown d0/d45/d81/ca2 1508 1 2024-09-16T09:46:17.494 INFO:tasks.workunit.client.0.smithi111.stdout:6/646: creat d0/d57/db0/d49/d5b/d93/fe0 x:0 0 0 2024-09-16T09:46:17.496 INFO:tasks.workunit.client.0.smithi111.stdout:1/671: dwrite d3/d10/d72/da1/d28/d36/f64 [0,4194304] 0 2024-09-16T09:46:17.497 INFO:tasks.workunit.client.0.smithi111.stdout:1/672: chown d3/d10/d1c/f31 1210150 1 2024-09-16T09:46:17.497 INFO:tasks.workunit.client.0.smithi111.stdout:4/636: creat d2/d6/dd/d1b/d38/d64/d92/fc7 x:0 0 0 2024-09-16T09:46:17.497 INFO:tasks.workunit.client.0.smithi111.stdout:4/637: dread - d2/d6/dd/d1b/d38/db0/d2f/d6c/fa7 zero size 2024-09-16T09:46:17.498 INFO:tasks.workunit.client.0.smithi111.stdout:2/822: mknod d0/da6/dea/d109/c11a 0 2024-09-16T09:46:17.498 INFO:tasks.workunit.client.0.smithi111.stdout:2/823: truncate d0/d45/f79 4943677 0 2024-09-16T09:46:17.499 INFO:tasks.workunit.client.0.smithi111.stdout:6/647: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/dc9/de1 0 2024-09-16T09:46:17.501 INFO:tasks.workunit.client.0.smithi111.stdout:1/673: creat d3/d10/d72/da1/d28/d36/fdb x:0 0 0 2024-09-16T09:46:17.502 INFO:tasks.workunit.client.0.smithi111.stdout:4/638: creat d2/d6/dd/d1b/d38/db0/d2f/d8d/fc8 x:0 0 0 2024-09-16T09:46:17.505 INFO:tasks.workunit.client.0.smithi111.stdout:2/824: rename d0/fa7 to d0/d22/f11b 0 2024-09-16T09:46:17.505 INFO:tasks.workunit.client.0.smithi111.stdout:5/799: dwrite d19/d1b/d27/d2e/df3/ffe [0,4194304] 0 2024-09-16T09:46:17.506 INFO:tasks.workunit.client.0.smithi111.stdout:6/648: symlink d0/d57/db0/d47/d68/le2 0 2024-09-16T09:46:17.506 INFO:tasks.workunit.client.0.smithi111.stdout:6/649: readlink d0/d57/db0/d49/d5b/l84 0 2024-09-16T09:46:17.506 INFO:tasks.workunit.client.0.smithi111.stdout:6/650: truncate d0/d57/db0/d47/d68/d6a/f8d 4882995 0 2024-09-16T09:46:17.507 INFO:tasks.workunit.client.0.smithi111.stdout:1/674: mknod d3/d10/d72/da1/d28/d36/d3d/d47/cdc 0 2024-09-16T09:46:17.507 INFO:tasks.workunit.client.0.smithi111.stdout:4/639: creat d2/d30/da1/fc9 x:0 0 0 2024-09-16T09:46:17.508 INFO:tasks.workunit.client.0.smithi111.stdout:2/825: creat d0/da/f11c x:0 0 0 2024-09-16T09:46:17.508 INFO:tasks.workunit.client.0.smithi111.stdout:2/826: truncate d0/da/f11c 915512 0 2024-09-16T09:46:17.511 INFO:tasks.workunit.client.0.smithi111.stdout:5/800: mknod d19/d1b/d27/d2e/d4a/d4b/d9c/c112 0 2024-09-16T09:46:17.514 INFO:tasks.workunit.client.0.smithi111.stdout:1/675: rename d3/d10/d72/c73 to d3/d26/d63/cdd 0 2024-09-16T09:46:17.516 INFO:tasks.workunit.client.0.smithi111.stdout:4/640: fdatasync d2/d6/f20 0 2024-09-16T09:46:17.516 INFO:tasks.workunit.client.0.smithi111.stdout:2/827: mknod d0/d2/d5a/c11d 0 2024-09-16T09:46:17.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/641: read d2/d6/dd/d1b/f5d [561853,8099] 0 2024-09-16T09:46:17.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/642: chown d2/d6/dd/d1b/d38/db0/d2f/d4e/f74 1 1 2024-09-16T09:46:17.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/643: write d2/f42 [1869741,59507] 0 2024-09-16T09:46:17.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/644: fsync d2/f8 0 2024-09-16T09:46:17.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/645: readlink d2/d30/d44/d69/l6a 0 2024-09-16T09:46:17.520 INFO:tasks.workunit.client.0.smithi111.stdout:6/651: link d0/ca d0/d57/db0/d47/ce3 0 2024-09-16T09:46:17.520 INFO:tasks.workunit.client.0.smithi111.stdout:6/652: write d0/d57/db0/d49/f71 [558913,61877] 0 2024-09-16T09:46:17.520 INFO:tasks.workunit.client.0.smithi111.stdout:6/653: write d0/f13 [4509124,29123] 0 2024-09-16T09:46:17.521 INFO:tasks.workunit.client.0.smithi111.stdout:2/828: mknod d0/da6/dea/d109/c11e 0 2024-09-16T09:46:17.524 INFO:tasks.workunit.client.0.smithi111.stdout:4/646: mknod d2/d6/d80/cca 0 2024-09-16T09:46:17.525 INFO:tasks.workunit.client.0.smithi111.stdout:4/647: write d2/d6/dd/d1b/d38/db0/d2f/fc5 [310606,18032] 0 2024-09-16T09:46:17.526 INFO:tasks.workunit.client.0.smithi111.stdout:6/654: rename d0/d57/db0/d47/d88/f97 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/fe4 0 2024-09-16T09:46:17.528 INFO:tasks.workunit.client.0.smithi111.stdout:2/829: rmdir d0/d22/d98/dc9 39 2024-09-16T09:46:17.528 INFO:tasks.workunit.client.0.smithi111.stdout:2/830: readlink d0/d45/d81/le9 0 2024-09-16T09:46:17.528 INFO:tasks.workunit.client.0.smithi111.stdout:2/831: write d0/d22/d98/d114/d9f/faf [1529,1390] 0 2024-09-16T09:46:17.528 INFO:tasks.workunit.client.0.smithi111.stdout:2/832: chown d0/d2/d59/d86/d96/dd1/cf3 485400 1 2024-09-16T09:46:17.535 INFO:tasks.workunit.client.0.smithi111.stdout:1/676: dwrite d3/f9 [0,4194304] 0 2024-09-16T09:46:17.535 INFO:tasks.workunit.client.0.smithi111.stdout:5/801: dwrite d19/d1b/d27/f3b [0,4194304] 0 2024-09-16T09:46:17.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/833: dread d0/d2/f15 [0,4194304] 0 2024-09-16T09:46:17.536 INFO:tasks.workunit.client.0.smithi111.stdout:2/834: truncate d0/d2/d59/d86/d96/ff4 1058532 0 2024-09-16T09:46:17.539 INFO:tasks.workunit.client.0.smithi111.stdout:4/648: symlink d2/d6/dd/d1b/d38/d64/d92/lcb 0 2024-09-16T09:46:17.541 INFO:tasks.workunit.client.0.smithi111.stdout:1/677: dread d3/d10/f18 [0,4194304] 0 2024-09-16T09:46:17.545 INFO:tasks.workunit.client.0.smithi111.stdout:5/802: mkdir d19/d1b/d9f/deb/d113 0 2024-09-16T09:46:17.547 INFO:tasks.workunit.client.0.smithi111.stdout:2/835: write d0/d45/d5c/d67/fa1 [4076720,23312] 0 2024-09-16T09:46:17.547 INFO:tasks.workunit.client.0.smithi111.stdout:2/836: truncate d0/d45/d5c/d67/d63/dd4/dc3/fe2 45440 0 2024-09-16T09:46:17.549 INFO:tasks.workunit.client.0.smithi111.stdout:4/649: rename d2/d6/dd/d1b/d38/f8e to d2/d6/dd/d1b/d6d/fcc 0 2024-09-16T09:46:17.549 INFO:tasks.workunit.client.0.smithi111.stdout:4/650: chown d2/c9 1094 1 2024-09-16T09:46:17.550 INFO:tasks.workunit.client.0.smithi111.stdout:1/678: creat d3/fde x:0 0 0 2024-09-16T09:46:17.550 INFO:tasks.workunit.client.0.smithi111.stdout:1/679: readlink d3/d10/d72/da1/l19 0 2024-09-16T09:46:17.551 INFO:tasks.workunit.client.0.smithi111.stdout:4/651: rename d2/d6/dd/d1b/d38/d64/lc0 to d2/d6/dd/d1b/d38/db0/d2f/d9e/lcd 0 2024-09-16T09:46:17.552 INFO:tasks.workunit.client.0.smithi111.stdout:2/837: dread d0/d2/f1e [0,4194304] 0 2024-09-16T09:46:17.552 INFO:tasks.workunit.client.0.smithi111.stdout:1/680: creat d3/d10/d1c/fdf x:0 0 0 2024-09-16T09:46:17.553 INFO:tasks.workunit.client.0.smithi111.stdout:5/803: write d19/d1b/d1e/f76 [1474534,88034] 0 2024-09-16T09:46:17.554 INFO:tasks.workunit.client.0.smithi111.stdout:4/652: rename d2/d6/dd/d1b/d38/db0/l57 to d2/d6/dd/d1b/d38/d64/d92/da0/db5/lce 0 2024-09-16T09:46:17.555 INFO:tasks.workunit.client.0.smithi111.stdout:1/681: symlink d3/d10/d72/da1/d28/d36/d3d/d47/d5a/le0 0 2024-09-16T09:46:17.557 INFO:tasks.workunit.client.0.smithi111.stdout:2/838: dread d0/d2/f1e [0,4194304] 0 2024-09-16T09:46:17.559 INFO:tasks.workunit.client.0.smithi111.stdout:5/804: truncate d19/d1b/d27/d2e/d39/f62 3524667 0 2024-09-16T09:46:17.560 INFO:tasks.workunit.client.0.smithi111.stdout:1/682: creat d3/d10/d72/da1/d28/d36/d3d/d47/fe1 x:0 0 0 2024-09-16T09:46:17.562 INFO:tasks.workunit.client.0.smithi111.stdout:1/683: dread d3/d10/d72/f9e [0,4194304] 0 2024-09-16T09:46:17.564 INFO:tasks.workunit.client.0.smithi111.stdout:1/684: creat d3/d24/d4e/fe2 x:0 0 0 2024-09-16T09:46:17.564 INFO:tasks.workunit.client.0.smithi111.stdout:1/685: chown d3/d26/d63/cc1 61 1 2024-09-16T09:46:17.566 INFO:tasks.workunit.client.0.smithi111.stdout:1/686: mkdir d3/d24/d29/dc8/de3 0 2024-09-16T09:46:17.567 INFO:tasks.workunit.client.0.smithi111.stdout:1/687: chown d3/d10/d57/d95/fbd 5475 1 2024-09-16T09:46:17.573 INFO:tasks.workunit.client.0.smithi111.stdout:4/653: dwrite d2/d6/dd/d1b/d6d/fcc [0,4194304] 0 2024-09-16T09:46:17.581 INFO:tasks.workunit.client.0.smithi111.stdout:2/839: dwrite d0/da6/f112 [0,4194304] 0 2024-09-16T09:46:17.581 INFO:tasks.workunit.client.0.smithi111.stdout:2/840: getdents d0/dc5 0 2024-09-16T09:46:17.581 INFO:tasks.workunit.client.0.smithi111.stdout:2/841: chown d0/d2/fb0 65740 1 2024-09-16T09:46:17.581 INFO:tasks.workunit.client.0.smithi111.stdout:2/842: stat d0/d29/f31 0 2024-09-16T09:46:17.582 INFO:tasks.workunit.client.0.smithi111.stdout:4/654: mknod d2/d6/d80/ccf 0 2024-09-16T09:46:17.582 INFO:tasks.workunit.client.0.smithi111.stdout:4/655: write d2/d6/dd/d1b/d38/f68 [1142614,73439] 0 2024-09-16T09:46:17.582 INFO:tasks.workunit.client.0.smithi111.stdout:4/656: truncate d2/d6/dd/d1b/d38/db0/d2f/f81 392428 0 2024-09-16T09:46:17.586 INFO:tasks.workunit.client.0.smithi111.stdout:2/843: creat d0/d2/d5a/f11f x:0 0 0 2024-09-16T09:46:17.586 INFO:tasks.workunit.client.0.smithi111.stdout:2/844: write d0/d2/f1e [3974735,52406] 0 2024-09-16T09:46:17.587 INFO:tasks.workunit.client.0.smithi111.stdout:2/845: write d0/da/d4e/fbe [693479,76079] 0 2024-09-16T09:46:17.588 INFO:tasks.workunit.client.0.smithi111.stdout:4/657: getdents d2/d6/dd/d1b/d38/d64/d65 0 2024-09-16T09:46:17.595 INFO:tasks.workunit.client.0.smithi111.stdout:5/805: dwrite d19/d1b/d1e/f76 [0,4194304] 0 2024-09-16T09:46:17.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/806: symlink d19/d1b/d27/d83/d2a/l114 0 2024-09-16T09:46:17.598 INFO:tasks.workunit.client.0.smithi111.stdout:5/807: truncate d19/d1b/d27/d2e/d98/fce 1659552 0 2024-09-16T09:46:17.617 INFO:tasks.workunit.client.0.smithi111.stdout:5/808: dread d19/d1b/d27/d83/d2a/de2/ff1 [0,4194304] 0 2024-09-16T09:46:17.622 INFO:tasks.workunit.client.0.smithi111.stdout:4/658: dwrite d2/d6/f14 [0,4194304] 0 2024-09-16T09:46:17.627 INFO:tasks.workunit.client.0.smithi111.stdout:2/846: dwrite d0/da/f3b [4194304,4194304] 0 2024-09-16T09:46:17.628 INFO:tasks.workunit.client.0.smithi111.stdout:2/847: symlink d0/dc5/l120 0 2024-09-16T09:46:17.636 INFO:tasks.workunit.client.0.smithi111.stdout:4/659: write d2/f8 [2626846,5049] 0 2024-09-16T09:46:17.637 INFO:tasks.workunit.client.0.smithi111.stdout:4/660: creat d2/d6/dd/d1b/d38/d64/dac/fd0 x:0 0 0 2024-09-16T09:46:17.639 INFO:tasks.workunit.client.0.smithi111.stdout:4/661: mknod d2/d6/dd/d1b/d38/d64/dac/cd1 0 2024-09-16T09:46:17.641 INFO:tasks.workunit.client.0.smithi111.stdout:5/809: dwrite d19/d1b/d1e/d21/d29/d32/d46/f78 [0,4194304] 0 2024-09-16T09:46:17.642 INFO:tasks.workunit.client.0.smithi111.stdout:4/662: mkdir d2/d6/dd/d1b/d38/dd2 0 2024-09-16T09:46:17.646 INFO:tasks.workunit.client.0.smithi111.stdout:2/848: write d0/d2/d44/f4b [3423929,12285] 0 2024-09-16T09:46:17.647 INFO:tasks.workunit.client.0.smithi111.stdout:5/810: creat d19/d1b/d27/d2e/d98/f115 x:0 0 0 2024-09-16T09:46:17.647 INFO:tasks.workunit.client.0.smithi111.stdout:5/811: readlink d19/la7 0 2024-09-16T09:46:17.648 INFO:tasks.workunit.client.0.smithi111.stdout:2/849: mknod d0/d29/c121 0 2024-09-16T09:46:17.651 INFO:tasks.workunit.client.0.smithi111.stdout:2/850: dread d0/d22/fcc [4194304,4194304] 0 2024-09-16T09:46:17.653 INFO:tasks.workunit.client.0.smithi111.stdout:2/851: creat d0/d45/d5c/d67/f122 x:0 0 0 2024-09-16T09:46:17.653 INFO:tasks.workunit.client.0.smithi111.stdout:2/852: chown d0/d2/d5a/c10d 64 1 2024-09-16T09:46:17.655 INFO:tasks.workunit.client.0.smithi111.stdout:2/853: mknod d0/d45/d5c/d67/d63/c123 0 2024-09-16T09:46:17.655 INFO:tasks.workunit.client.0.smithi111.stdout:2/854: fsync d0/d2/f6a 0 2024-09-16T09:46:17.656 INFO:tasks.workunit.client.0.smithi111.stdout:2/855: mknod d0/d45/d5c/dc6/c124 0 2024-09-16T09:46:17.658 INFO:tasks.workunit.client.0.smithi111.stdout:2/856: creat d0/d45/d81/f125 x:0 0 0 2024-09-16T09:46:17.659 INFO:tasks.workunit.client.0.smithi111.stdout:2/857: creat d0/d45/d5c/dc6/f126 x:0 0 0 2024-09-16T09:46:17.660 INFO:tasks.workunit.client.0.smithi111.stdout:2/858: creat d0/d22/dac/df0/f127 x:0 0 0 2024-09-16T09:46:17.661 INFO:tasks.workunit.client.0.smithi111.stdout:2/859: write d0/d2/f100 [142343,36839] 0 2024-09-16T09:46:17.661 INFO:tasks.workunit.client.0.smithi111.stdout:2/860: mkdir d0/da/d128 0 2024-09-16T09:46:17.663 INFO:tasks.workunit.client.0.smithi111.stdout:2/861: creat d0/d2/d59/d86/f129 x:0 0 0 2024-09-16T09:46:17.663 INFO:tasks.workunit.client.0.smithi111.stdout:5/812: dread f15 [0,4194304] 0 2024-09-16T09:46:17.667 INFO:tasks.workunit.client.0.smithi111.stdout:2/862: creat d0/d45/d81/f12a x:0 0 0 2024-09-16T09:46:17.668 INFO:tasks.workunit.client.0.smithi111.stdout:5/813: truncate d19/d1b/d1e/d21/d29/d32/f61 1735027 0 2024-09-16T09:46:17.675 INFO:tasks.workunit.client.0.smithi111.stdout:4/663: dwrite d2/d30/da1/fc9 [0,4194304] 0 2024-09-16T09:46:17.678 INFO:tasks.workunit.client.0.smithi111.stdout:4/664: creat d2/d6/dd/d1b/d38/d64/d92/da0/db5/fd3 x:0 0 0 2024-09-16T09:46:17.680 INFO:tasks.workunit.client.0.smithi111.stdout:4/665: symlink d2/d6/d80/d98/ld4 0 2024-09-16T09:46:17.682 INFO:tasks.workunit.client.0.smithi111.stdout:4/666: write d2/f42 [1867373,47379] 0 2024-09-16T09:46:17.684 INFO:tasks.workunit.client.0.smithi111.stdout:4/667: mkdir d2/d30/d44/d96/dd5 0 2024-09-16T09:46:17.686 INFO:tasks.workunit.client.0.smithi111.stdout:4/668: link d2/d6/dd/l24 d2/d6/dd/d1b/d38/db0/d2f/d9e/ld6 0 2024-09-16T09:46:17.688 INFO:tasks.workunit.client.0.smithi111.stdout:4/669: getdents d2/d6/dd/d1b/d38/d64 0 2024-09-16T09:46:17.695 INFO:tasks.workunit.client.0.smithi111.stdout:2/863: dwrite d0/d45/d5c/ffb [0,4194304] 0 2024-09-16T09:46:17.696 INFO:tasks.workunit.client.0.smithi111.stdout:5/814: dwrite d19/d1b/d1e/d21/fd4 [4194304,4194304] 0 2024-09-16T09:46:17.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/864: getdents d0/d22/dac 0 2024-09-16T09:46:17.704 INFO:tasks.workunit.client.0.smithi111.stdout:2/865: getdents d0/d2/d59/d86/d96/dc7 0 2024-09-16T09:46:17.704 INFO:tasks.workunit.client.0.smithi111.stdout:2/866: readlink d0/d2/d44/le4 0 2024-09-16T09:46:17.707 INFO:tasks.workunit.client.0.smithi111.stdout:2/867: link d0/d2/f41 d0/d45/d5c/d67/f12b 0 2024-09-16T09:46:17.707 INFO:tasks.workunit.client.0.smithi111.stdout:2/868: readlink d0/dc5/l120 0 2024-09-16T09:46:17.708 INFO:tasks.workunit.client.0.smithi111.stdout:2/869: creat d0/d2/d59/d86/db1/f12c x:0 0 0 2024-09-16T09:46:17.718 INFO:tasks.workunit.client.0.smithi111.stdout:4/670: dwrite d2/d6/f67 [0,4194304] 0 2024-09-16T09:46:17.718 INFO:tasks.workunit.client.0.smithi111.stdout:4/671: stat d2/d6/dd/d1b/d38/db0/d2f/fc5 0 2024-09-16T09:46:17.722 INFO:tasks.workunit.client.0.smithi111.stdout:5/815: dwrite d19/fd1 [0,4194304] 0 2024-09-16T09:46:17.725 INFO:tasks.workunit.client.0.smithi111.stdout:2/870: dread d0/d2/f41 [0,4194304] 0 2024-09-16T09:46:17.734 INFO:tasks.workunit.client.0.smithi111.stdout:5/816: mknod d19/d1b/d10e/c116 0 2024-09-16T09:46:17.734 INFO:tasks.workunit.client.0.smithi111.stdout:2/871: dread d0/d29/f2b [0,4194304] 0 2024-09-16T09:46:17.737 INFO:tasks.workunit.client.0.smithi111.stdout:2/872: rename d0/d45/fdc to d0/d45/d5c/d67/d63/dd4/f12d 0 2024-09-16T09:46:17.742 INFO:tasks.workunit.client.0.smithi111.stdout:2/873: symlink d0/d45/d5c/d67/d63/l12e 0 2024-09-16T09:46:17.752 INFO:tasks.workunit.client.0.smithi111.stdout:2/874: dread d0/d2/f17 [0,4194304] 0 2024-09-16T09:46:17.753 INFO:tasks.workunit.client.0.smithi111.stdout:2/875: mkdir d0/d29/d12f 0 2024-09-16T09:46:17.758 INFO:tasks.workunit.client.0.smithi111.stdout:4/672: dwrite d2/d6/dd/d1b/d38/db0/f54 [0,4194304] 0 2024-09-16T09:46:17.762 INFO:tasks.workunit.client.0.smithi111.stdout:4/673: link d2/d6/dd/d1b/d38/c7e d2/d30/d44/d96/cd7 0 2024-09-16T09:46:17.764 INFO:tasks.workunit.client.0.smithi111.stdout:4/674: mkdir d2/d6/dd/d1b/d38/d64/dd8 0 2024-09-16T09:46:17.767 INFO:tasks.workunit.client.0.smithi111.stdout:4/675: rename d2/d6/dd/d1b/d38/c3d to d2/d6/dd/d1b/d38/d64/dd8/cd9 0 2024-09-16T09:46:17.768 INFO:tasks.workunit.client.0.smithi111.stdout:4/676: unlink d2/d6/dd/d1b/d38/la4 0 2024-09-16T09:46:17.769 INFO:tasks.workunit.client.0.smithi111.stdout:4/677: symlink d2/d6/dd/d1b/d38/db0/d2f/d9e/lda 0 2024-09-16T09:46:17.770 INFO:tasks.workunit.client.0.smithi111.stdout:4/678: creat d2/d6/dd/d1b/d38/db0/d2f/d9e/fdb x:0 0 0 2024-09-16T09:46:17.770 INFO:tasks.workunit.client.0.smithi111.stdout:4/679: chown d2/d30/d44/d69/cb1 95 1 2024-09-16T09:46:17.781 INFO:tasks.workunit.client.0.smithi111.stdout:4/680: write d2/d6/f48 [2737407,55512] 0 2024-09-16T09:46:17.781 INFO:tasks.workunit.client.0.smithi111.stdout:4/681: fsync d2/d30/d44/d96/fb9 0 2024-09-16T09:46:17.876 INFO:tasks.workunit.client.0.smithi111.stdout:5/817: dwrite d19/d1b/d27/d83/f63 [0,4194304] 0 2024-09-16T09:46:17.888 INFO:tasks.workunit.client.0.smithi111.stdout:4/682: dwrite d2/d6/f20 [4194304,4194304] 0 2024-09-16T09:46:17.888 INFO:tasks.workunit.client.0.smithi111.stdout:4/683: dread - d2/d6/dd/d1b/d38/d64/d92/fc7 zero size 2024-09-16T09:46:17.895 INFO:tasks.workunit.client.0.smithi111.stdout:5/818: link d19/d1b/d27/d83/f75 d19/d1b/d27/d83/d2a/dc4/dc0/f117 0 2024-09-16T09:46:17.898 INFO:tasks.workunit.client.0.smithi111.stdout:4/684: symlink d2/d30/d44/d96/dd5/ldc 0 2024-09-16T09:46:17.901 INFO:tasks.workunit.client.0.smithi111.stdout:4/685: creat d2/d6/dd/d1b/d38/d64/d92/da0/fdd x:0 0 0 2024-09-16T09:46:17.903 INFO:tasks.workunit.client.0.smithi111.stdout:4/686: dread d2/d6/dd/d1b/d6d/d8f/fa9 [0,4194304] 0 2024-09-16T09:46:17.905 INFO:tasks.workunit.client.0.smithi111.stdout:4/687: symlink d2/d30/da1/lde 0 2024-09-16T09:46:17.909 INFO:tasks.workunit.client.0.smithi111.stdout:4/688: mkdir d2/d6/ddf 0 2024-09-16T09:46:17.912 INFO:tasks.workunit.client.0.smithi111.stdout:4/689: link d2/d6/c21 d2/d30/ce0 0 2024-09-16T09:46:17.921 INFO:tasks.workunit.client.0.smithi111.stdout:7/577: sync 2024-09-16T09:46:17.921 INFO:tasks.workunit.client.0.smithi111.stdout:0/750: sync 2024-09-16T09:46:17.923 INFO:tasks.workunit.client.0.smithi111.stdout:0/751: unlink d0/d1d/d67/d3a/d3d/ffc 0 2024-09-16T09:46:17.924 INFO:tasks.workunit.client.0.smithi111.stdout:7/578: creat d1/d9/fc8 x:0 0 0 2024-09-16T09:46:17.925 INFO:tasks.workunit.client.0.smithi111.stdout:7/579: write d1/d9/f35 [2040835,75472] 0 2024-09-16T09:46:17.925 INFO:tasks.workunit.client.0.smithi111.stdout:0/752: creat d0/da4/f114 x:0 0 0 2024-09-16T09:46:17.926 INFO:tasks.workunit.client.0.smithi111.stdout:0/753: dread d0/f44 [0,4194304] 0 2024-09-16T09:46:17.927 INFO:tasks.workunit.client.0.smithi111.stdout:7/580: creat d1/d16/d17/d18/d4f/fc9 x:0 0 0 2024-09-16T09:46:17.928 INFO:tasks.workunit.client.0.smithi111.stdout:4/690: dwrite d2/f8 [4194304,4194304] 0 2024-09-16T09:46:17.929 INFO:tasks.workunit.client.0.smithi111.stdout:4/691: chown d2/d6/dd/d1b/d38/d64/dac/cd1 322344 1 2024-09-16T09:46:17.929 INFO:tasks.workunit.client.0.smithi111.stdout:0/754: mkdir d0/d1d/d67/d3a/d80/dee/d115 0 2024-09-16T09:46:17.930 INFO:tasks.workunit.client.0.smithi111.stdout:0/755: mkdir d0/d26/d35/d86/de5/d116 0 2024-09-16T09:46:17.940 INFO:tasks.workunit.client.0.smithi111.stdout:0/756: write d0/f17 [5823335,101919] 0 2024-09-16T09:46:17.942 INFO:tasks.workunit.client.0.smithi111.stdout:0/757: symlink d0/d1d/d67/d3a/d80/dee/d115/l117 0 2024-09-16T09:46:17.944 INFO:tasks.workunit.client.0.smithi111.stdout:0/758: creat d0/d1d/d58/d83/f118 x:0 0 0 2024-09-16T09:46:17.944 INFO:tasks.workunit.client.0.smithi111.stdout:0/759: write d0/d1d/d67/d3a/d3d/d59/f6a [5157424,56706] 0 2024-09-16T09:46:17.953 INFO:tasks.workunit.client.0.smithi111.stdout:0/760: dread d0/d1d/d67/d3a/d3d/d59/fc8 [0,4194304] 0 2024-09-16T09:46:17.957 INFO:tasks.workunit.client.0.smithi111.stdout:7/581: dwrite d1/d16/d17/d18/d1b/d79/d8c/d98/fb7 [0,4194304] 0 2024-09-16T09:46:17.960 INFO:tasks.workunit.client.0.smithi111.stdout:4/692: dwrite d2/d6/dd/f9d [0,4194304] 0 2024-09-16T09:46:17.963 INFO:tasks.workunit.client.0.smithi111.stdout:7/582: dread d1/d16/d17/d18/f6f [0,4194304] 0 2024-09-16T09:46:17.999 INFO:tasks.workunit.client.0.smithi111.stdout:4/693: truncate d2/d30/da1/fc9 3470195 0 2024-09-16T09:46:17.999 INFO:tasks.workunit.client.0.smithi111.stdout:4/694: chown d2/d6/dd/d1b/d6d/d8f/f9a 0 1 2024-09-16T09:46:17.999 INFO:tasks.workunit.client.0.smithi111.stdout:4/695: readlink d2/d30/d44/d96/dd5/ldc 0 2024-09-16T09:46:18.003 INFO:tasks.workunit.client.0.smithi111.stdout:7/583: unlink d1/d16/d17/d18/d1d/fae 0 2024-09-16T09:46:18.004 INFO:tasks.workunit.client.0.smithi111.stdout:4/696: creat d2/d6/dd/d1b/d38/db0/d2f/d6c/fe1 x:0 0 0 2024-09-16T09:46:18.006 INFO:tasks.workunit.client.0.smithi111.stdout:4/697: creat d2/d6/dd/d1b/d38/d64/dac/fe2 x:0 0 0 2024-09-16T09:46:18.008 INFO:tasks.workunit.client.0.smithi111.stdout:7/584: rename d1/d9/cb to d1/d16/d17/d18/d4f/cca 0 2024-09-16T09:46:18.015 INFO:tasks.workunit.client.0.smithi111.stdout:8/784: sync 2024-09-16T09:46:18.018 INFO:tasks.workunit.client.0.smithi111.stdout:4/698: dread d2/d6/dd/d1b/d38/db0/d2f/f36 [0,4194304] 0 2024-09-16T09:46:18.018 INFO:tasks.workunit.client.0.smithi111.stdout:4/699: chown d2/d6/dd/d1b/d38/db0/d2f/d6c/fe1 31 1 2024-09-16T09:46:18.021 INFO:tasks.workunit.client.0.smithi111.stdout:4/700: unlink d2/d6/dd/d1b/d38/d64/d65/lbc 0 2024-09-16T09:46:18.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/701: write d2/f56 [2363591,5479] 0 2024-09-16T09:46:18.027 INFO:tasks.workunit.client.0.smithi111.stdout:4/702: stat d2/d6/dd/d1b/d38/d64/d92/fc7 0 2024-09-16T09:46:18.033 INFO:tasks.workunit.client.0.smithi111.stdout:8/785: dwrite d3/de/d1e/d2e/d74/f8c [0,4194304] 0 2024-09-16T09:46:18.033 INFO:tasks.workunit.client.0.smithi111.stdout:7/585: dwrite d1/d16/d17/d18/d1d/d2f/f71 [0,4194304] 0 2024-09-16T09:46:18.045 INFO:tasks.workunit.client.0.smithi111.stdout:8/786: dread d3/d26/d6d/db6/fe7 [0,4194304] 0 2024-09-16T09:46:18.046 INFO:tasks.workunit.client.0.smithi111.stdout:8/787: rmdir d3/de/d1e/d2e/d2f/da8/dbe/d6b 39 2024-09-16T09:46:18.047 INFO:tasks.workunit.client.0.smithi111.stdout:8/788: write d3/f19 [3750096,29186] 0 2024-09-16T09:46:18.047 INFO:tasks.workunit.client.0.smithi111.stdout:4/703: dwrite d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:18.050 INFO:tasks.workunit.client.0.smithi111.stdout:7/586: dread d1/d9/fa [0,4194304] 0 2024-09-16T09:46:18.051 INFO:tasks.workunit.client.0.smithi111.stdout:8/789: link d3/da/db/d59/dd7/f25 d3/de/d1e/d2e/d2f/da8/f108 0 2024-09-16T09:46:18.051 INFO:tasks.workunit.client.0.smithi111.stdout:4/704: creat d2/d6/dd/d1b/d38/db0/d2f/d6c/fe3 x:0 0 0 2024-09-16T09:46:18.053 INFO:tasks.workunit.client.0.smithi111.stdout:7/587: mknod d1/d16/d17/d18/d1b/d79/daa/da7/da8/ccb 0 2024-09-16T09:46:18.053 INFO:tasks.workunit.client.0.smithi111.stdout:8/790: dread d3/da/db/d59/dd7/d9e/dd8/f6f [0,4194304] 0 2024-09-16T09:46:18.053 INFO:tasks.workunit.client.0.smithi111.stdout:8/791: chown d3/dc3 3707366 1 2024-09-16T09:46:18.054 INFO:tasks.workunit.client.0.smithi111.stdout:4/705: rename d2/d6/dd/d1b/d38/db0/d2f/d8d to d2/d6/dd/d1b/d38/d64/dd8/de4 0 2024-09-16T09:46:18.055 INFO:tasks.workunit.client.0.smithi111.stdout:7/588: creat d1/d3e/d9e/fcc x:0 0 0 2024-09-16T09:46:18.057 INFO:tasks.workunit.client.0.smithi111.stdout:4/706: rename d2/d6/dd/d1b/d38/d64/dd8/de4/fc8 to d2/d6/dd/fe5 0 2024-09-16T09:46:18.058 INFO:tasks.workunit.client.0.smithi111.stdout:7/589: creat d1/d16/d17/d18/d1b/d79/da5/db2/fcd x:0 0 0 2024-09-16T09:46:18.059 INFO:tasks.workunit.client.0.smithi111.stdout:4/707: mknod d2/d6/dd/d1b/d38/d64/d92/da0/db5/ce6 0 2024-09-16T09:46:18.059 INFO:tasks.workunit.client.0.smithi111.stdout:4/708: fsync d2/d6/f67 0 2024-09-16T09:46:18.060 INFO:tasks.workunit.client.0.smithi111.stdout:7/590: truncate d1/d9/d43/d82/fba 2436743 0 2024-09-16T09:46:18.061 INFO:tasks.workunit.client.0.smithi111.stdout:8/792: dread d3/da/fe9 [0,4194304] 0 2024-09-16T09:46:18.062 INFO:tasks.workunit.client.0.smithi111.stdout:4/709: rename d2/d6/dd/d1b/d38/d64/d92/da0/db5/lce to d2/d6/dd/d1b/d38/db0/d2f/d4e/le7 0 2024-09-16T09:46:18.063 INFO:tasks.workunit.client.0.smithi111.stdout:7/591: rmdir d1/d20 39 2024-09-16T09:46:18.065 INFO:tasks.workunit.client.0.smithi111.stdout:8/793: truncate d3/da/db/d59/dd7/d9e/dd8/fbb 1591691 0 2024-09-16T09:46:18.066 INFO:tasks.workunit.client.0.smithi111.stdout:8/794: chown d3/de/d1e/d2e/d74 26675 1 2024-09-16T09:46:18.067 INFO:tasks.workunit.client.0.smithi111.stdout:4/710: getdents d2/d6/dd/d1b 0 2024-09-16T09:46:18.068 INFO:tasks.workunit.client.0.smithi111.stdout:5/819: sync 2024-09-16T09:46:18.068 INFO:tasks.workunit.client.0.smithi111.stdout:9/590: sync 2024-09-16T09:46:18.069 INFO:tasks.workunit.client.0.smithi111.stdout:7/592: dread - d1/d16/d17/d18/d4f/f97 zero size 2024-09-16T09:46:18.069 INFO:tasks.workunit.client.0.smithi111.stdout:8/795: dread d3/da/db/fc8 [0,4194304] 0 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:6/655: sync 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:2/876: sync 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:1/688: sync 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:1/689: fsync d3/d10/d72/da1/d28/d36/d3d/d47/daf/dbc/fc7 0 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:6/656: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f99 213427119 1 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:6/657: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f9e 22908556 1 2024-09-16T09:46:18.070 INFO:tasks.workunit.client.0.smithi111.stdout:6/658: rename d0/d57/db0/d14 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/de5 22 2024-09-16T09:46:18.071 INFO:tasks.workunit.client.0.smithi111.stdout:3/873: sync 2024-09-16T09:46:18.074 INFO:tasks.workunit.client.0.smithi111.stdout:4/711: truncate d2/d6/dd/d1b/d38/d64/f66 1546210 0 2024-09-16T09:46:18.075 INFO:tasks.workunit.client.0.smithi111.stdout:7/593: mkdir d1/d16/d17/d18/d1b/d79/dce 0 2024-09-16T09:46:18.075 INFO:tasks.workunit.client.0.smithi111.stdout:7/594: truncate d1/d3e/f74 1195392 0 2024-09-16T09:46:18.075 INFO:tasks.workunit.client.0.smithi111.stdout:7/595: chown d1/d16/d17/d18/d1b/d79/c86 1129 1 2024-09-16T09:46:18.076 INFO:tasks.workunit.client.0.smithi111.stdout:7/596: readlink d1/d16/d17/d18/d1d/l25 0 2024-09-16T09:46:18.077 INFO:tasks.workunit.client.0.smithi111.stdout:1/690: dread d3/d10/f96 [0,4194304] 0 2024-09-16T09:46:18.080 INFO:tasks.workunit.client.0.smithi111.stdout:5/820: dread d19/d1b/d27/f3d [0,4194304] 0 2024-09-16T09:46:18.081 INFO:tasks.workunit.client.0.smithi111.stdout:4/712: dread d2/d6/dd/d1b/d38/db0/d2f/f4d [0,4194304] 0 2024-09-16T09:46:18.081 INFO:tasks.workunit.client.0.smithi111.stdout:4/713: fsync d2/d6/dd/d1b/d38/db0/d2f/d4e/f71 0 2024-09-16T09:46:18.084 INFO:tasks.workunit.client.0.smithi111.stdout:9/591: write d0/f1e [3854589,64271] 0 2024-09-16T09:46:18.085 INFO:tasks.workunit.client.0.smithi111.stdout:2/877: link d0/d22/f23 d0/da6/dea/f130 0 2024-09-16T09:46:18.086 INFO:tasks.workunit.client.0.smithi111.stdout:6/659: rename d0/d57/db0/d49/d5b/c91 to d0/d57/db0/d47/d52/db3/ce6 0 2024-09-16T09:46:18.087 INFO:tasks.workunit.client.0.smithi111.stdout:8/796: dwrite d3/d26/d6d/db6/fe7 [0,4194304] 0 2024-09-16T09:46:18.090 INFO:tasks.workunit.client.0.smithi111.stdout:7/597: rmdir d1/d16/d17 39 2024-09-16T09:46:18.091 INFO:tasks.workunit.client.0.smithi111.stdout:1/691: unlink d3/d10/d57/f68 0 2024-09-16T09:46:18.091 INFO:tasks.workunit.client.0.smithi111.stdout:1/692: readlink d3/d24/d3f/la8 0 2024-09-16T09:46:18.091 INFO:tasks.workunit.client.0.smithi111.stdout:1/693: truncate d3/d10/d72/da1/fc9 517333 0 2024-09-16T09:46:18.092 INFO:tasks.workunit.client.0.smithi111.stdout:9/592: dread d0/d21/f66 [0,4194304] 0 2024-09-16T09:46:18.092 INFO:tasks.workunit.client.0.smithi111.stdout:9/593: stat d0/d6/l1a 0 2024-09-16T09:46:18.092 INFO:tasks.workunit.client.0.smithi111.stdout:4/714: rmdir d2/d6/dd/d1b/d38/dd2 0 2024-09-16T09:46:18.094 INFO:tasks.workunit.client.0.smithi111.stdout:2/878: mkdir d0/d45/d5c/d67/d63/dd4/dc3/d131 0 2024-09-16T09:46:18.096 INFO:tasks.workunit.client.0.smithi111.stdout:6/660: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/ce7 0 2024-09-16T09:46:18.098 INFO:tasks.workunit.client.0.smithi111.stdout:3/874: rename d5/da/db/d3a/d6d/de7/d88/db8/fdd to d5/da/db/d5a/df8/f127 0 2024-09-16T09:46:18.099 INFO:tasks.workunit.client.0.smithi111.stdout:7/598: dread d1/d16/d17/d18/d1b/d79/daa/f8d [0,4194304] 0 2024-09-16T09:46:18.102 INFO:tasks.workunit.client.0.smithi111.stdout:9/594: creat d0/d48/d9d/fcc x:0 0 0 2024-09-16T09:46:18.102 INFO:tasks.workunit.client.0.smithi111.stdout:9/595: chown d0/d48/d9d/fa3 1808 1 2024-09-16T09:46:18.103 INFO:tasks.workunit.client.0.smithi111.stdout:5/821: dwrite fd [0,4194304] 0 2024-09-16T09:46:18.103 INFO:tasks.workunit.client.0.smithi111.stdout:1/694: read d3/d24/d62/f81 [2505164,35783] 0 2024-09-16T09:46:18.103 INFO:tasks.workunit.client.0.smithi111.stdout:6/661: mknod d0/d57/db0/d47/d68/ce8 0 2024-09-16T09:46:18.103 INFO:tasks.workunit.client.0.smithi111.stdout:6/662: dread - d0/d57/db0/d14/d20/d42/d4e/d62/d7b/fdc zero size 2024-09-16T09:46:18.103 INFO:tasks.workunit.client.0.smithi111.stdout:6/663: fsync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/f51 0 2024-09-16T09:46:18.104 INFO:tasks.workunit.client.0.smithi111.stdout:3/875: mknod d5/da/db/d5a/c128 0 2024-09-16T09:46:18.106 INFO:tasks.workunit.client.0.smithi111.stdout:7/599: dread d1/d16/d17/d18/f6f [0,4194304] 0 2024-09-16T09:46:18.108 INFO:tasks.workunit.client.0.smithi111.stdout:9/596: link d0/d6/f90 d0/fcd 0 2024-09-16T09:46:18.110 INFO:tasks.workunit.client.0.smithi111.stdout:5/822: creat d19/d1b/f118 x:0 0 0 2024-09-16T09:46:18.114 INFO:tasks.workunit.client.0.smithi111.stdout:1/695: mknod d3/d24/d3f/ce4 0 2024-09-16T09:46:18.116 INFO:tasks.workunit.client.0.smithi111.stdout:6/664: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/de9 0 2024-09-16T09:46:18.120 INFO:tasks.workunit.client.0.smithi111.stdout:5/823: dread d19/d1b/d1e/d21/f5e [0,4194304] 0 2024-09-16T09:46:18.121 INFO:tasks.workunit.client.0.smithi111.stdout:9/597: symlink d0/d21/d22/d6e/d51/lce 0 2024-09-16T09:46:18.121 INFO:tasks.workunit.client.0.smithi111.stdout:9/598: truncate d0/d7b/faa 275779 0 2024-09-16T09:46:18.121 INFO:tasks.workunit.client.0.smithi111.stdout:3/876: read d5/da/db/d35/d45/fa7 [4032254,39758] 0 2024-09-16T09:46:18.121 INFO:tasks.workunit.client.0.smithi111.stdout:1/696: mknod d3/d10/d1c/ce5 0 2024-09-16T09:46:18.121 INFO:tasks.workunit.client.0.smithi111.stdout:1/697: read d3/d24/d4e/f5b [378060,97348] 0 2024-09-16T09:46:18.123 INFO:tasks.workunit.client.0.smithi111.stdout:7/600: rename d1/d16/d17/d18/d4f/c96 to d1/d3e/d9f/ccf 0 2024-09-16T09:46:18.123 INFO:tasks.workunit.client.0.smithi111.stdout:5/824: symlink d19/d1b/d27/d2e/df3/d100/l119 0 2024-09-16T09:46:18.124 INFO:tasks.workunit.client.0.smithi111.stdout:5/825: chown d19/d1b/d1e/d21/d29/d32/d46/l6e 5915993 1 2024-09-16T09:46:18.125 INFO:tasks.workunit.client.0.smithi111.stdout:4/715: dwrite d2/d6/dd/d1b/d38/f4f [0,4194304] 0 2024-09-16T09:46:18.126 INFO:tasks.workunit.client.0.smithi111.stdout:4/716: chown d2/d6/dd/d1b/d38/d64/dd8/cd9 446 1 2024-09-16T09:46:18.126 INFO:tasks.workunit.client.0.smithi111.stdout:9/599: rmdir d0/d21/d22/d6e/d7d/d9a 39 2024-09-16T09:46:18.126 INFO:tasks.workunit.client.0.smithi111.stdout:3/877: symlink d5/da/db/d3a/d6d/de7/d88/db8/d112/l129 0 2024-09-16T09:46:18.127 INFO:tasks.workunit.client.0.smithi111.stdout:8/797: dwrite d3/de/d1e/d2e/d74/f86 [0,4194304] 0 2024-09-16T09:46:18.127 INFO:tasks.workunit.client.0.smithi111.stdout:2/879: dwrite d0/da/d4e/f77 [0,4194304] 0 2024-09-16T09:46:18.128 INFO:tasks.workunit.client.0.smithi111.stdout:2/880: fsync d0/d45/d81/fc4 0 2024-09-16T09:46:18.129 INFO:tasks.workunit.client.0.smithi111.stdout:1/698: creat d3/d10/d72/da1/d28/d36/d3d/fe6 x:0 0 0 2024-09-16T09:46:18.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/826: mkdir d19/d1b/d27/d2e/d39/d54/d60/d11a 0 2024-09-16T09:46:18.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/827: write d19/d1b/d27/f3d [1812259,23386] 0 2024-09-16T09:46:18.131 INFO:tasks.workunit.client.0.smithi111.stdout:5/828: write d19/d1b/d27/d2e/d4a/d4b/dac/dd2/f111 [633897,55433] 0 2024-09-16T09:46:18.133 INFO:tasks.workunit.client.0.smithi111.stdout:9/600: mkdir d0/d6/d8/de/d56/d8e/dcf 0 2024-09-16T09:46:18.134 INFO:tasks.workunit.client.0.smithi111.stdout:3/878: truncate d5/da/db/d35/f39 2035154 0 2024-09-16T09:46:18.134 INFO:tasks.workunit.client.0.smithi111.stdout:3/879: write d5/da/f121 [29853,14124] 0 2024-09-16T09:46:18.138 INFO:tasks.workunit.client.0.smithi111.stdout:9/601: read d0/d21/d22/d6e/d51/d76/f98 [913091,39571] 0 2024-09-16T09:46:18.139 INFO:tasks.workunit.client.0.smithi111.stdout:2/881: rmdir d0/dc5 39 2024-09-16T09:46:18.140 INFO:tasks.workunit.client.0.smithi111.stdout:1/699: symlink d3/d10/d72/da1/d28/d36/d3d/d47/daf/le7 0 2024-09-16T09:46:18.141 INFO:tasks.workunit.client.0.smithi111.stdout:8/798: dread d3/d26/d6d/fa6 [0,4194304] 0 2024-09-16T09:46:18.141 INFO:tasks.workunit.client.0.smithi111.stdout:8/799: write d3/da/fe9 [2204455,100335] 0 2024-09-16T09:46:18.141 INFO:tasks.workunit.client.0.smithi111.stdout:5/829: getdents d19/d1b/d27/d83/d2a/dc4 0 2024-09-16T09:46:18.143 INFO:tasks.workunit.client.0.smithi111.stdout:9/602: rmdir d0/d6/d8/de/d56/d8e 39 2024-09-16T09:46:18.143 INFO:tasks.workunit.client.0.smithi111.stdout:1/700: mkdir d3/d10/d23/de8 0 2024-09-16T09:46:18.144 INFO:tasks.workunit.client.0.smithi111.stdout:8/800: rmdir d3/de/d1e/d2e/d74/d83 39 2024-09-16T09:46:18.146 INFO:tasks.workunit.client.0.smithi111.stdout:5/830: rename d19/d1b/d1e/d21/d29/d32/d46/f90 to d19/d1b/d27/d83/d2a/de2/f11b 0 2024-09-16T09:46:18.147 INFO:tasks.workunit.client.0.smithi111.stdout:7/601: dwrite d1/d16/d17/d18/d4f/fc9 [0,4194304] 0 2024-09-16T09:46:18.147 INFO:tasks.workunit.client.0.smithi111.stdout:6/665: dwrite d0/f1a [0,4194304] 0 2024-09-16T09:46:18.150 INFO:tasks.workunit.client.0.smithi111.stdout:8/801: rename d3/de/d1e/d2e/l61 to d3/d26/l109 0 2024-09-16T09:46:18.152 INFO:tasks.workunit.client.0.smithi111.stdout:9/603: read d0/d48/d9d/fa3 [2764468,43592] 0 2024-09-16T09:46:18.152 INFO:tasks.workunit.client.0.smithi111.stdout:6/666: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f98 [0,4194304] 0 2024-09-16T09:46:18.153 INFO:tasks.workunit.client.0.smithi111.stdout:6/667: chown d0/d57/db0/d14/c35 11706 1 2024-09-16T09:46:18.153 INFO:tasks.workunit.client.0.smithi111.stdout:5/831: symlink d19/d1b/d1e/d81/l11c 0 2024-09-16T09:46:18.153 INFO:tasks.workunit.client.0.smithi111.stdout:5/832: chown d19/d1b/d27/d2e/d39/d54/fc5 3 1 2024-09-16T09:46:18.153 INFO:tasks.workunit.client.0.smithi111.stdout:6/668: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/fe4 [492192,24420] 0 2024-09-16T09:46:18.159 INFO:tasks.workunit.client.0.smithi111.stdout:7/602: rename d1/d16/d17/d18/d4f/d56/c64 to d1/dc7/cd0 0 2024-09-16T09:46:18.161 INFO:tasks.workunit.client.0.smithi111.stdout:8/802: creat d3/da/db/f10a x:0 0 0 2024-09-16T09:46:18.162 INFO:tasks.workunit.client.0.smithi111.stdout:5/833: truncate d19/d1b/d1e/f50 745376 0 2024-09-16T09:46:18.164 INFO:tasks.workunit.client.0.smithi111.stdout:6/669: mknod d0/d57/db0/d14/d20/d42/dbd/cea 0 2024-09-16T09:46:18.166 INFO:tasks.workunit.client.0.smithi111.stdout:8/803: symlink d3/de/d1e/l10b 0 2024-09-16T09:46:18.166 INFO:tasks.workunit.client.0.smithi111.stdout:8/804: chown d3/d26/d6d/ld0 43032901 1 2024-09-16T09:46:18.166 INFO:tasks.workunit.client.0.smithi111.stdout:8/805: truncate d3/da/fe9 4672985 0 2024-09-16T09:46:18.166 INFO:tasks.workunit.client.0.smithi111.stdout:8/806: truncate d3/da/db/d59/dd7/dcc/f101 603271 0 2024-09-16T09:46:18.168 INFO:tasks.workunit.client.0.smithi111.stdout:5/834: truncate d19/d1b/d27/d83/f36 852887 0 2024-09-16T09:46:18.168 INFO:tasks.workunit.client.0.smithi111.stdout:5/835: chown d19/f43 105 1 2024-09-16T09:46:18.170 INFO:tasks.workunit.client.0.smithi111.stdout:6/670: rename d0/d57/db0/d47/d68/d6a/cdd to d0/d57/db0/d14/d20/d42/d4e/d62/dc9/ceb 0 2024-09-16T09:46:18.172 INFO:tasks.workunit.client.0.smithi111.stdout:5/836: symlink d19/d1b/d27/l11d 0 2024-09-16T09:46:18.174 INFO:tasks.workunit.client.0.smithi111.stdout:6/671: rmdir d0/d57/db0/d14/d20/d42/d4e/d62/dc9/de1 0 2024-09-16T09:46:18.175 INFO:tasks.workunit.client.0.smithi111.stdout:5/837: mkdir d19/d1b/d11e 0 2024-09-16T09:46:18.177 INFO:tasks.workunit.client.0.smithi111.stdout:6/672: link d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f98 d0/d57/db0/d14/d20/d42/d4e/d62/dc9/fec 0 2024-09-16T09:46:18.177 INFO:tasks.workunit.client.0.smithi111.stdout:6/673: write d0/d57/db0/d47/d68/f73 [387814,7309] 0 2024-09-16T09:46:18.177 INFO:tasks.workunit.client.0.smithi111.stdout:3/880: dwrite d5/da/d42/d74/da4/fd7 [0,4194304] 0 2024-09-16T09:46:18.177 INFO:tasks.workunit.client.0.smithi111.stdout:3/881: write d5/d18/d78/dfd/da0/dd9/fb4 [3123613,111870] 0 2024-09-16T09:46:18.178 INFO:tasks.workunit.client.0.smithi111.stdout:5/838: mkdir d19/d1b/d27/d2e/d39/d54/d60/dc9/d11f 0 2024-09-16T09:46:18.178 INFO:tasks.workunit.client.0.smithi111.stdout:5/839: chown d19/d1b/d27/d2e/d39/d6c/ca6 20653 1 2024-09-16T09:46:18.179 INFO:tasks.workunit.client.0.smithi111.stdout:6/674: creat d0/d57/db0/fed x:0 0 0 2024-09-16T09:46:18.179 INFO:tasks.workunit.client.0.smithi111.stdout:6/675: write d0/d57/db0/d47/d88/da9/fd2 [629624,17830] 0 2024-09-16T09:46:18.180 INFO:tasks.workunit.client.0.smithi111.stdout:2/882: dwrite d0/d45/d5c/d67/d63/dd4/dc3/fe2 [0,4194304] 0 2024-09-16T09:46:18.183 INFO:tasks.workunit.client.0.smithi111.stdout:3/882: creat d5/da/db/d3a/d6d/d125/f12a x:0 0 0 2024-09-16T09:46:18.185 INFO:tasks.workunit.client.0.smithi111.stdout:5/840: rename d19/d1b/d27/d83/d2a/lba to d19/d1b/d1e/d21/d29/d32/d46/l120 0 2024-09-16T09:46:18.185 INFO:tasks.workunit.client.0.smithi111.stdout:5/841: fsync d19/d1b/d27/d2e/d4a/d4b/d9c/fa8 0 2024-09-16T09:46:18.188 INFO:tasks.workunit.client.0.smithi111.stdout:4/717: write d2/d6/dd/f16 [2338944,129609] 0 2024-09-16T09:46:18.189 INFO:tasks.workunit.client.0.smithi111.stdout:6/676: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f34 [0,4194304] 0 2024-09-16T09:46:18.189 INFO:tasks.workunit.client.0.smithi111.stdout:4/718: dread d2/d6/dd/d1b/d38/db0/d2f/d4e/f59 [0,4194304] 0 2024-09-16T09:46:18.189 INFO:tasks.workunit.client.0.smithi111.stdout:6/677: chown d0/d57/db0/d49/d5b/fa4 7 1 2024-09-16T09:46:18.189 INFO:tasks.workunit.client.0.smithi111.stdout:4/719: chown d2/d6/dd/d1b/d38/d64/d92/lcb 17342 1 2024-09-16T09:46:18.189 INFO:tasks.workunit.client.0.smithi111.stdout:6/678: getdents d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/de9 0 2024-09-16T09:46:18.191 INFO:tasks.workunit.client.0.smithi111.stdout:2/883: mknod d0/d2/d59/d86/c132 0 2024-09-16T09:46:18.192 INFO:tasks.workunit.client.0.smithi111.stdout:5/842: rmdir d19/d1b/d27/d83/d2a/dc4/dc0 39 2024-09-16T09:46:18.193 INFO:tasks.workunit.client.0.smithi111.stdout:5/843: readlink d19/d1b/d27/d2e/d39/d6c/l8b 0 2024-09-16T09:46:18.195 INFO:tasks.workunit.client.0.smithi111.stdout:9/604: dwrite d0/d6/d8/f72 [0,4194304] 0 2024-09-16T09:46:18.195 INFO:tasks.workunit.client.0.smithi111.stdout:9/605: fsync d0/d6/d30/d81/fa8 0 2024-09-16T09:46:18.196 INFO:tasks.workunit.client.0.smithi111.stdout:3/883: dread d5/da/d42/d74/da4/fd7 [0,4194304] 0 2024-09-16T09:46:18.196 INFO:tasks.workunit.client.0.smithi111.stdout:3/884: dread - d5/da/d42/d74/da4/fec zero size 2024-09-16T09:46:18.196 INFO:tasks.workunit.client.0.smithi111.stdout:3/885: getdents d5/da/db/d35/d45/d107 0 2024-09-16T09:46:18.196 INFO:tasks.workunit.client.0.smithi111.stdout:7/603: dwrite d1/d9/fb9 [0,4194304] 0 2024-09-16T09:46:18.197 INFO:tasks.workunit.client.0.smithi111.stdout:7/604: write d1/d16/d17/d18/d4f/f97 [548920,83826] 0 2024-09-16T09:46:18.197 INFO:tasks.workunit.client.0.smithi111.stdout:1/701: dwrite d3/d24/d3f/f92 [0,4194304] 0 2024-09-16T09:46:18.197 INFO:tasks.workunit.client.0.smithi111.stdout:1/702: fsync d3/d24/d29/f37 0 2024-09-16T09:46:18.197 INFO:tasks.workunit.client.0.smithi111.stdout:1/703: truncate d3/d24/d3f/fc4 773945 0 2024-09-16T09:46:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:4/720: unlink d2/d30/d44/f47 0 2024-09-16T09:46:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:8/807: dwrite d3/de/d1e/f98 [0,4194304] 0 2024-09-16T09:46:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:8/808: write d3/da/f8b [854940,64518] 0 2024-09-16T09:46:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:8/809: write d3/da/db/d59/dd7/d9e/dd8/f6f [839049,90813] 0 2024-09-16T09:46:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:3/886: write d5/da/db/d35/f4f [1106152,96200] 0 2024-09-16T09:46:18.198 INFO:tasks.workunit.client.0.smithi111.stdout:3/887: write d5/da/f121 [268368,27624] 0 2024-09-16T09:46:18.199 INFO:tasks.workunit.client.0.smithi111.stdout:2/884: rename d0/da/la0 to d0/d2/l133 0 2024-09-16T09:46:18.199 INFO:tasks.workunit.client.0.smithi111.stdout:2/885: fdatasync d0/da/f3b 0 2024-09-16T09:46:18.199 INFO:tasks.workunit.client.0.smithi111.stdout:2/886: fsync d0/d45/d5c/d67/d63/dd4/fd3 0 2024-09-16T09:46:18.201 INFO:tasks.workunit.client.0.smithi111.stdout:9/606: dread d0/d6/d30/fb1 [0,4194304] 0 2024-09-16T09:46:18.202 INFO:tasks.workunit.client.0.smithi111.stdout:5/844: symlink d19/d1b/d27/d2e/df3/l121 0 2024-09-16T09:46:18.202 INFO:tasks.workunit.client.0.smithi111.stdout:3/888: write d5/da/db/d3a/d6d/de7/d75/f106 [3646665,11370] 0 2024-09-16T09:46:18.202 INFO:tasks.workunit.client.0.smithi111.stdout:0/761: sync 2024-09-16T09:46:18.211 INFO:tasks.workunit.client.0.smithi111.stdout:1/704: rmdir d3 39 2024-09-16T09:46:18.211 INFO:tasks.workunit.client.0.smithi111.stdout:1/705: write d3/d10/d72/fcb [3861967,116591] 0 2024-09-16T09:46:18.223 INFO:tasks.workunit.client.0.smithi111.stdout:8/810: creat d3/d26/f10c x:0 0 0 2024-09-16T09:46:18.225 INFO:tasks.workunit.client.0.smithi111.stdout:7/605: dwrite d1/d16/d17/d18/d1d/f5d [0,4194304] 0 2024-09-16T09:46:18.225 INFO:tasks.workunit.client.0.smithi111.stdout:7/606: truncate d1/d16/d17/d18/d1b/d79/daa/fb8 769824 0 2024-09-16T09:46:18.227 INFO:tasks.workunit.client.0.smithi111.stdout:5/845: dwrite d19/d1b/d27/d2e/f91 [0,4194304] 0 2024-09-16T09:46:18.229 INFO:tasks.workunit.client.0.smithi111.stdout:4/721: rename d2/d6/dd/c53 to d2/d6/d80/d98/ce8 0 2024-09-16T09:46:18.229 INFO:tasks.workunit.client.0.smithi111.stdout:4/722: write d2/d6/dd/d1b/d38/db0/f5f [1005,3143] 0 2024-09-16T09:46:18.230 INFO:tasks.workunit.client.0.smithi111.stdout:2/887: mkdir d0/d22/d98/d114/d134 0 2024-09-16T09:46:18.232 INFO:tasks.workunit.client.0.smithi111.stdout:5/846: dread d19/d1b/d27/d2e/d4a/d4b/fa3 [0,4194304] 0 2024-09-16T09:46:18.233 INFO:tasks.workunit.client.0.smithi111.stdout:9/607: truncate d0/f2a 2927402 0 2024-09-16T09:46:18.233 INFO:tasks.workunit.client.0.smithi111.stdout:9/608: getdents d0/d6/d8/de/d56/d4e/dc5 0 2024-09-16T09:46:18.235 INFO:tasks.workunit.client.0.smithi111.stdout:3/889: creat d5/d18/d78/dfd/f12b x:0 0 0 2024-09-16T09:46:18.240 INFO:tasks.workunit.client.0.smithi111.stdout:8/811: rmdir d3/d26/d6d 39 2024-09-16T09:46:18.240 INFO:tasks.workunit.client.0.smithi111.stdout:8/812: truncate d3/de/d1e/d2e/d2f/f49 509926 0 2024-09-16T09:46:18.241 INFO:tasks.workunit.client.0.smithi111.stdout:8/813: truncate d3/de/d1e/d2e/d2f/da8/dbe/f28 1697097 0 2024-09-16T09:46:18.244 INFO:tasks.workunit.client.0.smithi111.stdout:0/762: rename d0/d1d/d58/d83/fbd to d0/f119 0 2024-09-16T09:46:18.244 INFO:tasks.workunit.client.0.smithi111.stdout:0/763: chown d0/d1d/d67/d3a/d80/dee 286574 1 2024-09-16T09:46:18.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/888: mknod d0/d22/d98/d114/d9f/c135 0 2024-09-16T09:46:18.251 INFO:tasks.workunit.client.0.smithi111.stdout:9/609: creat d0/d21/d22/d6e/dab/fd0 x:0 0 0 2024-09-16T09:46:18.253 INFO:tasks.workunit.client.0.smithi111.stdout:8/814: dwrite d3/fa7 [0,4194304] 0 2024-09-16T09:46:18.253 INFO:tasks.workunit.client.0.smithi111.stdout:8/815: chown d3/da/db/d59/de5/fef 167910 1 2024-09-16T09:46:18.254 INFO:tasks.workunit.client.0.smithi111.stdout:3/890: creat d5/da/de1/d120/f12c x:0 0 0 2024-09-16T09:46:18.254 INFO:tasks.workunit.client.0.smithi111.stdout:3/891: chown d5/d18/d78/dfd/da0/l110 78 1 2024-09-16T09:46:18.254 INFO:tasks.workunit.client.0.smithi111.stdout:3/892: chown d5/da/db/d3a/d6d/de7/lf7 68 1 2024-09-16T09:46:18.254 INFO:tasks.workunit.client.0.smithi111.stdout:3/893: fdatasync d5/d18/fdc 0 2024-09-16T09:46:18.256 INFO:tasks.workunit.client.0.smithi111.stdout:1/706: link d3/d10/d23/d8e/fb8 d3/fe9 0 2024-09-16T09:46:18.258 INFO:tasks.workunit.client.0.smithi111.stdout:7/607: rename d1/d3e/fa9 to d1/d59/fd1 0 2024-09-16T09:46:18.258 INFO:tasks.workunit.client.0.smithi111.stdout:7/608: write d1/d9/f3c [5191675,47385] 0 2024-09-16T09:46:18.260 INFO:tasks.workunit.client.0.smithi111.stdout:2/889: symlink d0/d45/d5c/d67/d63/dd4/dc3/l136 0 2024-09-16T09:46:18.262 INFO:tasks.workunit.client.0.smithi111.stdout:9/610: creat d0/d48/d9d/fd1 x:0 0 0 2024-09-16T09:46:18.266 INFO:tasks.workunit.client.0.smithi111.stdout:8/816: symlink d3/de/d6e/l10d 0 2024-09-16T09:46:18.266 INFO:tasks.workunit.client.0.smithi111.stdout:8/817: readlink d3/de/d6e/l10d 0 2024-09-16T09:46:18.267 INFO:tasks.workunit.client.0.smithi111.stdout:3/894: creat d5/da/db/d3a/d6d/de7/d88/db8/f12d x:0 0 0 2024-09-16T09:46:18.269 INFO:tasks.workunit.client.0.smithi111.stdout:1/707: symlink d3/d24/d4e/lea 0 2024-09-16T09:46:18.272 INFO:tasks.workunit.client.0.smithi111.stdout:4/723: rename d2/d6/f14 to d2/d6/dd/d1b/d38/d64/dac/fe9 0 2024-09-16T09:46:18.274 INFO:tasks.workunit.client.0.smithi111.stdout:7/609: rmdir d1/d16/d17/d18/d1b/d79 39 2024-09-16T09:46:18.276 INFO:tasks.workunit.client.0.smithi111.stdout:2/890: link d0/d2/f51 d0/d2/d59/d86/d96/dd1/f137 0 2024-09-16T09:46:18.277 INFO:tasks.workunit.client.0.smithi111.stdout:9/611: unlink d0/d21/d22/d6e/d7d/cb2 0 2024-09-16T09:46:18.278 INFO:tasks.workunit.client.0.smithi111.stdout:8/818: link d3/da/db/d59/dd7/d9e/dd8/f38 d3/da/db/d59/dd7/d9e/f10e 0 2024-09-16T09:46:18.279 INFO:tasks.workunit.client.0.smithi111.stdout:3/895: mkdir d5/d18/d78/dfd/d12e 0 2024-09-16T09:46:18.281 INFO:tasks.workunit.client.0.smithi111.stdout:1/708: mknod d3/d10/d1c/ceb 0 2024-09-16T09:46:18.283 INFO:tasks.workunit.client.0.smithi111.stdout:5/847: rename l6 to d19/d1b/d27/d2e/d39/d6c/l122 0 2024-09-16T09:46:18.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/610: truncate d1/d9/d43/f7a 476916 0 2024-09-16T09:46:18.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/611: truncate d1/d16/d17/d18/d1b/f6d 2005565 0 2024-09-16T09:46:18.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/612: stat d1/d16/d17/d18/d4f 0 2024-09-16T09:46:18.289 INFO:tasks.workunit.client.0.smithi111.stdout:2/891: creat d0/d2/d59/d86/db1/f138 x:0 0 0 2024-09-16T09:46:18.289 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:17 smithi114 ceph-mon[35635]: pgmap v262: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 147 MiB/s rd, 196 MiB/s wr, 439 op/s 2024-09-16T09:46:18.290 INFO:tasks.workunit.client.0.smithi111.stdout:9/612: creat d0/d6/d8/de/d56/d4e/dc5/fd2 x:0 0 0 2024-09-16T09:46:18.293 INFO:tasks.workunit.client.0.smithi111.stdout:8/819: mkdir d3/de/d1e/d2e/d2f/d10f 0 2024-09-16T09:46:18.294 INFO:tasks.workunit.client.0.smithi111.stdout:3/896: symlink d5/da/db/d3a/d6d/de7/d88/db8/d112/l12f 0 2024-09-16T09:46:18.296 INFO:tasks.workunit.client.0.smithi111.stdout:1/709: dwrite d3/d10/d57/d8f/fca [0,4194304] 0 2024-09-16T09:46:18.297 INFO:tasks.workunit.client.0.smithi111.stdout:0/764: rename d0/c112 to d0/d1d/d58/c11a 0 2024-09-16T09:46:18.298 INFO:tasks.workunit.client.0.smithi111.stdout:5/848: creat d19/d1b/d27/d2e/f123 x:0 0 0 2024-09-16T09:46:18.298 INFO:tasks.workunit.client.0.smithi111.stdout:5/849: dread - d19/d1b/d27/d2e/d98/faa zero size 2024-09-16T09:46:18.302 INFO:tasks.workunit.client.0.smithi111.stdout:7/613: creat d1/d3e/d9e/fd2 x:0 0 0 2024-09-16T09:46:18.303 INFO:tasks.workunit.client.0.smithi111.stdout:2/892: unlink d0/d2/d5a/l7b 0 2024-09-16T09:46:18.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/893: chown d0/d45/d5c/d67/f122 119 1 2024-09-16T09:46:18.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/894: chown d0/d2/d5a/f68 98835192 1 2024-09-16T09:46:18.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/895: chown d0/d2/f41 138 1 2024-09-16T09:46:18.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/613: mknod d0/d6/d8/de/cd3 0 2024-09-16T09:46:18.305 INFO:tasks.workunit.client.0.smithi111.stdout:9/614: dread - d0/d6/d30/d47/f52 zero size 2024-09-16T09:46:18.307 INFO:tasks.workunit.client.0.smithi111.stdout:3/897: link d5/da/db/d3a/fae d5/d18/d78/dfd/da0/dd9/f130 0 2024-09-16T09:46:18.311 INFO:tasks.workunit.client.0.smithi111.stdout:1/710: rmdir d3/d24/d62/dd3 0 2024-09-16T09:46:18.311 INFO:tasks.workunit.client.0.smithi111.stdout:1/711: truncate d3/d10/d57/d95/fbd 1007879 0 2024-09-16T09:46:18.313 INFO:tasks.workunit.client.0.smithi111.stdout:4/724: rename d2/d6/dd/d1b/d38/d64/l9f to d2/d6/dd/d1b/d38/db0/d2f/d4e/lea 0 2024-09-16T09:46:18.316 INFO:tasks.workunit.client.0.smithi111.stdout:9/615: write d0/d6/d8/de/d56/d4e/f73 [1320827,943] 0 2024-09-16T09:46:18.317 INFO:tasks.workunit.client.0.smithi111.stdout:5/850: dwrite d19/d1b/d1e/d41/f8e [0,4194304] 0 2024-09-16T09:46:18.317 INFO:tasks.workunit.client.0.smithi111.stdout:0/765: creat d0/d1d/f11b x:0 0 0 2024-09-16T09:46:18.317 INFO:tasks.workunit.client.0.smithi111.stdout:7/614: symlink d1/d3e/d9e/dac/ld3 0 2024-09-16T09:46:18.319 INFO:tasks.workunit.client.0.smithi111.stdout:3/898: symlink d5/da/d42/d74/da4/l131 0 2024-09-16T09:46:18.321 INFO:tasks.workunit.client.0.smithi111.stdout:1/712: unlink d3/fde 0 2024-09-16T09:46:18.325 INFO:tasks.workunit.client.0.smithi111.stdout:8/820: rename d3/da/db/d59/dd7/cae to d3/da/c110 0 2024-09-16T09:46:18.325 INFO:tasks.workunit.client.0.smithi111.stdout:5/851: mkdir d19/d1b/d1e/d81/d124 0 2024-09-16T09:46:18.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/713: truncate d3/f7 7237557 0 2024-09-16T09:46:18.328 INFO:tasks.workunit.client.0.smithi111.stdout:1/714: write d3/d10/d72/da1/d28/d36/d3d/d47/d65/d74/f7a [4933507,74874] 0 2024-09-16T09:46:18.328 INFO:tasks.workunit.client.0.smithi111.stdout:1/715: stat d3 0 2024-09-16T09:46:18.330 INFO:tasks.workunit.client.0.smithi111.stdout:2/896: rename d0/d2/d5a/c10e to d0/dd8/c139 0 2024-09-16T09:46:18.331 INFO:tasks.workunit.client.0.smithi111.stdout:3/899: dread d5/d18/d78/dfd/db6/fbd [0,4194304] 0 2024-09-16T09:46:18.331 INFO:tasks.workunit.client.0.smithi111.stdout:8/821: mkdir d3/de/d1e/d2e/d74/dad/dba/d111 0 2024-09-16T09:46:18.332 INFO:tasks.workunit.client.0.smithi111.stdout:8/822: stat d3/de/d1e/d2e/d2f/dbc/f8a 0 2024-09-16T09:46:18.333 INFO:tasks.workunit.client.0.smithi111.stdout:5/852: rmdir d19/d1b/d27/d83/d2a/dc4/dc0/db1 39 2024-09-16T09:46:18.340 INFO:tasks.workunit.client.0.smithi111.stdout:2/897: symlink d0/d2/d44/l13a 0 2024-09-16T09:46:18.341 INFO:tasks.workunit.client.0.smithi111.stdout:2/898: chown d0/d45 43382 1 2024-09-16T09:46:18.342 INFO:tasks.workunit.client.0.smithi111.stdout:3/900: mknod d5/da/db/d3a/d6d/de7/d88/db8/c132 0 2024-09-16T09:46:18.346 INFO:tasks.workunit.client.0.smithi111.stdout:8/823: mknod d3/de/d1e/d2e/d74/dad/c112 0 2024-09-16T09:46:18.346 INFO:tasks.workunit.client.0.smithi111.stdout:5/853: write d19/d1b/d27/d2e/d39/d54/d60/f86 [345182,15021] 0 2024-09-16T09:46:18.347 INFO:tasks.workunit.client.0.smithi111.stdout:5/854: write d19/d1b/d27/d83/d2a/f69 [215534,114811] 0 2024-09-16T09:46:18.347 INFO:tasks.workunit.client.0.smithi111.stdout:4/725: dwrite d2/d6/dd/d1b/d38/db0/d2f/d9e/fdb [0,4194304] 0 2024-09-16T09:46:18.349 INFO:tasks.workunit.client.0.smithi111.stdout:3/901: truncate d5/da/db/d3a/d6d/de7/fb7 3908521 0 2024-09-16T09:46:18.350 INFO:tasks.workunit.client.0.smithi111.stdout:3/902: dread d5/d18/d78/dab/fc3 [0,4194304] 0 2024-09-16T09:46:18.357 INFO:tasks.workunit.client.0.smithi111.stdout:5/855: write d19/d1b/d27/d83/d2a/de2/ff1 [2806741,124083] 0 2024-09-16T09:46:18.362 INFO:tasks.workunit.client.0.smithi111.stdout:8/824: dread d3/f10 [0,4194304] 0 2024-09-16T09:46:18.362 INFO:tasks.workunit.client.0.smithi111.stdout:8/825: chown d3/d26/d6d/db6 247251 1 2024-09-16T09:46:18.364 INFO:tasks.workunit.client.0.smithi111.stdout:3/903: mknod d5/da/db/de/ddb/dcd/c133 0 2024-09-16T09:46:18.366 INFO:tasks.workunit.client.0.smithi111.stdout:3/904: mkdir d5/da/db/de/d134 0 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:3/905: dread - d5/da/db/d3a/d6d/de7/d88/f126 zero size 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:4/726: write d2/d6/dd/d1b/d38/d64/dac/fe9 [3612507,1488] 0 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:4/727: chown d2/d6/dd/d1b/d38/db0/d2f/d4e/lea 387 1 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:4/728: truncate d2/d6/fba 589734 0 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:8/826: dread d3/d26/f75 [0,4194304] 0 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:8/827: truncate d3/d26/ff8 527024 0 2024-09-16T09:46:18.367 INFO:tasks.workunit.client.0.smithi111.stdout:8/828: write d3/d26/d6d/fb5 [4853835,33032] 0 2024-09-16T09:46:18.368 INFO:tasks.workunit.client.0.smithi111.stdout:3/906: truncate d5/d18/f29 1917196 0 2024-09-16T09:46:18.368 INFO:tasks.workunit.client.0.smithi111.stdout:3/907: write d5/d18/d78/dab/fc3 [904923,44646] 0 2024-09-16T09:46:18.369 INFO:tasks.workunit.client.0.smithi111.stdout:8/829: rename d3/da/db/d59/c99 to d3/de/d1e/d2e/d2f/da8/dbe/d6b/c113 0 2024-09-16T09:46:18.370 INFO:tasks.workunit.client.0.smithi111.stdout:8/830: truncate d3/de/d1e/d2e/d2f/f7c 1453557 0 2024-09-16T09:46:18.370 INFO:tasks.workunit.client.0.smithi111.stdout:8/831: chown d3/da/db/d59/dd7/d9e/ceb 146 1 2024-09-16T09:46:18.376 INFO:tasks.workunit.client.0.smithi111.stdout:1/716: dwrite d3/d10/d72/da1/f1b [0,4194304] 0 2024-09-16T09:46:18.376 INFO:tasks.workunit.client.0.smithi111.stdout:1/717: readlink d3/d26/l3a 0 2024-09-16T09:46:18.376 INFO:tasks.workunit.client.0.smithi111.stdout:1/718: write d3/d10/d72/da1/d28/d36/d3d/d47/daf/fa6 [326997,38911] 0 2024-09-16T09:46:18.376 INFO:tasks.workunit.client.0.smithi111.stdout:1/719: fdatasync d3/d24/d3f/fc4 0 2024-09-16T09:46:18.378 INFO:tasks.workunit.client.0.smithi111.stdout:0/766: dwrite d0/d1d/d67/d3a/d77/ffa [0,4194304] 0 2024-09-16T09:46:18.379 INFO:tasks.workunit.client.0.smithi111.stdout:2/899: dwrite d0/f4 [4194304,4194304] 0 2024-09-16T09:46:18.379 INFO:tasks.workunit.client.0.smithi111.stdout:2/900: chown d0/d2/d59/d86 25 1 2024-09-16T09:46:18.379 INFO:tasks.workunit.client.0.smithi111.stdout:7/615: dwrite d1/d3e/d9e/fcc [0,4194304] 0 2024-09-16T09:46:18.379 INFO:tasks.workunit.client.0.smithi111.stdout:7/616: truncate d1/d9/fb4 812853 0 2024-09-16T09:46:18.379 INFO:tasks.workunit.client.0.smithi111.stdout:9/616: dwrite d0/d6/fad [0,4194304] 0 2024-09-16T09:46:18.380 INFO:tasks.workunit.client.0.smithi111.stdout:8/832: write d3/de/d1e/d2e/d74/f86 [2699409,72653] 0 2024-09-16T09:46:18.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/856: dwrite d19/d1b/d1e/d21/d29/d32/d8f/fd8 [4194304,4194304] 0 2024-09-16T09:46:18.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/857: chown d19/d1b/d1e/d81/d124 29 1 2024-09-16T09:46:18.380 INFO:tasks.workunit.client.0.smithi111.stdout:5/858: write d19/d1b/d27/d83/d2a/dc4/dc0/fef [701234,18821] 0 2024-09-16T09:46:18.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:17 smithi111 ceph-mon[27997]: pgmap v262: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 147 MiB/s rd, 196 MiB/s wr, 439 op/s 2024-09-16T09:46:18.383 INFO:tasks.workunit.client.0.smithi111.stdout:0/767: creat d0/dfb/f11c x:0 0 0 2024-09-16T09:46:18.383 INFO:tasks.workunit.client.0.smithi111.stdout:0/768: fsync d0/d1d/d67/d3a/d80/f78 0 2024-09-16T09:46:18.386 INFO:tasks.workunit.client.0.smithi111.stdout:4/729: dwrite d2/d6/dd/d1b/d38/db0/d2f/d6c/fa7 [0,4194304] 0 2024-09-16T09:46:18.386 INFO:tasks.workunit.client.0.smithi111.stdout:4/730: dread - d2/d6/dd/d1b/d6d/d8f/f9a zero size 2024-09-16T09:46:18.387 INFO:tasks.workunit.client.0.smithi111.stdout:2/901: truncate d0/d2/f39 712950 0 2024-09-16T09:46:18.388 INFO:tasks.workunit.client.0.smithi111.stdout:7/617: creat d1/d20/fd4 x:0 0 0 2024-09-16T09:46:18.395 INFO:tasks.workunit.client.0.smithi111.stdout:8/833: link d3/de/d1e/d2e/d74/f8c d3/d26/d6d/f114 0 2024-09-16T09:46:18.397 INFO:tasks.workunit.client.0.smithi111.stdout:5/859: unlink d19/d1b/d1e/d21/d29/c7a 0 2024-09-16T09:46:18.399 INFO:tasks.workunit.client.0.smithi111.stdout:0/769: creat d0/d1d/d67/d3a/d80/dee/f11d x:0 0 0 2024-09-16T09:46:18.399 INFO:tasks.workunit.client.0.smithi111.stdout:0/770: write d0/da4/ddd/fb5 [1567544,35393] 0 2024-09-16T09:46:18.399 INFO:tasks.workunit.client.0.smithi111.stdout:0/771: write d0/d1d/d67/d3a/fa5 [21709,36885] 0 2024-09-16T09:46:18.401 INFO:tasks.workunit.client.0.smithi111.stdout:1/720: dwrite d3/d24/d62/f90 [4194304,4194304] 0 2024-09-16T09:46:18.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/721: fsync d3/d24/d3f/fc4 0 2024-09-16T09:46:18.402 INFO:tasks.workunit.client.0.smithi111.stdout:4/731: creat d2/d30/d44/d69/feb x:0 0 0 2024-09-16T09:46:18.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/722: dread d3/d10/d23/d8e/fa3 [0,4194304] 0 2024-09-16T09:46:18.403 INFO:tasks.workunit.client.0.smithi111.stdout:1/723: write d3/d10/d72/da1/d28/d36/d3d/d47/daf/fba [778061,45263] 0 2024-09-16T09:46:18.405 INFO:tasks.workunit.client.0.smithi111.stdout:2/902: mknod d0/dc5/c13b 0 2024-09-16T09:46:18.406 INFO:tasks.workunit.client.0.smithi111.stdout:7/618: unlink d1/c4b 0 2024-09-16T09:46:18.408 INFO:tasks.workunit.client.0.smithi111.stdout:0/772: mkdir d0/de3/d11e 0 2024-09-16T09:46:18.408 INFO:tasks.workunit.client.0.smithi111.stdout:0/773: write d0/d1d/d67/d3a/d92/f97 [4692958,113838] 0 2024-09-16T09:46:18.411 INFO:tasks.workunit.client.0.smithi111.stdout:7/619: dread d1/d9/f1f [0,4194304] 0 2024-09-16T09:46:18.412 INFO:tasks.workunit.client.0.smithi111.stdout:7/620: write d1/d16/d17/d18/f8b [226626,21408] 0 2024-09-16T09:46:18.412 INFO:tasks.workunit.client.0.smithi111.stdout:4/732: mkdir d2/d6/dd/d1b/d38/d64/dd8/dec 0 2024-09-16T09:46:18.416 INFO:tasks.workunit.client.0.smithi111.stdout:7/621: symlink d1/d9/ld5 0 2024-09-16T09:46:18.418 INFO:tasks.workunit.client.0.smithi111.stdout:2/903: dread d0/d21/f4f [0,4194304] 0 2024-09-16T09:46:18.420 INFO:tasks.workunit.client.0.smithi111.stdout:2/904: unlink d0/f36 0 2024-09-16T09:46:18.420 INFO:tasks.workunit.client.0.smithi111.stdout:2/905: write d0/da6/f103 [513882,32801] 0 2024-09-16T09:46:18.423 INFO:tasks.workunit.client.0.smithi111.stdout:2/906: unlink d0/d2/d59/l87 0 2024-09-16T09:46:18.424 INFO:tasks.workunit.client.0.smithi111.stdout:2/907: write d0/d2/d5a/f93 [5055337,68839] 0 2024-09-16T09:46:18.424 INFO:tasks.workunit.client.0.smithi111.stdout:2/908: truncate d0/d22/d98/d114/d9f/faf 43805 0 2024-09-16T09:46:18.424 INFO:tasks.workunit.client.0.smithi111.stdout:2/909: fdatasync d0/f4 0 2024-09-16T09:46:18.424 INFO:tasks.workunit.client.0.smithi111.stdout:4/733: dread d2/f56 [0,4194304] 0 2024-09-16T09:46:18.424 INFO:tasks.workunit.client.0.smithi111.stdout:4/734: dread - d2/d6/dd/d1b/d38/d64/d92/fc7 zero size 2024-09-16T09:46:18.426 INFO:tasks.workunit.client.0.smithi111.stdout:2/910: getdents d0/d45/d5c/d67/d63/dd4/dc3/dc8 0 2024-09-16T09:46:18.426 INFO:tasks.workunit.client.0.smithi111.stdout:2/911: truncate d0/d2/d5a/f62 5122466 0 2024-09-16T09:46:18.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/774: dwrite d0/d1d/d67/f65 [0,4194304] 0 2024-09-16T09:46:18.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/775: chown d0/d1d/c1f 5 1 2024-09-16T09:46:18.429 INFO:tasks.workunit.client.0.smithi111.stdout:4/735: getdents d2/d6/dd/d1b/d38/db0/d2f/d9e 0 2024-09-16T09:46:18.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/912: rename d0/da/d4e/fbe to d0/d45/f13c 0 2024-09-16T09:46:18.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/913: fdatasync d0/d45/d5c/fd6 0 2024-09-16T09:46:18.431 INFO:tasks.workunit.client.0.smithi111.stdout:2/914: stat d0/d22/d98/d114/d9f/c135 0 2024-09-16T09:46:18.432 INFO:tasks.workunit.client.0.smithi111.stdout:7/622: read d1/d16/d17/d18/d1d/f24 [7924912,27075] 0 2024-09-16T09:46:18.435 INFO:tasks.workunit.client.0.smithi111.stdout:4/736: creat d2/d30/d44/d69/fed x:0 0 0 2024-09-16T09:46:18.435 INFO:tasks.workunit.client.0.smithi111.stdout:4/737: write d2/d30/da1/fb4 [522698,82902] 0 2024-09-16T09:46:18.435 INFO:tasks.workunit.client.0.smithi111.stdout:4/738: chown d2/d30/d44/d96/cd7 745547 1 2024-09-16T09:46:18.436 INFO:tasks.workunit.client.0.smithi111.stdout:7/623: rmdir d1/d3e/d9f 39 2024-09-16T09:46:18.436 INFO:tasks.workunit.client.0.smithi111.stdout:7/624: dread - d1/d3e/f70 zero size 2024-09-16T09:46:18.437 INFO:tasks.workunit.client.0.smithi111.stdout:7/625: write d1/d9/fc8 [57161,36913] 0 2024-09-16T09:46:18.443 INFO:tasks.workunit.client.0.smithi111.stdout:7/626: dread d1/d16/d17/f9b [0,4194304] 0 2024-09-16T09:46:18.445 INFO:tasks.workunit.client.0.smithi111.stdout:7/627: symlink d1/ld6 0 2024-09-16T09:46:18.446 INFO:tasks.workunit.client.0.smithi111.stdout:7/628: getdents d1/d16/d17/d18/d1b/d79/da5 0 2024-09-16T09:46:18.447 INFO:tasks.workunit.client.0.smithi111.stdout:7/629: mkdir d1/d20/dc6/dd7 0 2024-09-16T09:46:18.472 INFO:tasks.workunit.client.0.smithi111.stdout:0/776: dwrite d0/d1d/d58/d64/f109 [0,4194304] 0 2024-09-16T09:46:18.472 INFO:tasks.workunit.client.0.smithi111.stdout:2/915: dwrite d0/da/d4e/da8/fed [0,4194304] 0 2024-09-16T09:46:18.473 INFO:tasks.workunit.client.0.smithi111.stdout:0/777: write d0/f22 [3659991,55812] 0 2024-09-16T09:46:18.473 INFO:tasks.workunit.client.0.smithi111.stdout:2/916: write d0/da/f11c [1663470,71603] 0 2024-09-16T09:46:18.473 INFO:tasks.workunit.client.0.smithi111.stdout:4/739: dwrite d2/d6/dd/d1b/d38/d64/f7f [0,4194304] 0 2024-09-16T09:46:18.473 INFO:tasks.workunit.client.0.smithi111.stdout:7/630: dwrite d1/d9/f34 [0,4194304] 0 2024-09-16T09:46:18.474 INFO:tasks.workunit.client.0.smithi111.stdout:2/917: symlink d0/d2/d59/d86/l13d 0 2024-09-16T09:46:18.476 INFO:tasks.workunit.client.0.smithi111.stdout:4/740: rename d2/d6/dd/d1b/d38/db0/f5f to d2/d6/dd/d1b/d38/db0/d2f/fee 0 2024-09-16T09:46:18.477 INFO:tasks.workunit.client.0.smithi111.stdout:7/631: mkdir d1/d16/dd8 0 2024-09-16T09:46:18.478 INFO:tasks.workunit.client.0.smithi111.stdout:2/918: rmdir d0/da/d4e 39 2024-09-16T09:46:18.480 INFO:tasks.workunit.client.0.smithi111.stdout:4/741: rename d2/d30/d44 to d2/d6/dd/d1b/d6d/def 0 2024-09-16T09:46:18.482 INFO:tasks.workunit.client.0.smithi111.stdout:2/919: unlink d0/da/d4e/l7e 0 2024-09-16T09:46:18.483 INFO:tasks.workunit.client.0.smithi111.stdout:4/742: truncate d2/d6/dd/d1b/d6d/def/f82 1204485 0 2024-09-16T09:46:18.484 INFO:tasks.workunit.client.0.smithi111.stdout:2/920: mkdir d0/da6/dea/d13e 0 2024-09-16T09:46:18.484 INFO:tasks.workunit.client.0.smithi111.stdout:2/921: fdatasync d0/d2/d59/d86/d96/dd1/f137 0 2024-09-16T09:46:18.486 INFO:tasks.workunit.client.0.smithi111.stdout:0/778: dwrite d0/d1d/d58/d64/d4f/f75 [0,4194304] 0 2024-09-16T09:46:18.486 INFO:tasks.workunit.client.0.smithi111.stdout:0/779: stat d0/d1d/d67/d3a/d3d/f9d 0 2024-09-16T09:46:18.487 INFO:tasks.workunit.client.0.smithi111.stdout:2/922: rmdir d0/d29/d12f 0 2024-09-16T09:46:18.487 INFO:tasks.workunit.client.0.smithi111.stdout:2/923: chown d0/d2/d59/d86/f129 27974981 1 2024-09-16T09:46:18.489 INFO:tasks.workunit.client.0.smithi111.stdout:0/780: mknod d0/dfb/c11f 0 2024-09-16T09:46:18.489 INFO:tasks.workunit.client.0.smithi111.stdout:0/781: dread - d0/d1d/d58/d83/f118 zero size 2024-09-16T09:46:18.489 INFO:tasks.workunit.client.0.smithi111.stdout:0/782: fdatasync d0/d1d/d67/d3a/d80/f78 0 2024-09-16T09:46:18.491 INFO:tasks.workunit.client.0.smithi111.stdout:4/743: getdents d2/d6/dd/d1b/d38/db0/d2f 0 2024-09-16T09:46:18.492 INFO:tasks.workunit.client.0.smithi111.stdout:2/924: link d0/d22/d98/d114/d9f/ld7 d0/d2/d5a/l13f 0 2024-09-16T09:46:18.492 INFO:tasks.workunit.client.0.smithi111.stdout:4/744: getdents d2/d6/dd/d1b/d6d/def/d96 0 2024-09-16T09:46:18.496 INFO:tasks.workunit.client.0.smithi111.stdout:2/925: rename d0/da6/dea/d109 to d0/d29/d80/d140 0 2024-09-16T09:46:18.497 INFO:tasks.workunit.client.0.smithi111.stdout:2/926: symlink d0/d22/d98/d114/d9f/l141 0 2024-09-16T09:46:18.497 INFO:tasks.workunit.client.0.smithi111.stdout:2/927: stat d0/d45/d5c/d67/d63/c123 0 2024-09-16T09:46:18.507 INFO:tasks.workunit.client.0.smithi111.stdout:2/928: write d0/da/d4e/f77 [2198347,68290] 0 2024-09-16T09:46:18.508 INFO:tasks.workunit.client.0.smithi111.stdout:2/929: rename d0/d21/ldd to d0/d2/d44/l142 0 2024-09-16T09:46:18.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/930: mknod d0/da6/c143 0 2024-09-16T09:46:18.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/931: readlink d0/dc5/l120 0 2024-09-16T09:46:18.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/932: chown d0/da/f11c 819206374 1 2024-09-16T09:46:18.509 INFO:tasks.workunit.client.0.smithi111.stdout:2/933: fsync d0/d2/d44/f5e 0 2024-09-16T09:46:18.510 INFO:tasks.workunit.client.0.smithi111.stdout:2/934: mkdir d0/d29/d144 0 2024-09-16T09:46:18.510 INFO:tasks.workunit.client.0.smithi111.stdout:2/935: mknod d0/d45/d5c/d67/c145 0 2024-09-16T09:46:18.514 INFO:tasks.workunit.client.0.smithi111.stdout:7/632: dwrite d1/d9/f15 [0,4194304] 0 2024-09-16T09:46:18.517 INFO:tasks.workunit.client.0.smithi111.stdout:0/783: dwrite d0/d1d/d67/d3a/f8d [4194304,4194304] 0 2024-09-16T09:46:18.517 INFO:tasks.workunit.client.0.smithi111.stdout:0/784: chown d0/de3/fe8 708 1 2024-09-16T09:46:18.518 INFO:tasks.workunit.client.0.smithi111.stdout:4/745: dwrite d2/d6/dd/d1b/d6d/fcc [4194304,4194304] 0 2024-09-16T09:46:18.533 INFO:tasks.workunit.client.0.smithi111.stdout:0/785: truncate d0/d1d/d67/d3a/d3d/d59/f6a 1900395 0 2024-09-16T09:46:18.534 INFO:tasks.workunit.client.0.smithi111.stdout:2/936: dwrite d0/da/f57 [0,4194304] 0 2024-09-16T09:46:18.535 INFO:tasks.workunit.client.0.smithi111.stdout:7/633: dwrite d1/d59/fd1 [0,4194304] 0 2024-09-16T09:46:18.538 INFO:tasks.workunit.client.0.smithi111.stdout:4/746: rename d2/d6/dd/d1b/d38/f68 to d2/d6/dd/d1b/d38/db0/d2f/ff0 0 2024-09-16T09:46:18.544 INFO:tasks.workunit.client.0.smithi111.stdout:0/786: read d0/f13 [4189692,2603] 0 2024-09-16T09:46:18.544 INFO:tasks.workunit.client.0.smithi111.stdout:0/787: chown d0/d1d/d67/d3a/d3d/f46 181448 1 2024-09-16T09:46:18.550 INFO:tasks.workunit.client.0.smithi111.stdout:0/788: dread d0/f31 [0,4194304] 0 2024-09-16T09:46:18.551 INFO:tasks.workunit.client.0.smithi111.stdout:0/789: fsync d0/f1c 0 2024-09-16T09:46:18.563 INFO:tasks.workunit.client.0.smithi111.stdout:7/634: creat d1/d16/d17/d18/d1d/d2f/fd9 x:0 0 0 2024-09-16T09:46:18.563 INFO:tasks.workunit.client.0.smithi111.stdout:7/635: chown d1/d16/l7b 16791 1 2024-09-16T09:46:18.563 INFO:tasks.workunit.client.0.smithi111.stdout:7/636: chown d1/d16/d17/d18/d1b/d79/daa/f83 28 1 2024-09-16T09:46:18.564 INFO:tasks.workunit.client.0.smithi111.stdout:7/637: stat d1/d16/d17/d18/d1b/d79 0 2024-09-16T09:46:18.566 INFO:tasks.workunit.client.0.smithi111.stdout:4/747: fdatasync d2/d6/f3f 0 2024-09-16T09:46:18.568 INFO:tasks.workunit.client.0.smithi111.stdout:7/638: rename d1/d16/d17/d18/d1d/l99 to d1/d9/d53/lda 0 2024-09-16T09:46:18.568 INFO:tasks.workunit.client.0.smithi111.stdout:7/639: chown d1/d16/f5f 25 1 2024-09-16T09:46:18.568 INFO:tasks.workunit.client.0.smithi111.stdout:7/640: readlink d1/d20/l6b 0 2024-09-16T09:46:18.568 INFO:tasks.workunit.client.0.smithi111.stdout:7/641: chown d1/d3e/d9f/lbf 968 1 2024-09-16T09:46:18.568 INFO:tasks.workunit.client.0.smithi111.stdout:0/790: dwrite d0/d1d/d67/f65 [0,4194304] 0 2024-09-16T09:46:18.570 INFO:tasks.workunit.client.0.smithi111.stdout:6/679: sync 2024-09-16T09:46:18.571 INFO:tasks.workunit.client.0.smithi111.stdout:4/748: creat d2/d6/dd/d1b/d38/db0/d2f/d9e/ff1 x:0 0 0 2024-09-16T09:46:18.573 INFO:tasks.workunit.client.0.smithi111.stdout:6/680: dread d0/d57/db0/d14/fb7 [0,4194304] 0 2024-09-16T09:46:18.575 INFO:tasks.workunit.client.0.smithi111.stdout:7/642: mknod d1/d16/d17/d18/d4f/cdb 0 2024-09-16T09:46:18.576 INFO:tasks.workunit.client.0.smithi111.stdout:6/681: mknod d0/d57/db0/d14/d20/d42/d4e/d64/cee 0 2024-09-16T09:46:18.580 INFO:tasks.workunit.client.0.smithi111.stdout:7/643: link d1/d9/d43/d82/f8a d1/d16/d17/fdc 0 2024-09-16T09:46:18.594 INFO:tasks.workunit.client.0.smithi111.stdout:4/749: dwrite d2/d6/dd/d1b/d38/db0/f43 [0,4194304] 0 2024-09-16T09:46:18.594 INFO:tasks.workunit.client.0.smithi111.stdout:7/644: dread d1/d3e/d9e/fcc [0,4194304] 0 2024-09-16T09:46:18.594 INFO:tasks.workunit.client.0.smithi111.stdout:7/645: write d1/d3e/f74 [1479894,103563] 0 2024-09-16T09:46:18.598 INFO:tasks.workunit.client.0.smithi111.stdout:4/750: symlink d2/d6/dd/d1b/d38/db0/d2f/d4e/lf2 0 2024-09-16T09:46:18.599 INFO:tasks.workunit.client.0.smithi111.stdout:4/751: creat d2/d6/dd/d1b/d38/d64/d65/ff3 x:0 0 0 2024-09-16T09:46:18.599 INFO:tasks.workunit.client.0.smithi111.stdout:4/752: fsync d2/d6/dd/d1b/d38/db0/d2f/d6c/fe1 0 2024-09-16T09:46:18.601 INFO:tasks.workunit.client.0.smithi111.stdout:4/753: creat d2/d6/dd/d1b/d38/db0/d2f/d4e/ff4 x:0 0 0 2024-09-16T09:46:18.602 INFO:tasks.workunit.client.0.smithi111.stdout:6/682: dwrite d0/f3a [0,4194304] 0 2024-09-16T09:46:18.603 INFO:tasks.workunit.client.0.smithi111.stdout:4/754: mkdir d2/d6/dd/df5 0 2024-09-16T09:46:18.604 INFO:tasks.workunit.client.0.smithi111.stdout:6/683: truncate d0/d57/db0/d14/f74 3719784 0 2024-09-16T09:46:18.604 INFO:tasks.workunit.client.0.smithi111.stdout:6/684: write d0/d57/d72/f8b [1179394,68486] 0 2024-09-16T09:46:18.606 INFO:tasks.workunit.client.0.smithi111.stdout:4/755: truncate d2/d30/f61 3616105 0 2024-09-16T09:46:18.606 INFO:tasks.workunit.client.0.smithi111.stdout:4/756: write d2/d6/dd/d1b/d6d/d8f/fa9 [1364549,61966] 0 2024-09-16T09:46:18.606 INFO:tasks.workunit.client.0.smithi111.stdout:4/757: write d2/d6/dd/d1b/d38/db0/d2f/d6c/f87 [507179,84029] 0 2024-09-16T09:46:18.607 INFO:tasks.workunit.client.0.smithi111.stdout:6/685: mkdir d0/d57/db0/d14/d20/d42/d4e/d64/def 0 2024-09-16T09:46:18.607 INFO:tasks.workunit.client.0.smithi111.stdout:6/686: fsync d0/d57/db0/d47/d52/f82 0 2024-09-16T09:46:18.609 INFO:tasks.workunit.client.0.smithi111.stdout:4/758: link d2/d6/dd/d1b/d6d/def/d69/cb1 d2/d30/cf6 0 2024-09-16T09:46:18.610 INFO:tasks.workunit.client.0.smithi111.stdout:4/759: mknod d2/d6/dd/d1b/d38/d64/d65/cf7 0 2024-09-16T09:46:18.625 INFO:tasks.workunit.client.0.smithi111.stdout:6/687: dwrite d0/d57/db0/d14/d20/d42/f55 [0,4194304] 0 2024-09-16T09:46:18.691 INFO:tasks.workunit.client.0.smithi111.stdout:6/688: symlink d0/d57/db0/d14/d20/d42/d4e/d64/def/lf0 0 2024-09-16T09:46:18.695 INFO:tasks.workunit.client.0.smithi111.stdout:6/689: link d0/l9 d0/d57/db0/d49/d5b/d93/lf1 0 2024-09-16T09:46:18.696 INFO:tasks.workunit.client.0.smithi111.stdout:6/690: symlink d0/d57/db0/d14/d20/d42/dbd/lf2 0 2024-09-16T09:46:18.696 INFO:tasks.workunit.client.0.smithi111.stdout:6/691: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f6b [355979,5017] 0 2024-09-16T09:46:18.697 INFO:tasks.workunit.client.0.smithi111.stdout:6/692: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/f51 [3881248,87648] 0 2024-09-16T09:46:18.699 INFO:tasks.workunit.client.0.smithi111.stdout:6/693: rename d0/d57/d72/db2/lb8 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/lf3 0 2024-09-16T09:46:18.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/694: creat d0/d57/db0/d47/d52/db3/ff4 x:0 0 0 2024-09-16T09:46:18.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/695: write d0/d57/fd8 [8410,58082] 0 2024-09-16T09:46:18.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/696: readlink d0/d57/db0/d49/d5b/d93/lf1 0 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:9/617: sync 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/860: sync 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:8/834: sync 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:1/724: sync 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/861: chown d19/d1b/d27/d2e/d39/d54/fc5 8138310 1 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:5/862: fsync d19/d1b/d1e/d21/d29/d32/d46/fa2 0 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/908: sync 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/909: read d5/d18/f29 [1135031,43775] 0 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/910: write d5/d18/fdc [903441,17280] 0 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/911: chown d5/da/db/d3a/d6d/de7/d88/db8/l103 14865863 1 2024-09-16T09:46:18.733 INFO:tasks.workunit.client.0.smithi111.stdout:3/912: chown d5/da/db/fad 32513 1 2024-09-16T09:46:18.734 INFO:tasks.workunit.client.0.smithi111.stdout:3/913: dread d5/da/db/d5a/f76 [0,4194304] 0 2024-09-16T09:46:18.734 INFO:tasks.workunit.client.0.smithi111.stdout:3/914: write d5/da/db/d3a/d6d/dd1/d10c/f113 [389085,5146] 0 2024-09-16T09:46:18.740 INFO:tasks.workunit.client.0.smithi111.stdout:3/915: write d5/da/d42/f48 [1185063,65169] 0 2024-09-16T09:46:18.756 INFO:tasks.workunit.client.0.smithi111.stdout:3/916: dwrite d5/da/db/d3a/d6d/de7/f83 [0,4194304] 0 2024-09-16T09:46:18.826 INFO:tasks.workunit.client.0.smithi111.stdout:8/835: link d3/l9 d3/da/db/d59/dd7/d9e/l115 0 2024-09-16T09:46:18.826 INFO:tasks.workunit.client.0.smithi111.stdout:1/725: mknod d3/d24/d29/dc8/cec 0 2024-09-16T09:46:18.827 INFO:tasks.workunit.client.0.smithi111.stdout:9/618: creat d0/d21/d22/d6e/d7d/d9a/fd4 x:0 0 0 2024-09-16T09:46:18.828 INFO:tasks.workunit.client.0.smithi111.stdout:5/863: getdents d19/d1b/d27/d83/d2a/dc4/dc0 0 2024-09-16T09:46:18.828 INFO:tasks.workunit.client.0.smithi111.stdout:5/864: readlink d19/d1b/d27/d2e/d39/d6c/l122 0 2024-09-16T09:46:18.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/917: rmdir d5/d18/d78/dfd/d12e 0 2024-09-16T09:46:18.831 INFO:tasks.workunit.client.0.smithi111.stdout:3/918: dread - d5/da/db/d5a/fc7 zero size 2024-09-16T09:46:18.835 INFO:tasks.workunit.client.0.smithi111.stdout:9/619: creat d0/d6c/fd5 x:0 0 0 2024-09-16T09:46:18.835 INFO:tasks.workunit.client.0.smithi111.stdout:9/620: dread - d0/d6/d75/fae zero size 2024-09-16T09:46:18.838 INFO:tasks.workunit.client.0.smithi111.stdout:5/865: symlink d19/d1b/d27/d2e/d39/d54/d60/dc9/d11f/l125 0 2024-09-16T09:46:18.839 INFO:tasks.workunit.client.0.smithi111.stdout:3/919: rmdir d5/da/def 39 2024-09-16T09:46:18.839 INFO:tasks.workunit.client.0.smithi111.stdout:3/920: write d5/da/d42/d74/da4/fe0 [1744618,91196] 0 2024-09-16T09:46:18.841 INFO:tasks.workunit.client.0.smithi111.stdout:8/836: dread d3/de/d1e/f51 [0,4194304] 0 2024-09-16T09:46:18.842 INFO:tasks.workunit.client.0.smithi111.stdout:1/726: write d3/d10/d72/da1/d28/d36/fce [3121365,79187] 0 2024-09-16T09:46:18.842 INFO:tasks.workunit.client.0.smithi111.stdout:5/866: creat d19/d1b/d27/d2e/d39/d54/f126 x:0 0 0 2024-09-16T09:46:18.846 INFO:tasks.workunit.client.0.smithi111.stdout:3/921: creat d5/d18/df6/f135 x:0 0 0 2024-09-16T09:46:18.851 INFO:tasks.workunit.client.0.smithi111.stdout:8/837: unlink d3/f13 0 2024-09-16T09:46:18.851 INFO:tasks.workunit.client.0.smithi111.stdout:8/838: fdatasync d3/d26/d6d/f70 0 2024-09-16T09:46:18.854 INFO:tasks.workunit.client.0.smithi111.stdout:1/727: rename d3/d26/d63/cdd to d3/d24/d29/dc8/de3/ced 0 2024-09-16T09:46:18.856 INFO:tasks.workunit.client.0.smithi111.stdout:8/839: creat d3/f116 x:0 0 0 2024-09-16T09:46:18.857 INFO:tasks.workunit.client.0.smithi111.stdout:1/728: symlink d3/d10/d72/da1/d28/d36/d3d/d47/d65/lee 0 2024-09-16T09:46:18.858 INFO:tasks.workunit.client.0.smithi111.stdout:1/729: write d3/d24/d62/f81 [203759,107898] 0 2024-09-16T09:46:18.860 INFO:tasks.workunit.client.0.smithi111.stdout:9/621: dwrite d0/d48/d9d/fcc [0,4194304] 0 2024-09-16T09:46:18.860 INFO:tasks.workunit.client.0.smithi111.stdout:9/622: readlink d0/d6/d8/de/l57 0 2024-09-16T09:46:18.861 INFO:tasks.workunit.client.0.smithi111.stdout:5/867: rename d19/d1b/d27/d2e/d39/dc6/fe6 to d19/d1b/d27/d2e/d39/d54/f127 0 2024-09-16T09:46:18.861 INFO:tasks.workunit.client.0.smithi111.stdout:5/868: stat d19/d1b/d27/d83/cb7 0 2024-09-16T09:46:18.861 INFO:tasks.workunit.client.0.smithi111.stdout:8/840: rmdir d3/de/d1e/d2e/d2f 39 2024-09-16T09:46:18.863 INFO:tasks.workunit.client.0.smithi111.stdout:1/730: mknod d3/d24/d62/db3/dbb/cef 0 2024-09-16T09:46:18.866 INFO:tasks.workunit.client.0.smithi111.stdout:3/922: dwrite d5/da/db/de/ddb/dcd/f10d [0,4194304] 0 2024-09-16T09:46:18.868 INFO:tasks.workunit.client.0.smithi111.stdout:9/623: mknod d0/d6/d30/d47/dbd/cd6 0 2024-09-16T09:46:18.868 INFO:tasks.workunit.client.0.smithi111.stdout:9/624: readlink d0/d6/d8/de/l94 0 2024-09-16T09:46:18.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/869: mkdir d19/d1b/d9f/deb/d128 0 2024-09-16T09:46:18.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/870: truncate d19/d1b/d27/d2e/d39/d54/d60/ff8 504413 0 2024-09-16T09:46:18.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/871: getdents d19/d1b/d27/d83/d2a/dc4/dc0 0 2024-09-16T09:46:18.873 INFO:tasks.workunit.client.0.smithi111.stdout:8/841: creat d3/da/db/d59/dd7/dcc/d100/f117 x:0 0 0 2024-09-16T09:46:18.874 INFO:tasks.workunit.client.0.smithi111.stdout:5/872: dread d19/d1b/d27/d2e/d4a/d4b/fa3 [0,4194304] 0 2024-09-16T09:46:18.874 INFO:tasks.workunit.client.0.smithi111.stdout:1/731: rename d3/d24/d3f to d3/d10/d23/d8e/df0 0 2024-09-16T09:46:18.881 INFO:tasks.workunit.client.0.smithi111.stdout:9/625: symlink d0/d6/d75/da9/ld7 0 2024-09-16T09:46:18.883 INFO:tasks.workunit.client.0.smithi111.stdout:8/842: mkdir d3/de/d1e/d2e/d2f/da8/dbe/d118 0 2024-09-16T09:46:18.883 INFO:tasks.workunit.client.0.smithi111.stdout:8/843: fdatasync d3/da/db/d59/dd7/d9e/dd8/f6f 0 2024-09-16T09:46:18.886 INFO:tasks.workunit.client.0.smithi111.stdout:1/732: mkdir d3/d10/d72/da1/d28/d36/d3d/d47/daf/df1 0 2024-09-16T09:46:18.887 INFO:tasks.workunit.client.0.smithi111.stdout:9/626: creat d0/d21/d22/d6e/dab/fd8 x:0 0 0 2024-09-16T09:46:18.887 INFO:tasks.workunit.client.0.smithi111.stdout:1/733: write d3/d10/d72/da1/fc9 [935654,22967] 0 2024-09-16T09:46:18.888 INFO:tasks.workunit.client.0.smithi111.stdout:8/844: symlink d3/da/db/d59/dd7/d9e/dd8/l119 0 2024-09-16T09:46:18.890 INFO:tasks.workunit.client.0.smithi111.stdout:9/627: truncate d0/d21/d22/f86 929002 0 2024-09-16T09:46:18.890 INFO:tasks.workunit.client.0.smithi111.stdout:9/628: truncate d0/d6/d8/de/d56/fbb 708401 0 2024-09-16T09:46:18.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/873: dwrite d19/d1b/d1e/d41/f6f [0,4194304] 0 2024-09-16T09:46:18.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/874: chown d19/d1b/d27/l38 1 1 2024-09-16T09:46:18.893 INFO:tasks.workunit.client.0.smithi111.stdout:5/875: fdatasync d19/d1b/d27/d83/d2a/f7c 0 2024-09-16T09:46:18.895 INFO:tasks.workunit.client.0.smithi111.stdout:1/734: dread d3/d10/d1c/f31 [0,4194304] 0 2024-09-16T09:46:18.895 INFO:tasks.workunit.client.0.smithi111.stdout:8/845: rename d3/de/c58 to d3/da/db/d59/dd7/d9e/dd8/c11a 0 2024-09-16T09:46:18.895 INFO:tasks.workunit.client.0.smithi111.stdout:8/846: fsync d3/da/fe9 0 2024-09-16T09:46:18.895 INFO:tasks.workunit.client.0.smithi111.stdout:9/629: creat d0/d6/d8/de/d56/fd9 x:0 0 0 2024-09-16T09:46:18.906 INFO:tasks.workunit.client.0.smithi111.stdout:8/847: symlink d3/d26/d6d/l11b 0 2024-09-16T09:46:18.909 INFO:tasks.workunit.client.0.smithi111.stdout:9/630: dread d0/d6/d45/f4c [4194304,4194304] 0 2024-09-16T09:46:18.910 INFO:tasks.workunit.client.0.smithi111.stdout:8/848: rename d3/d26/d6d/fa6 to d3/de/d1e/d2e/d2f/da8/dbe/f11c 0 2024-09-16T09:46:18.911 INFO:tasks.workunit.client.0.smithi111.stdout:8/849: dread d3/d26/ff8 [0,4194304] 0 2024-09-16T09:46:18.912 INFO:tasks.workunit.client.0.smithi111.stdout:9/631: mkdir d0/d6/d45/db0/dcb/dda 0 2024-09-16T09:46:18.912 INFO:tasks.workunit.client.0.smithi111.stdout:9/632: write d0/d6/d8/de/f95 [995749,39868] 0 2024-09-16T09:46:18.913 INFO:tasks.workunit.client.0.smithi111.stdout:8/850: getdents d3/de/d1e/d2e/dce 0 2024-09-16T09:46:18.913 INFO:tasks.workunit.client.0.smithi111.stdout:8/851: fsync d3/de/d1e/fbf 0 2024-09-16T09:46:18.915 INFO:tasks.workunit.client.0.smithi111.stdout:9/633: rename d0/d6c/d70/d8c to d0/d21/d22/d6e/d51/d76/dc0/ddb 0 2024-09-16T09:46:18.917 INFO:tasks.workunit.client.0.smithi111.stdout:8/852: link d3/da/db/d59/dd7/c71 d3/de/d1e/d2e/d2f/c11d 0 2024-09-16T09:46:18.918 INFO:tasks.workunit.client.0.smithi111.stdout:9/634: rmdir d0/d6/d45/db0 39 2024-09-16T09:46:18.925 INFO:tasks.workunit.client.0.smithi111.stdout:5/876: dwrite f10 [4194304,4194304] 0 2024-09-16T09:46:18.925 INFO:tasks.workunit.client.0.smithi111.stdout:1/735: dwrite d3/d26/d63/f9b [0,4194304] 0 2024-09-16T09:46:18.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/877: mkdir d19/d1b/d27/d2e/d4a/d4b/d9c/d129 0 2024-09-16T09:46:18.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/878: readlink d19/d1b/d27/d83/d2a/dc4/dc0/db1/led 0 2024-09-16T09:46:18.928 INFO:tasks.workunit.client.0.smithi111.stdout:5/879: stat d19/d1b/d27/d83/d2a/dc4/dc0 0 2024-09-16T09:46:18.930 INFO:tasks.workunit.client.0.smithi111.stdout:8/853: write d3/de/d1e/d2e/f68 [436138,11380] 0 2024-09-16T09:46:18.933 INFO:tasks.workunit.client.0.smithi111.stdout:1/736: link d3/d10/d23/d8e/df0/f92 d3/d10/d23/d8e/ff2 0 2024-09-16T09:46:18.934 INFO:tasks.workunit.client.0.smithi111.stdout:5/880: getdents d19/d1b/d27/d2e/d4a/d4b/dac 0 2024-09-16T09:46:18.935 INFO:tasks.workunit.client.0.smithi111.stdout:5/881: creat d19/d1b/d1e/d41/f12a x:0 0 0 2024-09-16T09:46:18.937 INFO:tasks.workunit.client.0.smithi111.stdout:5/882: rmdir d19/d1b/d27/d83/d2a/dc4 39 2024-09-16T09:46:18.937 INFO:tasks.workunit.client.0.smithi111.stdout:8/854: write d3/da/db/fc8 [2145782,60312] 0 2024-09-16T09:46:18.938 INFO:tasks.workunit.client.0.smithi111.stdout:5/883: creat d19/d1b/d27/d2e/d4a/d4b/dd7/f12b x:0 0 0 2024-09-16T09:46:18.938 INFO:tasks.workunit.client.0.smithi111.stdout:5/884: read - d19/d1b/d27/d2e/d98/faa zero size 2024-09-16T09:46:18.938 INFO:tasks.workunit.client.0.smithi111.stdout:5/885: truncate d19/d1b/d27/d83/d2a/f69 1315348 0 2024-09-16T09:46:18.938 INFO:tasks.workunit.client.0.smithi111.stdout:5/886: read d19/d1b/d1e/d41/fb5 [32426,104748] 0 2024-09-16T09:46:18.939 INFO:tasks.workunit.client.0.smithi111.stdout:8/855: rename d3/dc3/fe0 to d3/da/db/f11e 0 2024-09-16T09:46:18.940 INFO:tasks.workunit.client.0.smithi111.stdout:5/887: creat d19/d1b/d1e/d21/d29/d32/d8f/f12c x:0 0 0 2024-09-16T09:46:18.949 INFO:tasks.workunit.client.0.smithi111.stdout:5/888: write d19/d1b/d27/d2e/d39/d54/fc5 [2276326,105591] 0 2024-09-16T09:46:18.952 INFO:tasks.workunit.client.0.smithi111.stdout:5/889: rename d19/d1b/d27/l11d to d19/d1b/d27/d83/l12d 0 2024-09-16T09:46:18.952 INFO:tasks.workunit.client.0.smithi111.stdout:5/890: fdatasync d19/d1b/d27/d2e/d4a/d4b/dac/fe0 0 2024-09-16T09:46:18.953 INFO:tasks.workunit.client.0.smithi111.stdout:2/937: sync 2024-09-16T09:46:18.954 INFO:tasks.workunit.client.0.smithi111.stdout:2/938: fsync d0/d2/d59/d86/d96/f101 0 2024-09-16T09:46:18.954 INFO:tasks.workunit.client.0.smithi111.stdout:2/939: readlink d0/d2/d44/le4 0 2024-09-16T09:46:18.963 INFO:tasks.workunit.client.0.smithi111.stdout:0/791: sync 2024-09-16T09:46:18.963 INFO:tasks.workunit.client.0.smithi111.stdout:7/646: sync 2024-09-16T09:46:18.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/647: unlink d1/d9/l12 0 2024-09-16T09:46:18.966 INFO:tasks.workunit.client.0.smithi111.stdout:7/648: creat d1/fdd x:0 0 0 2024-09-16T09:46:18.967 INFO:tasks.workunit.client.0.smithi111.stdout:5/891: dwrite d19/d1b/d27/d2e/d4a/d4b/dac/dd2/f111 [0,4194304] 0 2024-09-16T09:46:18.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/649: write d1/d3e/f70 [362053,85309] 0 2024-09-16T09:46:18.972 INFO:tasks.workunit.client.0.smithi111.stdout:7/650: readlink d1/d16/d17/d18/d1d/l25 0 2024-09-16T09:46:18.972 INFO:tasks.workunit.client.0.smithi111.stdout:5/892: rmdir d19/d1b/d27/d2e/d39/d54/d60 39 2024-09-16T09:46:18.972 INFO:tasks.workunit.client.0.smithi111.stdout:5/893: dread - d19/d1b/d27/d2e/d39/d54/f126 zero size 2024-09-16T09:46:18.972 INFO:tasks.workunit.client.0.smithi111.stdout:5/894: fdatasync d19/d1b/d27/d2e/f52 0 2024-09-16T09:46:18.972 INFO:tasks.workunit.client.0.smithi111.stdout:5/895: truncate d19/d1b/d27/d2e/d39/d6c/f7e 712128 0 2024-09-16T09:46:18.972 INFO:tasks.workunit.client.0.smithi111.stdout:8/856: getdents d3/de/d1e/d2e/d2f 0 2024-09-16T09:46:18.973 INFO:tasks.workunit.client.0.smithi111.stdout:7/651: mknod d1/d9/d53/cde 0 2024-09-16T09:46:18.973 INFO:tasks.workunit.client.0.smithi111.stdout:7/652: chown d1/d20/c65 712973068 1 2024-09-16T09:46:18.974 INFO:tasks.workunit.client.0.smithi111.stdout:7/653: fdatasync d1/f14 0 2024-09-16T09:46:18.978 INFO:tasks.workunit.client.0.smithi111.stdout:5/896: write d19/d1b/d27/d83/f26 [1532658,74897] 0 2024-09-16T09:46:18.979 INFO:tasks.workunit.client.0.smithi111.stdout:0/792: dwrite d0/d1d/f8f [0,4194304] 0 2024-09-16T09:46:18.979 INFO:tasks.workunit.client.0.smithi111.stdout:0/793: readlink d0/d1d/d58/d83/d9a/l108 0 2024-09-16T09:46:18.979 INFO:tasks.workunit.client.0.smithi111.stdout:0/794: chown d0/d1d/d58/d64/dd6/f107 131497012 1 2024-09-16T09:46:19.064 INFO:tasks.workunit.client.0.smithi111.stdout:8/857: rename d3/de/d1e/d2e/d2f/da8/dbe/f9d to d3/de/d1e/d2e/d2f/da8/f11f 0 2024-09-16T09:46:19.065 INFO:tasks.workunit.client.0.smithi111.stdout:7/654: getdents d1/d16/d17/d18/d1b/d79 0 2024-09-16T09:46:19.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/897: mkdir d19/d1b/d27/d2e/d4a/d4b/d12e 0 2024-09-16T09:46:19.069 INFO:tasks.workunit.client.0.smithi111.stdout:5/898: truncate d19/d1b/f97 1706994 0 2024-09-16T09:46:19.072 INFO:tasks.workunit.client.0.smithi111.stdout:0/795: mkdir d0/d120 0 2024-09-16T09:46:19.081 INFO:tasks.workunit.client.0.smithi111.stdout:7/655: symlink d1/dc7/ldf 0 2024-09-16T09:46:19.084 INFO:tasks.workunit.client.0.smithi111.stdout:8/858: dwrite d3/d26/d6d/db6/fc6 [0,4194304] 0 2024-09-16T09:46:19.084 INFO:tasks.workunit.client.0.smithi111.stdout:8/859: truncate d3/de/d1e/ffb 333522 0 2024-09-16T09:46:19.084 INFO:tasks.workunit.client.0.smithi111.stdout:5/899: rename d19/d1b/d27/d83/d2a/dc4/dc0/f117 to d19/d1b/d27/d2e/d4a/d4b/d12e/f12f 0 2024-09-16T09:46:19.086 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:19 smithi114 ceph-mon[35635]: Standby manager daemon smithi114.xvotey restarted 2024-09-16T09:46:19.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:19 smithi114 ceph-mon[35635]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:46:19.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:19 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:46:19.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:19 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:46:19.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:19 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:46:19.087 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:19 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:46:19.089 INFO:tasks.workunit.client.0.smithi111.stdout:7/656: getdents d1/d16/d17/d18/d1b/d79/daa 0 2024-09-16T09:46:19.098 INFO:tasks.workunit.client.0.smithi111.stdout:8/860: write d3/de/f14 [407681,14931] 0 2024-09-16T09:46:19.098 INFO:tasks.workunit.client.0.smithi111.stdout:8/861: dread - d3/d26/d6d/f70 zero size 2024-09-16T09:46:19.099 INFO:tasks.workunit.client.0.smithi111.stdout:0/796: rename d0/d1d/d67/d3a/d77/dad/f10c to d0/d1d/d67/d3a/d3d/f121 0 2024-09-16T09:46:19.100 INFO:tasks.workunit.client.0.smithi111.stdout:0/797: truncate d0/f42 4585636 0 2024-09-16T09:46:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:7/657: mkdir d1/d3e/d9e/de0 0 2024-09-16T09:46:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:6/697: sync 2024-09-16T09:46:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:4/760: sync 2024-09-16T09:46:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:4/761: chown d2/d6/dd/d1b/d38/d64/d65/f70 13 1 2024-09-16T09:46:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:4/762: dread - d2/d6/dd/d1b/d38/db0/d2f/d4e/f71 zero size 2024-09-16T09:46:19.102 INFO:tasks.workunit.client.0.smithi111.stdout:0/798: mkdir d0/d120/d122 0 2024-09-16T09:46:19.103 INFO:tasks.workunit.client.0.smithi111.stdout:0/799: getdents d0/d1d/d58/d64/d4f/d10f 0 2024-09-16T09:46:19.104 INFO:tasks.workunit.client.0.smithi111.stdout:6/698: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/ff5 x:0 0 0 2024-09-16T09:46:19.108 INFO:tasks.workunit.client.0.smithi111.stdout:8/862: dread d3/de/d1e/d2e/d74/d83/f93 [0,4194304] 0 2024-09-16T09:46:19.109 INFO:tasks.workunit.client.0.smithi111.stdout:0/800: getdents d0/d1d/d58/d64 0 2024-09-16T09:46:19.112 INFO:tasks.workunit.client.0.smithi111.stdout:0/801: unlink d0/d1d/d58/d83/d9a/ff0 0 2024-09-16T09:46:19.115 INFO:tasks.workunit.client.0.smithi111.stdout:0/802: creat d0/d1d/d58/d83/d9a/dd9/de9/f123 x:0 0 0 2024-09-16T09:46:19.116 INFO:tasks.workunit.client.0.smithi111.stdout:6/699: dread d0/d57/d72/f65 [0,4194304] 0 2024-09-16T09:46:19.117 INFO:tasks.workunit.client.0.smithi111.stdout:0/803: getdents d0/d1d/d58/d83 0 2024-09-16T09:46:19.121 INFO:tasks.workunit.client.0.smithi111.stdout:0/804: rename d0/d1d/d58/d64/d4f/d10f to d0/dfb/d124 0 2024-09-16T09:46:19.126 INFO:tasks.workunit.client.0.smithi111.stdout:0/805: creat d0/d1d/d58/d64/dd6/ddf/df3/f125 x:0 0 0 2024-09-16T09:46:19.135 INFO:tasks.workunit.client.0.smithi111.stdout:0/806: dread d0/d1d/d67/d3a/f8c [0,4194304] 0 2024-09-16T09:46:19.139 INFO:tasks.workunit.client.0.smithi111.stdout:4/763: dwrite d2/d6/dd/d1b/d38/d64/d65/f70 [0,4194304] 0 2024-09-16T09:46:19.139 INFO:tasks.workunit.client.0.smithi111.stdout:4/764: chown d2/d6/dd/d1b/f5d 103 1 2024-09-16T09:46:19.139 INFO:tasks.workunit.client.0.smithi111.stdout:6/700: dwrite d0/d57/db0/d14/d20/d42/f5c [0,4194304] 0 2024-09-16T09:46:19.140 INFO:tasks.workunit.client.0.smithi111.stdout:7/658: dwrite d1/d16/d17/d18/f90 [0,4194304] 0 2024-09-16T09:46:19.140 INFO:tasks.workunit.client.0.smithi111.stdout:7/659: stat d1/d20/fd4 0 2024-09-16T09:46:19.144 INFO:tasks.workunit.client.0.smithi111.stdout:0/807: dread d0/d26/f2a [0,4194304] 0 2024-09-16T09:46:19.144 INFO:tasks.workunit.client.0.smithi111.stdout:0/808: chown d0/d1d/d58/d64/d4f/ccb 14 1 2024-09-16T09:46:19.145 INFO:tasks.workunit.client.0.smithi111.stdout:8/863: truncate d3/de/f14 1119125 0 2024-09-16T09:46:19.145 INFO:tasks.workunit.client.0.smithi111.stdout:8/864: fdatasync d3/de/d1e/d2e/d2f/f63 0 2024-09-16T09:46:19.145 INFO:tasks.workunit.client.0.smithi111.stdout:8/865: chown d3/da/db/d59/dd7/l102 494 1 2024-09-16T09:46:19.145 INFO:tasks.workunit.client.0.smithi111.stdout:8/866: chown d3/da/ld 9 1 2024-09-16T09:46:19.146 INFO:tasks.workunit.client.0.smithi111.stdout:7/660: rename d1/d9/c9d to d1/d16/d17/d18/d4f/ce1 0 2024-09-16T09:46:19.147 INFO:tasks.workunit.client.0.smithi111.stdout:7/661: fdatasync d1/d20/fd4 0 2024-09-16T09:46:19.147 INFO:tasks.workunit.client.0.smithi111.stdout:8/867: stat d3/de/d1e/d2e/dce/cf1 0 2024-09-16T09:46:19.148 INFO:tasks.workunit.client.0.smithi111.stdout:7/662: mkdir d1/d3e/d9f/de2 0 2024-09-16T09:46:19.149 INFO:tasks.workunit.client.0.smithi111.stdout:4/765: read d2/d30/f61 [954419,110636] 0 2024-09-16T09:46:19.151 INFO:tasks.workunit.client.0.smithi111.stdout:8/868: rename d3/de/d1e/d2e/dce/d106 to d3/de/d1e/d2e/d74/d83/d120 0 2024-09-16T09:46:19.152 INFO:tasks.workunit.client.0.smithi111.stdout:7/663: mkdir d1/dc7/de3 0 2024-09-16T09:46:19.154 INFO:tasks.workunit.client.0.smithi111.stdout:8/869: mknod d3/da/db/c121 0 2024-09-16T09:46:19.156 INFO:tasks.workunit.client.0.smithi111.stdout:0/809: read d0/da4/ddd/fd3 [241007,38111] 0 2024-09-16T09:46:19.156 INFO:tasks.workunit.client.0.smithi111.stdout:0/810: chown d0/d1d/d58/d64/f88 300263504 1 2024-09-16T09:46:19.156 INFO:tasks.workunit.client.0.smithi111.stdout:6/701: dwrite d0/d57/db0/d47/d88/fc5 [0,4194304] 0 2024-09-16T09:46:19.158 INFO:tasks.workunit.client.0.smithi111.stdout:7/664: rename d1/d20/dc6 to d1/d16/db6/de4 0 2024-09-16T09:46:19.162 INFO:tasks.workunit.client.0.smithi111.stdout:0/811: rmdir d0/d26/d35/d86/de5 39 2024-09-16T09:46:19.169 INFO:tasks.workunit.client.0.smithi111.stdout:7/665: mknod d1/d16/d17/d18/d1d/d2f/ce5 0 2024-09-16T09:46:19.170 INFO:tasks.workunit.client.0.smithi111.stdout:0/812: mkdir d0/d26/d35/d126 0 2024-09-16T09:46:19.171 INFO:tasks.workunit.client.0.smithi111.stdout:7/666: mknod d1/d3e/d9f/de2/ce6 0 2024-09-16T09:46:19.171 INFO:tasks.workunit.client.0.smithi111.stdout:0/813: creat d0/d1d/d67/d3a/d77/dad/f127 x:0 0 0 2024-09-16T09:46:19.172 INFO:tasks.workunit.client.0.smithi111.stdout:7/667: mkdir d1/d9/d53/dc0/de7 0 2024-09-16T09:46:19.172 INFO:tasks.workunit.client.0.smithi111.stdout:7/668: getdents d1/d3e/d9e 0 2024-09-16T09:46:19.173 INFO:tasks.workunit.client.0.smithi111.stdout:7/669: link d1/d16/d17/d18/d1b/d79/c86 d1/d3e/d9f/ce8 0 2024-09-16T09:46:19.174 INFO:tasks.workunit.client.0.smithi111.stdout:7/670: creat d1/d16/d17/d18/d1b/d79/fe9 x:0 0 0 2024-09-16T09:46:19.174 INFO:tasks.workunit.client.0.smithi111.stdout:7/671: fdatasync d1/d16/d17/d18/d1b/d79/fe9 0 2024-09-16T09:46:19.174 INFO:tasks.workunit.client.0.smithi111.stdout:4/766: dwrite d2/f7d [4194304,4194304] 0 2024-09-16T09:46:19.175 INFO:tasks.workunit.client.0.smithi111.stdout:4/767: creat d2/d6/dd/d1b/d38/d64/ff8 x:0 0 0 2024-09-16T09:46:19.180 INFO:tasks.workunit.client.0.smithi111.stdout:0/814: write d0/d1d/d58/d83/d9a/dd9/f100 [3175870,129920] 0 2024-09-16T09:46:19.187 INFO:tasks.workunit.client.0.smithi111.stdout:7/672: dread d1/d16/d17/d18/d1b/d79/d8c/d98/fb7 [0,4194304] 0 2024-09-16T09:46:19.187 INFO:tasks.workunit.client.0.smithi111.stdout:8/870: dwrite d3/f8 [0,4194304] 0 2024-09-16T09:46:19.188 INFO:tasks.workunit.client.0.smithi111.stdout:6/702: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f7e [4194304,4194304] 0 2024-09-16T09:46:19.191 INFO:tasks.workunit.client.0.smithi111.stdout:8/871: rmdir d3/de/d1e/d2e/d2f/dbc 39 2024-09-16T09:46:19.192 INFO:tasks.workunit.client.0.smithi111.stdout:4/768: dwrite d2/d30/f6e [0,4194304] 0 2024-09-16T09:46:19.193 INFO:tasks.workunit.client.0.smithi111.stdout:0/815: dread d0/d1d/d67/d3a/fac [0,4194304] 0 2024-09-16T09:46:19.202 INFO:tasks.workunit.client.0.smithi111.stdout:6/703: creat d0/d57/db0/d47/d68/d6a/ff6 x:0 0 0 2024-09-16T09:46:19.203 INFO:tasks.workunit.client.0.smithi111.stdout:7/673: mknod d1/d3e/cea 0 2024-09-16T09:46:19.204 INFO:tasks.workunit.client.0.smithi111.stdout:8/872: mkdir d3/da/db/d59/de5/d122 0 2024-09-16T09:46:19.206 INFO:tasks.workunit.client.0.smithi111.stdout:4/769: dwrite d2/f17 [0,4194304] 0 2024-09-16T09:46:19.206 INFO:tasks.workunit.client.0.smithi111.stdout:4/770: truncate d2/d6/dd/d1b/d38/db0/d2f/f81 555627 0 2024-09-16T09:46:19.207 INFO:tasks.workunit.client.0.smithi111.stdout:0/816: rename d0/da4/fa2 to d0/d1d/d67/d3a/f128 0 2024-09-16T09:46:19.209 INFO:tasks.workunit.client.0.smithi111.stdout:6/704: unlink d0/d57/db0/l66 0 2024-09-16T09:46:19.209 INFO:tasks.workunit.client.0.smithi111.stdout:6/705: stat d0/d57/db0/d47/fa8 0 2024-09-16T09:46:19.209 INFO:tasks.workunit.client.0.smithi111.stdout:6/706: readlink d0/d57/d72/db2/lbc 0 2024-09-16T09:46:19.211 INFO:tasks.workunit.client.0.smithi111.stdout:7/674: truncate d1/d20/f7c 2422243 0 2024-09-16T09:46:19.212 INFO:tasks.workunit.client.0.smithi111.stdout:8/873: readlink d3/da/db/d59/dd7/d9e/dd8/l9f 0 2024-09-16T09:46:19.212 INFO:tasks.workunit.client.0.smithi111.stdout:8/874: write d3/de/d1e/d2e/d74/d83/fb4 [411200,17782] 0 2024-09-16T09:46:19.216 INFO:tasks.workunit.client.0.smithi111.stdout:4/771: mkdir d2/d6/dd/d1b/d38/d64/d92/dbf/df9 0 2024-09-16T09:46:19.217 INFO:tasks.workunit.client.0.smithi111.stdout:0/817: symlink d0/d1d/d58/d64/dd6/ddf/df3/l129 0 2024-09-16T09:46:19.218 INFO:tasks.workunit.client.0.smithi111.stdout:7/675: symlink d1/d16/d17/d18/leb 0 2024-09-16T09:46:19.220 INFO:tasks.workunit.client.0.smithi111.stdout:8/875: creat d3/da/db/d59/dd7/d9e/f123 x:0 0 0 2024-09-16T09:46:19.220 INFO:tasks.workunit.client.0.smithi111.stdout:8/876: fdatasync d3/de/d1e/d2e/d2f/f7c 0 2024-09-16T09:46:19.221 INFO:tasks.workunit.client.0.smithi111.stdout:4/772: stat d2/d6/dd/d1b/d6d/def/d69/cb1 0 2024-09-16T09:46:19.224 INFO:tasks.workunit.client.0.smithi111.stdout:3/923: sync 2024-09-16T09:46:19.227 INFO:tasks.workunit.client.0.smithi111.stdout:7/676: unlink d1/d16/d17/d18/d4f/f50 0 2024-09-16T09:46:19.228 INFO:tasks.workunit.client.0.smithi111.stdout:7/677: fsync d1/d16/d17/d18/d1b/d79/da5/db2/fbb 0 2024-09-16T09:46:19.231 INFO:tasks.workunit.client.0.smithi111.stdout:7/678: creat d1/d9/d53/fec x:0 0 0 2024-09-16T09:46:19.238 INFO:tasks.workunit.client.0.smithi111.stdout:0/818: dwrite d0/dfb/f11c [0,4194304] 0 2024-09-16T09:46:19.243 INFO:tasks.workunit.client.0.smithi111.stdout:0/819: creat d0/f12a x:0 0 0 2024-09-16T09:46:19.245 INFO:tasks.workunit.client.0.smithi111.stdout:0/820: unlink d0/d26/d35/d86/fcd 0 2024-09-16T09:46:19.245 INFO:tasks.workunit.client.0.smithi111.stdout:0/821: write d0/d1d/d58/d83/fdc [850535,57467] 0 2024-09-16T09:46:19.252 INFO:tasks.workunit.client.0.smithi111.stdout:7/679: write d1/d16/d17/d18/d1d/d2f/f7e [612236,51127] 0 2024-09-16T09:46:19.252 INFO:tasks.workunit.client.0.smithi111.stdout:8/877: write d3/de/d1e/d2e/d2f/f49 [287467,102749] 0 2024-09-16T09:46:19.253 INFO:tasks.workunit.client.0.smithi111.stdout:7/680: mknod d1/d16/d17/d18/d1d/ced 0 2024-09-16T09:46:19.254 INFO:tasks.workunit.client.0.smithi111.stdout:8/878: rename d3/de/d6e/d8f/fb2 to d3/de/d6e/d8f/f124 0 2024-09-16T09:46:19.254 INFO:tasks.workunit.client.0.smithi111.stdout:8/879: write d3/da/db/d59/de5/fef [2135260,62628] 0 2024-09-16T09:46:19.256 INFO:tasks.workunit.client.0.smithi111.stdout:4/773: dwrite d2/d6/f48 [0,4194304] 0 2024-09-16T09:46:19.256 INFO:tasks.workunit.client.0.smithi111.stdout:3/924: dwrite d5/da/db/d3a/d59/f61 [0,4194304] 0 2024-09-16T09:46:19.256 INFO:tasks.workunit.client.0.smithi111.stdout:3/925: truncate d5/da/db/fcb 187333 0 2024-09-16T09:46:19.256 INFO:tasks.workunit.client.0.smithi111.stdout:7/681: link d1/d16/d17/d18/d1b/l68 d1/d9/d53/dc0/de7/lee 0 2024-09-16T09:46:19.257 INFO:tasks.workunit.client.0.smithi111.stdout:8/880: creat d3/de/d6e/f125 x:0 0 0 2024-09-16T09:46:19.257 INFO:tasks.workunit.client.0.smithi111.stdout:8/881: write d3/d26/f55 [961480,110866] 0 2024-09-16T09:46:19.258 INFO:tasks.workunit.client.0.smithi111.stdout:8/882: fsync d3/da/db/d59/dd7/dcc/d100/f9b 0 2024-09-16T09:46:19.262 INFO:tasks.workunit.client.0.smithi111.stdout:4/774: truncate d2/d6/dd/d1b/d38/d64/f7f 3804086 0 2024-09-16T09:46:19.263 INFO:tasks.workunit.client.0.smithi111.stdout:0/822: dwrite d0/f12a [0,4194304] 0 2024-09-16T09:46:19.264 INFO:tasks.workunit.client.0.smithi111.stdout:7/682: dread d1/d9/f3c [0,4194304] 0 2024-09-16T09:46:19.264 INFO:tasks.workunit.client.0.smithi111.stdout:3/926: creat d5/da/db/d35/d45/da1/f136 x:0 0 0 2024-09-16T09:46:19.265 INFO:tasks.workunit.client.0.smithi111.stdout:8/883: mknod d3/da/db/d59/c126 0 2024-09-16T09:46:19.267 INFO:tasks.workunit.client.0.smithi111.stdout:4/775: rename d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/lbe to d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/lfa 0 2024-09-16T09:46:19.269 INFO:tasks.workunit.client.0.smithi111.stdout:3/927: unlink d5/da/d42/f115 0 2024-09-16T09:46:19.273 INFO:tasks.workunit.client.0.smithi111.stdout:4/776: rename d2/d6/dd/d1b/d38/db0/d2f/l79 to d2/d6/dd/d1b/d6d/d8f/lfb 0 2024-09-16T09:46:19.275 INFO:tasks.workunit.client.0.smithi111.stdout:4/777: creat d2/d6/dd/d1b/d38/d64/dd8/ffc x:0 0 0 2024-09-16T09:46:19.282 INFO:tasks.workunit.client.0.smithi111.stdout:7/683: dread d1/f14 [4194304,4194304] 0 2024-09-16T09:46:19.282 INFO:tasks.workunit.client.0.smithi111.stdout:7/684: chown d1/d9/d53/l6c 5883 1 2024-09-16T09:46:19.284 INFO:tasks.workunit.client.0.smithi111.stdout:7/685: truncate d1/d16/d17/d18/d1d/d2f/f71 2942407 0 2024-09-16T09:46:19.286 INFO:tasks.workunit.client.0.smithi111.stdout:7/686: rmdir d1/d3e/d9e/dac 39 2024-09-16T09:46:19.289 INFO:tasks.workunit.client.0.smithi111.stdout:7/687: creat d1/d16/d17/d18/d1b/d79/d8c/fef x:0 0 0 2024-09-16T09:46:19.290 INFO:tasks.workunit.client.0.smithi111.stdout:4/778: read d2/d6/dd/d1b/d38/db0/d2f/d9e/fdb [828500,22976] 0 2024-09-16T09:46:19.290 INFO:tasks.workunit.client.0.smithi111.stdout:8/884: dwrite d3/de/d1e/d2e/d2f/da8/dbe/fc7 [0,4194304] 0 2024-09-16T09:46:19.292 INFO:tasks.workunit.client.0.smithi111.stdout:7/688: mkdir d1/d3e/d9f/df0 0 2024-09-16T09:46:19.293 INFO:tasks.workunit.client.0.smithi111.stdout:4/779: creat d2/d6/dd/d1b/d38/d64/dd8/dec/ffd x:0 0 0 2024-09-16T09:46:19.294 INFO:tasks.workunit.client.0.smithi111.stdout:4/780: dread d2/d6/dd/d1b/d38/db0/d2f/d4e/f59 [0,4194304] 0 2024-09-16T09:46:19.298 INFO:tasks.workunit.client.0.smithi111.stdout:8/885: mknod d3/da/db/d59/dd7/d9e/dd8/c127 0 2024-09-16T09:46:19.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/886: rename d3/da/db/d59/dd7/dcc/d100/lf4 to d3/de/d1e/d2e/d2f/da8/l128 0 2024-09-16T09:46:19.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/887: fsync d3/dc3/f104 0 2024-09-16T09:46:19.301 INFO:tasks.workunit.client.0.smithi111.stdout:0/823: dwrite d0/d1d/d58/d83/fdc [0,4194304] 0 2024-09-16T09:46:19.302 INFO:tasks.workunit.client.0.smithi111.stdout:8/888: mkdir d3/de/d1e/d2e/d2f/dbc/d129 0 2024-09-16T09:46:19.302 INFO:tasks.workunit.client.0.smithi111.stdout:3/928: dwrite d5/da/db/d5a/f116 [0,4194304] 0 2024-09-16T09:46:19.304 INFO:tasks.workunit.client.0.smithi111.stdout:8/889: mkdir d3/de/d1e/d2e/d2f/dbc/d129/d12a 0 2024-09-16T09:46:19.304 INFO:tasks.workunit.client.0.smithi111.stdout:8/890: chown d3/de/d6e/d8f/f124 0 1 2024-09-16T09:46:19.304 INFO:tasks.workunit.client.0.smithi111.stdout:8/891: chown d3/d26/d6d/l11b 22 1 2024-09-16T09:46:19.306 INFO:tasks.workunit.client.0.smithi111.stdout:3/929: link d5/d18/d78/dfd/db6/fbd d5/d18/d78/dfd/da0/d10e/f137 0 2024-09-16T09:46:19.306 INFO:tasks.workunit.client.0.smithi111.stdout:3/930: write d5/da/f121 [734949,95166] 0 2024-09-16T09:46:19.306 INFO:tasks.workunit.client.0.smithi111.stdout:3/931: chown d5/da/db/d3a/d59/f61 61542958 1 2024-09-16T09:46:19.307 INFO:tasks.workunit.client.0.smithi111.stdout:4/781: dread d2/d6/dd/d1b/d38/db0/d2f/d4e/f74 [0,4194304] 0 2024-09-16T09:46:19.310 INFO:tasks.workunit.client.0.smithi111.stdout:4/782: creat d2/d6/dd/d1b/d38/d64/dd8/ffe x:0 0 0 2024-09-16T09:46:19.313 INFO:tasks.workunit.client.0.smithi111.stdout:4/783: symlink d2/d6/dd/d1b/d38/d64/lff 0 2024-09-16T09:46:19.314 INFO:tasks.workunit.client.0.smithi111.stdout:7/689: dwrite d1/d16/d17/d18/d1b/d79/d8c/d98/fb7 [0,4194304] 0 2024-09-16T09:46:19.316 INFO:tasks.workunit.client.0.smithi111.stdout:4/784: symlink d2/d6/dd/d1b/d6d/def/d96/l100 0 2024-09-16T09:46:19.319 INFO:tasks.workunit.client.0.smithi111.stdout:7/690: truncate d1/d16/d17/d18/d1d/f24 7687799 0 2024-09-16T09:46:19.319 INFO:tasks.workunit.client.0.smithi111.stdout:7/691: fdatasync d1/d9/fa 0 2024-09-16T09:46:19.320 INFO:tasks.workunit.client.0.smithi111.stdout:7/692: stat d1/d9/fc8 0 2024-09-16T09:46:19.320 INFO:tasks.workunit.client.0.smithi111.stdout:3/932: dread d5/da/d42/f6e [0,4194304] 0 2024-09-16T09:46:19.320 INFO:tasks.workunit.client.0.smithi111.stdout:0/824: dwrite d0/d1d/d67/d3a/d3d/d59/fc8 [0,4194304] 0 2024-09-16T09:46:19.323 INFO:tasks.workunit.client.0.smithi111.stdout:4/785: mknod d2/d6/dd/d1b/d38/d64/c101 0 2024-09-16T09:46:19.326 INFO:tasks.workunit.client.0.smithi111.stdout:7/693: link d1/d9/d53/l6e d1/d3e/d9e/lf1 0 2024-09-16T09:46:19.330 INFO:tasks.workunit.client.0.smithi111.stdout:3/933: rmdir d5/da/db/d3a/d6d/de7/d75 39 2024-09-16T09:46:19.333 INFO:tasks.workunit.client.0.smithi111.stdout:0/825: dread d0/d1d/d58/d64/f109 [0,4194304] 0 2024-09-16T09:46:19.333 INFO:tasks.workunit.client.0.smithi111.stdout:0/826: dread - d0/d1d/d58/ff2 zero size 2024-09-16T09:46:19.333 INFO:tasks.workunit.client.0.smithi111.stdout:0/827: getdents d0/d1d/d58/d83 0 2024-09-16T09:46:19.346 INFO:tasks.workunit.client.0.smithi111.stdout:4/786: symlink d2/d6/dd/d1b/d6d/def/d96/dd5/l102 0 2024-09-16T09:46:19.346 INFO:tasks.workunit.client.0.smithi111.stdout:4/787: write d2/d6/dd/d1b/d38/db0/f73 [208753,75261] 0 2024-09-16T09:46:19.348 INFO:tasks.workunit.client.0.smithi111.stdout:7/694: creat d1/d3e/ff2 x:0 0 0 2024-09-16T09:46:19.351 INFO:tasks.workunit.client.0.smithi111.stdout:3/934: symlink d5/da/db/d3a/d6d/d125/l138 0 2024-09-16T09:46:19.351 INFO:tasks.workunit.client.0.smithi111.stdout:3/935: truncate d5/da/db/d5a/df8/f11a 357546 0 2024-09-16T09:46:19.352 INFO:tasks.workunit.client.0.smithi111.stdout:0/828: mkdir d0/d1d/d12b 0 2024-09-16T09:46:19.352 INFO:tasks.workunit.client.0.smithi111.stdout:0/829: fdatasync d0/d1d/d67/d3a/d77/f84 0 2024-09-16T09:46:19.354 INFO:tasks.workunit.client.0.smithi111.stdout:4/788: symlink d2/d6/dd/d1b/d38/d64/dd8/dec/l103 0 2024-09-16T09:46:19.354 INFO:tasks.workunit.client.0.smithi111.stdout:4/789: write d2/d6/dd/d1b/d38/d64/dd8/ffc [337815,67226] 0 2024-09-16T09:46:19.356 INFO:tasks.workunit.client.0.smithi111.stdout:4/790: dread d2/d6/dd/d1b/d38/db0/d2f/d6c/f87 [0,4194304] 0 2024-09-16T09:46:19.357 INFO:tasks.workunit.client.0.smithi111.stdout:7/695: dread d1/d3e/f70 [0,4194304] 0 2024-09-16T09:46:19.358 INFO:tasks.workunit.client.0.smithi111.stdout:3/936: rename d5/d18/d78/dfd/da0/dd9 to d5/da/db/d5a/df8/d11f/d139 0 2024-09-16T09:46:19.358 INFO:tasks.workunit.client.0.smithi111.stdout:3/937: write d5/da/db/d3a/d6d/dd1/d10c/f108 [667631,74035] 0 2024-09-16T09:46:19.359 INFO:tasks.workunit.client.0.smithi111.stdout:0/830: creat d0/d1d/d58/d83/d111/f12c x:0 0 0 2024-09-16T09:46:19.362 INFO:tasks.workunit.client.0.smithi111.stdout:7/696: mknod d1/d16/db6/cf3 0 2024-09-16T09:46:19.362 INFO:tasks.workunit.client.0.smithi111.stdout:9/635: sync 2024-09-16T09:46:19.362 INFO:tasks.workunit.client.0.smithi111.stdout:1/737: sync 2024-09-16T09:46:19.362 INFO:tasks.workunit.client.0.smithi111.stdout:9/636: chown d0/d6/d30/d81/fa8 2554064 1 2024-09-16T09:46:19.363 INFO:tasks.workunit.client.0.smithi111.stdout:3/938: truncate d5/da/db/d5a/f116 847508 0 2024-09-16T09:46:19.367 INFO:tasks.workunit.client.0.smithi111.stdout:0/831: creat d0/d26/d35/d86/de5/d116/f12d x:0 0 0 2024-09-16T09:46:19.368 INFO:tasks.workunit.client.0.smithi111.stdout:9/637: creat d0/d21/d22/d6e/d51/d76/dc0/fdc x:0 0 0 2024-09-16T09:46:19.368 INFO:tasks.workunit.client.0.smithi111.stdout:9/638: readlink d0/d6/d45/l6d 0 2024-09-16T09:46:19.373 INFO:tasks.workunit.client.0.smithi111.stdout:0/832: link d0/d1d/d67/d3a/f128 d0/d1d/d67/d3a/d80/f12e 0 2024-09-16T09:46:19.373 INFO:tasks.workunit.client.0.smithi111.stdout:0/833: chown d0/d1d/d67/d3a/d77/f84 594552 1 2024-09-16T09:46:19.373 INFO:tasks.workunit.client.0.smithi111.stdout:9/639: creat d0/d6/d45/db0/fdd x:0 0 0 2024-09-16T09:46:19.375 INFO:tasks.workunit.client.0.smithi111.stdout:0/834: symlink d0/d1d/d67/d3a/d92/l12f 0 2024-09-16T09:46:19.376 INFO:tasks.workunit.client.0.smithi111.stdout:9/640: creat d0/d6/d8/de/d56/fde x:0 0 0 2024-09-16T09:46:19.376 INFO:tasks.workunit.client.0.smithi111.stdout:9/641: dread - d0/d6/d30/d47/f52 zero size 2024-09-16T09:46:19.377 INFO:tasks.workunit.client.0.smithi111.stdout:7/697: write d1/d16/d17/d18/d1d/d2f/f77 [840991,117402] 0 2024-09-16T09:46:19.377 INFO:tasks.workunit.client.0.smithi111.stdout:7/698: fsync d1/d16/d17/d18/d1d/d2f/f71 0 2024-09-16T09:46:19.377 INFO:tasks.workunit.client.0.smithi111.stdout:0/835: symlink d0/d1d/d58/d64/dd6/l130 0 2024-09-16T09:46:19.378 INFO:tasks.workunit.client.0.smithi111.stdout:9/642: rename d0/f3f to d0/d7b/dac/fdf 0 2024-09-16T09:46:19.380 INFO:tasks.workunit.client.0.smithi111.stdout:0/836: link d0/d1d/d58/d64/faf d0/d1d/d67/d3a/d77/dad/f131 0 2024-09-16T09:46:19.380 INFO:tasks.workunit.client.0.smithi111.stdout:0/837: write d0/f17 [7222257,86888] 0 2024-09-16T09:46:19.381 INFO:tasks.workunit.client.0.smithi111.stdout:7/699: rename d1/d16/f29 to d1/d9/d53/dc0/ff4 0 2024-09-16T09:46:19.381 INFO:tasks.workunit.client.0.smithi111.stdout:7/700: write d1/d16/d17/d18/d4f/d56/fa1 [551041,18270] 0 2024-09-16T09:46:19.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:19 smithi111 ceph-mon[27997]: Standby manager daemon smithi114.xvotey restarted 2024-09-16T09:46:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:19 smithi111 ceph-mon[27997]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:46:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:19 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:46:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:19 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:46:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:19 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:46:19.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:19 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:46:19.382 INFO:tasks.workunit.client.0.smithi111.stdout:9/643: unlink d0/f2a 0 2024-09-16T09:46:19.384 INFO:tasks.workunit.client.0.smithi111.stdout:4/791: dwrite d2/f7d [4194304,4194304] 0 2024-09-16T09:46:19.384 INFO:tasks.workunit.client.0.smithi111.stdout:7/701: rename d1/d16/d17/d18/d1b/d79/daa to d1/d16/d17/d18/d4f/df5 0 2024-09-16T09:46:19.384 INFO:tasks.workunit.client.0.smithi111.stdout:1/738: dwrite d3/d10/f96 [0,4194304] 0 2024-09-16T09:46:19.385 INFO:tasks.workunit.client.0.smithi111.stdout:4/792: mkdir d2/d6/dd/d1b/d38/d64/d92/d104 0 2024-09-16T09:46:19.387 INFO:tasks.workunit.client.0.smithi111.stdout:7/702: symlink d1/d16/d17/d18/d1d/d2f/lf6 0 2024-09-16T09:46:19.390 INFO:tasks.workunit.client.0.smithi111.stdout:9/644: write d0/d6/d8/de/d56/f5e [3545719,71375] 0 2024-09-16T09:46:19.390 INFO:tasks.workunit.client.0.smithi111.stdout:1/739: mkdir d3/d10/d57/dcc/df3 0 2024-09-16T09:46:19.392 INFO:tasks.workunit.client.0.smithi111.stdout:4/793: unlink d2/d6/dd/d1b/d38/db0/d2f/d6c/f87 0 2024-09-16T09:46:19.392 INFO:tasks.workunit.client.0.smithi111.stdout:4/794: stat d2/d6/dd/d1b/d6d/def/d69/la5 0 2024-09-16T09:46:19.392 INFO:tasks.workunit.client.0.smithi111.stdout:4/795: getdents d2/d6/dd/d1b/d38/d64/d92/dbf/df9 0 2024-09-16T09:46:19.394 INFO:tasks.workunit.client.0.smithi111.stdout:7/703: rename d1/d16/d17/c1e to d1/d9/d43/d82/cf7 0 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/645: truncate d0/d21/d22/d6e/d51/d76/f5c 3313543 0 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/646: write d0/d6c/fd5 [379136,121806] 0 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/647: fdatasync d0/d21/d22/fa6 0 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/648: write d0/d21/d22/d6e/d51/d76/dc0/fc6 [685620,112707] 0 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/649: chown d0/d21/d22/d6e 3579065 1 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/650: fdatasync d0/d6/d8/f1c 0 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/651: chown d0/d7b/dac 46657 1 2024-09-16T09:46:19.396 INFO:tasks.workunit.client.0.smithi111.stdout:9/652: stat d0/d6/d8/de/l57 0 2024-09-16T09:46:19.397 INFO:tasks.workunit.client.0.smithi111.stdout:1/740: mkdir d3/d24/df4 0 2024-09-16T09:46:19.398 INFO:tasks.workunit.client.0.smithi111.stdout:4/796: mknod d2/d6/dd/d1b/d38/d64/dd8/c105 0 2024-09-16T09:46:19.399 INFO:tasks.workunit.client.0.smithi111.stdout:0/838: dwrite d0/d1d/d58/d64/d4f/f7f [0,4194304] 0 2024-09-16T09:46:19.399 INFO:tasks.workunit.client.0.smithi111.stdout:7/704: truncate d1/d59/fd1 3180926 0 2024-09-16T09:46:19.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/741: creat d3/d26/d63/d84/ff5 x:0 0 0 2024-09-16T09:46:19.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/742: truncate d3/d10/d72/da1/d28/d36/d3d/d47/daf/dbc/fc7 177944 0 2024-09-16T09:46:19.403 INFO:tasks.workunit.client.0.smithi111.stdout:0/839: dread d0/d26/d35/d86/fd5 [0,4194304] 0 2024-09-16T09:46:19.408 INFO:tasks.workunit.client.0.smithi111.stdout:1/743: rename d3/d10/d72/da1/d28/d36/d3d to d3/d10/d23/df6 0 2024-09-16T09:46:19.408 INFO:tasks.workunit.client.0.smithi111.stdout:1/744: chown d3/d26/d63/lb0 0 1 2024-09-16T09:46:19.412 INFO:tasks.workunit.client.0.smithi111.stdout:0/840: truncate d0/d1d/d67/f41 697115 0 2024-09-16T09:46:19.413 INFO:tasks.workunit.client.0.smithi111.stdout:4/797: write d2/d6/fe [610267,34409] 0 2024-09-16T09:46:19.415 INFO:tasks.workunit.client.0.smithi111.stdout:0/841: creat d0/d26/d35/d86/f132 x:0 0 0 2024-09-16T09:46:19.417 INFO:tasks.workunit.client.0.smithi111.stdout:0/842: mkdir d0/d1d/d58/d83/d133 0 2024-09-16T09:46:19.420 INFO:tasks.workunit.client.0.smithi111.stdout:1/745: write d3/d10/d23/df6/d47/d65/d74/f80 [1202351,4241] 0 2024-09-16T09:46:19.420 INFO:tasks.workunit.client.0.smithi111.stdout:0/843: symlink d0/d1d/d67/d3a/d80/dee/d115/l134 0 2024-09-16T09:46:19.424 INFO:tasks.workunit.client.0.smithi111.stdout:9/653: dwrite d0/d6/d8/de/f2f [0,4194304] 0 2024-09-16T09:46:19.424 INFO:tasks.workunit.client.0.smithi111.stdout:9/654: read d0/d6/d8/f26 [2732597,43617] 0 2024-09-16T09:46:19.425 INFO:tasks.workunit.client.0.smithi111.stdout:1/746: mkdir d3/d10/d23/df6/d47/d65/df7 0 2024-09-16T09:46:19.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/798: read d2/d6/dd/d1b/d38/f4f [3939669,2604] 0 2024-09-16T09:46:19.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/705: dwrite d1/d16/d17/d18/f21 [0,4194304] 0 2024-09-16T09:46:19.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/706: chown d1/d9/d43/f67 125382 1 2024-09-16T09:46:19.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/707: write d1/f14 [6403553,64674] 0 2024-09-16T09:46:19.427 INFO:tasks.workunit.client.0.smithi111.stdout:7/708: rename d1/d16/d17/d18/d4f to d1/d16/d17/d18/d4f/d56/df8 22 2024-09-16T09:46:19.427 INFO:tasks.workunit.client.0.smithi111.stdout:0/844: creat d0/d1d/d58/d64/dd6/ddf/f135 x:0 0 0 2024-09-16T09:46:19.430 INFO:tasks.workunit.client.0.smithi111.stdout:3/939: dwrite d5/da/db/fcb [0,4194304] 0 2024-09-16T09:46:19.434 INFO:tasks.workunit.client.0.smithi111.stdout:9/655: mkdir d0/d21/d22/d6e/d51/d76/de0 0 2024-09-16T09:46:19.435 INFO:tasks.workunit.client.0.smithi111.stdout:1/747: link d3/d10/d23/df6/c41 d3/d10/d23/df6/cf8 0 2024-09-16T09:46:19.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/845: mknod d0/d1d/d12b/c136 0 2024-09-16T09:46:19.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/846: chown d0/d1d/d58/c95 56296 1 2024-09-16T09:46:19.445 INFO:tasks.workunit.client.0.smithi111.stdout:7/709: symlink d1/d3e/lf9 0 2024-09-16T09:46:19.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/847: mkdir d0/d1d/d67/d3a/d77/dad/d106/d137 0 2024-09-16T09:46:19.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/848: chown d0/d1d/d67/d3a/d77/f84 3 1 2024-09-16T09:46:19.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/849: dread - d0/dc1/fc6 zero size 2024-09-16T09:46:19.447 INFO:tasks.workunit.client.0.smithi111.stdout:7/710: mkdir d1/d20/da3/dfa 0 2024-09-16T09:46:19.448 INFO:tasks.workunit.client.0.smithi111.stdout:0/850: rmdir d0/d26/d35/d86/de5/d116 39 2024-09-16T09:46:19.448 INFO:tasks.workunit.client.0.smithi111.stdout:0/851: stat d0/da4/ddd/fb5 0 2024-09-16T09:46:19.451 INFO:tasks.workunit.client.0.smithi111.stdout:0/852: creat d0/d26/d35/d126/f138 x:0 0 0 2024-09-16T09:46:19.464 INFO:tasks.workunit.client.0.smithi111.stdout:7/711: dread d1/d9/f15 [0,4194304] 0 2024-09-16T09:46:19.464 INFO:tasks.workunit.client.0.smithi111.stdout:7/712: chown d1/d20 1062745947 1 2024-09-16T09:46:19.465 INFO:tasks.workunit.client.0.smithi111.stdout:7/713: readlink d1/d9/d43/l55 0 2024-09-16T09:46:19.465 INFO:tasks.workunit.client.0.smithi111.stdout:7/714: link d1/d16/d17/d18/d4f/df5/l4e d1/d16/lfb 0 2024-09-16T09:46:19.469 INFO:tasks.workunit.client.0.smithi111.stdout:7/715: dread d1/d16/d17/d18/f8b [0,4194304] 0 2024-09-16T09:46:19.470 INFO:tasks.workunit.client.0.smithi111.stdout:7/716: mkdir d1/d20/da3/dfa/dfc 0 2024-09-16T09:46:19.470 INFO:tasks.workunit.client.0.smithi111.stdout:7/717: mknod d1/d16/d17/d18/d1d/d2f/cfd 0 2024-09-16T09:46:19.471 INFO:tasks.workunit.client.0.smithi111.stdout:7/718: stat d1/d16/d17/d18/f6f 0 2024-09-16T09:46:19.473 INFO:tasks.workunit.client.0.smithi111.stdout:7/719: dread d1/d16/d17/d18/d4f/f97 [0,4194304] 0 2024-09-16T09:46:19.478 INFO:tasks.workunit.client.0.smithi111.stdout:3/940: dwrite d5/d18/d78/dab/fc3 [0,4194304] 0 2024-09-16T09:46:19.478 INFO:tasks.workunit.client.0.smithi111.stdout:1/748: dwrite d3/d24/d29/f37 [4194304,4194304] 0 2024-09-16T09:46:19.478 INFO:tasks.workunit.client.0.smithi111.stdout:9/656: dwrite d0/d6/f44 [0,4194304] 0 2024-09-16T09:46:19.479 INFO:tasks.workunit.client.0.smithi111.stdout:0/853: dwrite d0/d1d/d67/d3a/d3d/ff6 [0,4194304] 0 2024-09-16T09:46:19.484 INFO:tasks.workunit.client.0.smithi111.stdout:9/657: creat d0/d21/d22/d6e/dab/fe1 x:0 0 0 2024-09-16T09:46:19.485 INFO:tasks.workunit.client.0.smithi111.stdout:9/658: chown d0/d21/d22/d6e/d7d/cc4 138 1 2024-09-16T09:46:19.487 INFO:tasks.workunit.client.0.smithi111.stdout:0/854: creat d0/d1d/d67/d3a/d80/f139 x:0 0 0 2024-09-16T09:46:19.488 INFO:tasks.workunit.client.0.smithi111.stdout:9/659: write d0/d6c/d70/fa4 [955076,29921] 0 2024-09-16T09:46:19.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/660: unlink d0/d21/d22/d6e/d51/d76/f98 0 2024-09-16T09:46:19.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/661: fsync d0/d21/d22/d6e/d51/d76/dc0/fdc 0 2024-09-16T09:46:19.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/662: fdatasync d0/d6/d8/de/d56/f5e 0 2024-09-16T09:46:19.491 INFO:tasks.workunit.client.0.smithi111.stdout:9/663: rmdir d0/d48 39 2024-09-16T09:46:19.492 INFO:tasks.workunit.client.0.smithi111.stdout:9/664: truncate d0/d6/d30/f39 7228387 0 2024-09-16T09:46:19.492 INFO:tasks.workunit.client.0.smithi111.stdout:3/941: write d5/da/db/d35/f5c [363201,130457] 0 2024-09-16T09:46:19.494 INFO:tasks.workunit.client.0.smithi111.stdout:9/665: link d0/d6/c37 d0/d7b/ce2 0 2024-09-16T09:46:19.495 INFO:tasks.workunit.client.0.smithi111.stdout:3/942: symlink d5/da/db/de/ddb/dcd/l13a 0 2024-09-16T09:46:19.496 INFO:tasks.workunit.client.0.smithi111.stdout:9/666: mknod d0/d6/d45/db0/dcb/dda/ce3 0 2024-09-16T09:46:19.497 INFO:tasks.workunit.client.0.smithi111.stdout:9/667: write d0/d6c/d70/fa4 [437830,110384] 0 2024-09-16T09:46:19.498 INFO:tasks.workunit.client.0.smithi111.stdout:3/943: rmdir d5/d18/d78 39 2024-09-16T09:46:19.501 INFO:tasks.workunit.client.0.smithi111.stdout:3/944: truncate d5/da/db/d3a/d6d/de7/f83 528213 0 2024-09-16T09:46:19.506 INFO:tasks.workunit.client.0.smithi111.stdout:7/720: dwrite d1/d9/d43/f7a [0,4194304] 0 2024-09-16T09:46:19.509 INFO:tasks.workunit.client.0.smithi111.stdout:1/749: dwrite d3/d10/d23/df6/d47/daf/dbc/fc7 [0,4194304] 0 2024-09-16T09:46:19.510 INFO:tasks.workunit.client.0.smithi111.stdout:0/855: dwrite d0/d1d/d67/d3a/d3d/f71 [0,4194304] 0 2024-09-16T09:46:19.512 INFO:tasks.workunit.client.0.smithi111.stdout:7/721: truncate d1/d9/f3c 5200647 0 2024-09-16T09:46:19.513 INFO:tasks.workunit.client.0.smithi111.stdout:9/668: truncate d0/d21/d22/d6e/d51/d76/f5c 3619125 0 2024-09-16T09:46:19.516 INFO:tasks.workunit.client.0.smithi111.stdout:1/750: rmdir d3/d10/d23/df6/d47/d5a 39 2024-09-16T09:46:19.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/669: dread d0/d6/f3c [0,4194304] 0 2024-09-16T09:46:19.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/670: dread - d0/d21/d22/d6e/d51/d76/dc0/fc2 zero size 2024-09-16T09:46:19.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/671: write d0/d6/f3c [1002736,8969] 0 2024-09-16T09:46:19.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/672: read - d0/d21/d22/d6e/dab/fd8 zero size 2024-09-16T09:46:19.519 INFO:tasks.workunit.client.0.smithi111.stdout:9/673: dread - d0/d6/d8/de/d56/fd9 zero size 2024-09-16T09:46:19.523 INFO:tasks.workunit.client.0.smithi111.stdout:0/856: write d0/d1d/f8f [1467939,122401] 0 2024-09-16T09:46:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:9/674: link d0/d6/d8/de/d56/d4e/dc5/fd2 d0/d48/fe4 0 2024-09-16T09:46:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:9/675: truncate d0/d48/fa1 1442509 0 2024-09-16T09:46:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:9/676: readlink d0/d21/d22/d6e/d51/l6a 0 2024-09-16T09:46:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:9/677: fdatasync d0/d21/d22/d6e/d51/d76/f5c 0 2024-09-16T09:46:19.524 INFO:tasks.workunit.client.0.smithi111.stdout:9/678: truncate d0/d7b/fa5 98536 0 2024-09-16T09:46:19.525 INFO:tasks.workunit.client.0.smithi111.stdout:5/900: sync 2024-09-16T09:46:19.526 INFO:tasks.workunit.client.0.smithi111.stdout:2/940: sync 2024-09-16T09:46:19.526 INFO:tasks.workunit.client.0.smithi111.stdout:5/901: fdatasync d19/d1b/d27/f3b 0 2024-09-16T09:46:19.526 INFO:tasks.workunit.client.0.smithi111.stdout:2/941: fsync d0/d45/d5c/d67/f12b 0 2024-09-16T09:46:19.526 INFO:tasks.workunit.client.0.smithi111.stdout:7/722: write d1/d16/d17/d18/d4f/df5/f45 [882317,75209] 0 2024-09-16T09:46:19.526 INFO:tasks.workunit.client.0.smithi111.stdout:7/723: chown d1/d20/f7c 1679560 1 2024-09-16T09:46:19.529 INFO:tasks.workunit.client.0.smithi111.stdout:9/679: stat d0/d6/d30/c3b 0 2024-09-16T09:46:19.533 INFO:tasks.workunit.client.0.smithi111.stdout:3/945: dwrite d5/da/d92/fb9 [0,4194304] 0 2024-09-16T09:46:19.536 INFO:tasks.workunit.client.0.smithi111.stdout:7/724: write d1/d16/d17/d18/d4f/d88/fad [3304256,25530] 0 2024-09-16T09:46:19.539 INFO:tasks.workunit.client.0.smithi111.stdout:2/942: creat d0/d45/d5c/d67/d63/dd4/dc3/d131/f146 x:0 0 0 2024-09-16T09:46:19.539 INFO:tasks.workunit.client.0.smithi111.stdout:2/943: stat d0/d2/d59/d86/d96/dd1 0 2024-09-16T09:46:19.542 INFO:tasks.workunit.client.0.smithi111.stdout:9/680: rmdir d0/d6/d45/db0/dcb/dda 39 2024-09-16T09:46:19.548 INFO:tasks.workunit.client.0.smithi111.stdout:0/857: truncate d0/d1d/f8f 608679 0 2024-09-16T09:46:19.548 INFO:tasks.workunit.client.0.smithi111.stdout:0/858: write d0/d26/d35/d86/fd5 [1510386,103421] 0 2024-09-16T09:46:19.550 INFO:tasks.workunit.client.0.smithi111.stdout:7/725: rename d1/d16/c5b to d1/d20/da3/dfa/dfc/cfe 0 2024-09-16T09:46:19.550 INFO:tasks.workunit.client.0.smithi111.stdout:7/726: write d1/d16/d17/d18/d4f/d56/f5a [4981660,18019] 0 2024-09-16T09:46:19.552 INFO:tasks.workunit.client.0.smithi111.stdout:9/681: write d0/d6/d8/f72 [3083299,80744] 0 2024-09-16T09:46:19.553 INFO:tasks.workunit.client.0.smithi111.stdout:2/944: creat d0/d22/d98/d114/d9f/f147 x:0 0 0 2024-09-16T09:46:19.558 INFO:tasks.workunit.client.0.smithi111.stdout:3/946: dwrite d5/da/db/d5a/fc7 [0,4194304] 0 2024-09-16T09:46:19.558 INFO:tasks.workunit.client.0.smithi111.stdout:3/947: readlink d5/da/d42/d74/le4 0 2024-09-16T09:46:19.558 INFO:tasks.workunit.client.0.smithi111.stdout:3/948: write d5/da/db/d35/f5c [52323,35257] 0 2024-09-16T09:46:19.561 INFO:tasks.workunit.client.0.smithi111.stdout:0/859: symlink d0/d1d/d67/l13a 0 2024-09-16T09:46:19.561 INFO:tasks.workunit.client.0.smithi111.stdout:0/860: write d0/d1d/d67/d3a/d3d/d59/f94 [174221,30833] 0 2024-09-16T09:46:19.567 INFO:tasks.workunit.client.0.smithi111.stdout:5/902: dwrite d19/d1b/d1e/f50 [0,4194304] 0 2024-09-16T09:46:19.570 INFO:tasks.workunit.client.0.smithi111.stdout:7/727: rename d1/dc7/ldf to d1/d20/da3/lff 0 2024-09-16T09:46:19.571 INFO:tasks.workunit.client.0.smithi111.stdout:9/682: creat d0/d21/d22/d6e/d7d/d9a/fe5 x:0 0 0 2024-09-16T09:46:19.572 INFO:tasks.workunit.client.0.smithi111.stdout:7/728: dread d1/d16/d17/d18/d4f/df5/f83 [0,4194304] 0 2024-09-16T09:46:19.572 INFO:tasks.workunit.client.0.smithi111.stdout:7/729: write d1/d16/d17/d18/d4f/f97 [781486,28769] 0 2024-09-16T09:46:19.576 INFO:tasks.workunit.client.0.smithi111.stdout:2/945: truncate d0/d45/d5c/d67/f8c 1765702 0 2024-09-16T09:46:19.577 INFO:tasks.workunit.client.0.smithi111.stdout:2/946: write d0/d22/dac/df0/f10b [50158,100266] 0 2024-09-16T09:46:19.584 INFO:tasks.workunit.client.0.smithi111.stdout:0/861: creat d0/d1d/d58/f13b x:0 0 0 2024-09-16T09:46:19.589 INFO:tasks.workunit.client.0.smithi111.stdout:9/683: link d0/d6/d30/f39 d0/d6/d8/de/d56/d8e/dcf/fe6 0 2024-09-16T09:46:19.591 INFO:tasks.workunit.client.0.smithi111.stdout:5/903: dwrite d19/d1b/d27/d83/f3f [4194304,4194304] 0 2024-09-16T09:46:19.591 INFO:tasks.workunit.client.0.smithi111.stdout:5/904: fdatasync d19/f95 0 2024-09-16T09:46:19.591 INFO:tasks.workunit.client.0.smithi111.stdout:0/862: creat d0/d1d/d58/d64/d4f/f13c x:0 0 0 2024-09-16T09:46:19.593 INFO:tasks.workunit.client.0.smithi111.stdout:9/684: symlink d0/d6/d8/de/d56/d4e/le7 0 2024-09-16T09:46:19.595 INFO:tasks.workunit.client.0.smithi111.stdout:5/905: symlink d19/d1b/d27/d2e/d39/dc6/l130 0 2024-09-16T09:46:19.595 INFO:tasks.workunit.client.0.smithi111.stdout:0/863: mknod d0/d1d/d58/d83/d9a/c13d 0 2024-09-16T09:46:19.596 INFO:tasks.workunit.client.0.smithi111.stdout:0/864: write d0/da4/f4c [1117593,78571] 0 2024-09-16T09:46:19.596 INFO:tasks.workunit.client.0.smithi111.stdout:0/865: dread - d0/d1d/d58/d83/d111/f12c zero size 2024-09-16T09:46:19.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/906: creat d19/d1b/d27/d9d/f131 x:0 0 0 2024-09-16T09:46:19.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/907: chown d19/d1b/d1e/le4 143 1 2024-09-16T09:46:19.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/908: chown d19/d1b/d27/d2e/d39/d54/f126 0 1 2024-09-16T09:46:19.597 INFO:tasks.workunit.client.0.smithi111.stdout:5/909: chown d19/f48 864 1 2024-09-16T09:46:19.598 INFO:tasks.workunit.client.0.smithi111.stdout:5/910: creat d19/d1b/d27/d2e/d39/d54/d60/f132 x:0 0 0 2024-09-16T09:46:19.598 INFO:tasks.workunit.client.0.smithi111.stdout:5/911: write d19/d1b/d27/d2e/f42 [3254624,6519] 0 2024-09-16T09:46:19.598 INFO:tasks.workunit.client.0.smithi111.stdout:5/912: chown d19/d1b/d27/d2e/d39/d54 0 1 2024-09-16T09:46:19.598 INFO:tasks.workunit.client.0.smithi111.stdout:5/913: write d19/d1b/d1e/d81/fcb [132619,115203] 0 2024-09-16T09:46:19.598 INFO:tasks.workunit.client.0.smithi111.stdout:5/914: write d19/d1b/d1e/fd0 [985107,117547] 0 2024-09-16T09:46:19.599 INFO:tasks.workunit.client.0.smithi111.stdout:0/866: mkdir d0/d1d/d58/d64/d4f/d13e 0 2024-09-16T09:46:19.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/915: unlink d19/d1b/d27/d2e/d4a/d4b/d9c/cae 0 2024-09-16T09:46:19.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/916: write d19/d1b/d27/d2e/d4a/f8c [33694,75046] 0 2024-09-16T09:46:19.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/917: readlink d19/d1b/d27/d2e/d98/lb2 0 2024-09-16T09:46:19.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/867: getdents d0/dfb 0 2024-09-16T09:46:19.601 INFO:tasks.workunit.client.0.smithi111.stdout:0/868: write d0/d26/d35/d86/de5/d116/f12d [424808,8516] 0 2024-09-16T09:46:19.602 INFO:tasks.workunit.client.0.smithi111.stdout:0/869: chown d0/d1d/d12b/c136 64292 1 2024-09-16T09:46:19.602 INFO:tasks.workunit.client.0.smithi111.stdout:5/918: link d19/f95 d19/d1b/d9f/deb/d128/f133 0 2024-09-16T09:46:19.603 INFO:tasks.workunit.client.0.smithi111.stdout:0/870: creat d0/d1d/d58/d64/d4f/f13f x:0 0 0 2024-09-16T09:46:19.603 INFO:tasks.workunit.client.0.smithi111.stdout:0/871: read - d0/d1d/d58/d64/dd6/ddf/df3/f125 zero size 2024-09-16T09:46:19.604 INFO:tasks.workunit.client.0.smithi111.stdout:5/919: creat d19/d1b/d27/d83/d2a/dc4/dc0/f134 x:0 0 0 2024-09-16T09:46:19.605 INFO:tasks.workunit.client.0.smithi111.stdout:0/872: creat d0/d26/d35/d86/de5/f140 x:0 0 0 2024-09-16T09:46:19.605 INFO:tasks.workunit.client.0.smithi111.stdout:0/873: write d0/d1d/d67/d3a/d3d/f46 [2497578,36596] 0 2024-09-16T09:46:19.606 INFO:tasks.workunit.client.0.smithi111.stdout:5/920: symlink d19/d1b/d27/d9d/l135 0 2024-09-16T09:46:19.607 INFO:tasks.workunit.client.0.smithi111.stdout:0/874: mknod d0/d1d/d67/d3a/d92/c141 0 2024-09-16T09:46:19.608 INFO:tasks.workunit.client.0.smithi111.stdout:5/921: mknod d19/d1b/d1e/d21/d29/d32/dee/c136 0 2024-09-16T09:46:19.608 INFO:tasks.workunit.client.0.smithi111.stdout:5/922: chown d19/d1b/d1e/d21/d29/l3a 0 1 2024-09-16T09:46:19.608 INFO:tasks.workunit.client.0.smithi111.stdout:9/685: dread d0/d6/d8/de/d56/d8e/dcf/fe6 [0,4194304] 0 2024-09-16T09:46:19.608 INFO:tasks.workunit.client.0.smithi111.stdout:7/730: dwrite d1/d16/d17/d18/d1d/d2f/f5c [0,4194304] 0 2024-09-16T09:46:19.609 INFO:tasks.workunit.client.0.smithi111.stdout:9/686: fdatasync d0/d6/d8/de/d56/d4e/f73 0 2024-09-16T09:46:19.609 INFO:tasks.workunit.client.0.smithi111.stdout:7/731: rmdir d1/d16/d17/d18/d4f 39 2024-09-16T09:46:19.610 INFO:tasks.workunit.client.0.smithi111.stdout:9/687: mkdir d0/d6/d45/db0/de8 0 2024-09-16T09:46:19.610 INFO:tasks.workunit.client.0.smithi111.stdout:9/688: chown d0/d48/d9d 328482 1 2024-09-16T09:46:19.610 INFO:tasks.workunit.client.0.smithi111.stdout:7/732: getdents d1/dc7 0 2024-09-16T09:46:19.611 INFO:tasks.workunit.client.0.smithi111.stdout:9/689: mkdir d0/d21/dc3/de9 0 2024-09-16T09:46:19.612 INFO:tasks.workunit.client.0.smithi111.stdout:3/949: dwrite d5/da/db/d5a/fc7 [4194304,4194304] 0 2024-09-16T09:46:19.614 INFO:tasks.workunit.client.0.smithi111.stdout:9/690: creat d0/d21/d22/d6e/d51/d76/dc0/fea x:0 0 0 2024-09-16T09:46:19.615 INFO:tasks.workunit.client.0.smithi111.stdout:9/691: fsync d0/d6c/fd5 0 2024-09-16T09:46:19.615 INFO:tasks.workunit.client.0.smithi111.stdout:0/875: dread d0/d1d/d67/d3a/d3d/d59/fc8 [0,4194304] 0 2024-09-16T09:46:19.615 INFO:tasks.workunit.client.0.smithi111.stdout:2/947: dwrite d0/d22/dac/df0/f127 [0,4194304] 0 2024-09-16T09:46:19.616 INFO:tasks.workunit.client.0.smithi111.stdout:3/950: rename d5/da/db/d3a/d6d/d125/l138 to d5/da/db/d3a/d6d/de7/d88/db8/l13b 0 2024-09-16T09:46:19.619 INFO:tasks.workunit.client.0.smithi111.stdout:0/876: symlink d0/d26/d35/d126/l142 0 2024-09-16T09:46:19.619 INFO:tasks.workunit.client.0.smithi111.stdout:0/877: write d0/d1d/d58/d83/d9a/dd9/de9/f123 [631403,85734] 0 2024-09-16T09:46:19.619 INFO:tasks.workunit.client.0.smithi111.stdout:0/878: stat d0/d1d/d67/d3a/d3d/f121 0 2024-09-16T09:46:19.630 INFO:tasks.workunit.client.0.smithi111.stdout:0/879: read d0/da4/f7c [3285511,44802] 0 2024-09-16T09:46:19.635 INFO:tasks.workunit.client.0.smithi111.stdout:7/733: dwrite d1/d16/d17/d18/d1b/f6d [0,4194304] 0 2024-09-16T09:46:19.637 INFO:tasks.workunit.client.0.smithi111.stdout:5/923: dwrite d19/d1b/d9f/deb/d128/f133 [0,4194304] 0 2024-09-16T09:46:19.637 INFO:tasks.workunit.client.0.smithi111.stdout:2/948: mkdir d0/d45/d5c/d67/d63/dd4/dc3/d148 0 2024-09-16T09:46:19.637 INFO:tasks.workunit.client.0.smithi111.stdout:2/949: dread - d0/d45/f116 zero size 2024-09-16T09:46:19.639 INFO:tasks.workunit.client.0.smithi111.stdout:3/951: creat d5/da/db/d3a/f13c x:0 0 0 2024-09-16T09:46:19.639 INFO:tasks.workunit.client.0.smithi111.stdout:3/952: fsync d5/da/db/d3a/d6d/ffb 0 2024-09-16T09:46:19.640 INFO:tasks.workunit.client.0.smithi111.stdout:0/880: mkdir d0/da4/d143 0 2024-09-16T09:46:19.646 INFO:tasks.workunit.client.0.smithi111.stdout:7/734: mkdir d1/d16/d17/d18/d1b/d79/da5/db2/d100 0 2024-09-16T09:46:19.656 INFO:tasks.workunit.client.0.smithi111.stdout:7/735: dread d1/d16/d17/d18/f4c [0,4194304] 0 2024-09-16T09:46:19.656 INFO:tasks.workunit.client.0.smithi111.stdout:5/924: symlink d19/d1b/d27/d83/d2a/dc4/dc0/db1/l137 0 2024-09-16T09:46:19.657 INFO:tasks.workunit.client.0.smithi111.stdout:2/950: symlink d0/da/d4e/l149 0 2024-09-16T09:46:19.658 INFO:tasks.workunit.client.0.smithi111.stdout:2/951: read - d0/d45/f90 zero size 2024-09-16T09:46:19.661 INFO:tasks.workunit.client.0.smithi111.stdout:0/881: creat d0/d1d/d58/d83/d9a/f144 x:0 0 0 2024-09-16T09:46:19.661 INFO:tasks.workunit.client.0.smithi111.stdout:3/953: dwrite d5/d18/d78/dab/fc3 [0,4194304] 0 2024-09-16T09:46:19.661 INFO:tasks.workunit.client.0.smithi111.stdout:3/954: fsync d5/da/db/d5a/df8/d11f/d139/f130 0 2024-09-16T09:46:19.666 INFO:tasks.workunit.client.0.smithi111.stdout:7/736: creat d1/d3e/d9f/de2/f101 x:0 0 0 2024-09-16T09:46:19.666 INFO:tasks.workunit.client.0.smithi111.stdout:7/737: write d1/d9/d53/f78 [817025,76756] 0 2024-09-16T09:46:19.666 INFO:tasks.workunit.client.0.smithi111.stdout:7/738: chown d1/d16/d17/d18/d1b/d79/d8c/fef 105524 1 2024-09-16T09:46:19.666 INFO:tasks.workunit.client.0.smithi111.stdout:2/952: rmdir d0/d2/d5a 39 2024-09-16T09:46:19.669 INFO:tasks.workunit.client.0.smithi111.stdout:0/882: mknod d0/d1d/d67/d3a/d3d/d59/c145 0 2024-09-16T09:46:19.670 INFO:tasks.workunit.client.0.smithi111.stdout:7/739: mknod d1/d20/da3/dfa/dfc/c102 0 2024-09-16T09:46:19.677 INFO:tasks.workunit.client.0.smithi111.stdout:3/955: dwrite d5/f13 [4194304,4194304] 0 2024-09-16T09:46:19.679 INFO:tasks.workunit.client.0.smithi111.stdout:5/925: dwrite d19/d1b/d1e/d21/f5e [0,4194304] 0 2024-09-16T09:46:19.682 INFO:tasks.workunit.client.0.smithi111.stdout:3/956: mkdir d5/da/db/de/d134/d13d 0 2024-09-16T09:46:19.684 INFO:tasks.workunit.client.0.smithi111.stdout:5/926: unlink d19/d1b/d27/d83/d2a/de2/f11b 0 2024-09-16T09:46:19.684 INFO:tasks.workunit.client.0.smithi111.stdout:6/707: sync 2024-09-16T09:46:19.685 INFO:tasks.workunit.client.0.smithi111.stdout:3/957: mkdir d5/da/db/d3a/d6d/de7/d75/d13e 0 2024-09-16T09:46:19.686 INFO:tasks.workunit.client.0.smithi111.stdout:5/927: unlink d19/d1b/d27/d2e/d4a/d4b/d9c/l101 0 2024-09-16T09:46:19.689 INFO:tasks.workunit.client.0.smithi111.stdout:8/892: sync 2024-09-16T09:46:19.689 INFO:tasks.workunit.client.0.smithi111.stdout:8/893: dread - d3/de/d1e/fbf zero size 2024-09-16T09:46:19.692 INFO:tasks.workunit.client.0.smithi111.stdout:8/894: creat d3/de/d1e/d2e/d2f/dbc/f12b x:0 0 0 2024-09-16T09:46:19.692 INFO:tasks.workunit.client.0.smithi111.stdout:0/883: dwrite d0/d26/d35/f101 [0,4194304] 0 2024-09-16T09:46:19.693 INFO:tasks.workunit.client.0.smithi111.stdout:8/895: rmdir d3/de/d1e 39 2024-09-16T09:46:19.696 INFO:tasks.workunit.client.0.smithi111.stdout:0/884: mkdir d0/d1d/d67/d3a/d80/dee/d146 0 2024-09-16T09:46:19.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/896: truncate d3/da/db/f11e 417549 0 2024-09-16T09:46:19.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/897: fsync d3/de/d1e/d2e/f37 0 2024-09-16T09:46:19.697 INFO:tasks.workunit.client.0.smithi111.stdout:8/898: write d3/d26/d6d/f4f [2367231,42332] 0 2024-09-16T09:46:19.698 INFO:tasks.workunit.client.0.smithi111.stdout:6/708: dread d0/d57/db0/d47/d52/f82 [0,4194304] 0 2024-09-16T09:46:19.699 INFO:tasks.workunit.client.0.smithi111.stdout:6/709: dread - d0/d57/db0/d14/fcf zero size 2024-09-16T09:46:19.699 INFO:tasks.workunit.client.0.smithi111.stdout:6/710: fdatasync d0/d57/db0/d47/d88/fc5 0 2024-09-16T09:46:19.699 INFO:tasks.workunit.client.0.smithi111.stdout:1/751: sync 2024-09-16T09:46:19.699 INFO:tasks.workunit.client.0.smithi111.stdout:1/752: chown d3/d10/f18 0 1 2024-09-16T09:46:19.699 INFO:tasks.workunit.client.0.smithi111.stdout:4/799: sync 2024-09-16T09:46:19.700 INFO:tasks.workunit.client.0.smithi111.stdout:0/885: dread d0/d26/d35/f76 [0,4194304] 0 2024-09-16T09:46:19.701 INFO:tasks.workunit.client.0.smithi111.stdout:1/753: creat d3/d10/d23/de8/ff9 x:0 0 0 2024-09-16T09:46:19.705 INFO:tasks.workunit.client.0.smithi111.stdout:1/754: creat d3/d10/d23/df6/d47/d65/df7/ffa x:0 0 0 2024-09-16T09:46:19.705 INFO:tasks.workunit.client.0.smithi111.stdout:4/800: dread d2/d6/fe [0,4194304] 0 2024-09-16T09:46:19.705 INFO:tasks.workunit.client.0.smithi111.stdout:4/801: chown d2/d6/dd/d1b/d38/d64/dac/fe2 2 1 2024-09-16T09:46:19.707 INFO:tasks.workunit.client.0.smithi111.stdout:4/802: getdents d2/d6/dd/d1b/d38 0 2024-09-16T09:46:19.708 INFO:tasks.workunit.client.0.smithi111.stdout:5/928: dwrite d19/f6b [0,4194304] 0 2024-09-16T09:46:19.710 INFO:tasks.workunit.client.0.smithi111.stdout:4/803: mkdir d2/d6/dd/d1b/d6d/def/d96/d106 0 2024-09-16T09:46:19.712 INFO:tasks.workunit.client.0.smithi111.stdout:5/929: creat d19/d1b/d27/d2e/d4a/d4b/d12e/f138 x:0 0 0 2024-09-16T09:46:19.714 INFO:tasks.workunit.client.0.smithi111.stdout:4/804: rename d2/d6/dd/d1b/d38/db0/d2f/d4e/lea to d2/d6/dd/d1b/d38/d64/d92/l107 0 2024-09-16T09:46:19.715 INFO:tasks.workunit.client.0.smithi111.stdout:1/755: write d3/d10/d23/df6/d47/d65/d74/f7a [2387070,63675] 0 2024-09-16T09:46:19.716 INFO:tasks.workunit.client.0.smithi111.stdout:5/930: creat d19/d1b/d27/d83/d2a/dc4/dc0/db1/f139 x:0 0 0 2024-09-16T09:46:19.717 INFO:tasks.workunit.client.0.smithi111.stdout:4/805: symlink d2/d30/da1/l108 0 2024-09-16T09:46:19.719 INFO:tasks.workunit.client.0.smithi111.stdout:1/756: mknod d3/d10/d57/dcc/cfb 0 2024-09-16T09:46:19.719 INFO:tasks.workunit.client.0.smithi111.stdout:1/757: stat d3/d10/d23 0 2024-09-16T09:46:19.720 INFO:tasks.workunit.client.0.smithi111.stdout:1/758: dread d3/d10/d1c/f7c [0,4194304] 0 2024-09-16T09:46:19.722 INFO:tasks.workunit.client.0.smithi111.stdout:4/806: link d2/d6/c86 d2/d6/dd/d1b/d38/d64/d92/d104/c109 0 2024-09-16T09:46:19.722 INFO:tasks.workunit.client.0.smithi111.stdout:4/807: dread - d2/d6/dd/d1b/d38/db0/d2f/d4e/fad zero size 2024-09-16T09:46:19.722 INFO:tasks.workunit.client.0.smithi111.stdout:4/808: readlink d2/d6/d80/l91 0 2024-09-16T09:46:19.722 INFO:tasks.workunit.client.0.smithi111.stdout:6/711: dwrite d0/d57/db0/d47/d52/db3/ff4 [0,4194304] 0 2024-09-16T09:46:19.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/759: creat d3/d10/d23/df6/d47/daf/df1/ffc x:0 0 0 2024-09-16T09:46:19.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/760: truncate d3/d10/d72/da1/d28/d36/fdb 33565 0 2024-09-16T09:46:19.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/761: fsync d3/d10/fa9 0 2024-09-16T09:46:19.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/762: write d3/d10/d1c/f25 [4221294,111957] 0 2024-09-16T09:46:19.724 INFO:tasks.workunit.client.0.smithi111.stdout:1/763: chown d3/d24/df4 684949 1 2024-09-16T09:46:19.729 INFO:tasks.workunit.client.0.smithi111.stdout:6/712: mknod d0/d57/db0/cf7 0 2024-09-16T09:46:19.730 INFO:tasks.workunit.client.0.smithi111.stdout:1/764: creat d3/d10/d23/de8/ffd x:0 0 0 2024-09-16T09:46:19.730 INFO:tasks.workunit.client.0.smithi111.stdout:1/765: chown d3/d10/d57/d8f 82864954 1 2024-09-16T09:46:19.737 INFO:tasks.workunit.client.0.smithi111.stdout:6/713: dread d0/d57/db0/d14/d20/d42/f9c [0,4194304] 0 2024-09-16T09:46:19.737 INFO:tasks.workunit.client.0.smithi111.stdout:6/714: read - d0/d57/db0/d47/d88/fd1 zero size 2024-09-16T09:46:19.746 INFO:tasks.workunit.client.0.smithi111.stdout:1/766: dread d3/d10/d72/da1/fe [0,4194304] 0 2024-09-16T09:46:19.746 INFO:tasks.workunit.client.0.smithi111.stdout:1/767: read - d3/d10/d23/de8/ff9 zero size 2024-09-16T09:46:19.747 INFO:tasks.workunit.client.0.smithi111.stdout:5/931: write d19/d1b/d1e/f55 [3695161,75447] 0 2024-09-16T09:46:19.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/899: dwrite d3/de/d1e/d2e/d74/d83/f93 [0,4194304] 0 2024-09-16T09:46:19.749 INFO:tasks.workunit.client.0.smithi111.stdout:8/900: getdents d3/da/db/d59/de5/d122 0 2024-09-16T09:46:19.765 INFO:tasks.workunit.client.0.smithi111.stdout:5/932: dread fc [0,4194304] 0 2024-09-16T09:46:19.765 INFO:tasks.workunit.client.0.smithi111.stdout:4/809: dwrite d2/d6/dd/d1b/d38/db0/d2f/f81 [0,4194304] 0 2024-09-16T09:46:19.765 INFO:tasks.workunit.client.0.smithi111.stdout:4/810: chown d2/d6/dd/d1b/d6d/def/d96/dd5/ldc 13 1 2024-09-16T09:46:19.765 INFO:tasks.workunit.client.0.smithi111.stdout:4/811: truncate d2/d6/dd/d1b/d38/d64/ff8 244946 0 2024-09-16T09:46:19.769 INFO:tasks.workunit.client.0.smithi111.stdout:1/768: dwrite d3/d10/d23/d8e/df0/f4c [0,4194304] 0 2024-09-16T09:46:19.769 INFO:tasks.workunit.client.0.smithi111.stdout:1/769: chown d3/d10/d23/d8e/df0/f55 688819490 1 2024-09-16T09:46:19.770 INFO:tasks.workunit.client.0.smithi111.stdout:8/901: dwrite d3/de/d1e/d2e/d2f/da8/fea [0,4194304] 0 2024-09-16T09:46:19.772 INFO:tasks.workunit.client.0.smithi111.stdout:5/933: symlink d19/d1b/d9f/deb/l13a 0 2024-09-16T09:46:19.774 INFO:tasks.workunit.client.0.smithi111.stdout:4/812: truncate d2/d30/f6e 242736 0 2024-09-16T09:46:19.785 INFO:tasks.workunit.client.0.smithi111.stdout:5/934: creat d19/d1b/d10e/f13b x:0 0 0 2024-09-16T09:46:19.787 INFO:tasks.workunit.client.0.smithi111.stdout:5/935: symlink d19/d1b/d27/d83/d2a/de2/l13c 0 2024-09-16T09:46:19.795 INFO:tasks.workunit.client.0.smithi111.stdout:1/770: dwrite d3/d10/d72/da1/f1b [8388608,4194304] 0 2024-09-16T09:46:19.796 INFO:tasks.workunit.client.0.smithi111.stdout:8/902: dwrite d3/f5f [0,4194304] 0 2024-09-16T09:46:19.797 INFO:tasks.workunit.client.0.smithi111.stdout:1/771: symlink d3/d10/dd0/lfe 0 2024-09-16T09:46:19.797 INFO:tasks.workunit.client.0.smithi111.stdout:1/772: write d3/d10/d72/da1/d28/d36/fdb [347974,1549] 0 2024-09-16T09:46:19.803 INFO:tasks.workunit.client.0.smithi111.stdout:4/813: dwrite d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:19.803 INFO:tasks.workunit.client.0.smithi111.stdout:1/773: creat d3/d24/d62/db3/dbb/fff x:0 0 0 2024-09-16T09:46:19.807 INFO:tasks.workunit.client.0.smithi111.stdout:1/774: creat d3/d10/d23/d8e/f100 x:0 0 0 2024-09-16T09:46:19.807 INFO:tasks.workunit.client.0.smithi111.stdout:1/775: chown d3/d10/d72/da1/fe 1 1 2024-09-16T09:46:19.807 INFO:tasks.workunit.client.0.smithi111.stdout:1/776: write d3/d10/d23/df6/fd5 [147715,57056] 0 2024-09-16T09:46:19.811 INFO:tasks.workunit.client.0.smithi111.stdout:8/903: dread d3/f50 [0,4194304] 0 2024-09-16T09:46:19.813 INFO:tasks.workunit.client.0.smithi111.stdout:5/936: dwrite d19/d1b/d27/d2e/df3/ffe [0,4194304] 0 2024-09-16T09:46:19.814 INFO:tasks.workunit.client.0.smithi111.stdout:8/904: link d3/da/db/d59/dd7/dcc/d100/f117 d3/da/db/d59/dd7/dcc/d100/f12c 0 2024-09-16T09:46:19.814 INFO:tasks.workunit.client.0.smithi111.stdout:8/905: fdatasync d3/da/db/d59/dd7/d9e/f123 0 2024-09-16T09:46:19.814 INFO:tasks.workunit.client.0.smithi111.stdout:5/937: dread d19/d1b/d1e/d41/fb5 [0,4194304] 0 2024-09-16T09:46:19.819 INFO:tasks.workunit.client.0.smithi111.stdout:1/777: read d3/d24/f75 [3500363,24328] 0 2024-09-16T09:46:19.825 INFO:tasks.workunit.client.0.smithi111.stdout:4/814: dwrite d2/d6/dd/d1b/d38/db0/f2c [0,4194304] 0 2024-09-16T09:46:19.825 INFO:tasks.workunit.client.0.smithi111.stdout:4/815: chown d2/d6/dd/d1b/d38/d64/d65/ff3 27 1 2024-09-16T09:46:19.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/778: dwrite d3/d24/d4e/fe2 [0,4194304] 0 2024-09-16T09:46:19.848 INFO:tasks.workunit.client.0.smithi111.stdout:5/938: rename d19/d1b/d27/d83/d2a/f71 to d19/d1b/d10e/f13d 0 2024-09-16T09:46:19.848 INFO:tasks.workunit.client.0.smithi111.stdout:8/906: dread d3/da/db/d59/dd7/d9e/dd8/fbb [0,4194304] 0 2024-09-16T09:46:19.849 INFO:tasks.workunit.client.0.smithi111.stdout:9/692: sync 2024-09-16T09:46:19.850 INFO:tasks.workunit.client.0.smithi111.stdout:8/907: write d3/da/db/d59/dd7/d9e/f10e [811117,91940] 0 2024-09-16T09:46:19.851 INFO:tasks.workunit.client.0.smithi111.stdout:4/816: stat d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/cab 0 2024-09-16T09:46:19.852 INFO:tasks.workunit.client.0.smithi111.stdout:4/817: dread d2/d6/dd/d1b/f5d [0,4194304] 0 2024-09-16T09:46:19.859 INFO:tasks.workunit.client.0.smithi111.stdout:1/779: link d3/d10/d57/d8f/cd9 d3/d10/d1c/c101 0 2024-09-16T09:46:19.861 INFO:tasks.workunit.client.0.smithi111.stdout:9/693: creat d0/d6/d8/da2/feb x:0 0 0 2024-09-16T09:46:19.863 INFO:tasks.workunit.client.0.smithi111.stdout:5/939: dwrite d19/d1b/f4d [0,4194304] 0 2024-09-16T09:46:19.863 INFO:tasks.workunit.client.0.smithi111.stdout:5/940: fsync f10 0 2024-09-16T09:46:19.863 INFO:tasks.workunit.client.0.smithi111.stdout:1/780: getdents d3/d10/d23/df6/d47/d65/df7 0 2024-09-16T09:46:19.867 INFO:tasks.workunit.client.0.smithi111.stdout:9/694: creat d0/d7b/dac/fec x:0 0 0 2024-09-16T09:46:19.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/941: mkdir d19/d1b/d27/d2e/d39/d54/d60/dc9/d11f/d13e 0 2024-09-16T09:46:19.871 INFO:tasks.workunit.client.0.smithi111.stdout:5/942: chown d19/d1b/d1e/f76 20143737 1 2024-09-16T09:46:19.873 INFO:tasks.workunit.client.0.smithi111.stdout:4/818: rmdir d2/d6/dd/d1b/d38/d64/d92/dbf/df9 0 2024-09-16T09:46:19.873 INFO:tasks.workunit.client.0.smithi111.stdout:4/819: truncate d2/d6/dd/d1b/d6d/def/d69/fed 424812 0 2024-09-16T09:46:19.876 INFO:tasks.workunit.client.0.smithi111.stdout:1/781: read d3/d26/d63/f9b [1242908,109974] 0 2024-09-16T09:46:19.876 INFO:tasks.workunit.client.0.smithi111.stdout:1/782: dread - d3/d10/d23/de8/ffd zero size 2024-09-16T09:46:19.877 INFO:tasks.workunit.client.0.smithi111.stdout:9/695: dread d0/d21/d22/d6e/d51/d76/dc0/fc6 [0,4194304] 0 2024-09-16T09:46:19.877 INFO:tasks.workunit.client.0.smithi111.stdout:9/696: write d0/d21/d22/d6e/dab/fd0 [120107,27053] 0 2024-09-16T09:46:19.884 INFO:tasks.workunit.client.0.smithi111.stdout:8/908: dwrite d3/da/db/d59/dd7/d9e/dd8/f6f [0,4194304] 0 2024-09-16T09:46:19.898 INFO:tasks.workunit.client.0.smithi111.stdout:8/909: dwrite d3/f116 [0,4194304] 0 2024-09-16T09:46:19.901 INFO:tasks.workunit.client.0.smithi111.stdout:4/820: write d2/d6/dd/d1b/d38/d64/d65/f70 [1577742,9217] 0 2024-09-16T09:46:19.918 INFO:tasks.workunit.client.0.smithi111.stdout:4/821: dwrite d2/d6/dd/d1b/d38/db0/d2f/d9e/ff1 [0,4194304] 0 2024-09-16T09:46:19.918 INFO:tasks.workunit.client.0.smithi111.stdout:4/822: readlink d2/d6/dd/d1b/d6d/def/d96/dd5/l102 0 2024-09-16T09:46:19.927 INFO:tasks.workunit.client.0.smithi111.stdout:1/783: creat d3/d10/d23/df6/d47/d65/f102 x:0 0 0 2024-09-16T09:46:19.927 INFO:tasks.workunit.client.0.smithi111.stdout:1/784: stat d3/d10/f18 0 2024-09-16T09:46:19.928 INFO:tasks.workunit.client.0.smithi111.stdout:9/697: symlink d0/d6c/led 0 2024-09-16T09:46:19.943 INFO:tasks.workunit.client.0.smithi111.stdout:9/698: write d0/d21/d22/d6e/d51/d76/f5c [1857796,75657] 0 2024-09-16T09:46:19.956 INFO:tasks.workunit.client.0.smithi111.stdout:1/785: dwrite d3/d10/d23/d8e/df0/f55 [4194304,4194304] 0 2024-09-16T09:46:19.957 INFO:tasks.workunit.client.0.smithi111.stdout:1/786: dread d3/d10/d23/d8e/fa3 [0,4194304] 0 2024-09-16T09:46:19.958 INFO:tasks.workunit.client.0.smithi111.stdout:1/787: write d3/d10/d57/d95/fbd [1166955,75735] 0 2024-09-16T09:46:19.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/910: getdents d3/de/d1e 0 2024-09-16T09:46:19.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/911: write d3/de/d1e/d2e/d2f/da8/dbe/f11c [153170,55846] 0 2024-09-16T09:46:20.052 INFO:tasks.workunit.client.0.smithi111.stdout:4/823: creat d2/d6/dd/d1b/d38/db0/f10a x:0 0 0 2024-09-16T09:46:20.052 INFO:tasks.workunit.client.0.smithi111.stdout:4/824: truncate d2/d6/dd/d1b/d38/d64/dac/fe2 702361 0 2024-09-16T09:46:20.053 INFO:tasks.workunit.client.0.smithi111.stdout:4/825: dread d2/d6/dd/d1b/d38/d64/dac/fe2 [0,4194304] 0 2024-09-16T09:46:20.055 INFO:tasks.workunit.client.0.smithi111.stdout:9/699: symlink d0/d21/dc3/lee 0 2024-09-16T09:46:20.055 INFO:tasks.workunit.client.0.smithi111.stdout:9/700: readlink d0/d6/d45/l49 0 2024-09-16T09:46:20.061 INFO:tasks.workunit.client.0.smithi111.stdout:1/788: creat d3/d10/d23/df6/d47/f103 x:0 0 0 2024-09-16T09:46:20.064 INFO:tasks.workunit.client.0.smithi111.stdout:8/912: link d3/c84 d3/de/d1e/d2e/d2f/da8/dbe/d118/c12d 0 2024-09-16T09:46:20.070 INFO:tasks.workunit.client.0.smithi111.stdout:1/789: write d3/f9 [2712896,119775] 0 2024-09-16T09:46:20.073 INFO:tasks.workunit.client.0.smithi111.stdout:4/826: truncate d2/f17 1410058 0 2024-09-16T09:46:20.073 INFO:tasks.workunit.client.0.smithi111.stdout:4/827: fsync d2/d6/dd/d1b/d38/db0/d2f/d6c/fe1 0 2024-09-16T09:46:20.073 INFO:tasks.workunit.client.0.smithi111.stdout:4/828: chown d2/d6/d80 0 1 2024-09-16T09:46:20.085 INFO:tasks.workunit.client.0.smithi111.stdout:4/829: write d2/d6/dd/d1b/d38/db0/f43 [1757914,40683] 0 2024-09-16T09:46:20.087 INFO:tasks.workunit.client.0.smithi111.stdout:4/830: dread d2/d30/da1/fb4 [0,4194304] 0 2024-09-16T09:46:20.087 INFO:tasks.workunit.client.0.smithi111.stdout:1/790: symlink d3/d10/d23/df6/d47/d65/d74/l104 0 2024-09-16T09:46:20.087 INFO:tasks.workunit.client.0.smithi111.stdout:1/791: chown d3/d10/d72/da1/d99/la7 2179129 1 2024-09-16T09:46:20.104 INFO:tasks.workunit.client.0.smithi111.stdout:4/831: mkdir d2/d6/dd/d1b/d6d/d8f/d10b 0 2024-09-16T09:46:20.104 INFO:tasks.workunit.client.0.smithi111.stdout:4/832: readlink d2/d30/da1/lde 0 2024-09-16T09:46:20.105 INFO:tasks.workunit.client.0.smithi111.stdout:1/792: dwrite d3/fe9 [0,4194304] 0 2024-09-16T09:46:20.107 INFO:tasks.workunit.client.0.smithi111.stdout:4/833: mkdir d2/d6/dd/d1b/d10c 0 2024-09-16T09:46:20.108 INFO:tasks.workunit.client.0.smithi111.stdout:1/793: mkdir d3/d10/d23/de8/d105 0 2024-09-16T09:46:20.117 INFO:tasks.workunit.client.0.smithi111.stdout:4/834: dread d2/d6/dd/d1b/d38/d64/f66 [0,4194304] 0 2024-09-16T09:46:20.125 INFO:tasks.workunit.client.0.smithi111.stdout:4/835: write d2/d6/dd/d1b/d38/d64/f66 [704109,32617] 0 2024-09-16T09:46:20.127 INFO:tasks.workunit.client.0.smithi111.stdout:1/794: dwrite d3/d10/d57/d8f/fca [0,4194304] 0 2024-09-16T09:46:20.129 INFO:tasks.workunit.client.0.smithi111.stdout:4/836: rename d2/d6/dd/d1b/d38/db0/f2c to d2/d6/dd/d1b/d38/d64/d92/da0/db5/f10d 0 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: pgmap v263: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 120 MiB/s rd, 164 MiB/s wr, 321 op/s 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: mgrmap e20: smithi111.erxodt(active, since 7m), standbys: smithi114.xvotey 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr fail", "who": "smithi111.erxodt"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: Activating manager daemon smithi114.xvotey 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "mgr fail", "who": "smithi111.erxodt"}]': finished 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: osdmap e44: 6 total, 6 up, 6 in 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"}]: dispatch 2024-09-16T09:46:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr metadata", "who": "smithi114.xvotey", "id": "smithi114.xvotey"}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: mgrmap e21: smithi114.xvotey(active, starting, since 0.0150534s) 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:46:20.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:20 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:46:20.154 INFO:tasks.workunit.client.0.smithi111.stdout:1/795: dwrite d3/d26/d63/f9b [0,4194304] 0 2024-09-16T09:46:20.155 INFO:tasks.workunit.client.0.smithi111.stdout:4/837: dwrite d2/d30/da1/fa6 [0,4194304] 0 2024-09-16T09:46:20.155 INFO:tasks.workunit.client.0.smithi111.stdout:4/838: truncate d2/d6/dd/d1b/d6d/d8f/fa9 1883827 0 2024-09-16T09:46:20.156 INFO:tasks.workunit.client.0.smithi111.stdout:1/796: getdents d3/d10/d23/df6/d47/d65/dbf 0 2024-09-16T09:46:20.160 INFO:tasks.workunit.client.0.smithi111.stdout:1/797: rename d3/d24/d29/f39 to d3/d24/d29/dc8/f106 0 2024-09-16T09:46:20.165 INFO:tasks.workunit.client.0.smithi111.stdout:9/701: creat d0/d21/d22/d6e/d51/fef x:0 0 0 2024-09-16T09:46:20.166 INFO:tasks.workunit.client.0.smithi111.stdout:9/702: chown d0/d6/d8/de/d56/d8e/dcf/fe6 11082899 1 2024-09-16T09:46:20.166 INFO:tasks.workunit.client.0.smithi111.stdout:9/703: chown d0/d21/d22/d6e/dab 288746743 1 2024-09-16T09:46:20.166 INFO:tasks.workunit.client.0.smithi111.stdout:9/704: stat d0/d21/d22/d6e/d7d/d9a/fd4 0 2024-09-16T09:46:20.166 INFO:tasks.workunit.client.0.smithi111.stdout:9/705: stat d0/d7b/dac/lba 0 2024-09-16T09:46:20.166 INFO:tasks.workunit.client.0.smithi111.stdout:9/706: mknod d0/d21/dc3/cf0 0 2024-09-16T09:46:20.169 INFO:tasks.workunit.client.0.smithi111.stdout:8/913: link d3/de/d1e/d2e/d2f/dbc/f12b d3/de/d1e/d2e/d74/dad/f12e 0 2024-09-16T09:46:20.170 INFO:tasks.workunit.client.0.smithi111.stdout:8/914: dread - d3/da/db/d59/dd7/d9e/dd8/f8e zero size 2024-09-16T09:46:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: pgmap v263: 65 pgs: 65 active+clean; 1.6 GiB data, 4.9 GiB used, 532 GiB / 536 GiB avail; 120 MiB/s rd, 164 MiB/s wr, 321 op/s 2024-09-16T09:46:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: mgrmap e20: smithi111.erxodt(active, since 7m), standbys: smithi114.xvotey 2024-09-16T09:46:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr fail", "who": "smithi111.erxodt"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: Activating manager daemon smithi114.xvotey 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.14217 172.21.15.111:0/2357011113' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "mgr fail", "who": "smithi111.erxodt"}]': finished 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: osdmap e44: 6 total, 6 up, 6 in 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"}]: dispatch 2024-09-16T09:46:20.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr metadata", "who": "smithi114.xvotey", "id": "smithi114.xvotey"}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: mgrmap e21: smithi114.xvotey(active, starting, since 0.0150534s) 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:46:20.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:20 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:46:20.190 INFO:tasks.workunit.client.0.smithi111.stdout:8/915: dwrite d3/da/db/d59/dd7/d9e/dd8/f6f [4194304,4194304] 0 2024-09-16T09:46:20.192 INFO:tasks.workunit.client.0.smithi111.stdout:8/916: creat d3/da/db/d59/dd7/d9e/f12f x:0 0 0 2024-09-16T09:46:20.192 INFO:tasks.workunit.client.0.smithi111.stdout:8/917: readlink d3/l9 0 2024-09-16T09:46:20.198 INFO:tasks.workunit.client.0.smithi111.stdout:9/707: mkdir d0/d6/df1 0 2024-09-16T09:46:20.199 INFO:tasks.workunit.client.0.smithi111.stdout:4/839: dwrite d2/f17 [0,4194304] 0 2024-09-16T09:46:20.208 INFO:tasks.workunit.client.0.smithi111.stdout:4/840: dread d2/d6/f3f [0,4194304] 0 2024-09-16T09:46:20.209 INFO:tasks.workunit.client.0.smithi111.stdout:4/841: fdatasync d2/d6/dd/d1b/d38/db0/d2f/f36 0 2024-09-16T09:46:20.210 INFO:tasks.workunit.client.0.smithi111.stdout:9/708: dread d0/f1e [0,4194304] 0 2024-09-16T09:46:20.210 INFO:tasks.workunit.client.0.smithi111.stdout:9/709: dread - d0/d6/d45/db0/fdd zero size 2024-09-16T09:46:20.210 INFO:tasks.workunit.client.0.smithi111.stdout:9/710: write d0/d6/f3c [1888901,65387] 0 2024-09-16T09:46:20.211 INFO:tasks.workunit.client.0.smithi111.stdout:4/842: creat d2/d30/da1/f10e x:0 0 0 2024-09-16T09:46:20.211 INFO:tasks.workunit.client.0.smithi111.stdout:8/918: dwrite d3/de/d1e/d2e/d2f/da8/dbe/f28 [0,4194304] 0 2024-09-16T09:46:20.211 INFO:tasks.workunit.client.0.smithi111.stdout:8/919: readlink d3/de/d1e/d2e/l95 0 2024-09-16T09:46:20.211 INFO:tasks.workunit.client.0.smithi111.stdout:8/920: read d3/de/d1e/d2e/d2f/f7c [285039,21799] 0 2024-09-16T09:46:20.212 INFO:tasks.workunit.client.0.smithi111.stdout:9/711: creat d0/d6/d30/ff2 x:0 0 0 2024-09-16T09:46:20.212 INFO:tasks.workunit.client.0.smithi111.stdout:9/712: dread - d0/d21/d22/d6e/d51/d76/dc0/fea zero size 2024-09-16T09:46:20.215 INFO:tasks.workunit.client.0.smithi111.stdout:9/713: link d0/d6/d8/de/dca/c5d d0/d6/dc1/cf3 0 2024-09-16T09:46:20.215 INFO:tasks.workunit.client.0.smithi111.stdout:9/714: dread - d0/d21/d22/d6e/d51/d76/dc0/fc2 zero size 2024-09-16T09:46:20.218 INFO:tasks.workunit.client.0.smithi111.stdout:9/715: mknod d0/d6/cf4 0 2024-09-16T09:46:20.218 INFO:tasks.workunit.client.0.smithi111.stdout:9/716: fdatasync d0/d6/d30/fb1 0 2024-09-16T09:46:20.218 INFO:tasks.workunit.client.0.smithi111.stdout:9/717: write d0/d6/d8/da2/feb [70705,3733] 0 2024-09-16T09:46:20.221 INFO:tasks.workunit.client.0.smithi111.stdout:9/718: creat d0/d6/d30/d81/ff5 x:0 0 0 2024-09-16T09:46:20.223 INFO:tasks.workunit.client.0.smithi111.stdout:9/719: creat d0/d21/d22/d6e/d51/ff6 x:0 0 0 2024-09-16T09:46:20.224 INFO:tasks.workunit.client.0.smithi111.stdout:9/720: stat d0/d6/d8/de/d56/d4e/d92 0 2024-09-16T09:46:20.224 INFO:tasks.workunit.client.0.smithi111.stdout:9/721: dread - d0/d48/d9d/fbe zero size 2024-09-16T09:46:20.227 INFO:tasks.workunit.client.0.smithi111.stdout:9/722: rmdir d0/d21/d22/d6e/d51/d76/de0 0 2024-09-16T09:46:20.228 INFO:tasks.workunit.client.0.smithi111.stdout:1/798: rename d3/lc to d3/d10/d23/l107 0 2024-09-16T09:46:20.229 INFO:tasks.workunit.client.0.smithi111.stdout:9/723: rename d0/d21/d22/d6e/d51/d76/dc0/fea to d0/d6c/d70/ff7 0 2024-09-16T09:46:20.230 INFO:tasks.workunit.client.0.smithi111.stdout:1/799: creat d3/d10/d23/de8/f108 x:0 0 0 2024-09-16T09:46:20.231 INFO:tasks.workunit.client.0.smithi111.stdout:9/724: mknod d0/d6/d8/de/d56/d8e/dcf/cf8 0 2024-09-16T09:46:20.232 INFO:tasks.workunit.client.0.smithi111.stdout:1/800: mknod d3/d24/d62/c109 0 2024-09-16T09:46:20.233 INFO:tasks.workunit.client.0.smithi111.stdout:1/801: mkdir d3/d26/d63/d84/d10a 0 2024-09-16T09:46:20.236 INFO:tasks.workunit.client.0.smithi111.stdout:1/802: rename d3/d24/d4e/fd6 to d3/d10/dd0/f10b 0 2024-09-16T09:46:20.236 INFO:tasks.workunit.client.0.smithi111.stdout:1/803: chown d3/d10/d23/df6/d47/d65/d74/c79 0 1 2024-09-16T09:46:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:4/843: dwrite d2/d6/dd/d1b/d38/d64/ff8 [0,4194304] 0 2024-09-16T09:46:20.238 INFO:tasks.workunit.client.0.smithi111.stdout:8/921: dwrite d3/da/db/d59/dd7/fe8 [0,4194304] 0 2024-09-16T09:46:20.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/922: fsync d3/f10 0 2024-09-16T09:46:20.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/923: write d3/da/db/d59/dd7/d9e/f10e [1800088,74056] 0 2024-09-16T09:46:20.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/924: write d3/de/d1e/d2e/d74/f86 [3827887,71958] 0 2024-09-16T09:46:20.246 INFO:tasks.workunit.client.0.smithi111.stdout:9/725: write d0/d6/d8/f36 [1043748,59149] 0 2024-09-16T09:46:20.248 INFO:tasks.workunit.client.0.smithi111.stdout:7/740: sync 2024-09-16T09:46:20.248 INFO:tasks.workunit.client.0.smithi111.stdout:2/953: sync 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:3/958: sync 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:6/715: sync 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:3/959: read d5/da/db/d35/f4f [765823,1418] 0 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:6/716: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/lf3 1634665 1 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:0/886: sync 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:5/943: sync 2024-09-16T09:46:20.250 INFO:tasks.workunit.client.0.smithi111.stdout:8/925: rename d3/de/d1e/d2e/d2f/dbc to d3/dc3/d130 0 2024-09-16T09:46:20.251 INFO:tasks.workunit.client.0.smithi111.stdout:7/741: getdents d1 0 2024-09-16T09:46:20.251 INFO:tasks.workunit.client.0.smithi111.stdout:7/742: fsync d1/d16/d17/d18/d1d/d2f/f75 0 2024-09-16T09:46:20.253 INFO:tasks.workunit.client.0.smithi111.stdout:2/954: dread d0/d45/d5c/d67/d63/dd4/dc3/ff5 [0,4194304] 0 2024-09-16T09:46:20.253 INFO:tasks.workunit.client.0.smithi111.stdout:2/955: write d0/d2/f100 [152540,27153] 0 2024-09-16T09:46:20.253 INFO:tasks.workunit.client.0.smithi111.stdout:6/717: mknod d0/d57/db0/d47/cf8 0 2024-09-16T09:46:20.255 INFO:tasks.workunit.client.0.smithi111.stdout:3/960: write d5/da/f121 [137012,30586] 0 2024-09-16T09:46:20.257 INFO:tasks.workunit.client.0.smithi111.stdout:8/926: truncate d3/da/db/d59/dd7/f47 2732270 0 2024-09-16T09:46:20.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/887: truncate d0/d1d/d67/d3a/d92/fd1 436839 0 2024-09-16T09:46:20.257 INFO:tasks.workunit.client.0.smithi111.stdout:0/888: chown d0/dfb/c11f 5 1 2024-09-16T09:46:20.258 INFO:tasks.workunit.client.0.smithi111.stdout:6/718: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/db9/cf9 0 2024-09-16T09:46:20.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/961: rename d5/l2c to d5/da/db/d5a/l13f 0 2024-09-16T09:46:20.262 INFO:tasks.workunit.client.0.smithi111.stdout:3/962: chown d5/da/db/f84 1388 1 2024-09-16T09:46:20.265 INFO:tasks.workunit.client.0.smithi111.stdout:4/844: dwrite d2/d6/dd/f28 [0,4194304] 0 2024-09-16T09:46:20.265 INFO:tasks.workunit.client.0.smithi111.stdout:0/889: rename d0/d1d/d67/d3a/d3d/f121 to d0/f147 0 2024-09-16T09:46:20.268 INFO:tasks.workunit.client.0.smithi111.stdout:7/743: dread d1/d9/d43/f7a [0,4194304] 0 2024-09-16T09:46:20.269 INFO:tasks.workunit.client.0.smithi111.stdout:7/744: write d1/d59/fd1 [3229216,51913] 0 2024-09-16T09:46:20.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/963: dread d5/da/d42/f6e [0,4194304] 0 2024-09-16T09:46:20.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/964: stat d5/da 0 2024-09-16T09:46:20.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/965: chown d5/da/db/d3a/f8c 221 1 2024-09-16T09:46:20.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/966: dread - d5/da/d42/ff9 zero size 2024-09-16T09:46:20.272 INFO:tasks.workunit.client.0.smithi111.stdout:3/967: fsync d5/da/db/d5a/df8/d11f/d139/f9c 0 2024-09-16T09:46:20.273 INFO:tasks.workunit.client.0.smithi111.stdout:0/890: truncate d0/fa0 3173347 0 2024-09-16T09:46:20.277 INFO:tasks.workunit.client.0.smithi111.stdout:3/968: symlink d5/da/db/d3a/d6d/de7/l140 0 2024-09-16T09:46:20.277 INFO:tasks.workunit.client.0.smithi111.stdout:3/969: getdents d5/da/d92 0 2024-09-16T09:46:20.278 INFO:tasks.workunit.client.0.smithi111.stdout:3/970: rmdir d5/da/db/de/d134 39 2024-09-16T09:46:20.280 INFO:tasks.workunit.client.0.smithi111.stdout:3/971: creat d5/da/db/de/d134/f141 x:0 0 0 2024-09-16T09:46:20.281 INFO:tasks.workunit.client.0.smithi111.stdout:3/972: write d5/da/db/f84 [493706,127970] 0 2024-09-16T09:46:20.281 INFO:tasks.workunit.client.0.smithi111.stdout:6/719: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f54 [1671031,9226] 0 2024-09-16T09:46:20.283 INFO:tasks.workunit.client.0.smithi111.stdout:3/973: rmdir d5/d18/d78/dfd/db6/ddf 0 2024-09-16T09:46:20.298 INFO:tasks.workunit.client.0.smithi111.stdout:9/726: dwrite d0/d6c/fd5 [0,4194304] 0 2024-09-16T09:46:20.298 INFO:tasks.workunit.client.0.smithi111.stdout:2/956: dwrite d0/d45/d5c/ffb [0,4194304] 0 2024-09-16T09:46:20.298 INFO:tasks.workunit.client.0.smithi111.stdout:3/974: dread d5/d18/d78/dab/fc3 [0,4194304] 0 2024-09-16T09:46:20.300 INFO:tasks.workunit.client.0.smithi111.stdout:4/845: dwrite d2/d6/dd/d1b/d6d/def/f90 [0,4194304] 0 2024-09-16T09:46:20.300 INFO:tasks.workunit.client.0.smithi111.stdout:4/846: write d2/d6/fba [1528070,35521] 0 2024-09-16T09:46:20.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/927: dwrite d3/d26/f40 [0,4194304] 0 2024-09-16T09:46:20.300 INFO:tasks.workunit.client.0.smithi111.stdout:7/745: dwrite d1/d3e/d9f/de2/f101 [0,4194304] 0 2024-09-16T09:46:20.300 INFO:tasks.workunit.client.0.smithi111.stdout:7/746: stat d1/d3e/d9e/dac 0 2024-09-16T09:46:20.301 INFO:tasks.workunit.client.0.smithi111.stdout:1/804: truncate d3/fe9 1932855 0 2024-09-16T09:46:20.303 INFO:tasks.workunit.client.0.smithi111.stdout:2/957: mkdir d0/dc5/d14a 0 2024-09-16T09:46:20.304 INFO:tasks.workunit.client.0.smithi111.stdout:2/958: write d0/d45/d5c/d67/f8c [2619817,50177] 0 2024-09-16T09:46:20.305 INFO:tasks.workunit.client.0.smithi111.stdout:3/975: unlink d5/da/def/ffc 0 2024-09-16T09:46:20.308 INFO:tasks.workunit.client.0.smithi111.stdout:6/720: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/f6c [0,4194304] 0 2024-09-16T09:46:20.309 INFO:tasks.workunit.client.0.smithi111.stdout:8/928: dread d3/de/d1e/d2e/d2f/da8/dbe/f3f [0,4194304] 0 2024-09-16T09:46:20.309 INFO:tasks.workunit.client.0.smithi111.stdout:8/929: write d3/da/db/d59/dd7/f25 [5026462,44827] 0 2024-09-16T09:46:20.311 INFO:tasks.workunit.client.0.smithi111.stdout:4/847: unlink d2/d6/fe 0 2024-09-16T09:46:20.318 INFO:tasks.workunit.client.0.smithi111.stdout:7/747: mknod d1/d16/d17/d18/d1d/d2f/c103 0 2024-09-16T09:46:20.318 INFO:tasks.workunit.client.0.smithi111.stdout:4/848: dread d2/d6/dd/d1b/d38/db0/d2f/ff0 [0,4194304] 0 2024-09-16T09:46:20.322 INFO:tasks.workunit.client.0.smithi111.stdout:1/805: link d3/d26/d63/cc1 d3/d10/d72/da1/d28/c10c 0 2024-09-16T09:46:20.322 INFO:tasks.workunit.client.0.smithi111.stdout:9/727: dwrite d0/d6/d30/ff2 [0,4194304] 0 2024-09-16T09:46:20.326 INFO:tasks.workunit.client.0.smithi111.stdout:3/976: creat d5/da/db/d3a/d6d/de7/d75/d13e/f142 x:0 0 0 2024-09-16T09:46:20.326 INFO:tasks.workunit.client.0.smithi111.stdout:3/977: write d5/da/db/d3a/d6d/de7/fd5 [860647,12904] 0 2024-09-16T09:46:20.326 INFO:tasks.workunit.client.0.smithi111.stdout:3/978: readlink d5/da/l10f 0 2024-09-16T09:46:20.327 INFO:tasks.workunit.client.0.smithi111.stdout:3/979: dread - d5/d18/df6/f100 zero size 2024-09-16T09:46:20.330 INFO:tasks.workunit.client.0.smithi111.stdout:6/721: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/ffa x:0 0 0 2024-09-16T09:46:20.332 INFO:tasks.workunit.client.0.smithi111.stdout:2/959: dwrite d0/da/f11c [0,4194304] 0 2024-09-16T09:46:20.340 INFO:tasks.workunit.client.0.smithi111.stdout:8/930: creat d3/da/db/d59/f131 x:0 0 0 2024-09-16T09:46:20.340 INFO:tasks.workunit.client.0.smithi111.stdout:8/931: fdatasync d3/de/d1e/d2e/d74/f86 0 2024-09-16T09:46:20.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/806: mkdir d3/d10/d23/df6/d47/d65/df7/d10d 0 2024-09-16T09:46:20.341 INFO:tasks.workunit.client.0.smithi111.stdout:1/807: readlink d3/d10/d1c/l7f 0 2024-09-16T09:46:20.341 INFO:tasks.workunit.client.0.smithi111.stdout:6/722: dread d0/d57/db0/d47/f7d [0,4194304] 0 2024-09-16T09:46:20.342 INFO:tasks.workunit.client.0.smithi111.stdout:3/980: mkdir d5/da/d42/d74/d93/d143 0 2024-09-16T09:46:20.342 INFO:tasks.workunit.client.0.smithi111.stdout:3/981: truncate d5/da/de1/d120/f12c 633866 0 2024-09-16T09:46:20.348 INFO:tasks.workunit.client.0.smithi111.stdout:8/932: creat d3/de/d1e/d2e/d74/d83/f132 x:0 0 0 2024-09-16T09:46:20.349 INFO:tasks.workunit.client.0.smithi111.stdout:8/933: dread d3/d26/ff8 [0,4194304] 0 2024-09-16T09:46:20.349 INFO:tasks.workunit.client.0.smithi111.stdout:7/748: truncate d1/d20/f7c 2064278 0 2024-09-16T09:46:20.351 INFO:tasks.workunit.client.0.smithi111.stdout:1/808: getdents d3/d10/d23/df6/d47/d65/d74 0 2024-09-16T09:46:20.354 INFO:tasks.workunit.client.0.smithi111.stdout:3/982: mknod d5/d18/d78/dfd/da0/c144 0 2024-09-16T09:46:20.356 INFO:tasks.workunit.client.0.smithi111.stdout:4/849: dwrite d2/d6/dd/d1b/d38/d64/dac/fd0 [0,4194304] 0 2024-09-16T09:46:20.357 INFO:tasks.workunit.client.0.smithi111.stdout:7/749: dread d1/d9/d43/d82/fba [0,4194304] 0 2024-09-16T09:46:20.363 INFO:tasks.workunit.client.0.smithi111.stdout:2/960: dwrite d0/d2/f14 [0,4194304] 0 2024-09-16T09:46:20.363 INFO:tasks.workunit.client.0.smithi111.stdout:6/723: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f34 [0,4194304] 0 2024-09-16T09:46:20.363 INFO:tasks.workunit.client.0.smithi111.stdout:6/724: stat d0/d57/db0/d49/d5b/fa4 0 2024-09-16T09:46:20.363 INFO:tasks.workunit.client.0.smithi111.stdout:2/961: chown d0/d2/d59/d86/cda 3450 1 2024-09-16T09:46:20.364 INFO:tasks.workunit.client.0.smithi111.stdout:9/728: dwrite d0/d48/fe4 [0,4194304] 0 2024-09-16T09:46:20.364 INFO:tasks.workunit.client.0.smithi111.stdout:4/850: rmdir d2/d6/dd/d1b/d38/d64/dd8/de4 39 2024-09-16T09:46:20.370 INFO:tasks.workunit.client.0.smithi111.stdout:3/983: dread d5/da/db/de/ddb/dcd/f10d [0,4194304] 0 2024-09-16T09:46:20.377 INFO:tasks.workunit.client.0.smithi111.stdout:6/725: rmdir d0 39 2024-09-16T09:46:20.377 INFO:tasks.workunit.client.0.smithi111.stdout:6/726: getdents d0/d57/db0/d49 0 2024-09-16T09:46:20.378 INFO:tasks.workunit.client.0.smithi111.stdout:2/962: rename d0/da/l43 to d0/dd8/l14b 0 2024-09-16T09:46:20.381 INFO:tasks.workunit.client.0.smithi111.stdout:1/809: dwrite d3/d10/d23/df6/fd5 [0,4194304] 0 2024-09-16T09:46:20.381 INFO:tasks.workunit.client.0.smithi111.stdout:7/750: dwrite d1/d16/f1c [4194304,4194304] 0 2024-09-16T09:46:20.387 INFO:tasks.workunit.client.0.smithi111.stdout:9/729: creat d0/d6/d45/db0/ff9 x:0 0 0 2024-09-16T09:46:20.389 INFO:tasks.workunit.client.0.smithi111.stdout:4/851: mknod d2/d6/dd/d1b/d38/d64/d65/c10f 0 2024-09-16T09:46:20.393 INFO:tasks.workunit.client.0.smithi111.stdout:3/984: mkdir d5/da/db/d35/d45/d145 0 2024-09-16T09:46:20.394 INFO:tasks.workunit.client.0.smithi111.stdout:6/727: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/ffb x:0 0 0 2024-09-16T09:46:20.394 INFO:tasks.workunit.client.0.smithi111.stdout:6/728: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f 0 1 2024-09-16T09:46:20.397 INFO:tasks.workunit.client.0.smithi111.stdout:6/729: write d0/d57/db0/d47/d88/da9/fd2 [299469,47262] 0 2024-09-16T09:46:20.397 INFO:tasks.workunit.client.0.smithi111.stdout:6/730: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/f51 [1739445,117429] 0 2024-09-16T09:46:20.398 INFO:tasks.workunit.client.0.smithi111.stdout:1/810: mkdir d3/d10/d23/df6/d47/d10e 0 2024-09-16T09:46:20.398 INFO:tasks.workunit.client.0.smithi111.stdout:1/811: chown d3/fe9 123861789 1 2024-09-16T09:46:20.401 INFO:tasks.workunit.client.0.smithi111.stdout:7/751: truncate d1/f14 7789126 0 2024-09-16T09:46:20.401 INFO:tasks.workunit.client.0.smithi111.stdout:7/752: write d1/d9/d43/d82/f8a [488089,49882] 0 2024-09-16T09:46:20.402 INFO:tasks.workunit.client.0.smithi111.stdout:4/852: getdents d2/d6/dd/d1b/d38/d64/d92/da0 0 2024-09-16T09:46:20.403 INFO:tasks.workunit.client.0.smithi111.stdout:2/963: dwrite d0/d29/f6c [0,4194304] 0 2024-09-16T09:46:20.405 INFO:tasks.workunit.client.0.smithi111.stdout:3/985: mknod d5/da/db/d3a/d6d/dd1/c146 0 2024-09-16T09:46:20.407 INFO:tasks.workunit.client.0.smithi111.stdout:6/731: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/cfc 0 2024-09-16T09:46:20.407 INFO:tasks.workunit.client.0.smithi111.stdout:6/732: fsync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/f60 0 2024-09-16T09:46:20.409 INFO:tasks.workunit.client.0.smithi111.stdout:1/812: truncate d3/d10/d23/f8b 167946 0 2024-09-16T09:46:20.410 INFO:tasks.workunit.client.0.smithi111.stdout:4/853: creat d2/d6/dd/d1b/d6d/def/d96/f110 x:0 0 0 2024-09-16T09:46:20.413 INFO:tasks.workunit.client.0.smithi111.stdout:2/964: mkdir d0/d45/d5c/d67/d63/dd4/dc3/d14c 0 2024-09-16T09:46:20.413 INFO:tasks.workunit.client.0.smithi111.stdout:3/986: dread d5/da/db/f14 [0,4194304] 0 2024-09-16T09:46:20.414 INFO:tasks.workunit.client.0.smithi111.stdout:3/987: truncate d5/d18/df6/f100 70881 0 2024-09-16T09:46:20.415 INFO:tasks.workunit.client.0.smithi111.stdout:9/730: dwrite d0/d6/d45/f69 [0,4194304] 0 2024-09-16T09:46:20.415 INFO:tasks.workunit.client.0.smithi111.stdout:9/731: fdatasync d0/d48/d9d/fbe 0 2024-09-16T09:46:20.419 INFO:tasks.workunit.client.0.smithi111.stdout:6/733: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f36 [0,4194304] 0 2024-09-16T09:46:20.419 INFO:tasks.workunit.client.0.smithi111.stdout:6/734: write d0/d57/d72/f61 [4270991,79992] 0 2024-09-16T09:46:20.422 INFO:tasks.workunit.client.0.smithi111.stdout:7/753: dwrite d1/d16/d17/fdc [0,4194304] 0 2024-09-16T09:46:20.429 INFO:tasks.workunit.client.0.smithi111.stdout:1/813: creat d3/d10/d72/f10f x:0 0 0 2024-09-16T09:46:20.433 INFO:tasks.workunit.client.0.smithi111.stdout:7/754: write d1/d16/d17/d18/d1d/f5d [2638394,83075] 0 2024-09-16T09:46:20.433 INFO:tasks.workunit.client.0.smithi111.stdout:4/854: creat d2/d6/dd/d1b/d6d/f111 x:0 0 0 2024-09-16T09:46:20.434 INFO:tasks.workunit.client.0.smithi111.stdout:6/735: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/fe4 [0,4194304] 0 2024-09-16T09:46:20.436 INFO:tasks.workunit.client.0.smithi111.stdout:2/965: rename d0/dd8/l14b to d0/l14d 0 2024-09-16T09:46:20.437 INFO:tasks.workunit.client.0.smithi111.stdout:2/966: fdatasync d0/da6/f112 0 2024-09-16T09:46:20.439 INFO:tasks.workunit.client.0.smithi111.stdout:9/732: mkdir d0/d6/d8/de/d56/d8e/dfa 0 2024-09-16T09:46:20.439 INFO:tasks.workunit.client.0.smithi111.stdout:9/733: write d0/d6c/d70/ff7 [531080,125700] 0 2024-09-16T09:46:20.439 INFO:tasks.workunit.client.0.smithi111.stdout:9/734: fdatasync d0/d6/d8/de/d56/fde 0 2024-09-16T09:46:20.444 INFO:tasks.workunit.client.0.smithi111.stdout:4/855: link d2/c94 d2/d6/dd/d1b/d38/db0/d2f/c112 0 2024-09-16T09:46:20.444 INFO:tasks.workunit.client.0.smithi111.stdout:7/755: dread d1/d16/d17/d18/d4f/d88/fad [0,4194304] 0 2024-09-16T09:46:20.450 INFO:tasks.workunit.client.0.smithi111.stdout:1/814: dwrite d3/d10/d57/d95/fbd [0,4194304] 0 2024-09-16T09:46:20.453 INFO:tasks.workunit.client.0.smithi111.stdout:6/736: rmdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/dda 0 2024-09-16T09:46:20.457 INFO:tasks.workunit.client.0.smithi111.stdout:3/988: rename d5/da/db/d5a/c128 to d5/da/db/d35/d45/c147 0 2024-09-16T09:46:20.459 INFO:tasks.workunit.client.0.smithi111.stdout:4/856: mkdir d2/d6/dd/d1b/d6d/d8f/d113 0 2024-09-16T09:46:20.461 INFO:tasks.workunit.client.0.smithi111.stdout:7/756: mknod d1/d16/d17/d18/d4f/df5/c104 0 2024-09-16T09:46:20.461 INFO:tasks.workunit.client.0.smithi111.stdout:6/737: dread d0/d57/db0/d47/d68/fce [0,4194304] 0 2024-09-16T09:46:20.466 INFO:tasks.workunit.client.0.smithi111.stdout:3/989: write d5/f13 [1350368,50326] 0 2024-09-16T09:46:20.466 INFO:tasks.workunit.client.0.smithi111.stdout:3/990: dread - d5/da/db/d5a/ff4 zero size 2024-09-16T09:46:20.470 INFO:tasks.workunit.client.0.smithi111.stdout:4/857: dread d2/d6/dd/d1b/d38/d64/f66 [0,4194304] 0 2024-09-16T09:46:20.470 INFO:tasks.workunit.client.0.smithi111.stdout:4/858: write d2/d6/dd/d1b/d6d/def/d69/feb [540436,38128] 0 2024-09-16T09:46:20.470 INFO:tasks.workunit.client.0.smithi111.stdout:4/859: truncate d2/d6/dd/d1b/d38/d64/d92/fc7 934849 0 2024-09-16T09:46:20.470 INFO:tasks.workunit.client.0.smithi111.stdout:2/967: dwrite d0/d45/d81/fc4 [0,4194304] 0 2024-09-16T09:46:20.470 INFO:tasks.workunit.client.0.smithi111.stdout:1/815: dwrite d3/d24/d4e/f5b [0,4194304] 0 2024-09-16T09:46:20.472 INFO:tasks.workunit.client.0.smithi111.stdout:7/757: mknod d1/d9/d53/dc0/c105 0 2024-09-16T09:46:20.474 INFO:tasks.workunit.client.0.smithi111.stdout:6/738: getdents d0/d57/db0/d49/d5b/d93 0 2024-09-16T09:46:20.478 INFO:tasks.workunit.client.0.smithi111.stdout:2/968: dread d0/d29/f6c [0,4194304] 0 2024-09-16T09:46:20.478 INFO:tasks.workunit.client.0.smithi111.stdout:3/991: mkdir d5/d18/d78/dfd/da0/d148 0 2024-09-16T09:46:20.487 INFO:tasks.workunit.client.0.smithi111.stdout:1/816: creat d3/d10/d72/da1/d99/f110 x:0 0 0 2024-09-16T09:46:20.490 INFO:tasks.workunit.client.0.smithi111.stdout:7/758: truncate d1/d3e/f74 1220701 0 2024-09-16T09:46:20.493 INFO:tasks.workunit.client.0.smithi111.stdout:6/739: rename d0/d57/db0/l2f to d0/d57/db0/d14/d20/d42/d4e/d62/dc9/lfd 0 2024-09-16T09:46:20.494 INFO:tasks.workunit.client.0.smithi111.stdout:6/740: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/fcb [990505,105040] 0 2024-09-16T09:46:20.496 INFO:tasks.workunit.client.0.smithi111.stdout:2/969: symlink d0/d29/d80/l14e 0 2024-09-16T09:46:20.498 INFO:tasks.workunit.client.0.smithi111.stdout:3/992: truncate d5/d18/d78/dfd/da0/fda 3036361 0 2024-09-16T09:46:20.500 INFO:tasks.workunit.client.0.smithi111.stdout:4/860: symlink d2/d6/l114 0 2024-09-16T09:46:20.503 INFO:tasks.workunit.client.0.smithi111.stdout:6/741: mkdir d0/d57/db0/d49/d5b/dfe 0 2024-09-16T09:46:20.506 INFO:tasks.workunit.client.0.smithi111.stdout:2/970: link d0/d2/d59/d86/d96/dc7/ff6 d0/d22/d98/d114/d9f/f14f 0 2024-09-16T09:46:20.506 INFO:tasks.workunit.client.0.smithi111.stdout:2/971: truncate d0/d22/ff7 956079 0 2024-09-16T09:46:20.509 INFO:tasks.workunit.client.0.smithi111.stdout:3/993: creat d5/da/db/de/ddb/f149 x:0 0 0 2024-09-16T09:46:20.511 INFO:tasks.workunit.client.0.smithi111.stdout:4/861: truncate d2/d6/dd/d1b/d38/f4f 3206509 0 2024-09-16T09:46:20.512 INFO:tasks.workunit.client.0.smithi111.stdout:1/817: dwrite d3/d10/d23/d8e/f100 [0,4194304] 0 2024-09-16T09:46:20.512 INFO:tasks.workunit.client.0.smithi111.stdout:7/759: dwrite d1/d20/fd4 [0,4194304] 0 2024-09-16T09:46:20.513 INFO:tasks.workunit.client.0.smithi111.stdout:2/972: creat d0/da/d128/f150 x:0 0 0 2024-09-16T09:46:20.514 INFO:tasks.workunit.client.0.smithi111.stdout:6/742: read d0/d57/db0/d47/d88/fc5 [470599,9217] 0 2024-09-16T09:46:20.515 INFO:tasks.workunit.client.0.smithi111.stdout:3/994: rename d5/d18/f58 to d5/da/d42/d74/da4/f14a 0 2024-09-16T09:46:20.517 INFO:tasks.workunit.client.0.smithi111.stdout:4/862: link d2/d6/dd/d1b/d38/db0/f43 d2/f115 0 2024-09-16T09:46:20.523 INFO:tasks.workunit.client.0.smithi111.stdout:7/760: write d1/d9/f3c [2289964,42706] 0 2024-09-16T09:46:20.524 INFO:tasks.workunit.client.0.smithi111.stdout:1/818: stat d3/d10/d1c/c4f 0 2024-09-16T09:46:20.524 INFO:tasks.workunit.client.0.smithi111.stdout:1/819: chown d3/fe9 326 1 2024-09-16T09:46:20.529 INFO:tasks.workunit.client.0.smithi111.stdout:2/973: truncate d0/da/d4e/da8/fed 2670343 0 2024-09-16T09:46:20.534 INFO:tasks.workunit.client.0.smithi111.stdout:3/995: rename d5/da/db/d3a/d6d/de7/d88/f94 to d5/da/db/d3a/d6d/dd1/d10c/f14b 0 2024-09-16T09:46:20.535 INFO:tasks.workunit.client.0.smithi111.stdout:6/743: dwrite d0/d57/db0/d47/d52/db3/fb6 [0,4194304] 0 2024-09-16T09:46:20.537 INFO:tasks.workunit.client.0.smithi111.stdout:7/761: creat d1/d9/d43/d82/f106 x:0 0 0 2024-09-16T09:46:20.539 INFO:tasks.workunit.client.0.smithi111.stdout:1/820: creat d3/d26/d63/d84/f111 x:0 0 0 2024-09-16T09:46:20.543 INFO:tasks.workunit.client.0.smithi111.stdout:4/863: dwrite d2/d6/dd/d1b/d6d/def/f82 [0,4194304] 0 2024-09-16T09:46:20.544 INFO:tasks.workunit.client.0.smithi111.stdout:2/974: rename d0/d45/d5c/d67/fa1 to d0/d45/d5c/d67/f151 0 2024-09-16T09:46:20.545 INFO:tasks.workunit.client.0.smithi111.stdout:7/762: dread d1/d16/d17/d18/d1d/d2f/f7e [0,4194304] 0 2024-09-16T09:46:20.547 INFO:tasks.workunit.client.0.smithi111.stdout:3/996: mknod d5/da/db/d5a/df8/c14c 0 2024-09-16T09:46:20.548 INFO:tasks.workunit.client.0.smithi111.stdout:3/997: readlink d5/d18/d78/dfd/l57 0 2024-09-16T09:46:20.548 INFO:tasks.workunit.client.0.smithi111.stdout:3/998: fdatasync d5/da/db/d5a/f67 0 2024-09-16T09:46:20.552 INFO:tasks.workunit.client.0.smithi111.stdout:6/744: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/cff 0 2024-09-16T09:46:20.553 INFO:tasks.workunit.client.0.smithi111.stdout:6/745: chown d0/d57/db0/d47/d68/le2 169 1 2024-09-16T09:46:20.555 INFO:tasks.workunit.client.0.smithi111.stdout:4/864: truncate d2/d6/dd/d1b/d38/db0/d2f/d9e/ff1 2675041 0 2024-09-16T09:46:20.557 INFO:tasks.workunit.client.0.smithi111.stdout:4/865: write d2/d6/dd/d1b/d38/db0/d2f/fc5 [97696,7770] 0 2024-09-16T09:46:20.561 INFO:tasks.workunit.client.0.smithi111.stdout:2/975: symlink d0/d45/d5c/dc6/l152 0 2024-09-16T09:46:20.565 INFO:tasks.workunit.client.0.smithi111.stdout:3/999: dwrite d5/da/db/d5a/ff4 [0,4194304] 0 2024-09-16T09:46:20.572 INFO:tasks.workunit.client.0.smithi111.stdout:7/763: symlink d1/d16/d17/d18/d1b/d79/da5/db2/l107 0 2024-09-16T09:46:20.572 INFO:tasks.workunit.client.0.smithi111.stdout:7/764: fdatasync d1/d3e/d9f/de2/f101 0 2024-09-16T09:46:20.574 INFO:tasks.workunit.client.0.smithi111.stdout:6/746: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f100 x:0 0 0 2024-09-16T09:46:20.574 INFO:tasks.workunit.client.0.smithi111.stdout:6/747: readlink d0/d57/db0/d47/d52/lc2 0 2024-09-16T09:46:20.574 INFO:tasks.workunit.client.0.smithi111.stdout:6/748: chown d0/d57/db0/d47/d52/fa0 143021 1 2024-09-16T09:46:20.577 INFO:tasks.workunit.client.0.smithi111.stdout:4/866: creat d2/d6/dd/d1b/d38/db0/d2f/d9e/f116 x:0 0 0 2024-09-16T09:46:20.577 INFO:tasks.workunit.client.0.smithi111.stdout:4/867: fdatasync d2/d6/dd/d1b/d38/db0/f62 0 2024-09-16T09:46:20.579 INFO:tasks.workunit.client.0.smithi111.stdout:2/976: mknod d0/d22/d98/d114/c153 0 2024-09-16T09:46:20.580 INFO:tasks.workunit.client.0.smithi111.stdout:6/749: dread d0/d57/db0/d47/d52/f82 [0,4194304] 0 2024-09-16T09:46:20.589 INFO:tasks.workunit.client.0.smithi111.stdout:7/765: mknod d1/d16/d17/d18/d1d/d2f/c108 0 2024-09-16T09:46:20.591 INFO:tasks.workunit.client.0.smithi111.stdout:2/977: creat d0/d22/d98/d114/d134/f154 x:0 0 0 2024-09-16T09:46:20.591 INFO:tasks.workunit.client.0.smithi111.stdout:2/978: read d0/d45/d5c/d67/f8c [2623043,75616] 0 2024-09-16T09:46:20.611 INFO:tasks.workunit.client.0.smithi111.stdout:2/979: write d0/da6/f112 [857340,85084] 0 2024-09-16T09:46:20.611 INFO:tasks.workunit.client.0.smithi111.stdout:2/980: chown d0/da/f11c 46 1 2024-09-16T09:46:20.613 INFO:tasks.workunit.client.0.smithi111.stdout:2/981: unlink d0/d45/d81/fc4 0 2024-09-16T09:46:20.613 INFO:tasks.workunit.client.0.smithi111.stdout:2/982: dread - d0/d45/d5c/d67/d63/dd4/dc3/dc8/f102 zero size 2024-09-16T09:46:20.613 INFO:tasks.workunit.client.0.smithi111.stdout:2/983: fsync d0/d2/d5a/f11f 0 2024-09-16T09:46:20.613 INFO:tasks.workunit.client.0.smithi111.stdout:2/984: write d0/d45/d5c/fd6 [1290443,76843] 0 2024-09-16T09:46:20.615 INFO:tasks.workunit.client.0.smithi111.stdout:2/985: mknod d0/da6/c155 0 2024-09-16T09:46:20.615 INFO:tasks.workunit.client.0.smithi111.stdout:2/986: truncate d0/d2/d59/d86/d96/ff4 1740328 0 2024-09-16T09:46:20.621 INFO:tasks.workunit.client.0.smithi111.stdout:4/868: dwrite d2/d6/dd/d1b/d38/d64/dac/fd0 [0,4194304] 0 2024-09-16T09:46:20.621 INFO:tasks.workunit.client.0.smithi111.stdout:6/750: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/ffa [0,4194304] 0 2024-09-16T09:46:20.621 INFO:tasks.workunit.client.0.smithi111.stdout:7/766: dwrite d1/d16/d17/d18/d1d/d2f/fd9 [0,4194304] 0 2024-09-16T09:46:20.626 INFO:tasks.workunit.client.0.smithi111.stdout:2/987: dread d0/f53 [4194304,4194304] 0 2024-09-16T09:46:20.626 INFO:tasks.workunit.client.0.smithi111.stdout:2/988: fsync d0/d2/d5a/f62 0 2024-09-16T09:46:20.632 INFO:tasks.workunit.client.0.smithi111.stdout:6/751: rename d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/f81 to d0/d57/db0/d47/d88/f101 0 2024-09-16T09:46:20.632 INFO:tasks.workunit.client.0.smithi111.stdout:6/752: write d0/d57/d72/db2/fdb [141743,120073] 0 2024-09-16T09:46:20.636 INFO:tasks.workunit.client.0.smithi111.stdout:7/767: rmdir d1/d16/d17/d18/d4f/df5/da7/da8 39 2024-09-16T09:46:20.639 INFO:tasks.workunit.client.0.smithi111.stdout:6/753: getdents d0 0 2024-09-16T09:46:20.640 INFO:tasks.workunit.client.0.smithi111.stdout:7/768: symlink d1/d3e/d9f/l109 0 2024-09-16T09:46:20.642 INFO:tasks.workunit.client.0.smithi111.stdout:7/769: symlink d1/d16/d17/d18/d1d/l10a 0 2024-09-16T09:46:20.662 INFO:tasks.workunit.client.0.smithi111.stdout:4/869: dwrite d2/d30/da1/fa6 [0,4194304] 0 2024-09-16T09:46:20.664 INFO:tasks.workunit.client.0.smithi111.stdout:2/989: dwrite d0/da/f3b [0,4194304] 0 2024-09-16T09:46:20.665 INFO:tasks.workunit.client.0.smithi111.stdout:4/870: mkdir d2/d6/dd/d1b/d6d/def/d69/d117 0 2024-09-16T09:46:20.665 INFO:tasks.workunit.client.0.smithi111.stdout:6/754: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f98 [0,4194304] 0 2024-09-16T09:46:20.669 INFO:tasks.workunit.client.0.smithi111.stdout:2/990: stat d0/d45/d5c/d67/d63/dd4/cfe 0 2024-09-16T09:46:20.693 INFO:tasks.workunit.client.0.smithi111.stdout:4/871: mknod d2/d6/d80/d98/c118 0 2024-09-16T09:46:20.693 INFO:tasks.workunit.client.0.smithi111.stdout:4/872: dread - d2/d6/dd/d1b/d38/db0/d2f/d6c/fe3 zero size 2024-09-16T09:46:20.693 INFO:tasks.workunit.client.0.smithi111.stdout:4/873: readlink d2/d30/da1/lde 0 2024-09-16T09:46:20.694 INFO:tasks.workunit.client.0.smithi111.stdout:6/755: symlink d0/d57/db0/d49/l102 0 2024-09-16T09:46:20.695 INFO:tasks.workunit.client.0.smithi111.stdout:2/991: creat d0/d22/d98/d114/d134/f156 x:0 0 0 2024-09-16T09:46:20.696 INFO:tasks.workunit.client.0.smithi111.stdout:2/992: stat d0/d2/l6 0 2024-09-16T09:46:20.696 INFO:tasks.workunit.client.0.smithi111.stdout:2/993: chown d0/d2/d59/d86/d96/dd1/cf3 11004 1 2024-09-16T09:46:20.698 INFO:tasks.workunit.client.0.smithi111.stdout:4/874: mkdir d2/d6/dd/d1b/d38/db0/d2f/d119 0 2024-09-16T09:46:20.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/756: symlink d0/d57/db0/d47/d68/l103 0 2024-09-16T09:46:20.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/757: write d0/d57/db0/d47/fa8 [4034531,26129] 0 2024-09-16T09:46:20.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/758: write d0/d57/db0/d49/d5b/d93/fe0 [177055,59083] 0 2024-09-16T09:46:20.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/759: chown d0/d57/db0/d14/c48 30782 1 2024-09-16T09:46:20.700 INFO:tasks.workunit.client.0.smithi111.stdout:6/760: readlink d0/d57/db0/d47/d68/lb4 0 2024-09-16T09:46:20.701 INFO:tasks.workunit.client.0.smithi111.stdout:2/994: mkdir d0/dd8/d157 0 2024-09-16T09:46:20.703 INFO:tasks.workunit.client.0.smithi111.stdout:4/875: rename d2/d6/dd/d1b/d38/db0/d2f/d119 to d2/d6/dd/d1b/d38/d64/dd8/d11a 0 2024-09-16T09:46:20.707 INFO:tasks.workunit.client.0.smithi111.stdout:2/995: truncate d0/d22/f11b 2132577 0 2024-09-16T09:46:20.714 INFO:tasks.workunit.client.0.smithi111.stdout:4/876: creat d2/d6/dd/d1b/d38/db0/f11b x:0 0 0 2024-09-16T09:46:20.714 INFO:tasks.workunit.client.0.smithi111.stdout:2/996: rmdir d0/dc5 39 2024-09-16T09:46:20.717 INFO:tasks.workunit.client.0.smithi111.stdout:6/761: dwrite d0/d57/db0/d47/f77 [0,4194304] 0 2024-09-16T09:46:20.730 INFO:tasks.workunit.client.0.smithi111.stdout:6/762: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/fbf [0,4194304] 0 2024-09-16T09:46:20.730 INFO:tasks.workunit.client.0.smithi111.stdout:2/997: dread d0/d45/d5c/d67/d63/dd4/fd3 [0,4194304] 0 2024-09-16T09:46:20.735 INFO:tasks.workunit.client.0.smithi111.stdout:6/763: creat d0/d57/db0/d47/d68/d6a/f104 x:0 0 0 2024-09-16T09:46:20.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/877: dwrite d2/d6/dd/d1b/d38/db0/f73 [0,4194304] 0 2024-09-16T09:46:20.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/878: write d2/d6/dd/d1b/d38/d64/f6b [1091092,1258] 0 2024-09-16T09:46:20.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/879: read - d2/d6/dd/d1b/d38/d64/dd8/dec/ffd zero size 2024-09-16T09:46:20.738 INFO:tasks.workunit.client.0.smithi111.stdout:4/880: read d2/d6/dd/d1b/d38/d64/f66 [639088,129299] 0 2024-09-16T09:46:20.740 INFO:tasks.workunit.client.0.smithi111.stdout:2/998: mkdir d0/d22/d158 0 2024-09-16T09:46:20.740 INFO:tasks.workunit.client.0.smithi111.stdout:2/999: dread - d0/d45/d81/f125 zero size 2024-09-16T09:46:20.743 INFO:tasks.workunit.client.0.smithi111.stdout:6/764: rename d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/cff to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/c105 0 2024-09-16T09:46:20.753 INFO:tasks.workunit.client.0.smithi111.stdout:4/881: truncate d2/d6/dd/d1b/d38/db0/d2f/d6c/fa7 887553 0 2024-09-16T09:46:20.754 INFO:tasks.workunit.client.0.smithi111.stdout:4/882: dread - d2/d6/dd/d1b/d38/db0/d2f/d4e/fad zero size 2024-09-16T09:46:20.754 INFO:tasks.workunit.client.0.smithi111.stdout:4/883: write d2/d6/dd/d1b/d6d/def/d69/f8b [319154,14919] 0 2024-09-16T09:46:20.754 INFO:tasks.workunit.client.0.smithi111.stdout:4/884: write d2/d6/dd/d1b/d6d/def/d96/f110 [53304,13861] 0 2024-09-16T09:46:20.754 INFO:tasks.workunit.client.0.smithi111.stdout:4/885: stat d2/d6/f67 0 2024-09-16T09:46:20.758 INFO:tasks.workunit.client.0.smithi111.stdout:4/886: creat d2/d6/dd/d1b/d38/d64/d65/f11c x:0 0 0 2024-09-16T09:46:20.762 INFO:tasks.workunit.client.0.smithi111.stdout:4/887: mkdir d2/d6/dd/d1b/d38/db0/d2f/d9e/d11d 0 2024-09-16T09:46:20.770 INFO:tasks.workunit.client.0.smithi111.stdout:6/765: dwrite d0/d57/db0/d47/d52/db3/ff4 [0,4194304] 0 2024-09-16T09:46:20.774 INFO:tasks.workunit.client.0.smithi111.stdout:4/888: dread d2/d6/f67 [0,4194304] 0 2024-09-16T09:46:20.780 INFO:tasks.workunit.client.0.smithi111.stdout:6/766: rename d0/d57/db0/d14/d20/d42/d4e/d62/f6c to d0/d57/db0/d14/d20/d42/d4e/d64/dcc/f106 0 2024-09-16T09:46:20.780 INFO:tasks.workunit.client.0.smithi111.stdout:4/889: symlink d2/d30/l11e 0 2024-09-16T09:46:20.781 INFO:tasks.workunit.client.0.smithi111.stdout:4/890: readlink d2/l51 0 2024-09-16T09:46:20.781 INFO:tasks.workunit.client.0.smithi111.stdout:4/891: readlink d2/d6/dd/d1b/d38/db0/d2f/d4e/le7 0 2024-09-16T09:46:20.787 INFO:tasks.workunit.client.0.smithi111.stdout:6/767: link d0/d57/db0/d47/d88/f101 d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/f107 0 2024-09-16T09:46:20.797 INFO:tasks.workunit.client.0.smithi111.stdout:6/768: unlink d0/d57/d72/f6f 0 2024-09-16T09:46:20.797 INFO:tasks.workunit.client.0.smithi111.stdout:6/769: chown d0/d57/db0/d14/d20/d42/f55 716397 1 2024-09-16T09:46:20.810 INFO:tasks.workunit.client.0.smithi111.stdout:6/770: read d0/d57/d72/f61 [2490161,122502] 0 2024-09-16T09:46:20.813 INFO:tasks.workunit.client.0.smithi111.stdout:6/771: mkdir d0/d57/db0/d47/d88/da9/d108 0 2024-09-16T09:46:20.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/772: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/l109 0 2024-09-16T09:46:20.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/773: write d0/d57/db0/d14/d20/d42/d4e/d62/f70 [41753,56972] 0 2024-09-16T09:46:20.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/774: write d0/d57/db0/d14/fcf [932372,19441] 0 2024-09-16T09:46:20.816 INFO:tasks.workunit.client.0.smithi111.stdout:6/775: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f2e [8666181,101420] 0 2024-09-16T09:46:20.819 INFO:tasks.workunit.client.0.smithi111.stdout:6/776: link d0/d57/db0/d14/d20/d42/d4e/d64/f69 d0/d57/db0/d47/d52/db3/f10a 0 2024-09-16T09:46:20.821 INFO:tasks.workunit.client.0.smithi111.stdout:6/777: rmdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f 39 2024-09-16T09:46:20.821 INFO:tasks.workunit.client.0.smithi111.stdout:6/778: write d0/d57/db0/d47/f7d [4910261,57221] 0 2024-09-16T09:46:20.823 INFO:tasks.workunit.client.0.smithi111.stdout:6/779: creat d0/daf/f10b x:0 0 0 2024-09-16T09:46:20.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/944: sync 2024-09-16T09:46:20.868 INFO:tasks.workunit.client.0.smithi111.stdout:5/945: truncate d19/d1b/d27/d2e/d98/faa 341620 0 2024-09-16T09:46:20.873 INFO:tasks.workunit.client.0.smithi111.stdout:6/780: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/f60 [0,4194304] 0 2024-09-16T09:46:20.876 INFO:tasks.workunit.client.0.smithi111.stdout:5/946: write d19/d1b/d27/d2e/d98/fce [656998,89118] 0 2024-09-16T09:46:20.885 INFO:tasks.workunit.client.0.smithi111.stdout:5/947: rename d19/d1b/d27/d2e/d39/dc6/l130 to d19/d1b/d27/d2e/d39/d6c/l13f 0 2024-09-16T09:46:20.888 INFO:tasks.workunit.client.0.smithi111.stdout:5/948: unlink d19/d1b/d9f/deb/l13a 0 2024-09-16T09:46:20.889 INFO:tasks.workunit.client.0.smithi111.stdout:6/781: dwrite d0/d57/db0/d14/f31 [0,4194304] 0 2024-09-16T09:46:20.892 INFO:tasks.workunit.client.0.smithi111.stdout:5/949: creat d19/d1b/f140 x:0 0 0 2024-09-16T09:46:20.892 INFO:tasks.workunit.client.0.smithi111.stdout:5/950: stat d19/d1b/d27/d83/l30 0 2024-09-16T09:46:20.895 INFO:tasks.workunit.client.0.smithi111.stdout:6/782: rmdir d0/d57/db0/d47/d88/da9/d108 0 2024-09-16T09:46:20.895 INFO:tasks.workunit.client.0.smithi111.stdout:6/783: readlink d0/d57/db0/d47/d68/lb4 0 2024-09-16T09:46:20.898 INFO:tasks.workunit.client.0.smithi111.stdout:6/784: mknod d0/d57/db0/d14/d20/d42/d4e/c10c 0 2024-09-16T09:46:20.900 INFO:tasks.workunit.client.0.smithi111.stdout:5/951: dread fa [0,4194304] 0 2024-09-16T09:46:20.901 INFO:tasks.workunit.client.0.smithi111.stdout:6/785: getdents d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f 0 2024-09-16T09:46:20.904 INFO:tasks.workunit.client.0.smithi111.stdout:5/952: mknod d19/d1b/d27/d2e/d39/c141 0 2024-09-16T09:46:20.907 INFO:tasks.workunit.client.0.smithi111.stdout:6/786: unlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/lcd 0 2024-09-16T09:46:20.911 INFO:tasks.workunit.client.0.smithi111.stdout:5/953: dread d19/d1b/d27/d2e/d39/d54/fc5 [0,4194304] 0 2024-09-16T09:46:20.914 INFO:tasks.workunit.client.0.smithi111.stdout:6/787: write d0/d57/db0/d47/d52/f82 [4169699,34383] 0 2024-09-16T09:46:20.914 INFO:tasks.workunit.client.0.smithi111.stdout:6/788: readlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/lf3 0 2024-09-16T09:46:20.914 INFO:tasks.workunit.client.0.smithi111.stdout:6/789: fdatasync d0/d57/db0/d14/d20/d42/d4e/d62/f70 0 2024-09-16T09:46:20.918 INFO:tasks.workunit.client.0.smithi111.stdout:6/790: symlink d0/d57/db0/l10d 0 2024-09-16T09:46:20.919 INFO:tasks.workunit.client.0.smithi111.stdout:5/954: write d19/d1b/d27/d83/f2b [2401071,33921] 0 2024-09-16T09:46:20.923 INFO:tasks.workunit.client.0.smithi111.stdout:5/955: mknod d19/d1b/d1e/d21/d29/c142 0 2024-09-16T09:46:20.923 INFO:tasks.workunit.client.0.smithi111.stdout:5/956: write d19/d1b/d27/f3b [5158111,20751] 0 2024-09-16T09:46:20.926 INFO:tasks.workunit.client.0.smithi111.stdout:5/957: rename d19/d1b/d27/d2e/l10d to d19/d1b/d27/d83/d2a/dc4/dc0/l143 0 2024-09-16T09:46:20.929 INFO:tasks.workunit.client.0.smithi111.stdout:5/958: mkdir d19/d1b/d27/d2e/d4a/d4b/d9c/d129/d144 0 2024-09-16T09:46:20.935 INFO:tasks.workunit.client.0.smithi111.stdout:6/791: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f99 [0,4194304] 0 2024-09-16T09:46:20.942 INFO:tasks.workunit.client.0.smithi111.stdout:6/792: creat d0/d57/d72/db2/f10e x:0 0 0 2024-09-16T09:46:20.943 INFO:tasks.workunit.client.0.smithi111.stdout:6/793: truncate d0/d57/db0/d47/d68/d6a/ff6 492500 0 2024-09-16T09:46:20.944 INFO:tasks.workunit.client.0.smithi111.stdout:6/794: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f9e [686770,28843] 0 2024-09-16T09:46:20.946 INFO:tasks.workunit.client.0.smithi111.stdout:6/795: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/l10f 0 2024-09-16T09:46:20.946 INFO:tasks.workunit.client.0.smithi111.stdout:6/796: fsync d0/d57/db0/d47/fad 0 2024-09-16T09:46:20.947 INFO:tasks.workunit.client.0.smithi111.stdout:6/797: truncate d0/d57/db0/d47/fa8 1974829 0 2024-09-16T09:46:20.948 INFO:tasks.workunit.client.0.smithi111.stdout:6/798: write d0/d57/db0/fed [332188,117010] 0 2024-09-16T09:46:20.950 INFO:tasks.workunit.client.0.smithi111.stdout:6/799: creat d0/d57/db0/d49/d5b/dfe/f110 x:0 0 0 2024-09-16T09:46:20.951 INFO:tasks.workunit.client.0.smithi111.stdout:6/800: readlink d0/d57/db0/l10d 0 2024-09-16T09:46:20.951 INFO:tasks.workunit.client.0.smithi111.stdout:6/801: truncate d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/fcb 1930239 0 2024-09-16T09:46:20.952 INFO:tasks.workunit.client.0.smithi111.stdout:6/802: write d0/d57/db0/d47/fac [166573,69837] 0 2024-09-16T09:46:20.954 INFO:tasks.workunit.client.0.smithi111.stdout:6/803: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/l111 0 2024-09-16T09:46:20.954 INFO:tasks.workunit.client.0.smithi111.stdout:6/804: fdatasync d0/d57/f75 0 2024-09-16T09:46:20.956 INFO:tasks.workunit.client.0.smithi111.stdout:6/805: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/l112 0 2024-09-16T09:46:20.956 INFO:tasks.workunit.client.0.smithi111.stdout:6/806: truncate d0/d57/db0/d49/d5b/dfe/f110 606661 0 2024-09-16T09:46:20.958 INFO:tasks.workunit.client.0.smithi111.stdout:6/807: rmdir d0/d57/db0/d47/d88/da9 39 2024-09-16T09:46:20.958 INFO:tasks.workunit.client.0.smithi111.stdout:6/808: fdatasync d0/d57/db0/d49/d5b/d93/fe0 0 2024-09-16T09:46:20.975 INFO:tasks.workunit.client.0.smithi111.stdout:6/809: dwrite d0/d57/db0/d14/f31 [0,4194304] 0 2024-09-16T09:46:20.977 INFO:tasks.workunit.client.0.smithi111.stdout:6/810: rmdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33 39 2024-09-16T09:46:20.978 INFO:tasks.workunit.client.0.smithi111.stdout:6/811: write d0/d57/db0/d47/d68/d6a/ff6 [1007524,1038] 0 2024-09-16T09:46:20.978 INFO:tasks.workunit.client.0.smithi111.stdout:6/812: rmdir d0/d57/db0/d14/d20/d42/d4e/d62/dc9 39 2024-09-16T09:46:20.980 INFO:tasks.workunit.client.0.smithi111.stdout:6/813: getdents d0/d57/db0/d14/d20/d42 0 2024-09-16T09:46:20.980 INFO:tasks.workunit.client.0.smithi111.stdout:6/814: chown d0/d57/db0/d14/d20/d42/d4e/d64 514127701 1 2024-09-16T09:46:20.980 INFO:tasks.workunit.client.0.smithi111.stdout:6/815: fdatasync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f100 0 2024-09-16T09:46:20.980 INFO:tasks.workunit.client.0.smithi111.stdout:6/816: write d0/d57/db0/d47/d68/fce [1309686,129351] 0 2024-09-16T09:46:20.982 INFO:tasks.workunit.client.0.smithi111.stdout:6/817: getdents d0/d57/db0/d14/d20 0 2024-09-16T09:46:20.983 INFO:tasks.workunit.client.0.smithi111.stdout:6/818: creat d0/d57/db0/d14/d20/d42/dbd/f113 x:0 0 0 2024-09-16T09:46:20.986 INFO:tasks.workunit.client.0.smithi111.stdout:6/819: rename d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/fe4 to d0/d57/db0/d49/f114 0 2024-09-16T09:46:20.988 INFO:tasks.workunit.client.0.smithi111.stdout:6/820: rename d0/d57/db0/d47/d52/f82 to d0/d57/db0/d47/d88/f115 0 2024-09-16T09:46:20.991 INFO:tasks.workunit.client.0.smithi111.stdout:0/891: sync 2024-09-16T09:46:20.991 INFO:tasks.workunit.client.0.smithi111.stdout:8/934: sync 2024-09-16T09:46:20.993 INFO:tasks.workunit.client.0.smithi111.stdout:0/892: truncate d0/d1d/d67/d3a/d92/f97 4154075 0 2024-09-16T09:46:20.993 INFO:tasks.workunit.client.0.smithi111.stdout:0/893: chown d0/d1d/d58/d83/d9a/dd9/de9/f123 245948 1 2024-09-16T09:46:20.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/935: rename d3/de/d1e/d2e/dce/cf1 to d3/de/d1e/d2e/d74/d83/c133 0 2024-09-16T09:46:20.996 INFO:tasks.workunit.client.0.smithi111.stdout:8/936: write d3/f19 [4779337,101039] 0 2024-09-16T09:46:20.997 INFO:tasks.workunit.client.0.smithi111.stdout:8/937: readlink d3/de/d1e/d2e/d2f/da8/dbe/laa 0 2024-09-16T09:46:20.997 INFO:tasks.workunit.client.0.smithi111.stdout:6/821: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f2e [4194304,4194304] 0 2024-09-16T09:46:20.998 INFO:tasks.workunit.client.0.smithi111.stdout:0/894: mkdir d0/d120/d148 0 2024-09-16T09:46:21.000 INFO:tasks.workunit.client.0.smithi111.stdout:8/938: creat d3/f134 x:0 0 0 2024-09-16T09:46:21.002 INFO:tasks.workunit.client.0.smithi111.stdout:6/822: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/c116 0 2024-09-16T09:46:21.002 INFO:tasks.workunit.client.0.smithi111.stdout:6/823: chown d0/d57/db0/d47/d52/db3/f10a 31885 1 2024-09-16T09:46:21.002 INFO:tasks.workunit.client.0.smithi111.stdout:6/824: readlink d0/d57/db0/l10d 0 2024-09-16T09:46:21.002 INFO:tasks.workunit.client.0.smithi111.stdout:6/825: dread - d0/d57/d72/db2/f10e zero size 2024-09-16T09:46:21.002 INFO:tasks.workunit.client.0.smithi111.stdout:6/826: readlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/l10f 0 2024-09-16T09:46:21.005 INFO:tasks.workunit.client.0.smithi111.stdout:0/895: rmdir d0/de3/d11e 0 2024-09-16T09:46:21.005 INFO:tasks.workunit.client.0.smithi111.stdout:0/896: write d0/de3/ff8 [399798,20029] 0 2024-09-16T09:46:21.007 INFO:tasks.workunit.client.0.smithi111.stdout:8/939: readlink d3/da/db/d59/dd7/d9e/dd8/l119 0 2024-09-16T09:46:21.007 INFO:tasks.workunit.client.0.smithi111.stdout:8/940: write d3/de/d6e/d8f/f124 [1487694,52557] 0 2024-09-16T09:46:21.009 INFO:tasks.workunit.client.0.smithi111.stdout:6/827: rename d0/d57/db0/d49/cc0 to d0/d57/d72/db2/c117 0 2024-09-16T09:46:21.014 INFO:tasks.workunit.client.0.smithi111.stdout:0/897: mknod d0/da4/d143/c149 0 2024-09-16T09:46:21.014 INFO:tasks.workunit.client.0.smithi111.stdout:0/898: readlink d0/d1d/d58/d83/lc3 0 2024-09-16T09:46:21.031 INFO:tasks.workunit.client.0.smithi111.stdout:6/828: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f2e [4194304,4194304] 0 2024-09-16T09:46:21.031 INFO:tasks.workunit.client.0.smithi111.stdout:8/941: rename d3/d26/d6d/db6/fc6 to d3/de/d1e/d2e/d74/f135 0 2024-09-16T09:46:21.034 INFO:tasks.workunit.client.0.smithi111.stdout:0/899: mkdir d0/d26/d35/d14a 0 2024-09-16T09:46:21.034 INFO:tasks.workunit.client.0.smithi111.stdout:6/829: dread d0/d57/db0/d47/fac [0,4194304] 0 2024-09-16T09:46:21.034 INFO:tasks.workunit.client.0.smithi111.stdout:6/830: write d0/d57/d72/db2/fdb [205168,80989] 0 2024-09-16T09:46:21.034 INFO:tasks.workunit.client.0.smithi111.stdout:6/831: stat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/l109 0 2024-09-16T09:46:21.034 INFO:tasks.workunit.client.0.smithi111.stdout:6/832: write d0/f12 [4673371,34248] 0 2024-09-16T09:46:21.035 INFO:tasks.workunit.client.0.smithi111.stdout:6/833: dread - d0/d57/db0/d49/d5b/fa4 zero size 2024-09-16T09:46:21.036 INFO:tasks.workunit.client.0.smithi111.stdout:8/942: mkdir d3/de/d136 0 2024-09-16T09:46:21.038 INFO:tasks.workunit.client.0.smithi111.stdout:0/900: getdents d0/d1d/d67/d3a/d77/dad/d106 0 2024-09-16T09:46:21.039 INFO:tasks.workunit.client.0.smithi111.stdout:0/901: truncate d0/d1d/d58/d83/fdc 5007969 0 2024-09-16T09:46:21.041 INFO:tasks.workunit.client.0.smithi111.stdout:6/834: link d0/d57/db0/d14/d20/d42/d4e/d62/dc9/lfd d0/d57/db0/d14/d20/d42/d4e/d62/l118 0 2024-09-16T09:46:21.041 INFO:tasks.workunit.client.0.smithi111.stdout:6/835: chown d0/d57/db0/d14/fcf 2 1 2024-09-16T09:46:21.044 INFO:tasks.workunit.client.0.smithi111.stdout:0/902: dread d0/d1d/d67/d3a/d80/f56 [0,4194304] 0 2024-09-16T09:46:21.045 INFO:tasks.workunit.client.0.smithi111.stdout:8/943: rename d3/da/fe9 to d3/dc3/d130/d129/d12a/f137 0 2024-09-16T09:46:21.048 INFO:tasks.workunit.client.0.smithi111.stdout:0/903: symlink d0/d1d/d67/d3a/l14b 0 2024-09-16T09:46:21.052 INFO:tasks.workunit.client.0.smithi111.stdout:6/836: write d0/f3a [1085014,4076] 0 2024-09-16T09:46:21.052 INFO:tasks.workunit.client.0.smithi111.stdout:6/837: dread - d0/daf/f10b zero size 2024-09-16T09:46:21.052 INFO:tasks.workunit.client.0.smithi111.stdout:8/944: dread d3/de/d1e/d2e/d2f/f63 [0,4194304] 0 2024-09-16T09:46:21.052 INFO:tasks.workunit.client.0.smithi111.stdout:0/904: mknod d0/da4/ddd/c14c 0 2024-09-16T09:46:21.056 INFO:tasks.workunit.client.0.smithi111.stdout:0/905: creat d0/d1d/d67/d3a/d80/f14d x:0 0 0 2024-09-16T09:46:21.056 INFO:tasks.workunit.client.0.smithi111.stdout:0/906: write d0/d1d/d58/ff2 [481498,111747] 0 2024-09-16T09:46:21.056 INFO:tasks.workunit.client.0.smithi111.stdout:0/907: fdatasync d0/d1d/d67/d3a/d3d/f48 0 2024-09-16T09:46:21.061 INFO:tasks.workunit.client.0.smithi111.stdout:0/908: mkdir d0/d1d/d58/d64/dd6/ddf/d14e 0 2024-09-16T09:46:21.061 INFO:tasks.workunit.client.0.smithi111.stdout:0/909: dread - d0/d1d/d58/d64/fb1 zero size 2024-09-16T09:46:21.061 INFO:tasks.workunit.client.0.smithi111.stdout:0/910: fsync d0/d1d/d67/d3a/d92/ff5 0 2024-09-16T09:46:21.068 INFO:tasks.workunit.client.0.smithi111.stdout:0/911: link d0/d26/d35/d86/f132 d0/d1d/d67/d3a/d92/f14f 0 2024-09-16T09:46:21.068 INFO:tasks.workunit.client.0.smithi111.stdout:0/912: write d0/f22 [11703471,100139] 0 2024-09-16T09:46:21.072 INFO:tasks.workunit.client.0.smithi111.stdout:0/913: link d0/d1d/d67/d3a/f6f d0/dfb/f150 0 2024-09-16T09:46:21.072 INFO:tasks.workunit.client.0.smithi111.stdout:0/914: dread - d0/da4/f114 zero size 2024-09-16T09:46:21.112 INFO:tasks.workunit.client.0.smithi111.stdout:6/838: dwrite d0/d57/db0/d14/d20/d42/f55 [4194304,4194304] 0 2024-09-16T09:46:21.119 INFO:tasks.workunit.client.0.smithi111.stdout:0/915: write d0/de3/fe4 [3741665,25352] 0 2024-09-16T09:46:21.119 INFO:tasks.workunit.client.0.smithi111.stdout:0/916: fsync d0/d1d/d58/d64/f104 0 2024-09-16T09:46:21.139 INFO:tasks.workunit.client.0.smithi111.stdout:0/917: dwrite d0/da4/f82 [0,4194304] 0 2024-09-16T09:46:21.139 INFO:tasks.workunit.client.0.smithi111.stdout:0/918: write d0/d1d/d58/d64/fd7 [489908,2444] 0 2024-09-16T09:46:21.144 INFO:tasks.workunit.client.0.smithi111.stdout:0/919: mknod d0/d120/d148/c151 0 2024-09-16T09:46:21.155 INFO:tasks.workunit.client.0.smithi111.stdout:0/920: write d0/d1d/d58/d64/d4f/f52 [3264976,1051] 0 2024-09-16T09:46:21.155 INFO:tasks.workunit.client.0.smithi111.stdout:0/921: write d0/fc0 [807559,22199] 0 2024-09-16T09:46:21.159 INFO:tasks.workunit.client.0.smithi111.stdout:0/922: mknod d0/da4/c152 0 2024-09-16T09:46:21.159 INFO:tasks.workunit.client.0.smithi111.stdout:0/923: chown d0/d1d/d67/d3a/d3d/f48 7 1 2024-09-16T09:46:21.177 INFO:tasks.workunit.client.0.smithi111.stdout:0/924: dwrite d0/fa0 [0,4194304] 0 2024-09-16T09:46:21.177 INFO:tasks.workunit.client.0.smithi111.stdout:0/925: fdatasync d0/f12a 0 2024-09-16T09:46:21.188 INFO:tasks.workunit.client.0.smithi111.stdout:0/926: write d0/d26/d35/d86/fa3 [717840,73026] 0 2024-09-16T09:46:21.202 INFO:tasks.workunit.client.0.smithi111.stdout:0/927: dwrite d0/d1d/d67/d3a/f6f [0,4194304] 0 2024-09-16T09:46:21.208 INFO:tasks.workunit.client.0.smithi111.stdout:0/928: rename d0/d1d/d58/d64/cb0 to d0/d1d/d58/d83/d133/c153 0 2024-09-16T09:46:21.212 INFO:tasks.workunit.client.0.smithi111.stdout:0/929: mknod d0/d1d/d58/d64/dd6/ddf/c154 0 2024-09-16T09:46:21.213 INFO:tasks.workunit.client.0.smithi111.stdout:0/930: fsync d0/d1d/d67/fda 0 2024-09-16T09:46:21.213 INFO:tasks.workunit.client.0.smithi111.stdout:9/735: sync 2024-09-16T09:46:21.213 INFO:tasks.workunit.client.0.smithi111.stdout:1/821: sync 2024-09-16T09:46:21.213 INFO:tasks.workunit.client.0.smithi111.stdout:1/822: fsync d3/f1a 0 2024-09-16T09:46:21.213 INFO:tasks.workunit.client.0.smithi111.stdout:1/823: readlink d3/d10/d23/df6/d47/d65/d85/l9d 0 2024-09-16T09:46:21.213 INFO:tasks.workunit.client.0.smithi111.stdout:1/824: fsync d3/d24/d4e/f5b 0 2024-09-16T09:46:21.215 INFO:tasks.workunit.client.0.smithi111.stdout:0/931: creat d0/d1d/d67/f155 x:0 0 0 2024-09-16T09:46:21.216 INFO:tasks.workunit.client.0.smithi111.stdout:0/932: readlink d0/d1d/d58/d83/lc3 0 2024-09-16T09:46:21.216 INFO:tasks.workunit.client.0.smithi111.stdout:0/933: chown d0/f1c 2 1 2024-09-16T09:46:21.216 INFO:tasks.workunit.client.0.smithi111.stdout:0/934: chown d0/d1d/d58/d64/f88 1893759 1 2024-09-16T09:46:21.216 INFO:tasks.workunit.client.0.smithi111.stdout:0/935: fsync d0/f13 0 2024-09-16T09:46:21.216 INFO:tasks.workunit.client.0.smithi111.stdout:0/936: dread - d0/d1d/d58/d64/dd6/ddf/f135 zero size 2024-09-16T09:46:21.218 INFO:tasks.workunit.client.0.smithi111.stdout:1/825: rename d3/d10/d72/da1/d28/d36/c58 to d3/d10/d23/c112 0 2024-09-16T09:46:21.218 INFO:tasks.workunit.client.0.smithi111.stdout:1/826: chown d3/d10/d23/de8/ffd 20394 1 2024-09-16T09:46:21.218 INFO:tasks.workunit.client.0.smithi111.stdout:1/827: stat d3/d10/d57/dcc/fd4 0 2024-09-16T09:46:21.221 INFO:tasks.workunit.client.0.smithi111.stdout:1/828: creat d3/d24/d29/f113 x:0 0 0 2024-09-16T09:46:21.222 INFO:tasks.workunit.client.0.smithi111.stdout:0/937: dread d0/d1d/d67/d3a/fac [0,4194304] 0 2024-09-16T09:46:21.223 INFO:tasks.workunit.client.0.smithi111.stdout:1/829: rename d3/d10/d23/df6/d47/d65/c6d to d3/d24/d4e/d6f/c114 0 2024-09-16T09:46:21.225 INFO:tasks.workunit.client.0.smithi111.stdout:0/938: creat d0/d120/d148/f156 x:0 0 0 2024-09-16T09:46:21.225 INFO:tasks.workunit.client.0.smithi111.stdout:0/939: write d0/d26/d35/d86/de5/f140 [752164,1970] 0 2024-09-16T09:46:21.226 INFO:tasks.workunit.client.0.smithi111.stdout:0/940: mknod d0/d1d/d58/d64/dd6/ddf/c157 0 2024-09-16T09:46:21.229 INFO:tasks.workunit.client.0.smithi111.stdout:0/941: creat d0/d1d/d58/d64/dd6/ddf/f158 x:0 0 0 2024-09-16T09:46:21.229 INFO:tasks.workunit.client.0.smithi111.stdout:0/942: dread - d0/d1d/d67/fda zero size 2024-09-16T09:46:21.233 INFO:tasks.workunit.client.0.smithi111.stdout:9/736: dwrite d0/d21/d22/fa6 [0,4194304] 0 2024-09-16T09:46:21.238 INFO:tasks.workunit.client.0.smithi111.stdout:1/830: write d3/d10/d23/d8e/ff2 [10849,37675] 0 2024-09-16T09:46:21.238 INFO:tasks.workunit.client.0.smithi111.stdout:1/831: stat d3/d10/d57/d8f/l93 0 2024-09-16T09:46:21.240 INFO:tasks.workunit.client.0.smithi111.stdout:0/943: dread d0/f22 [8388608,4194304] 0 2024-09-16T09:46:21.240 INFO:tasks.workunit.client.0.smithi111.stdout:9/737: getdents d0/d6/d8/da2 0 2024-09-16T09:46:21.247 INFO:tasks.workunit.client.0.smithi111.stdout:0/944: creat d0/d1d/d58/d64/d4f/d13e/f159 x:0 0 0 2024-09-16T09:46:21.248 INFO:tasks.workunit.client.0.smithi111.stdout:0/945: truncate d0/d1d/d58/ff2 1095592 0 2024-09-16T09:46:21.250 INFO:tasks.workunit.client.0.smithi111.stdout:9/738: mknod d0/d6/d30/d81/cfb 0 2024-09-16T09:46:21.253 INFO:tasks.workunit.client.0.smithi111.stdout:9/739: link d0/d21/d22/d6e/dab/fd0 d0/ffc 0 2024-09-16T09:46:21.253 INFO:tasks.workunit.client.0.smithi111.stdout:9/740: chown d0/d21/d22/fa6 372667937 1 2024-09-16T09:46:21.257 INFO:tasks.workunit.client.0.smithi111.stdout:9/741: symlink d0/d6/d75/lfd 0 2024-09-16T09:46:21.257 INFO:tasks.workunit.client.0.smithi111.stdout:1/832: dwrite d3/d26/d63/f9b [0,4194304] 0 2024-09-16T09:46:21.257 INFO:tasks.workunit.client.0.smithi111.stdout:1/833: truncate d3/d24/d29/f113 859466 0 2024-09-16T09:46:21.257 INFO:tasks.workunit.client.0.smithi111.stdout:1/834: fsync d3/d24/d62/f90 0 2024-09-16T09:46:21.257 INFO:tasks.workunit.client.0.smithi111.stdout:1/835: chown d3/d26/c30 5 1 2024-09-16T09:46:21.259 INFO:tasks.workunit.client.0.smithi111.stdout:9/742: mkdir d0/d6/d8/de/d56/d8e/dfa/dfe 0 2024-09-16T09:46:21.262 INFO:tasks.workunit.client.0.smithi111.stdout:1/836: rmdir d3/d24/d62/db3 39 2024-09-16T09:46:21.274 INFO:tasks.workunit.client.0.smithi111.stdout:9/743: dread d0/d6/d8/de/d56/d8e/dcf/fe6 [4194304,4194304] 0 2024-09-16T09:46:21.274 INFO:tasks.workunit.client.0.smithi111.stdout:9/744: chown d0/d6/fb9 20 1 2024-09-16T09:46:21.274 INFO:tasks.workunit.client.0.smithi111.stdout:9/745: chown d0/d48/c88 5 1 2024-09-16T09:46:21.274 INFO:tasks.workunit.client.0.smithi111.stdout:9/746: write d0/d48/f96 [117992,12607] 0 2024-09-16T09:46:21.275 INFO:tasks.workunit.client.0.smithi111.stdout:9/747: chown d0/d6/d8/de/f2f 10 1 2024-09-16T09:46:21.281 INFO:tasks.workunit.client.0.smithi111.stdout:1/837: dwrite d3/d10/d23/df6/d47/d65/df7/ffa [0,4194304] 0 2024-09-16T09:46:21.288 INFO:tasks.workunit.client.0.smithi111.stdout:9/748: dread d0/d21/f8f [0,4194304] 0 2024-09-16T09:46:21.288 INFO:tasks.workunit.client.0.smithi111.stdout:9/749: chown d0/d21/d22/d6e/d7d/d9a/fd4 1641 1 2024-09-16T09:46:21.290 INFO:tasks.workunit.client.0.smithi111.stdout:1/838: rmdir d3/d10/d23/df6/d47/d10e 0 2024-09-16T09:46:21.292 INFO:tasks.workunit.client.0.smithi111.stdout:9/750: link d0/d48/f96 d0/d6/d8/de/d56/fff 0 2024-09-16T09:46:21.293 INFO:tasks.workunit.client.0.smithi111.stdout:9/751: fsync d0/d6/d8/de/d56/d4e/d92/fb3 0 2024-09-16T09:46:21.295 INFO:tasks.workunit.client.0.smithi111.stdout:9/752: rename d0/d6/c37 to d0/d6/d8/de/d56/d8e/dfa/dfe/c100 0 2024-09-16T09:46:21.295 INFO:tasks.workunit.client.0.smithi111.stdout:9/753: dread - d0/d6/d8/de/d56/fde zero size 2024-09-16T09:46:21.295 INFO:tasks.workunit.client.0.smithi111.stdout:9/754: read - d0/d6/fb9 zero size 2024-09-16T09:46:21.322 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:21 smithi111 ceph-mon[27997]: Manager daemon smithi114.xvotey is now available 2024-09-16T09:46:21.327 INFO:tasks.workunit.client.0.smithi111.stdout:4/892: sync 2024-09-16T09:46:21.327 INFO:tasks.workunit.client.0.smithi111.stdout:7/770: sync 2024-09-16T09:46:21.329 INFO:tasks.workunit.client.0.smithi111.stdout:7/771: creat d1/d20/da3/dfa/dfc/f10b x:0 0 0 2024-09-16T09:46:21.329 INFO:tasks.workunit.client.0.smithi111.stdout:7/772: stat d1/d9/d53/f78 0 2024-09-16T09:46:21.350 INFO:tasks.workunit.client.0.smithi111.stdout:7/773: dwrite d1/d9/f34 [0,4194304] 0 2024-09-16T09:46:21.350 INFO:tasks.workunit.client.0.smithi111.stdout:7/774: fdatasync d1/d3e/d9f/fbd 0 2024-09-16T09:46:21.357 INFO:tasks.workunit.client.0.smithi111.stdout:7/775: symlink d1/d9/l10c 0 2024-09-16T09:46:21.378 INFO:tasks.workunit.client.0.smithi111.stdout:7/776: dwrite d1/d9/f35 [0,4194304] 0 2024-09-16T09:46:21.383 INFO:tasks.workunit.client.0.smithi111.stdout:7/777: dread d1/d16/d17/d18/d4f/d88/fad [0,4194304] 0 2024-09-16T09:46:21.386 INFO:tasks.workunit.client.0.smithi111.stdout:7/778: read d1/f32 [4623342,115570] 0 2024-09-16T09:46:21.400 INFO:tasks.workunit.client.0.smithi111.stdout:7/779: dwrite d1/d16/f72 [0,4194304] 0 2024-09-16T09:46:21.408 INFO:tasks.workunit.client.0.smithi111.stdout:7/780: rename d1/d9/fb9 to d1/d16/d17/d18/d1b/f10d 0 2024-09-16T09:46:21.416 INFO:tasks.workunit.client.0.smithi111.stdout:7/781: write d1/d16/d17/d18/d4f/df5/f76 [3036789,107768] 0 2024-09-16T09:46:21.416 INFO:tasks.workunit.client.0.smithi111.stdout:7/782: chown d1/d3e/d9e/fd2 2389620 1 2024-09-16T09:46:21.419 INFO:tasks.workunit.client.0.smithi111.stdout:7/783: link d1/d3e/fc1 d1/d3e/d9f/de2/f10e 0 2024-09-16T09:46:21.422 INFO:tasks.workunit.client.0.smithi111.stdout:7/784: symlink d1/d16/d17/d18/d1b/d79/d8c/l10f 0 2024-09-16T09:46:21.425 INFO:tasks.workunit.client.0.smithi111.stdout:7/785: symlink d1/d9/d43/l110 0 2024-09-16T09:46:21.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:21 smithi114 ceph-mon[35635]: Manager daemon smithi114.xvotey is now available 2024-09-16T09:46:21.445 INFO:tasks.workunit.client.0.smithi111.stdout:7/786: dwrite d1/d16/d17/d18/d4f/df5/f76 [0,4194304] 0 2024-09-16T09:46:21.447 INFO:tasks.workunit.client.0.smithi111.stdout:7/787: creat d1/d9/d43/f111 x:0 0 0 2024-09-16T09:46:21.449 INFO:tasks.workunit.client.0.smithi111.stdout:7/788: symlink d1/d9/d53/dc0/l112 0 2024-09-16T09:46:21.452 INFO:tasks.workunit.client.0.smithi111.stdout:7/789: creat d1/d16/d17/d18/d4f/df5/da7/da8/f113 x:0 0 0 2024-09-16T09:46:21.452 INFO:tasks.workunit.client.0.smithi111.stdout:7/790: fsync d1/d16/d17/d18/d4f/df5/f45 0 2024-09-16T09:46:21.453 INFO:tasks.workunit.client.0.smithi111.stdout:7/791: creat d1/d16/d17/d18/d1b/d79/d8c/f114 x:0 0 0 2024-09-16T09:46:21.455 INFO:tasks.workunit.client.0.smithi111.stdout:7/792: creat d1/d16/d17/d18/d1b/d79/d8c/d98/f115 x:0 0 0 2024-09-16T09:46:21.456 INFO:tasks.workunit.client.0.smithi111.stdout:7/793: stat d1/d20/da3/dfa 0 2024-09-16T09:46:21.457 INFO:tasks.workunit.client.0.smithi111.stdout:7/794: unlink d1/d9/d53/cde 0 2024-09-16T09:46:21.458 INFO:tasks.workunit.client.0.smithi111.stdout:7/795: read d1/d16/d17/d18/d1d/d2f/f7e [1776413,42956] 0 2024-09-16T09:46:21.459 INFO:tasks.workunit.client.0.smithi111.stdout:7/796: symlink d1/d20/l116 0 2024-09-16T09:46:21.479 INFO:tasks.workunit.client.0.smithi111.stdout:7/797: dwrite d1/d16/d17/d18/f4c [0,4194304] 0 2024-09-16T09:46:21.481 INFO:tasks.workunit.client.0.smithi111.stdout:7/798: mknod d1/d16/d17/d18/d1b/d79/d8c/c117 0 2024-09-16T09:46:21.482 INFO:tasks.workunit.client.0.smithi111.stdout:7/799: getdents d1/d3e/d9e/de0 0 2024-09-16T09:46:21.486 INFO:tasks.workunit.client.0.smithi111.stdout:7/800: creat d1/d9/d53/f118 x:0 0 0 2024-09-16T09:46:21.489 INFO:tasks.workunit.client.0.smithi111.stdout:7/801: creat d1/d16/d17/d18/d1b/d79/da5/db2/f119 x:0 0 0 2024-09-16T09:46:21.492 INFO:tasks.workunit.client.0.smithi111.stdout:7/802: creat d1/d16/d17/d18/d1d/d2f/f11a x:0 0 0 2024-09-16T09:46:21.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/803: mknod d1/d16/d17/d18/d4f/d56/c11b 0 2024-09-16T09:46:21.498 INFO:tasks.workunit.client.0.smithi111.stdout:7/804: symlink d1/d16/d17/l11c 0 2024-09-16T09:46:21.507 INFO:tasks.workunit.client.0.smithi111.stdout:7/805: dread d1/d16/d17/d18/f4c [0,4194304] 0 2024-09-16T09:46:21.512 INFO:tasks.workunit.client.0.smithi111.stdout:7/806: dread d1/d9/d43/d82/fba [0,4194304] 0 2024-09-16T09:46:21.520 INFO:tasks.workunit.client.0.smithi111.stdout:7/807: dread d1/d16/f72 [0,4194304] 0 2024-09-16T09:46:21.523 INFO:tasks.workunit.client.0.smithi111.stdout:7/808: rename d1/d9/fb4 to d1/d16/d17/d18/f11d 0 2024-09-16T09:46:21.572 INFO:tasks.workunit.client.0.smithi111.stdout:8/945: sync 2024-09-16T09:46:21.572 INFO:tasks.workunit.client.0.smithi111.stdout:5/959: sync 2024-09-16T09:46:21.572 INFO:tasks.workunit.client.0.smithi111.stdout:5/960: read - d19/d1b/d27/d2e/d98/f10a zero size 2024-09-16T09:46:21.574 INFO:tasks.workunit.client.0.smithi111.stdout:5/961: symlink d19/d1b/d27/d2e/d39/d54/d60/d11a/l145 0 2024-09-16T09:46:21.574 INFO:tasks.workunit.client.0.smithi111.stdout:5/962: chown d19/d1b/d27/d83/f63 37 1 2024-09-16T09:46:21.575 INFO:tasks.workunit.client.0.smithi111.stdout:5/963: chown d19/d1b/d27/d2e/d39/f4e 968 1 2024-09-16T09:46:21.575 INFO:tasks.workunit.client.0.smithi111.stdout:5/964: dread - d19/d1b/d27/d2e/d39/d54/d60/f132 zero size 2024-09-16T09:46:21.576 INFO:tasks.workunit.client.0.smithi111.stdout:5/965: creat d19/d1b/d1e/d81/dec/f146 x:0 0 0 2024-09-16T09:46:21.576 INFO:tasks.workunit.client.0.smithi111.stdout:5/966: read d19/d1b/d27/f3d [1760182,123897] 0 2024-09-16T09:46:21.581 INFO:tasks.workunit.client.0.smithi111.stdout:8/946: dread d3/de/d1e/d2e/d74/fd3 [0,4194304] 0 2024-09-16T09:46:21.583 INFO:tasks.workunit.client.0.smithi111.stdout:8/947: truncate d3/de/d1e/d2e/d2f/da8/dbe/f11c 1755655 0 2024-09-16T09:46:21.586 INFO:tasks.workunit.client.0.smithi111.stdout:8/948: rmdir d3/dc3/d130/d129 39 2024-09-16T09:46:21.588 INFO:tasks.workunit.client.0.smithi111.stdout:8/949: rmdir d3/de 39 2024-09-16T09:46:21.592 INFO:tasks.workunit.client.0.smithi111.stdout:8/950: creat d3/d26/d6d/db6/de3/f138 x:0 0 0 2024-09-16T09:46:21.592 INFO:tasks.workunit.client.0.smithi111.stdout:8/951: chown d3/da/db/d59/dd7/dcc/ce2 12017 1 2024-09-16T09:46:21.592 INFO:tasks.workunit.client.0.smithi111.stdout:8/952: chown d3/da/db/d59/dd7/dcc/d100/f117 9886431 1 2024-09-16T09:46:21.592 INFO:tasks.workunit.client.0.smithi111.stdout:8/953: read d3/de/d6e/d8f/f124 [944352,17838] 0 2024-09-16T09:46:21.593 INFO:tasks.workunit.client.0.smithi111.stdout:5/967: dwrite d19/d1b/d27/d83/d2a/f84 [0,4194304] 0 2024-09-16T09:46:21.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/968: mkdir d19/d1b/d27/d2e/df3/d100/d10b/d147 0 2024-09-16T09:46:21.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/969: write d19/d1b/d27/d2e/d39/fbe [4853391,59216] 0 2024-09-16T09:46:21.601 INFO:tasks.workunit.client.0.smithi111.stdout:5/970: write d19/d1b/d1e/d21/f5e [5138652,59340] 0 2024-09-16T09:46:21.604 INFO:tasks.workunit.client.0.smithi111.stdout:5/971: mknod d19/d1b/d27/d2e/d4a/d4b/d12e/c148 0 2024-09-16T09:46:21.606 INFO:tasks.workunit.client.0.smithi111.stdout:5/972: rmdir d19/d1b/d27/d2e/d98 39 2024-09-16T09:46:21.609 INFO:tasks.workunit.client.0.smithi111.stdout:8/954: dwrite d3/d26/f40 [4194304,4194304] 0 2024-09-16T09:46:21.611 INFO:tasks.workunit.client.0.smithi111.stdout:8/955: symlink d3/de/d1e/d2e/d2f/da8/dbe/d6b/l139 0 2024-09-16T09:46:21.617 INFO:tasks.workunit.client.0.smithi111.stdout:5/973: dread d19/d1b/d27/d2e/f91 [0,4194304] 0 2024-09-16T09:46:21.621 INFO:tasks.workunit.client.0.smithi111.stdout:5/974: mknod d19/d1b/d27/d2e/d39/d6c/c149 0 2024-09-16T09:46:21.627 INFO:tasks.workunit.client.0.smithi111.stdout:5/975: mknod d19/d1b/d9f/deb/d113/c14a 0 2024-09-16T09:46:21.630 INFO:tasks.workunit.client.0.smithi111.stdout:5/976: symlink d19/d1b/d27/d2e/d4a/d4b/d12e/l14b 0 2024-09-16T09:46:21.632 INFO:tasks.workunit.client.0.smithi111.stdout:5/977: symlink d19/d1b/d1e/d81/dec/l14c 0 2024-09-16T09:46:21.641 INFO:tasks.workunit.client.0.smithi111.stdout:8/956: dwrite d3/de/d1e/d2e/d2f/fe1 [0,4194304] 0 2024-09-16T09:46:21.641 INFO:tasks.workunit.client.0.smithi111.stdout:8/957: dread - d3/de/d1e/fbf zero size 2024-09-16T09:46:21.645 INFO:tasks.workunit.client.0.smithi111.stdout:8/958: mknod d3/de/d1e/d2e/d74/dad/dba/c13a 0 2024-09-16T09:46:21.647 INFO:tasks.workunit.client.0.smithi111.stdout:8/959: mknod d3/da/db/d59/c13b 0 2024-09-16T09:46:21.649 INFO:tasks.workunit.client.0.smithi111.stdout:8/960: truncate d3/d26/f46 3680279 0 2024-09-16T09:46:21.649 INFO:tasks.workunit.client.0.smithi111.stdout:8/961: read d3/d26/d6d/f4f [2407709,88084] 0 2024-09-16T09:46:21.649 INFO:tasks.workunit.client.0.smithi111.stdout:8/962: write d3/de/d6e/fdb [4412628,43766] 0 2024-09-16T09:46:21.649 INFO:tasks.workunit.client.0.smithi111.stdout:5/978: dwrite d19/d1b/d1e/d81/faf [0,4194304] 0 2024-09-16T09:46:21.653 INFO:tasks.workunit.client.0.smithi111.stdout:8/963: unlink d3/de/d1e/d2e/d74/f8c 0 2024-09-16T09:46:21.675 INFO:tasks.workunit.client.0.smithi111.stdout:6/839: sync 2024-09-16T09:46:21.676 INFO:tasks.workunit.client.0.smithi111.stdout:6/840: truncate d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f34 2834637 0 2024-09-16T09:46:21.680 INFO:tasks.workunit.client.0.smithi111.stdout:6/841: write d0/f13 [3803998,94524] 0 2024-09-16T09:46:21.681 INFO:tasks.workunit.client.0.smithi111.stdout:6/842: write d0/d57/db0/d49/d5b/dfe/f110 [404474,20539] 0 2024-09-16T09:46:21.683 INFO:tasks.workunit.client.0.smithi111.stdout:6/843: rename d0/d57/db0/d49/d5b/d93/lf1 to d0/d57/l119 0 2024-09-16T09:46:21.701 INFO:tasks.workunit.client.0.smithi111.stdout:6/844: dwrite d0/d57/db0/f4a [4194304,4194304] 0 2024-09-16T09:46:21.717 INFO:tasks.workunit.client.0.smithi111.stdout:6/845: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f2e [0,4194304] 0 2024-09-16T09:46:21.717 INFO:tasks.workunit.client.0.smithi111.stdout:6/846: chown d0/d57/db0/d47/d52/db3/fb6 52 1 2024-09-16T09:46:21.719 INFO:tasks.workunit.client.0.smithi111.stdout:6/847: rename d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/c116 to d0/d57/db0/d47/d68/c11a 0 2024-09-16T09:46:21.719 INFO:tasks.workunit.client.0.smithi111.stdout:6/848: fsync d0/f3a 0 2024-09-16T09:46:21.746 INFO:tasks.workunit.client.0.smithi111.stdout:5/979: write d19/d1b/d27/d83/d2a/f8d [11471,65837] 0 2024-09-16T09:46:21.746 INFO:tasks.workunit.client.0.smithi111.stdout:5/980: readlink d19/d1b/d1e/d21/d29/d32/d46/l6e 0 2024-09-16T09:46:21.746 INFO:tasks.workunit.client.0.smithi111.stdout:5/981: write d19/f48 [5154778,48965] 0 2024-09-16T09:46:21.754 INFO:tasks.workunit.client.0.smithi111.stdout:5/982: rename d19/d1b/d1e/d21/d29/d32/d46/l120 to d19/d1b/d9f/deb/l14d 0 2024-09-16T09:46:21.774 INFO:tasks.workunit.client.0.smithi111.stdout:5/983: dwrite d19/d1b/d27/d83/f26 [4194304,4194304] 0 2024-09-16T09:46:21.778 INFO:tasks.workunit.client.0.smithi111.stdout:5/984: symlink d19/d1b/d27/d2e/d4a/d4b/dd7/l14e 0 2024-09-16T09:46:21.781 INFO:tasks.workunit.client.0.smithi111.stdout:5/985: mkdir d19/d1b/d27/d2e/d39/d54/d60/d11a/d14f 0 2024-09-16T09:46:21.781 INFO:tasks.workunit.client.0.smithi111.stdout:5/986: stat fc 0 2024-09-16T09:46:21.782 INFO:tasks.workunit.client.0.smithi111.stdout:5/987: write d19/d1b/d1e/d21/f5e [4991327,54914] 0 2024-09-16T09:46:21.785 INFO:tasks.workunit.client.0.smithi111.stdout:5/988: rmdir d19/d1b/d27/d2e/d4a/d4b/d9c/d129/d144 0 2024-09-16T09:46:21.797 INFO:tasks.workunit.client.0.smithi111.stdout:5/989: symlink d19/d1b/d27/d2e/d39/d54/d60/dc9/d11f/l150 0 2024-09-16T09:46:21.799 INFO:tasks.workunit.client.0.smithi111.stdout:5/990: creat d19/d1b/d11e/f151 x:0 0 0 2024-09-16T09:46:21.801 INFO:tasks.workunit.client.0.smithi111.stdout:5/991: unlink d19/d1b/d27/d2e/df3/d100/l119 0 2024-09-16T09:46:21.803 INFO:tasks.workunit.client.0.smithi111.stdout:5/992: link d19/d1b/d27/d2e/d39/d54/f127 d19/d1b/d27/d83/f152 0 2024-09-16T09:46:21.805 INFO:tasks.workunit.client.0.smithi111.stdout:5/993: symlink d19/d1b/d1e/d21/d29/d32/dee/l153 0 2024-09-16T09:46:21.814 INFO:tasks.workunit.client.0.smithi111.stdout:5/994: read d19/d1b/d1e/d21/f5e [3183844,62575] 0 2024-09-16T09:46:21.814 INFO:tasks.workunit.client.0.smithi111.stdout:5/995: read - d19/d1b/d27/d2e/d39/d54/d60/f132 zero size 2024-09-16T09:46:21.814 INFO:tasks.workunit.client.0.smithi111.stdout:5/996: write d19/d1b/d27/d83/f75 [4737059,9328] 0 2024-09-16T09:46:21.831 INFO:tasks.workunit.client.0.smithi111.stdout:5/997: dwrite d19/d1b/d27/d83/d2a/f8d [0,4194304] 0 2024-09-16T09:46:21.835 INFO:tasks.workunit.client.0.smithi111.stdout:5/998: unlink d19/d1b/d1e/f40 0 2024-09-16T09:46:21.839 INFO:tasks.workunit.client.0.smithi111.stdout:5/999: mkdir d19/d1b/d27/d83/d2a/dc4/dc0/d154 0 2024-09-16T09:46:21.885 INFO:tasks.workunit.client.0.smithi111.stdout:0/946: sync 2024-09-16T09:46:21.885 INFO:tasks.workunit.client.0.smithi111.stdout:1/839: sync 2024-09-16T09:46:21.889 INFO:tasks.workunit.client.0.smithi111.stdout:0/947: getdents d0/dc1 0 2024-09-16T09:46:21.891 INFO:tasks.workunit.client.0.smithi111.stdout:0/948: truncate d0/d1d/d67/d3a/fab 2801237 0 2024-09-16T09:46:21.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/949: mkdir d0/d1d/d58/d83/d9a/dd9/de9/d15a 0 2024-09-16T09:46:21.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/950: fsync d0/d1d/d58/d64/d4f/f7f 0 2024-09-16T09:46:21.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/951: chown d0/d1d/d58/d83/d9a/dd9/de9/f123 72 1 2024-09-16T09:46:21.893 INFO:tasks.workunit.client.0.smithi111.stdout:0/952: dread - d0/d1d/d67/fda zero size 2024-09-16T09:46:21.895 INFO:tasks.workunit.client.0.smithi111.stdout:0/953: link d0/d1d/d67/d3a/d3d/f48 d0/dc1/f15b 0 2024-09-16T09:46:21.895 INFO:tasks.workunit.client.0.smithi111.stdout:0/954: stat d0/da4/c8e 0 2024-09-16T09:46:21.908 INFO:tasks.workunit.client.0.smithi111.stdout:0/955: dwrite d0/d1d/d58/d64/dd6/ddf/df3/f125 [0,4194304] 0 2024-09-16T09:46:21.908 INFO:tasks.workunit.client.0.smithi111.stdout:0/956: dread - d0/d1d/d67/d3a/d80/f14d zero size 2024-09-16T09:46:21.913 INFO:tasks.workunit.client.0.smithi111.stdout:0/957: unlink d0/d1d/d58/ff2 0 2024-09-16T09:46:21.915 INFO:tasks.workunit.client.0.smithi111.stdout:0/958: rename d0/d1d/d67/d3a/d3d/ff6 to d0/d1d/d67/d3a/d92/f15c 0 2024-09-16T09:46:21.915 INFO:tasks.workunit.client.0.smithi111.stdout:0/959: dread - d0/d1d/d58/d64/d4f/f13c zero size 2024-09-16T09:46:21.916 INFO:tasks.workunit.client.0.smithi111.stdout:0/960: truncate d0/f6e 468187 0 2024-09-16T09:46:21.917 INFO:tasks.workunit.client.0.smithi111.stdout:0/961: write d0/d1d/d67/d3a/f128 [207526,97184] 0 2024-09-16T09:46:21.923 INFO:tasks.workunit.client.0.smithi111.stdout:9/755: sync 2024-09-16T09:46:21.923 INFO:tasks.workunit.client.0.smithi111.stdout:7/809: sync 2024-09-16T09:46:21.923 INFO:tasks.workunit.client.0.smithi111.stdout:4/893: sync 2024-09-16T09:46:21.923 INFO:tasks.workunit.client.0.smithi111.stdout:9/756: write d0/d6/d30/d47/f52 [827800,115169] 0 2024-09-16T09:46:21.924 INFO:tasks.workunit.client.0.smithi111.stdout:4/894: dread d2/d6/dd/d1b/d38/d64/d92/fc7 [0,4194304] 0 2024-09-16T09:46:21.926 INFO:tasks.workunit.client.0.smithi111.stdout:0/962: write d0/d26/d35/f101 [3024505,111336] 0 2024-09-16T09:46:21.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/757: mkdir d0/d21/d22/d6e/d7d/d9a/d101 0 2024-09-16T09:46:21.930 INFO:tasks.workunit.client.0.smithi111.stdout:0/963: getdents d0/d1d/d58/d64/d4f/d13e 0 2024-09-16T09:46:21.931 INFO:tasks.workunit.client.0.smithi111.stdout:9/758: truncate d0/d21/d22/d6e/d51/d76/f5c 2981560 0 2024-09-16T09:46:21.933 INFO:tasks.workunit.client.0.smithi111.stdout:9/759: write d0/d6/f3c [1782032,74933] 0 2024-09-16T09:46:21.933 INFO:tasks.workunit.client.0.smithi111.stdout:9/760: dread - d0/d6/d75/fae zero size 2024-09-16T09:46:21.935 INFO:tasks.workunit.client.0.smithi111.stdout:4/895: link d2/d6/dd/d1b/d38/d64/d92/l9b d2/d6/l11f 0 2024-09-16T09:46:21.937 INFO:tasks.workunit.client.0.smithi111.stdout:0/964: rename d0/dfb/d124 to d0/d1d/d67/d3a/d92/d15d 0 2024-09-16T09:46:21.937 INFO:tasks.workunit.client.0.smithi111.stdout:0/965: fdatasync d0/d1d/f110 0 2024-09-16T09:46:21.939 INFO:tasks.workunit.client.0.smithi111.stdout:9/761: creat d0/d6/d8/de/d56/d4e/dc5/f102 x:0 0 0 2024-09-16T09:46:21.940 INFO:tasks.workunit.client.0.smithi111.stdout:4/896: mkdir d2/d6/dd/d1b/d38/db0/d2f/d9e/d120 0 2024-09-16T09:46:21.942 INFO:tasks.workunit.client.0.smithi111.stdout:0/966: symlink d0/d1d/d58/d83/d111/l15e 0 2024-09-16T09:46:21.944 INFO:tasks.workunit.client.0.smithi111.stdout:9/762: mkdir d0/d6c/d103 0 2024-09-16T09:46:21.947 INFO:tasks.workunit.client.0.smithi111.stdout:4/897: creat d2/d6/dd/d1b/d38/db0/d2f/d6c/d9c/f121 x:0 0 0 2024-09-16T09:46:21.951 INFO:tasks.workunit.client.0.smithi111.stdout:4/898: unlink d2/d6/dd/d1b/d38/db0/d2f/d4e/f74 0 2024-09-16T09:46:21.953 INFO:tasks.workunit.client.0.smithi111.stdout:9/763: dread d0/d48/fe4 [0,4194304] 0 2024-09-16T09:46:21.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/899: mknod d2/d6/dd/d1b/d38/db0/d2f/d9e/d120/c122 0 2024-09-16T09:46:21.953 INFO:tasks.workunit.client.0.smithi111.stdout:4/900: chown d2/f56 11589044 1 2024-09-16T09:46:21.956 INFO:tasks.workunit.client.0.smithi111.stdout:9/764: creat d0/d7b/dac/f104 x:0 0 0 2024-09-16T09:46:21.956 INFO:tasks.workunit.client.0.smithi111.stdout:0/967: dwrite d0/f42 [4194304,4194304] 0 2024-09-16T09:46:21.958 INFO:tasks.workunit.client.0.smithi111.stdout:9/765: dread d0/d48/fa1 [0,4194304] 0 2024-09-16T09:46:21.959 INFO:tasks.workunit.client.0.smithi111.stdout:4/901: creat d2/d6/dd/d1b/d38/db0/d2f/d4e/f123 x:0 0 0 2024-09-16T09:46:21.962 INFO:tasks.workunit.client.0.smithi111.stdout:9/766: mkdir d0/d6/d8/de/d105 0 2024-09-16T09:46:21.977 INFO:tasks.workunit.client.0.smithi111.stdout:4/902: dwrite d2/d6/dd/d1b/d6d/d8f/f9a [0,4194304] 0 2024-09-16T09:46:21.983 INFO:tasks.workunit.client.0.smithi111.stdout:4/903: symlink d2/d6/dd/d1b/d38/db0/d2f/d9e/l124 0 2024-09-16T09:46:21.991 INFO:tasks.workunit.client.0.smithi111.stdout:4/904: dread d2/d6/dd/d1b/d6d/def/f90 [0,4194304] 0 2024-09-16T09:46:21.991 INFO:tasks.workunit.client.0.smithi111.stdout:4/905: chown d2/d6/dd/d1b/d38/db0/d2f/d4e/ff4 7417 1 2024-09-16T09:46:21.992 INFO:tasks.workunit.client.0.smithi111.stdout:4/906: rmdir d2/d6/dd/d1b/d38/d64/d92/d104 39 2024-09-16T09:46:21.994 INFO:tasks.workunit.client.0.smithi111.stdout:4/907: creat d2/d6/dd/d1b/d6d/def/d96/dd5/f125 x:0 0 0 2024-09-16T09:46:21.994 INFO:tasks.workunit.client.0.smithi111.stdout:4/908: chown d2/f17 4621515 1 2024-09-16T09:46:21.996 INFO:tasks.workunit.client.0.smithi111.stdout:4/909: mkdir d2/d6/dd/d1b/d126 0 2024-09-16T09:46:21.998 INFO:tasks.workunit.client.0.smithi111.stdout:4/910: rename d2/d6/c1a to d2/d6/dd/d1b/d38/d64/c127 0 2024-09-16T09:46:21.999 INFO:tasks.workunit.client.0.smithi111.stdout:4/911: truncate d2/d6/dd/d1b/d6d/def/d96/f110 604522 0 2024-09-16T09:46:22.018 INFO:tasks.workunit.client.0.smithi111.stdout:4/912: dwrite d2/d6/dd/d1b/d38/d64/dac/fe2 [0,4194304] 0 2024-09-16T09:46:22.118 INFO:tasks.workunit.client.0.smithi111.stdout:4/913: mknod d2/d6/dd/d1b/d38/d64/dd8/de4/c128 0 2024-09-16T09:46:22.118 INFO:tasks.workunit.client.0.smithi111.stdout:4/914: write d2/d6/dd/d1b/d38/db0/d2f/d4e/fad [893579,47809] 0 2024-09-16T09:46:22.143 INFO:tasks.workunit.client.0.smithi111.stdout:4/915: dwrite d2/d6/dd/d1b/d38/d64/dac/fd0 [0,4194304] 0 2024-09-16T09:46:22.144 INFO:tasks.workunit.client.0.smithi111.stdout:4/916: fsync d2/d6/dd/d1b/d38/db0/d2f/f4d 0 2024-09-16T09:46:22.148 INFO:tasks.workunit.client.0.smithi111.stdout:4/917: creat d2/d6/dd/d1b/d6d/d8f/f129 x:0 0 0 2024-09-16T09:46:22.148 INFO:tasks.workunit.client.0.smithi111.stdout:4/918: dread - d2/d30/da1/f10e zero size 2024-09-16T09:46:22.148 INFO:tasks.workunit.client.0.smithi111.stdout:4/919: getdents d2/d6/dd/d1b/d38/d64/dd8/d11a 0 2024-09-16T09:46:22.150 INFO:tasks.workunit.client.0.smithi111.stdout:4/920: creat d2/d6/dd/d1b/d6d/d8f/d113/f12a x:0 0 0 2024-09-16T09:46:22.153 INFO:tasks.workunit.client.0.smithi111.stdout:4/921: link d2/l13 d2/d6/dd/d1b/d38/d64/dac/l12b 0 2024-09-16T09:46:22.166 INFO:tasks.workunit.client.0.smithi111.stdout:4/922: dwrite d2/d6/dd/d1b/d38/d64/dd8/dec/ffd [0,4194304] 0 2024-09-16T09:46:22.171 INFO:tasks.workunit.client.0.smithi111.stdout:4/923: symlink d2/d6/dd/d1b/d38/d64/d92/l12c 0 2024-09-16T09:46:22.173 INFO:tasks.workunit.client.0.smithi111.stdout:4/924: fsync d2/d6/f8a 0 2024-09-16T09:46:22.173 INFO:tasks.workunit.client.0.smithi111.stdout:4/925: truncate d2/d6/dd/d1b/d38/d64/d65/ff3 701110 0 2024-09-16T09:46:22.175 INFO:tasks.workunit.client.0.smithi111.stdout:4/926: mkdir d2/d6/dd/d1b/d6d/d12d 0 2024-09-16T09:46:22.178 INFO:tasks.workunit.client.0.smithi111.stdout:4/927: dread d2/d6/dd/d1b/d38/db0/d2f/ff0 [0,4194304] 0 2024-09-16T09:46:22.178 INFO:tasks.workunit.client.0.smithi111.stdout:4/928: write d2/f42 [2581433,16551] 0 2024-09-16T09:46:22.178 INFO:tasks.workunit.client.0.smithi111.stdout:4/929: fsync d2/d6/dd/d1b/d38/d64/d65/f70 0 2024-09-16T09:46:22.178 INFO:tasks.workunit.client.0.smithi111.stdout:4/930: readlink d2/d6/dd/d1b/d38/db0/d2f/l5c 0 2024-09-16T09:46:22.179 INFO:tasks.workunit.client.0.smithi111.stdout:4/931: truncate d2/d6/dd/d1b/d38/db0/d2f/f46 4654976 0 2024-09-16T09:46:22.188 INFO:tasks.workunit.client.0.smithi111.stdout:4/932: dread d2/fb [4194304,4194304] 0 2024-09-16T09:46:22.188 INFO:tasks.workunit.client.0.smithi111.stdout:4/933: write d2/d6/dd/d1b/d38/db0/d2f/fee [753953,54553] 0 2024-09-16T09:46:22.188 INFO:tasks.workunit.client.0.smithi111.stdout:4/934: dread - d2/d6/dd/d1b/d6d/d8f/f129 zero size 2024-09-16T09:46:22.203 INFO:tasks.workunit.client.0.smithi111.stdout:4/935: dwrite d2/d6/dd/d1b/d6d/def/fc4 [0,4194304] 0 2024-09-16T09:46:22.204 INFO:tasks.workunit.client.0.smithi111.stdout:4/936: truncate d2/d6/dd/d1b/d6d/def/d96/f110 1197162 0 2024-09-16T09:46:22.211 INFO:tasks.workunit.client.0.smithi111.stdout:4/937: dread d2/d6/dd/d1b/d38/db0/d2f/f46 [0,4194304] 0 2024-09-16T09:46:22.211 INFO:tasks.workunit.client.0.smithi111.stdout:4/938: write d2/d6/dd/d1b/d6d/def/d69/feb [1161297,129180] 0 2024-09-16T09:46:22.221 INFO:tasks.workunit.client.0.smithi111.stdout:4/939: dread d2/d6/dd/d1b/d38/d64/ff8 [0,4194304] 0 2024-09-16T09:46:22.222 INFO:tasks.workunit.client.0.smithi111.stdout:4/940: mkdir d2/d6/dd/d1b/d6d/def/d96/d106/d12e 0 2024-09-16T09:46:22.225 INFO:tasks.workunit.client.0.smithi111.stdout:4/941: rename d2/d6/dd/d1b/d38/d64/d65/f11c to d2/d6/dd/df5/f12f 0 2024-09-16T09:46:22.228 INFO:tasks.workunit.client.0.smithi111.stdout:8/964: sync 2024-09-16T09:46:22.228 INFO:tasks.workunit.client.0.smithi111.stdout:6/849: sync 2024-09-16T09:46:22.231 INFO:tasks.workunit.client.0.smithi111.stdout:8/965: dread d3/dc3/d130/f8a [0,4194304] 0 2024-09-16T09:46:22.233 INFO:tasks.workunit.client.0.smithi111.stdout:8/966: symlink d3/de/d1e/d2e/d2f/d10f/l13c 0 2024-09-16T09:46:22.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/942: write d2/d6/dd/d1b/d6d/fcc [1597227,27924] 0 2024-09-16T09:46:22.234 INFO:tasks.workunit.client.0.smithi111.stdout:4/943: write d2/d30/da1/f10e [992096,36097] 0 2024-09-16T09:46:22.235 INFO:tasks.workunit.client.0.smithi111.stdout:8/967: mknod d3/de/d1e/d2e/dce/c13d 0 2024-09-16T09:46:22.235 INFO:tasks.workunit.client.0.smithi111.stdout:8/968: readlink d3/de/d1e/d2e/l7f 0 2024-09-16T09:46:22.236 INFO:tasks.workunit.client.0.smithi111.stdout:4/944: mknod d2/d6/dd/d1b/d38/d64/dac/c130 0 2024-09-16T09:46:22.237 INFO:tasks.workunit.client.0.smithi111.stdout:4/945: chown d2/d6/dd/d1b/d38/d64/dac/l12b 6137099 1 2024-09-16T09:46:22.237 INFO:tasks.workunit.client.0.smithi111.stdout:6/850: dread d0/f12 [0,4194304] 0 2024-09-16T09:46:22.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/969: getdents d3/dc3/d130/d129/d12a 0 2024-09-16T09:46:22.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/970: chown d3/lc5 915712 1 2024-09-16T09:46:22.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/971: dread - d3/de/d1e/d2e/d74/f7a zero size 2024-09-16T09:46:22.239 INFO:tasks.workunit.client.0.smithi111.stdout:8/972: dread - d3/de/d1e/d2e/d2f/f80 zero size 2024-09-16T09:46:22.242 INFO:tasks.workunit.client.0.smithi111.stdout:4/946: creat d2/d6/dd/d1b/d38/db0/d2f/d9e/d11d/f131 x:0 0 0 2024-09-16T09:46:22.242 INFO:tasks.workunit.client.0.smithi111.stdout:4/947: chown d2/d6/l114 36546 1 2024-09-16T09:46:22.242 INFO:tasks.workunit.client.0.smithi111.stdout:4/948: fsync d2/d6/dd/d1b/d6d/def/fc4 0 2024-09-16T09:46:22.246 INFO:tasks.workunit.client.0.smithi111.stdout:6/851: link d0/d57/db0/d47/d68/ce8 d0/d57/db0/d47/d88/c11b 0 2024-09-16T09:46:22.275 INFO:tasks.workunit.client.0.smithi111.stdout:6/852: dwrite d0/d57/db0/d14/d20/d42/d4e/d64/f69 [0,4194304] 0 2024-09-16T09:46:22.278 INFO:tasks.workunit.client.0.smithi111.stdout:8/973: dwrite d3/f10 [0,4194304] 0 2024-09-16T09:46:22.278 INFO:tasks.workunit.client.0.smithi111.stdout:8/974: write d3/de/d1e/d2e/d74/d83/f93 [4304288,1761] 0 2024-09-16T09:46:22.278 INFO:tasks.workunit.client.0.smithi111.stdout:8/975: chown d3/da/db/d59 162 1 2024-09-16T09:46:22.279 INFO:tasks.workunit.client.0.smithi111.stdout:4/949: dwrite d2/d30/f50 [0,4194304] 0 2024-09-16T09:46:22.284 INFO:tasks.workunit.client.0.smithi111.stdout:8/976: symlink d3/dc3/d130/d129/d12a/l13e 0 2024-09-16T09:46:22.284 INFO:tasks.workunit.client.0.smithi111.stdout:8/977: chown d3/lc5 93145269 1 2024-09-16T09:46:22.298 INFO:tasks.workunit.client.0.smithi111.stdout:4/950: rename d2/d6/dd/d1b/d6d/def/f90 to d2/d6/dd/d1b/d10c/f132 0 2024-09-16T09:46:22.298 INFO:tasks.workunit.client.0.smithi111.stdout:4/951: stat d2/d6/dd/f28 0 2024-09-16T09:46:22.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/978: getdents d3/da/db/d59/de5 0 2024-09-16T09:46:22.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/979: read d3/de/d1e/f87 [1158495,83353] 0 2024-09-16T09:46:22.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/980: readlink d3/da/db/d59/l91 0 2024-09-16T09:46:22.300 INFO:tasks.workunit.client.0.smithi111.stdout:8/981: chown d3/d26/ff8 2013955 1 2024-09-16T09:46:22.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/952: unlink d2/d6/dd/d1b/d6d/def/d69/feb 0 2024-09-16T09:46:22.305 INFO:tasks.workunit.client.0.smithi111.stdout:4/953: write d2/d6/dd/d1b/d38/d64/d65/ff3 [1521054,27488] 0 2024-09-16T09:46:22.307 INFO:tasks.workunit.client.0.smithi111.stdout:8/982: creat d3/de/d1e/d2e/d74/dad/dba/d111/f13f x:0 0 0 2024-09-16T09:46:22.307 INFO:tasks.workunit.client.0.smithi111.stdout:8/983: chown d3/de/d1e/d2e/d74 4 1 2024-09-16T09:46:22.307 INFO:tasks.workunit.client.0.smithi111.stdout:8/984: stat d3/d26/f10c 0 2024-09-16T09:46:22.310 INFO:tasks.workunit.client.0.smithi111.stdout:4/954: getdents d2/d30/da1 0 2024-09-16T09:46:22.310 INFO:tasks.workunit.client.0.smithi111.stdout:4/955: truncate d2/d6/dd/f76 678741 0 2024-09-16T09:46:22.313 INFO:tasks.workunit.client.0.smithi111.stdout:4/956: symlink d2/d6/dd/d1b/d38/d64/d92/d104/l133 0 2024-09-16T09:46:22.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:22 smithi114 ceph-mon[35635]: mgrmap e22: smithi114.xvotey(active, since 1.24602s) 2024-09-16T09:46:22.326 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:22 smithi114 ceph-mon[35635]: pgmap v3: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:22.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/840: sync 2024-09-16T09:46:22.331 INFO:tasks.workunit.client.0.smithi111.stdout:4/957: dwrite d2/d6/dd/df5/f12f [0,4194304] 0 2024-09-16T09:46:22.335 INFO:tasks.workunit.client.0.smithi111.stdout:4/958: creat d2/d6/dd/f134 x:0 0 0 2024-09-16T09:46:22.335 INFO:tasks.workunit.client.0.smithi111.stdout:4/959: write d2/d6/dd/d1b/d38/db0/d2f/d9e/d11d/f131 [138425,34075] 0 2024-09-16T09:46:22.335 INFO:tasks.workunit.client.0.smithi111.stdout:4/960: readlink d2/d6/l11f 0 2024-09-16T09:46:22.335 INFO:tasks.workunit.client.0.smithi111.stdout:4/961: chown d2/f7d 235419 1 2024-09-16T09:46:22.345 INFO:tasks.workunit.client.0.smithi111.stdout:4/962: write d2/d6/dd/d1b/d38/db0/d2f/d9e/ff1 [2673440,15115] 0 2024-09-16T09:46:22.346 INFO:tasks.workunit.client.0.smithi111.stdout:1/841: dwrite d3/d10/d72/da1/f35 [0,4194304] 0 2024-09-16T09:46:22.350 INFO:tasks.workunit.client.0.smithi111.stdout:1/842: unlink d3/d10/d23/d8e/df0/l82 0 2024-09-16T09:46:22.350 INFO:tasks.workunit.client.0.smithi111.stdout:4/963: dread d2/d30/da1/f10e [0,4194304] 0 2024-09-16T09:46:22.354 INFO:tasks.workunit.client.0.smithi111.stdout:1/843: rename d3/d24/d4e/f52 to d3/d10/d57/d95/f115 0 2024-09-16T09:46:22.358 INFO:tasks.workunit.client.0.smithi111.stdout:4/964: dread d2/d6/f20 [0,4194304] 0 2024-09-16T09:46:22.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:22 smithi111 ceph-mon[27997]: mgrmap e22: smithi114.xvotey(active, since 1.24602s) 2024-09-16T09:46:22.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:22 smithi111 ceph-mon[27997]: pgmap v3: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:22.383 INFO:tasks.workunit.client.0.smithi111.stdout:6/853: write d0/d57/db0/d47/d52/db3/f10a [4969038,65294] 0 2024-09-16T09:46:22.387 INFO:tasks.workunit.client.0.smithi111.stdout:6/854: rename d0/d57/db0/d49 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c 0 2024-09-16T09:46:22.389 INFO:tasks.workunit.client.0.smithi111.stdout:1/844: dwrite d3/d10/f96 [0,4194304] 0 2024-09-16T09:46:22.390 INFO:tasks.workunit.client.0.smithi111.stdout:6/855: link d0/d57/d72/db2/f10e d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f11d 0 2024-09-16T09:46:22.390 INFO:tasks.workunit.client.0.smithi111.stdout:4/965: dwrite d2/d6/dd/d1b/d38/db0/f11b [0,4194304] 0 2024-09-16T09:46:22.393 INFO:tasks.workunit.client.0.smithi111.stdout:1/845: truncate d3/d10/d1c/f31 1890569 0 2024-09-16T09:46:22.394 INFO:tasks.workunit.client.0.smithi111.stdout:0/968: sync 2024-09-16T09:46:22.394 INFO:tasks.workunit.client.0.smithi111.stdout:7/810: sync 2024-09-16T09:46:22.394 INFO:tasks.workunit.client.0.smithi111.stdout:0/969: chown d0/d1d/d67/d3a/fab 4823 1 2024-09-16T09:46:22.397 INFO:tasks.workunit.client.0.smithi111.stdout:6/856: creat d0/d57/db0/d14/d20/f11e x:0 0 0 2024-09-16T09:46:22.399 INFO:tasks.workunit.client.0.smithi111.stdout:4/966: mkdir d2/d6/d80/d98/d135 0 2024-09-16T09:46:22.400 INFO:tasks.workunit.client.0.smithi111.stdout:9/767: sync 2024-09-16T09:46:22.403 INFO:tasks.workunit.client.0.smithi111.stdout:7/811: symlink d1/d16/d17/d18/d1d/d2f/l11e 0 2024-09-16T09:46:22.405 INFO:tasks.workunit.client.0.smithi111.stdout:0/970: rename d0/d1d/d58/d64/fd7 to d0/d1d/d58/d83/f15f 0 2024-09-16T09:46:22.407 INFO:tasks.workunit.client.0.smithi111.stdout:6/857: unlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/l63 0 2024-09-16T09:46:22.410 INFO:tasks.workunit.client.0.smithi111.stdout:9/768: mkdir d0/d6/d8/da2/d106 0 2024-09-16T09:46:22.412 INFO:tasks.workunit.client.0.smithi111.stdout:9/769: read d0/d21/d22/d6e/d51/d76/f83 [42883,69601] 0 2024-09-16T09:46:22.414 INFO:tasks.workunit.client.0.smithi111.stdout:4/967: rename d2/d6/dd/d1b/d38/db0/d2f/c112 to d2/d6/dd/d1b/d38/d64/dd8/de4/c136 0 2024-09-16T09:46:22.414 INFO:tasks.workunit.client.0.smithi111.stdout:4/968: chown d2/d6/dd/d1b/d38/d64/d92/da0/db5 440627785 1 2024-09-16T09:46:22.414 INFO:tasks.workunit.client.0.smithi111.stdout:0/971: mknod d0/d1d/c160 0 2024-09-16T09:46:22.419 INFO:tasks.workunit.client.0.smithi111.stdout:1/846: rmdir d3/d10/d23/df6/d47/d65/dbf 0 2024-09-16T09:46:22.420 INFO:tasks.workunit.client.0.smithi111.stdout:7/812: rename d1/d9/l10c to d1/d3e/d9f/l11f 0 2024-09-16T09:46:22.421 INFO:tasks.workunit.client.0.smithi111.stdout:4/969: symlink d2/d6/dd/d1b/d38/db0/d2f/d9e/d120/l137 0 2024-09-16T09:46:22.423 INFO:tasks.workunit.client.0.smithi111.stdout:0/972: unlink d0/c23 0 2024-09-16T09:46:22.423 INFO:tasks.workunit.client.0.smithi111.stdout:7/813: creat d1/d16/d17/d18/d4f/df5/da7/da8/f120 x:0 0 0 2024-09-16T09:46:22.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/970: creat d2/d6/dd/d1b/d38/d64/dac/f138 x:0 0 0 2024-09-16T09:46:22.426 INFO:tasks.workunit.client.0.smithi111.stdout:4/971: fdatasync d2/d6/dd/fe5 0 2024-09-16T09:46:22.427 INFO:tasks.workunit.client.0.smithi111.stdout:6/858: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f100 [0,4194304] 0 2024-09-16T09:46:22.427 INFO:tasks.workunit.client.0.smithi111.stdout:6/859: dread - d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f9d zero size 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/973: symlink d0/d1d/d58/d83/d111/l161 0 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/974: write d0/d1d/d58/d64/fb1 [980576,108571] 0 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/975: stat d0/d1d/d58/d64/d4f/d13e 0 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/976: write d0/d1d/d58/d64/dd6/ddf/f135 [566505,124490] 0 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/977: chown d0/d1d/d67/d3a/d3d/d59/f6a 366266 1 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:0/978: fsync d0/d1d/d67/d3a/d80/f12e 0 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:7/814: creat d1/dc7/de3/f121 x:0 0 0 2024-09-16T09:46:22.428 INFO:tasks.workunit.client.0.smithi111.stdout:4/972: getdents d2/d6/dd/d1b/d38/d64/d92/d104 0 2024-09-16T09:46:22.431 INFO:tasks.workunit.client.0.smithi111.stdout:6/860: rmdir d0/d57/d72 39 2024-09-16T09:46:22.431 INFO:tasks.workunit.client.0.smithi111.stdout:6/861: fsync d0/f1a 0 2024-09-16T09:46:22.433 INFO:tasks.workunit.client.0.smithi111.stdout:0/979: mkdir d0/d1d/d58/d83/d162 0 2024-09-16T09:46:22.434 INFO:tasks.workunit.client.0.smithi111.stdout:7/815: mknod d1/dc7/c122 0 2024-09-16T09:46:22.435 INFO:tasks.workunit.client.0.smithi111.stdout:6/862: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f11f x:0 0 0 2024-09-16T09:46:22.437 INFO:tasks.workunit.client.0.smithi111.stdout:7/816: mknod d1/d16/d17/d18/d1b/d79/da5/c123 0 2024-09-16T09:46:22.437 INFO:tasks.workunit.client.0.smithi111.stdout:7/817: write d1/d16/d17/d18/d4f/df5/da7/da8/f113 [823558,42780] 0 2024-09-16T09:46:22.437 INFO:tasks.workunit.client.0.smithi111.stdout:7/818: stat d1/d20/l6b 0 2024-09-16T09:46:22.438 INFO:tasks.workunit.client.0.smithi111.stdout:0/980: dread d0/da4/f4c [0,4194304] 0 2024-09-16T09:46:22.438 INFO:tasks.workunit.client.0.smithi111.stdout:6/863: rename d0/d57/db0/f4a to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde/f120 0 2024-09-16T09:46:22.439 INFO:tasks.workunit.client.0.smithi111.stdout:6/864: readlink d0/d57/lc3 0 2024-09-16T09:46:22.439 INFO:tasks.workunit.client.0.smithi111.stdout:6/865: chown d0/d57/d72/db2/lbc 487002 1 2024-09-16T09:46:22.439 INFO:tasks.workunit.client.0.smithi111.stdout:0/981: creat d0/d1d/d58/f163 x:0 0 0 2024-09-16T09:46:22.441 INFO:tasks.workunit.client.0.smithi111.stdout:7/819: rename d1/d16/d17/d18/d4f/d56 to d1/d16/d124 0 2024-09-16T09:46:22.441 INFO:tasks.workunit.client.0.smithi111.stdout:7/820: chown d1/d16/d17/d18/d1b/f6d 233120096 1 2024-09-16T09:46:22.441 INFO:tasks.workunit.client.0.smithi111.stdout:7/821: stat d1/d16/d17/d18/d1d/d2f/fd9 0 2024-09-16T09:46:22.442 INFO:tasks.workunit.client.0.smithi111.stdout:0/982: mkdir d0/d120/d164 0 2024-09-16T09:46:22.444 INFO:tasks.workunit.client.0.smithi111.stdout:6/866: rename d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/db9 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d121 0 2024-09-16T09:46:22.444 INFO:tasks.workunit.client.0.smithi111.stdout:6/867: fsync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/dfe/f110 0 2024-09-16T09:46:22.445 INFO:tasks.workunit.client.0.smithi111.stdout:6/868: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/fa4 [876112,74142] 0 2024-09-16T09:46:22.447 INFO:tasks.workunit.client.0.smithi111.stdout:0/983: link d0/f6e d0/d26/d35/d86/f165 0 2024-09-16T09:46:22.448 INFO:tasks.workunit.client.0.smithi111.stdout:6/869: creat d0/d57/db0/d47/d52/f122 x:0 0 0 2024-09-16T09:46:22.449 INFO:tasks.workunit.client.0.smithi111.stdout:0/984: mknod d0/c166 0 2024-09-16T09:46:22.449 INFO:tasks.workunit.client.0.smithi111.stdout:0/985: fdatasync d0/d1d/d58/f13b 0 2024-09-16T09:46:22.449 INFO:tasks.workunit.client.0.smithi111.stdout:0/986: dread - d0/d1d/d58/d64/faf zero size 2024-09-16T09:46:22.449 INFO:tasks.workunit.client.0.smithi111.stdout:4/973: dwrite d2/d6/dd/f16 [0,4194304] 0 2024-09-16T09:46:22.450 INFO:tasks.workunit.client.0.smithi111.stdout:6/870: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde/d123 0 2024-09-16T09:46:22.451 INFO:tasks.workunit.client.0.smithi111.stdout:4/974: getdents d2/d6/dd/d1b/d38/d64/dd8 0 2024-09-16T09:46:22.451 INFO:tasks.workunit.client.0.smithi111.stdout:4/975: chown d2/d6/dd/fe5 4012765 1 2024-09-16T09:46:22.451 INFO:tasks.workunit.client.0.smithi111.stdout:4/976: write d2/d6/dd/d1b/d38/db0/d2f/d6c/fe3 [151117,124621] 0 2024-09-16T09:46:22.451 INFO:tasks.workunit.client.0.smithi111.stdout:4/977: write d2/d6/dd/d1b/d38/d64/dac/fe2 [5063366,62555] 0 2024-09-16T09:46:22.453 INFO:tasks.workunit.client.0.smithi111.stdout:6/871: rmdir d0/d57 39 2024-09-16T09:46:22.459 INFO:tasks.workunit.client.0.smithi111.stdout:6/872: creat d0/d57/db0/d47/d68/f124 x:0 0 0 2024-09-16T09:46:22.459 INFO:tasks.workunit.client.0.smithi111.stdout:6/873: fsync d0/d57/db0/d47/d68/fce 0 2024-09-16T09:46:22.459 INFO:tasks.workunit.client.0.smithi111.stdout:6/874: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/fcb [2469507,128700] 0 2024-09-16T09:46:22.463 INFO:tasks.workunit.client.0.smithi111.stdout:0/987: write d0/d1d/f62 [4000105,26307] 0 2024-09-16T09:46:22.465 INFO:tasks.workunit.client.0.smithi111.stdout:7/822: dwrite d1/d16/d17/d18/d1b/d79/d8c/d98/f115 [0,4194304] 0 2024-09-16T09:46:22.465 INFO:tasks.workunit.client.0.smithi111.stdout:0/988: mkdir d0/d1d/d67/d3a/d77/dad/d167 0 2024-09-16T09:46:22.467 INFO:tasks.workunit.client.0.smithi111.stdout:4/978: dwrite d2/d6/dd/d1b/d38/db0/d2f/d6c/fe1 [0,4194304] 0 2024-09-16T09:46:22.469 INFO:tasks.workunit.client.0.smithi111.stdout:0/989: creat d0/d1d/d67/d3a/d77/dad/d167/f168 x:0 0 0 2024-09-16T09:46:22.471 INFO:tasks.workunit.client.0.smithi111.stdout:0/990: dread d0/d1d/d58/d83/f15f [0,4194304] 0 2024-09-16T09:46:22.472 INFO:tasks.workunit.client.0.smithi111.stdout:4/979: creat d2/d6/dd/d1b/d6d/d12d/f139 x:0 0 0 2024-09-16T09:46:22.473 INFO:tasks.workunit.client.0.smithi111.stdout:0/991: creat d0/d120/d164/f169 x:0 0 0 2024-09-16T09:46:22.474 INFO:tasks.workunit.client.0.smithi111.stdout:4/980: creat d2/d6/dd/d1b/f13a x:0 0 0 2024-09-16T09:46:22.475 INFO:tasks.workunit.client.0.smithi111.stdout:0/992: rmdir d0/d120/d148 39 2024-09-16T09:46:22.477 INFO:tasks.workunit.client.0.smithi111.stdout:0/993: link d0/da4/f114 d0/d1d/d58/d64/f16a 0 2024-09-16T09:46:22.478 INFO:tasks.workunit.client.0.smithi111.stdout:0/994: creat d0/d26/d35/d86/de5/d116/f16b x:0 0 0 2024-09-16T09:46:22.479 INFO:tasks.workunit.client.0.smithi111.stdout:0/995: write d0/da4/f7c [638957,111053] 0 2024-09-16T09:46:22.482 INFO:tasks.workunit.client.0.smithi111.stdout:0/996: creat d0/d26/d35/d126/f16c x:0 0 0 2024-09-16T09:46:22.483 INFO:tasks.workunit.client.0.smithi111.stdout:0/997: creat d0/d1d/d67/d3a/d3d/f16d x:0 0 0 2024-09-16T09:46:22.483 INFO:tasks.workunit.client.0.smithi111.stdout:0/998: stat d0/l40 0 2024-09-16T09:46:22.485 INFO:tasks.workunit.client.0.smithi111.stdout:0/999: link d0/da4/l74 d0/d1d/d58/d83/d9a/dd9/de9/l16e 0 2024-09-16T09:46:22.495 INFO:tasks.workunit.client.0.smithi111.stdout:7/823: dwrite d1/d16/d17/d18/f4c [0,4194304] 0 2024-09-16T09:46:22.498 INFO:tasks.workunit.client.0.smithi111.stdout:6/875: dwrite d0/d57/db0/d14/f74 [4194304,4194304] 0 2024-09-16T09:46:22.511 INFO:tasks.workunit.client.0.smithi111.stdout:7/824: dwrite d1/d16/d17/d18/d1b/d79/da5/db2/fbb [0,4194304] 0 2024-09-16T09:46:22.511 INFO:tasks.workunit.client.0.smithi111.stdout:7/825: stat d1/d9/d43/d82/f8a 0 2024-09-16T09:46:22.512 INFO:tasks.workunit.client.0.smithi111.stdout:7/826: rename d1 to d1/d16/d17/d18/d1b/d79/da5/db2/d100/d125 22 2024-09-16T09:46:22.515 INFO:tasks.workunit.client.0.smithi111.stdout:7/827: creat d1/d3e/d9f/f126 x:0 0 0 2024-09-16T09:46:22.517 INFO:tasks.workunit.client.0.smithi111.stdout:7/828: link d1/d20/c65 d1/d16/d17/d18/d1b/d79/da5/c127 0 2024-09-16T09:46:22.519 INFO:tasks.workunit.client.0.smithi111.stdout:7/829: mkdir d1/d9/d128 0 2024-09-16T09:46:22.527 INFO:tasks.workunit.client.0.smithi111.stdout:7/830: dread d1/d16/d17/d18/d1b/d79/d8c/d98/f115 [0,4194304] 0 2024-09-16T09:46:22.528 INFO:tasks.workunit.client.0.smithi111.stdout:7/831: creat d1/d16/d17/d18/d4f/f129 x:0 0 0 2024-09-16T09:46:22.726 INFO:tasks.workunit.client.0.smithi111.stdout:8/985: sync 2024-09-16T09:46:22.726 INFO:tasks.workunit.client.0.smithi111.stdout:8/986: write d3/de/d1e/d2e/f68 [3798046,124120] 0 2024-09-16T09:46:22.727 INFO:tasks.workunit.client.0.smithi111.stdout:8/987: mknod d3/da/c140 0 2024-09-16T09:46:22.730 INFO:tasks.workunit.client.0.smithi111.stdout:8/988: dread d3/de/d1e/f87 [0,4194304] 0 2024-09-16T09:46:22.781 INFO:tasks.workunit.client.0.smithi111.stdout:8/989: symlink d3/da/db/d59/dd7/dcc/l141 0 2024-09-16T09:46:22.783 INFO:tasks.workunit.client.0.smithi111.stdout:8/990: creat d3/de/d1e/d2e/d2f/da8/f142 x:0 0 0 2024-09-16T09:46:22.793 INFO:tasks.workunit.client.0.smithi111.stdout:8/991: write d3/d26/f40 [7965096,62513] 0 2024-09-16T09:46:22.794 INFO:tasks.workunit.client.0.smithi111.stdout:8/992: mkdir d3/de/d1e/d2e/d74/dad/dba/d111/d143 0 2024-09-16T09:46:22.796 INFO:tasks.workunit.client.0.smithi111.stdout:8/993: symlink d3/da/db/d59/l144 0 2024-09-16T09:46:22.798 INFO:tasks.workunit.client.0.smithi111.stdout:8/994: link d3/de/d1e/d2e/d74/dad/dba/c13a d3/de/d6e/c145 0 2024-09-16T09:46:22.800 INFO:tasks.workunit.client.0.smithi111.stdout:8/995: mknod d3/de/d6e/c146 0 2024-09-16T09:46:22.800 INFO:tasks.workunit.client.0.smithi111.stdout:8/996: stat d3/de/d1e/d2e/d2f/da8/dbe/d118 0 2024-09-16T09:46:22.801 INFO:tasks.workunit.client.0.smithi111.stdout:8/997: truncate d3/f10 872282 0 2024-09-16T09:46:22.805 INFO:tasks.workunit.client.0.smithi111.stdout:9/770: sync 2024-09-16T09:46:22.805 INFO:tasks.workunit.client.0.smithi111.stdout:8/998: dread d3/d26/d6d/fb5 [4194304,4194304] 0 2024-09-16T09:46:22.807 INFO:tasks.workunit.client.0.smithi111.stdout:8/999: read d3/da/db/d59/dd7/d9e/dd8/f38 [1060156,81380] 0 2024-09-16T09:46:22.823 INFO:tasks.workunit.client.0.smithi111.stdout:9/771: dwrite d0/d6/d8/de/d56/fde [0,4194304] 0 2024-09-16T09:46:22.828 INFO:tasks.workunit.client.0.smithi111.stdout:9/772: symlink d0/d21/d22/d6e/d51/d76/dc0/ddb/l107 0 2024-09-16T09:46:22.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/773: mkdir d0/d6/dc1/d108 0 2024-09-16T09:46:22.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/774: dread - d0/d21/d22/d6e/dab/fe1 zero size 2024-09-16T09:46:22.831 INFO:tasks.workunit.client.0.smithi111.stdout:9/775: rmdir d0/d21/d22/d6e 39 2024-09-16T09:46:22.831 INFO:tasks.workunit.client.0.smithi111.stdout:9/776: rename d0/d6/d8/de to d0/d6/d8/de/d56/d4e/d92/d109 22 2024-09-16T09:46:22.832 INFO:tasks.workunit.client.0.smithi111.stdout:9/777: rmdir d0/d21/d22/d6e/d7d 39 2024-09-16T09:46:22.832 INFO:tasks.workunit.client.0.smithi111.stdout:9/778: write d0/d6/d45/db0/ff9 [370079,124007] 0 2024-09-16T09:46:22.850 INFO:tasks.workunit.client.0.smithi111.stdout:9/779: dwrite d0/d21/d22/d6e/d51/d76/dc0/fc2 [0,4194304] 0 2024-09-16T09:46:22.852 INFO:tasks.workunit.client.0.smithi111.stdout:9/780: creat d0/d7b/dac/f10a x:0 0 0 2024-09-16T09:46:22.853 INFO:tasks.workunit.client.0.smithi111.stdout:9/781: stat d0/d7b/dac 0 2024-09-16T09:46:22.868 INFO:tasks.workunit.client.0.smithi111.stdout:9/782: dwrite d0/d6/d30/d81/fb6 [0,4194304] 0 2024-09-16T09:46:22.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/783: dread d0/d6/d8/f72 [0,4194304] 0 2024-09-16T09:46:22.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/784: stat d0/d6/d75/da9/ld7 0 2024-09-16T09:46:22.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/785: chown d0/d7b/dac 7612836 1 2024-09-16T09:46:22.882 INFO:tasks.workunit.client.0.smithi111.stdout:9/786: symlink d0/d6/dc1/l10b 0 2024-09-16T09:46:22.883 INFO:tasks.workunit.client.0.smithi111.stdout:9/787: symlink d0/d6/d30/d81/l10c 0 2024-09-16T09:46:22.884 INFO:tasks.workunit.client.0.smithi111.stdout:9/788: symlink d0/d21/d22/d6e/d51/d76/l10d 0 2024-09-16T09:46:22.888 INFO:tasks.workunit.client.0.smithi111.stdout:1/847: sync 2024-09-16T09:46:22.890 INFO:tasks.workunit.client.0.smithi111.stdout:1/848: creat d3/d10/d72/da1/d99/f116 x:0 0 0 2024-09-16T09:46:22.891 INFO:tasks.workunit.client.0.smithi111.stdout:1/849: truncate d3/d10/d1c/f31 834071 0 2024-09-16T09:46:22.891 INFO:tasks.workunit.client.0.smithi111.stdout:1/850: write d3/d10/d1c/f54 [2826639,129381] 0 2024-09-16T09:46:22.891 INFO:tasks.workunit.client.0.smithi111.stdout:1/851: stat d3/d10/d72/da1/l19 0 2024-09-16T09:46:22.893 INFO:tasks.workunit.client.0.smithi111.stdout:1/852: mkdir d3/d10/d23/df6/d47/d65/df7/d117 0 2024-09-16T09:46:23.019 INFO:tasks.workunit.client.0.smithi111.stdout:7/832: sync 2024-09-16T09:46:23.019 INFO:tasks.workunit.client.0.smithi111.stdout:6/876: sync 2024-09-16T09:46:23.019 INFO:tasks.workunit.client.0.smithi111.stdout:4/981: sync 2024-09-16T09:46:23.019 INFO:tasks.workunit.client.0.smithi111.stdout:6/877: fsync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f36 0 2024-09-16T09:46:23.019 INFO:tasks.workunit.client.0.smithi111.stdout:6/878: truncate d0/f89 330964 0 2024-09-16T09:46:23.020 INFO:tasks.workunit.client.0.smithi111.stdout:4/982: rmdir d2/d6/dd/d1b 39 2024-09-16T09:46:23.021 INFO:tasks.workunit.client.0.smithi111.stdout:7/833: creat d1/d16/d17/d18/d4f/d88/f12a x:0 0 0 2024-09-16T09:46:23.021 INFO:tasks.workunit.client.0.smithi111.stdout:7/834: chown d1/d16/d17/d18/d1b/d79/fe9 9 1 2024-09-16T09:46:23.022 INFO:tasks.workunit.client.0.smithi111.stdout:4/983: symlink d2/d6/dd/d1b/d6d/def/d96/d106/d12e/l13b 0 2024-09-16T09:46:23.054 INFO:tasks.workunit.client.0.smithi111.stdout:6/879: dwrite d0/d57/db0/d47/f77 [0,4194304] 0 2024-09-16T09:46:23.054 INFO:tasks.workunit.client.0.smithi111.stdout:7/835: dwrite d1/f14 [4194304,4194304] 0 2024-09-16T09:46:23.054 INFO:tasks.workunit.client.0.smithi111.stdout:4/984: dwrite d2/d6/dd/d1b/d6d/def/f82 [0,4194304] 0 2024-09-16T09:46:23.057 INFO:tasks.workunit.client.0.smithi111.stdout:6/880: rename d0/d57/db0/d14/d20/d42/d4e/cc1 to d0/d57/db0/d14/d20/d42/dbd/c125 0 2024-09-16T09:46:23.057 INFO:tasks.workunit.client.0.smithi111.stdout:6/881: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/f71 [1253838,70314] 0 2024-09-16T09:46:23.060 INFO:tasks.workunit.client.0.smithi111.stdout:7/836: link d1/d9/d53/dc0/c105 d1/d16/d17/d18/d1b/d79/d8c/c12b 0 2024-09-16T09:46:23.065 INFO:tasks.workunit.client.0.smithi111.stdout:6/882: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/f126 x:0 0 0 2024-09-16T09:46:23.068 INFO:tasks.workunit.client.0.smithi111.stdout:6/883: creat d0/d57/db0/d14/d20/d42/d4e/f127 x:0 0 0 2024-09-16T09:46:23.069 INFO:tasks.workunit.client.0.smithi111.stdout:6/884: creat d0/d57/db0/d47/d88/f128 x:0 0 0 2024-09-16T09:46:23.071 INFO:tasks.workunit.client.0.smithi111.stdout:6/885: symlink d0/daf/l129 0 2024-09-16T09:46:23.072 INFO:tasks.workunit.client.0.smithi111.stdout:6/886: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/f12a x:0 0 0 2024-09-16T09:46:23.074 INFO:tasks.workunit.client.0.smithi111.stdout:6/887: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde/c12b 0 2024-09-16T09:46:23.075 INFO:tasks.workunit.client.0.smithi111.stdout:6/888: getdents d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c 0 2024-09-16T09:46:23.076 INFO:tasks.workunit.client.0.smithi111.stdout:6/889: dread - d0/d57/d72/db2/f10e zero size 2024-09-16T09:46:23.077 INFO:tasks.workunit.client.0.smithi111.stdout:6/890: getdents d0/d57/db0/d47/d68/d6a 0 2024-09-16T09:46:23.079 INFO:tasks.workunit.client.0.smithi111.stdout:4/985: dwrite d2/d6/dd/d1b/d6d/def/f82 [0,4194304] 0 2024-09-16T09:46:23.079 INFO:tasks.workunit.client.0.smithi111.stdout:4/986: truncate d2/d6/dd/fe5 948388 0 2024-09-16T09:46:23.079 INFO:tasks.workunit.client.0.smithi111.stdout:7/837: dwrite d1/d9/d43/f67 [0,4194304] 0 2024-09-16T09:46:23.080 INFO:tasks.workunit.client.0.smithi111.stdout:4/987: getdents d2/d6/dd 0 2024-09-16T09:46:23.082 INFO:tasks.workunit.client.0.smithi111.stdout:7/838: mknod d1/d16/db6/c12c 0 2024-09-16T09:46:23.083 INFO:tasks.workunit.client.0.smithi111.stdout:7/839: mkdir d1/dc7/d12d 0 2024-09-16T09:46:23.083 INFO:tasks.workunit.client.0.smithi111.stdout:7/840: chown d1/fdd 0 1 2024-09-16T09:46:23.083 INFO:tasks.workunit.client.0.smithi111.stdout:7/841: fdatasync d1/d3e/d9e/fd2 0 2024-09-16T09:46:23.083 INFO:tasks.workunit.client.0.smithi111.stdout:4/988: dread d2/d6/dd/d1b/d6d/d8f/fa9 [0,4194304] 0 2024-09-16T09:46:23.085 INFO:tasks.workunit.client.0.smithi111.stdout:7/842: write d1/d3e/f74 [924671,101372] 0 2024-09-16T09:46:23.085 INFO:tasks.workunit.client.0.smithi111.stdout:4/989: rename d2/d6/dd/df5/f12f to d2/d6/dd/d1b/d38/d64/d92/da0/db5/f13c 0 2024-09-16T09:46:23.088 INFO:tasks.workunit.client.0.smithi111.stdout:7/843: mknod d1/c12e 0 2024-09-16T09:46:23.089 INFO:tasks.workunit.client.0.smithi111.stdout:7/844: dread d1/d3e/f70 [0,4194304] 0 2024-09-16T09:46:23.089 INFO:tasks.workunit.client.0.smithi111.stdout:7/845: write d1/d9/d53/fec [845921,17279] 0 2024-09-16T09:46:23.094 INFO:tasks.workunit.client.0.smithi111.stdout:4/990: dread d2/d6/dd/d1b/d38/d64/d92/da0/db5/f13c [0,4194304] 0 2024-09-16T09:46:23.094 INFO:tasks.workunit.client.0.smithi111.stdout:4/991: chown d2/d6/dd/d1b/d38/d64/d65 72400 1 2024-09-16T09:46:23.095 INFO:tasks.workunit.client.0.smithi111.stdout:4/992: mknod d2/d6/d80/d98/d135/c13d 0 2024-09-16T09:46:23.095 INFO:tasks.workunit.client.0.smithi111.stdout:4/993: write d2/d6/dd/d1b/d6d/def/fc4 [4340799,70893] 0 2024-09-16T09:46:23.096 INFO:tasks.workunit.client.0.smithi111.stdout:7/846: dread d1/d59/fd1 [0,4194304] 0 2024-09-16T09:46:23.099 INFO:tasks.workunit.client.0.smithi111.stdout:4/994: unlink d2/d6/dd/d1b/d38/db0/f54 0 2024-09-16T09:46:23.100 INFO:tasks.workunit.client.0.smithi111.stdout:4/995: chown d2/d6/dd/d1b/d6d/d8f/f129 125634 1 2024-09-16T09:46:23.100 INFO:tasks.workunit.client.0.smithi111.stdout:4/996: write d2/d6/dd/d1b/d38/db0/d2f/d4e/f123 [424457,33246] 0 2024-09-16T09:46:23.100 INFO:tasks.workunit.client.0.smithi111.stdout:7/847: rename d1/d16/d17/d18/d1d/d2f/f7e to d1/d9/d53/dc0/de7/f12f 0 2024-09-16T09:46:23.103 INFO:tasks.workunit.client.0.smithi111.stdout:4/997: creat d2/d6/dd/f13e x:0 0 0 2024-09-16T09:46:23.103 INFO:tasks.workunit.client.0.smithi111.stdout:4/998: dread - d2/d6/dd/d1b/f13a zero size 2024-09-16T09:46:23.127 INFO:tasks.workunit.client.0.smithi111.stdout:7/848: dwrite d1/d16/d17/d18/d1b/d79/d8c/d98/f115 [0,4194304] 0 2024-09-16T09:46:23.129 INFO:tasks.workunit.client.0.smithi111.stdout:4/999: dwrite d2/d6/dd/d1b/d38/d64/d92/da0/db5/f13c [0,4194304] 0 2024-09-16T09:46:23.130 INFO:tasks.workunit.client.0.smithi111.stdout:7/849: link d1/d16/d17/d18/f90 d1/d16/d124/f130 0 2024-09-16T09:46:23.141 INFO:tasks.workunit.client.0.smithi111.stdout:7/850: dread d1/d16/f1c [4194304,4194304] 0 2024-09-16T09:46:23.141 INFO:tasks.workunit.client.0.smithi111.stdout:7/851: write d1/d16/d17/d18/d1d/d2f/f11a [993080,98293] 0 2024-09-16T09:46:23.142 INFO:tasks.workunit.client.0.smithi111.stdout:7/852: getdents d1/d3e/d9f 0 2024-09-16T09:46:23.143 INFO:tasks.workunit.client.0.smithi111.stdout:7/853: link d1/d16/d17/d18/d4f/fc9 d1/d9/d53/dc0/f131 0 2024-09-16T09:46:23.143 INFO:tasks.workunit.client.0.smithi111.stdout:7/854: fdatasync d1/d16/d17/d18/d1b/d79/fe9 0 2024-09-16T09:46:23.144 INFO:tasks.workunit.client.0.smithi111.stdout:7/855: write d1/d9/d53/fec [1854764,107027] 0 2024-09-16T09:46:23.144 INFO:tasks.workunit.client.0.smithi111.stdout:7/856: chown d1/d16/d17/d18/d4f/df5/f45 2216117 1 2024-09-16T09:46:23.144 INFO:tasks.workunit.client.0.smithi111.stdout:7/857: chown d1/d9/d43/f7a 741 1 2024-09-16T09:46:23.151 INFO:tasks.workunit.client.0.smithi111.stdout:7/858: dread d1/d9/d43/f67 [0,4194304] 0 2024-09-16T09:46:23.151 INFO:tasks.workunit.client.0.smithi111.stdout:7/859: stat d1/fc3 0 2024-09-16T09:46:23.153 INFO:tasks.workunit.client.0.smithi111.stdout:7/860: creat d1/d16/d17/d18/d1b/f132 x:0 0 0 2024-09-16T09:46:23.154 INFO:tasks.workunit.client.0.smithi111.stdout:7/861: symlink d1/d3e/d9e/dac/l133 0 2024-09-16T09:46:23.161 INFO:tasks.workunit.client.0.smithi111.stdout:7/862: dread d1/d16/d17/d18/d4f/d88/fad [0,4194304] 0 2024-09-16T09:46:23.162 INFO:tasks.workunit.client.0.smithi111.stdout:7/863: rename d1/d16/d17/d18/d1b/d79/da5/db2/l107 to d1/d16/d17/d18/d1b/d79/da5/db2/d100/l134 0 2024-09-16T09:46:23.164 INFO:tasks.workunit.client.0.smithi111.stdout:7/864: rename d1/d3e/d9e/de0 to d1/d16/db6/de4/dd7/d135 0 2024-09-16T09:46:23.167 INFO:tasks.workunit.client.0.smithi111.stdout:7/865: rename d1/fdd to d1/d59/f136 0 2024-09-16T09:46:23.170 INFO:tasks.workunit.client.0.smithi111.stdout:7/866: link d1/d16/d17/d18/d1d/d2f/c46 d1/d16/d17/d18/d4f/c137 0 2024-09-16T09:46:23.171 INFO:tasks.workunit.client.0.smithi111.stdout:7/867: symlink d1/d9/d43/d82/l138 0 2024-09-16T09:46:23.171 INFO:tasks.workunit.client.0.smithi111.stdout:7/868: chown d1/d20/f42 13268678 1 2024-09-16T09:46:23.173 INFO:tasks.workunit.client.0.smithi111.stdout:7/869: creat d1/dc7/f139 x:0 0 0 2024-09-16T09:46:23.173 INFO:tasks.workunit.client.0.smithi111.stdout:7/870: dread - d1/d16/d17/d18/d1b/f132 zero size 2024-09-16T09:46:23.175 INFO:tasks.workunit.client.0.smithi111.stdout:7/871: creat d1/d16/d17/d18/d4f/df5/da7/da8/f13a x:0 0 0 2024-09-16T09:46:23.176 INFO:tasks.workunit.client.0.smithi111.stdout:7/872: rmdir d1/d16/db6/de4 39 2024-09-16T09:46:23.176 INFO:tasks.workunit.client.0.smithi111.stdout:7/873: getdents d1/d9/d128 0 2024-09-16T09:46:23.178 INFO:tasks.workunit.client.0.smithi111.stdout:7/874: mknod d1/d3e/d9e/dac/c13b 0 2024-09-16T09:46:23.178 INFO:tasks.workunit.client.0.smithi111.stdout:7/875: chown d1/l36 55623 1 2024-09-16T09:46:23.181 INFO:tasks.workunit.client.0.smithi111.stdout:7/876: link d1/d16/d17/d18/d4f/f84 d1/d9/d53/dc0/de7/f13c 0 2024-09-16T09:46:23.184 INFO:tasks.workunit.client.0.smithi111.stdout:7/877: creat d1/d16/d17/f13d x:0 0 0 2024-09-16T09:46:23.184 INFO:tasks.workunit.client.0.smithi111.stdout:7/878: dread - d1/d16/d17/d18/d4f/f84 zero size 2024-09-16T09:46:23.197 INFO:tasks.workunit.client.0.smithi111.stdout:7/879: dwrite d1/d16/d17/d18/f11d [0,4194304] 0 2024-09-16T09:46:23.214 INFO:tasks.workunit.client.0.smithi111.stdout:7/880: dwrite d1/d9/fc8 [0,4194304] 0 2024-09-16T09:46:23.232 INFO:tasks.workunit.client.0.smithi111.stdout:9/789: sync 2024-09-16T09:46:23.235 INFO:tasks.workunit.client.0.smithi111.stdout:7/881: dwrite d1/fc3 [0,4194304] 0 2024-09-16T09:46:23.238 INFO:tasks.workunit.client.0.smithi111.stdout:9/790: write d0/d48/fe4 [1078553,6418] 0 2024-09-16T09:46:23.240 INFO:tasks.workunit.client.0.smithi111.stdout:1/853: sync 2024-09-16T09:46:23.240 INFO:tasks.workunit.client.0.smithi111.stdout:6/891: sync 2024-09-16T09:46:23.245 INFO:tasks.workunit.client.0.smithi111.stdout:9/791: getdents d0/d21/d22/d6e/d51 0 2024-09-16T09:46:23.245 INFO:tasks.workunit.client.0.smithi111.stdout:9/792: write d0/d21/d22/f3e [208609,90878] 0 2024-09-16T09:46:23.248 INFO:tasks.workunit.client.0.smithi111.stdout:9/793: symlink d0/d6/df1/l10e 0 2024-09-16T09:46:23.268 INFO:tasks.workunit.client.0.smithi111.stdout:7/882: dwrite d1/dc7/f139 [0,4194304] 0 2024-09-16T09:46:23.268 INFO:tasks.workunit.client.0.smithi111.stdout:7/883: fdatasync d1/d16/d17/d18/f8b 0 2024-09-16T09:46:23.268 INFO:tasks.workunit.client.0.smithi111.stdout:7/884: readlink d1/d16/d124/la6 0 2024-09-16T09:46:23.268 INFO:tasks.workunit.client.0.smithi111.stdout:7/885: getdents d1/d3e/d9f/df0 0 2024-09-16T09:46:23.268 INFO:tasks.workunit.client.0.smithi111.stdout:1/854: dwrite d3/fe9 [0,4194304] 0 2024-09-16T09:46:23.268 INFO:tasks.workunit.client.0.smithi111.stdout:9/794: dwrite d0/d21/d22/d6e/d51/d76/dc0/fc6 [0,4194304] 0 2024-09-16T09:46:23.273 INFO:tasks.workunit.client.0.smithi111.stdout:7/886: mkdir d1/d16/db6/de4/d13e 0 2024-09-16T09:46:23.276 INFO:tasks.workunit.client.0.smithi111.stdout:1/855: creat d3/d24/f118 x:0 0 0 2024-09-16T09:46:23.279 INFO:tasks.workunit.client.0.smithi111.stdout:9/795: write d0/d21/d22/d6e/d51/d76/dc0/fc2 [530962,83011] 0 2024-09-16T09:46:23.285 INFO:tasks.workunit.client.0.smithi111.stdout:7/887: unlink d1/d9/d43/l55 0 2024-09-16T09:46:23.285 INFO:tasks.workunit.client.0.smithi111.stdout:7/888: write d1/d3e/d9f/de2/f10e [841447,83063] 0 2024-09-16T09:46:23.291 INFO:tasks.workunit.client.0.smithi111.stdout:7/889: mknod d1/d16/db6/de4/d13e/c13f 0 2024-09-16T09:46:23.291 INFO:tasks.workunit.client.0.smithi111.stdout:7/890: read d1/d9/d53/dc0/ff4 [25562,28844] 0 2024-09-16T09:46:23.316 INFO:tasks.workunit.client.0.smithi111.stdout:1/856: dwrite d3/d10/d23/df6/d47/f103 [0,4194304] 0 2024-09-16T09:46:23.316 INFO:tasks.workunit.client.0.smithi111.stdout:9/796: dwrite d0/d6/d8/de/d56/f5e [0,4194304] 0 2024-09-16T09:46:23.316 INFO:tasks.workunit.client.0.smithi111.stdout:9/797: chown d0/d6/d8/de/d56/d8e/dcf 198330 1 2024-09-16T09:46:23.316 INFO:tasks.workunit.client.0.smithi111.stdout:9/798: fdatasync d0/d6/d8/de/d56/d8e/dcf/fe6 0 2024-09-16T09:46:23.321 INFO:tasks.workunit.client.0.smithi111.stdout:1/857: link d3/d10/d57/fb7 d3/d10/d23/d8e/f119 0 2024-09-16T09:46:23.321 INFO:tasks.workunit.client.0.smithi111.stdout:1/858: readlink d3/d10/d72/da1/d99/la7 0 2024-09-16T09:46:23.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/859: mkdir d3/d10/d23/df6/d11a 0 2024-09-16T09:46:23.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/860: chown d3/d24/d62/f90 26965 1 2024-09-16T09:46:23.327 INFO:tasks.workunit.client.0.smithi111.stdout:1/861: chown d3/d10 1033130 1 2024-09-16T09:46:23.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/862: creat d3/d10/d23/d8e/f11b x:0 0 0 2024-09-16T09:46:23.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/863: chown d3/d10/d23/df6/fe6 1 1 2024-09-16T09:46:23.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/864: stat d3/d10/d23/df6/d47/d65/df7/d10d 0 2024-09-16T09:46:23.330 INFO:tasks.workunit.client.0.smithi111.stdout:1/865: stat d3/d26/f34 0 2024-09-16T09:46:23.332 INFO:tasks.workunit.client.0.smithi111.stdout:1/866: getdents d3/d10/d23/de8 0 2024-09-16T09:46:23.332 INFO:tasks.workunit.client.0.smithi111.stdout:1/867: stat d3/d10/f18 0 2024-09-16T09:46:23.334 INFO:tasks.workunit.client.0.smithi111.stdout:1/868: unlink d3/d10/d57/d8f/fca 0 2024-09-16T09:46:23.338 INFO:tasks.workunit.client.0.smithi111.stdout:9/799: dwrite d0/d6/d8/de/d56/f5e [0,4194304] 0 2024-09-16T09:46:23.350 INFO:tasks.workunit.client.0.smithi111.stdout:1/869: dwrite d3/d10/d23/d8e/f11b [0,4194304] 0 2024-09-16T09:46:23.360 INFO:tasks.workunit.client.0.smithi111.stdout:1/870: dread d3/d24/d29/f37 [4194304,4194304] 0 2024-09-16T09:46:23.361 INFO:tasks.workunit.client.0.smithi111.stdout:1/871: chown d3/d10/d72/da1/d99 1344242917 1 2024-09-16T09:46:23.365 INFO:tasks.workunit.client.0.smithi111.stdout:1/872: rename d3/f1a to d3/d10/d72/da1/d28/d36/f11c 0 2024-09-16T09:46:23.369 INFO:tasks.workunit.client.0.smithi111.stdout:1/873: rename d3/d10/d1c/f33 to d3/d10/d23/df6/d47/daf/f11d 0 2024-09-16T09:46:23.374 INFO:tasks.workunit.client.0.smithi111.stdout:1/874: mknod d3/d10/d72/da1/d28/c11e 0 2024-09-16T09:46:23.378 INFO:tasks.workunit.client.0.smithi111.stdout:1/875: rename d3/d26/l3a to d3/d10/d72/da1/d28/l11f 0 2024-09-16T09:46:23.384 INFO:tasks.workunit.client.0.smithi111.stdout:1/876: creat d3/d10/d23/df6/d11a/f120 x:0 0 0 2024-09-16T09:46:23.387 INFO:tasks.workunit.client.0.smithi111.stdout:1/877: rmdir d3/d10/d23/df6/d11a 39 2024-09-16T09:46:23.392 INFO:tasks.workunit.client.0.smithi111.stdout:9/800: dwrite d0/d6/d8/de/d56/d8e/dcf/fe6 [4194304,4194304] 0 2024-09-16T09:46:23.393 INFO:tasks.workunit.client.0.smithi111.stdout:1/878: rename d3/d10/f18 to d3/d24/d62/f121 0 2024-09-16T09:46:23.404 INFO:tasks.workunit.client.0.smithi111.stdout:1/879: link d3/d10/d57/fb7 d3/d10/d23/df6/d47/d65/d74/f122 0 2024-09-16T09:46:23.420 INFO:tasks.workunit.client.0.smithi111.stdout:1/880: dwrite d3/d10/d72/da1/d28/d36/f64 [4194304,4194304] 0 2024-09-16T09:46:23.423 INFO:tasks.workunit.client.0.smithi111.stdout:1/881: symlink d3/d26/d63/d84/dd1/l123 0 2024-09-16T09:46:23.432 INFO:tasks.workunit.client.0.smithi111.stdout:1/882: read d3/fe9 [4056144,102790] 0 2024-09-16T09:46:23.434 INFO:tasks.workunit.client.0.smithi111.stdout:1/883: creat d3/d26/d63/d84/dd1/f124 x:0 0 0 2024-09-16T09:46:23.436 INFO:tasks.workunit.client.0.smithi111.stdout:1/884: creat d3/d10/d57/d95/f125 x:0 0 0 2024-09-16T09:46:23.453 INFO:tasks.workunit.client.0.smithi111.stdout:1/885: dwrite d3/d10/d1c/f7c [0,4194304] 0 2024-09-16T09:46:23.453 INFO:tasks.workunit.client.0.smithi111.stdout:1/886: fdatasync d3/d10/d57/dcc/fd4 0 2024-09-16T09:46:23.453 INFO:tasks.workunit.client.0.smithi111.stdout:1/887: fsync d3/d10/d23/df6/d47/d65/d74/f80 0 2024-09-16T09:46:23.453 INFO:tasks.workunit.client.0.smithi111.stdout:9/801: truncate d0/d6/d30/f39 7428510 0 2024-09-16T09:46:23.456 INFO:tasks.workunit.client.0.smithi111.stdout:1/888: symlink d3/d26/d63/d84/d10a/l126 0 2024-09-16T09:46:23.457 INFO:tasks.workunit.client.0.smithi111.stdout:1/889: unlink d3/d10/d1c/c101 0 2024-09-16T09:46:23.463 INFO:tasks.workunit.client.0.smithi111.stdout:9/802: write d0/d6c/fd5 [2057772,113484] 0 2024-09-16T09:46:23.467 INFO:tasks.workunit.client.0.smithi111.stdout:9/803: rename d0/d6/d8/f26 to d0/d48/f10f 0 2024-09-16T09:46:23.473 INFO:tasks.workunit.client.0.smithi111.stdout:1/890: dwrite d3/d10/d23/df6/d47/daf/fa6 [0,4194304] 0 2024-09-16T09:46:23.484 INFO:tasks.workunit.client.0.smithi111.stdout:1/891: write d3/d10/d72/da1/f35 [11037469,26177] 0 2024-09-16T09:46:23.484 INFO:tasks.workunit.client.0.smithi111.stdout:9/804: dwrite d0/d6/fb9 [0,4194304] 0 2024-09-16T09:46:23.484 INFO:tasks.workunit.client.0.smithi111.stdout:9/805: chown d0/d21/dc3/de9 487 1 2024-09-16T09:46:23.484 INFO:tasks.workunit.client.0.smithi111.stdout:9/806: fdatasync d0/d6/d8/f36 0 2024-09-16T09:46:23.488 INFO:tasks.workunit.client.0.smithi111.stdout:1/892: mknod d3/d10/d57/c127 0 2024-09-16T09:46:23.489 INFO:tasks.workunit.client.0.smithi111.stdout:9/807: creat d0/d6/d30/d81/f110 x:0 0 0 2024-09-16T09:46:23.490 INFO:tasks.workunit.client.0.smithi111.stdout:9/808: dread - d0/d21/d22/d6e/d51/d76/dc0/fdc zero size 2024-09-16T09:46:23.493 INFO:tasks.workunit.client.0.smithi111.stdout:9/809: dread d0/d6c/d70/fa4 [0,4194304] 0 2024-09-16T09:46:23.494 INFO:tasks.workunit.client.0.smithi111.stdout:9/810: stat d0/d21/d22/d6e/d7d/l82 0 2024-09-16T09:46:23.497 INFO:tasks.workunit.client.0.smithi111.stdout:1/893: dread d3/d10/d57/d95/fbd [0,4194304] 0 2024-09-16T09:46:23.498 INFO:tasks.workunit.client.0.smithi111.stdout:1/894: write d3/d10/d72/da1/d99/f116 [854404,21175] 0 2024-09-16T09:46:23.498 INFO:tasks.workunit.client.0.smithi111.stdout:9/811: symlink d0/d6/d45/db0/l111 0 2024-09-16T09:46:23.498 INFO:tasks.workunit.client.0.smithi111.stdout:9/812: stat d0/d6/f3c 0 2024-09-16T09:46:23.499 INFO:tasks.workunit.client.0.smithi111.stdout:1/895: creat d3/d10/d23/d8e/df0/f128 x:0 0 0 2024-09-16T09:46:23.499 INFO:tasks.workunit.client.0.smithi111.stdout:1/896: fdatasync d3/d10/d23/df6/d47/f103 0 2024-09-16T09:46:23.500 INFO:tasks.workunit.client.0.smithi111.stdout:9/813: creat d0/f112 x:0 0 0 2024-09-16T09:46:23.500 INFO:tasks.workunit.client.0.smithi111.stdout:9/814: chown d0/d6c/c85 41 1 2024-09-16T09:46:23.502 INFO:tasks.workunit.client.0.smithi111.stdout:1/897: symlink d3/d10/d23/de8/d105/l129 0 2024-09-16T09:46:23.502 INFO:tasks.workunit.client.0.smithi111.stdout:1/898: rename d3/d10/d23/df6 to d3/d10/d23/df6/d47/d65/d74/d12a 22 2024-09-16T09:46:23.503 INFO:tasks.workunit.client.0.smithi111.stdout:1/899: write d3/d10/d23/d8e/fa3 [903490,125026] 0 2024-09-16T09:46:23.503 INFO:tasks.workunit.client.0.smithi111.stdout:1/900: write d3/d24/f118 [180460,113635] 0 2024-09-16T09:46:23.504 INFO:tasks.workunit.client.0.smithi111.stdout:9/815: creat d0/d6/d75/f113 x:0 0 0 2024-09-16T09:46:23.507 INFO:tasks.workunit.client.0.smithi111.stdout:9/816: mkdir d0/d21/d22/d6e/d51/d76/dc0/d114 0 2024-09-16T09:46:23.510 INFO:tasks.workunit.client.0.smithi111.stdout:1/901: dread d3/d10/d23/df6/d47/daf/fa6 [0,4194304] 0 2024-09-16T09:46:23.515 INFO:tasks.workunit.client.0.smithi111.stdout:1/902: mknod d3/d10/d23/df6/d47/daf/dbc/c12b 0 2024-09-16T09:46:23.518 INFO:tasks.workunit.client.0.smithi111.stdout:1/903: rename d3/d10/d23/df6/d47/d65/d74/c79 to d3/d26/c12c 0 2024-09-16T09:46:23.518 INFO:tasks.workunit.client.0.smithi111.stdout:1/904: readlink d3/d10/d72/da1/d28/l11f 0 2024-09-16T09:46:23.526 INFO:tasks.workunit.client.0.smithi111.stdout:1/905: dread d3/d10/d72/da1/d28/d36/f11c [0,4194304] 0 2024-09-16T09:46:23.535 INFO:tasks.workunit.client.0.smithi111.stdout:1/906: write d3/d10/d72/fcb [6846905,37568] 0 2024-09-16T09:46:23.537 INFO:tasks.workunit.client.0.smithi111.stdout:1/907: rmdir d3/d10/d57/dcc 39 2024-09-16T09:46:23.539 INFO:tasks.workunit.client.0.smithi111.stdout:1/908: creat d3/d24/d4e/d6f/f12d x:0 0 0 2024-09-16T09:46:23.540 INFO:tasks.workunit.client.0.smithi111.stdout:6/892: sync 2024-09-16T09:46:23.561 INFO:tasks.workunit.client.0.smithi111.stdout:1/909: dwrite d3/d10/d72/da1/d28/d36/f11c [0,4194304] 0 2024-09-16T09:46:23.564 INFO:tasks.workunit.client.0.smithi111.stdout:1/910: mkdir d3/d10/d72/d12e 0 2024-09-16T09:46:23.564 INFO:tasks.workunit.client.0.smithi111.stdout:1/911: write d3/d10/d23/df6/d47/daf/fba [1005861,39653] 0 2024-09-16T09:46:23.564 INFO:tasks.workunit.client.0.smithi111.stdout:7/891: sync 2024-09-16T09:46:23.566 INFO:tasks.workunit.client.0.smithi111.stdout:1/912: rename d3/d10/d72/da1/d99/f116 to d3/d10/d23/d8e/df0/f12f 0 2024-09-16T09:46:23.571 INFO:tasks.workunit.client.0.smithi111.stdout:6/893: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/dfe/f110 [0,4194304] 0 2024-09-16T09:46:23.577 INFO:tasks.workunit.client.0.smithi111.stdout:7/892: dread d1/d16/d17/d18/d4f/df5/f76 [0,4194304] 0 2024-09-16T09:46:23.577 INFO:tasks.workunit.client.0.smithi111.stdout:6/894: dread d0/d57/d72/db2/fdb [0,4194304] 0 2024-09-16T09:46:23.582 INFO:tasks.workunit.client.0.smithi111.stdout:7/893: mknod d1/d16/db6/de4/d13e/c140 0 2024-09-16T09:46:23.584 INFO:tasks.workunit.client.0.smithi111.stdout:6/895: link d0/l43 d0/d57/db0/d47/d68/d6a/l12c 0 2024-09-16T09:46:23.585 INFO:tasks.workunit.client.0.smithi111.stdout:6/896: readlink d0/l1d 0 2024-09-16T09:46:23.585 INFO:tasks.workunit.client.0.smithi111.stdout:6/897: write d0/f12 [4806983,35959] 0 2024-09-16T09:46:23.585 INFO:tasks.workunit.client.0.smithi111.stdout:7/894: mknod d1/d20/c141 0 2024-09-16T09:46:23.586 INFO:tasks.workunit.client.0.smithi111.stdout:6/898: mknod d0/daf/c12d 0 2024-09-16T09:46:23.588 INFO:tasks.workunit.client.0.smithi111.stdout:7/895: mkdir d1/d20/da3/dfa/dfc/d142 0 2024-09-16T09:46:23.589 INFO:tasks.workunit.client.0.smithi111.stdout:1/913: dwrite d3/d10/d72/da1/d28/d36/fa5 [0,4194304] 0 2024-09-16T09:46:23.589 INFO:tasks.workunit.client.0.smithi111.stdout:6/899: unlink d0/d57/c7a 0 2024-09-16T09:46:23.590 INFO:tasks.workunit.client.0.smithi111.stdout:7/896: rmdir d1/d16/d17/d18/d1d/d2f/d73 39 2024-09-16T09:46:23.591 INFO:tasks.workunit.client.0.smithi111.stdout:1/914: symlink d3/d10/d23/l130 0 2024-09-16T09:46:23.593 INFO:tasks.workunit.client.0.smithi111.stdout:7/897: mknod d1/d20/da3/dfa/c143 0 2024-09-16T09:46:23.595 INFO:tasks.workunit.client.0.smithi111.stdout:1/915: unlink d3/d10/d72/fcb 0 2024-09-16T09:46:23.595 INFO:tasks.workunit.client.0.smithi111.stdout:1/916: chown d3/d10/d23/df6/d47/daf/dbc/c12b 19263262 1 2024-09-16T09:46:23.598 INFO:tasks.workunit.client.0.smithi111.stdout:7/898: creat d1/d16/d17/d18/d4f/df5/da7/da8/f144 x:0 0 0 2024-09-16T09:46:23.598 INFO:tasks.workunit.client.0.smithi111.stdout:6/900: write d0/d57/db0/d47/d52/db3/f10a [2441058,102816] 0 2024-09-16T09:46:23.600 INFO:tasks.workunit.client.0.smithi111.stdout:1/917: symlink d3/d24/d29/dc8/de3/l131 0 2024-09-16T09:46:23.600 INFO:tasks.workunit.client.0.smithi111.stdout:1/918: chown d3/d10/d23/df6 28732 1 2024-09-16T09:46:23.601 INFO:tasks.workunit.client.0.smithi111.stdout:7/899: rename d1/d9/d53/lda to d1/d3e/d9e/dac/l145 0 2024-09-16T09:46:23.602 INFO:tasks.workunit.client.0.smithi111.stdout:1/919: fsync d3/d10/d23/df6/d47/daf/fba 0 2024-09-16T09:46:23.603 INFO:tasks.workunit.client.0.smithi111.stdout:6/901: rmdir d0/d57/db0/d14/d20/d42/d4e/d64/dcc 39 2024-09-16T09:46:23.603 INFO:tasks.workunit.client.0.smithi111.stdout:6/902: dread - d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f9d zero size 2024-09-16T09:46:23.603 INFO:tasks.workunit.client.0.smithi111.stdout:6/903: stat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d121/fdf 0 2024-09-16T09:46:23.604 INFO:tasks.workunit.client.0.smithi111.stdout:9/817: truncate d0/d6/d8/de/d56/d8e/dcf/fe6 5750797 0 2024-09-16T09:46:23.604 INFO:tasks.workunit.client.0.smithi111.stdout:9/818: truncate d0/d21/d22/f3e 1714723 0 2024-09-16T09:46:23.604 INFO:tasks.workunit.client.0.smithi111.stdout:9/819: stat d0/d21/d22/f86 0 2024-09-16T09:46:23.605 INFO:tasks.workunit.client.0.smithi111.stdout:1/920: mknod d3/d10/d72/d12e/c132 0 2024-09-16T09:46:23.608 INFO:tasks.workunit.client.0.smithi111.stdout:6/904: rename d0/d57/db0/d14/d20/d42/dbd to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/d93/d12e 0 2024-09-16T09:46:23.610 INFO:tasks.workunit.client.0.smithi111.stdout:9/820: rename d0/d21/d22/d6e/d51/ff6 to d0/d21/f115 0 2024-09-16T09:46:23.610 INFO:tasks.workunit.client.0.smithi111.stdout:6/905: stat d0/d57/db0/d47/d68/lba 0 2024-09-16T09:46:23.611 INFO:tasks.workunit.client.0.smithi111.stdout:7/900: write d1/d3e/d9e/fcc [2701366,31465] 0 2024-09-16T09:46:23.612 INFO:tasks.workunit.client.0.smithi111.stdout:9/821: creat d0/d6/d45/f116 x:0 0 0 2024-09-16T09:46:23.614 INFO:tasks.workunit.client.0.smithi111.stdout:6/906: truncate d0/f13 4167242 0 2024-09-16T09:46:23.618 INFO:tasks.workunit.client.0.smithi111.stdout:7/901: rename d1/d16/d17/d18/d1d/d2f/lf6 to d1/d3e/d9f/de2/l146 0 2024-09-16T09:46:23.620 INFO:tasks.workunit.client.0.smithi111.stdout:6/907: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d121/d12f 0 2024-09-16T09:46:23.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/822: rename d0/d6c/d70 to d0/d6/d8/de/d56/d8e/d117 0 2024-09-16T09:46:23.624 INFO:tasks.workunit.client.0.smithi111.stdout:9/823: mknod d0/d6c/d103/c118 0 2024-09-16T09:46:23.625 INFO:tasks.workunit.client.0.smithi111.stdout:7/902: link d1/dc7/c122 d1/d9/c147 0 2024-09-16T09:46:23.625 INFO:tasks.workunit.client.0.smithi111.stdout:7/903: stat d1/d16/d17/d18/d4f/df5/c54 0 2024-09-16T09:46:23.626 INFO:tasks.workunit.client.0.smithi111.stdout:7/904: read - d1/d59/f136 zero size 2024-09-16T09:46:23.626 INFO:tasks.workunit.client.0.smithi111.stdout:7/905: fsync d1/d16/d17/d18/f6f 0 2024-09-16T09:46:23.626 INFO:tasks.workunit.client.0.smithi111.stdout:1/921: dwrite d3/d10/d23/df6/d47/fe1 [0,4194304] 0 2024-09-16T09:46:23.627 INFO:tasks.workunit.client.0.smithi111.stdout:7/906: link d1/d16/f1c d1/d3e/d9f/de2/f148 0 2024-09-16T09:46:23.627 INFO:tasks.workunit.client.0.smithi111.stdout:7/907: stat d1/d16/d17/d18/d1b/d79/dce 0 2024-09-16T09:46:23.629 INFO:tasks.workunit.client.0.smithi111.stdout:1/922: creat d3/d10/d23/df6/d47/d65/f133 x:0 0 0 2024-09-16T09:46:23.631 INFO:tasks.workunit.client.0.smithi111.stdout:7/908: mknod d1/d16/d17/d18/d1b/d79/d8c/c149 0 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: pgmap v4: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:46:23.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/trash_purge_schedule"}]: dispatch 2024-09-16T09:46:23.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:23 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/trash_purge_schedule"}]: dispatch 2024-09-16T09:46:23.634 INFO:tasks.workunit.client.0.smithi111.stdout:9/824: dread d0/d48/f10f [0,4194304] 0 2024-09-16T09:46:23.634 INFO:tasks.workunit.client.0.smithi111.stdout:1/923: dread d3/d10/d23/df6/d47/daf/fa6 [0,4194304] 0 2024-09-16T09:46:23.636 INFO:tasks.workunit.client.0.smithi111.stdout:9/825: unlink d0/d21/d22/d6e/d7d/cc4 0 2024-09-16T09:46:23.639 INFO:tasks.workunit.client.0.smithi111.stdout:1/924: unlink d3/d10/d57/d95/fbd 0 2024-09-16T09:46:23.639 INFO:tasks.workunit.client.0.smithi111.stdout:1/925: chown d3/d10/d72/da1/fc9 3 1 2024-09-16T09:46:23.640 INFO:tasks.workunit.client.0.smithi111.stdout:9/826: getdents d0/d6/d75/da9 0 2024-09-16T09:46:23.641 INFO:tasks.workunit.client.0.smithi111.stdout:1/926: getdents d3/d24/d62/db3/dbb 0 2024-09-16T09:46:23.641 INFO:tasks.workunit.client.0.smithi111.stdout:1/927: fsync d3/d10/d23/d8e/df0/f128 0 2024-09-16T09:46:23.642 INFO:tasks.workunit.client.0.smithi111.stdout:9/827: unlink d0/d6/d30/c9e 0 2024-09-16T09:46:23.644 INFO:tasks.workunit.client.0.smithi111.stdout:1/928: creat d3/d10/d23/df6/d11a/f134 x:0 0 0 2024-09-16T09:46:23.644 INFO:tasks.workunit.client.0.smithi111.stdout:1/929: fdatasync d3/d10/d23/df6/d47/d65/fae 0 2024-09-16T09:46:23.646 INFO:tasks.workunit.client.0.smithi111.stdout:9/828: rename d0/d7b/dac/f10a to d0/d6/d8/f119 0 2024-09-16T09:46:23.646 INFO:tasks.workunit.client.0.smithi111.stdout:9/829: readlink d0/d6/d45/db0/l111 0 2024-09-16T09:46:23.646 INFO:tasks.workunit.client.0.smithi111.stdout:9/830: chown d0/d21/d22/d6e/d51/l6a 258997482 1 2024-09-16T09:46:23.646 INFO:tasks.workunit.client.0.smithi111.stdout:9/831: truncate d0/d6/d8/de/f95 1720598 0 2024-09-16T09:46:23.650 INFO:tasks.workunit.client.0.smithi111.stdout:9/832: rename d0/d6/d8/de/d56/d4e to d0/d6c/d11a 0 2024-09-16T09:46:23.652 INFO:tasks.workunit.client.0.smithi111.stdout:9/833: mknod d0/d6/d8/de/dca/c11b 0 2024-09-16T09:46:23.657 INFO:tasks.workunit.client.0.smithi111.stdout:7/909: dwrite d1/d9/f3c [0,4194304] 0 2024-09-16T09:46:23.657 INFO:tasks.workunit.client.0.smithi111.stdout:7/910: chown d1/d16/d17/d18/d1b/d79/da5/db2/fbb 1582810 1 2024-09-16T09:46:23.658 INFO:tasks.workunit.client.0.smithi111.stdout:7/911: mknod d1/d3e/d9f/c14a 0 2024-09-16T09:46:23.658 INFO:tasks.workunit.client.0.smithi111.stdout:7/912: chown d1/d16/d17/d18/leb 0 1 2024-09-16T09:46:23.672 INFO:tasks.workunit.client.0.smithi111.stdout:9/834: dwrite d0/d6/d30/d81/f110 [0,4194304] 0 2024-09-16T09:46:23.682 INFO:tasks.workunit.client.0.smithi111.stdout:7/913: dwrite d1/d16/d17/d18/f8b [0,4194304] 0 2024-09-16T09:46:23.684 INFO:tasks.workunit.client.0.smithi111.stdout:7/914: truncate d1/d16/d17/d18/f90 2110451 0 2024-09-16T09:46:23.685 INFO:tasks.workunit.client.0.smithi111.stdout:7/915: truncate d1/d9/f34 901417 0 2024-09-16T09:46:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: pgmap v4: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:23.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:23.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:46:23.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:46:23.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:46:23.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:46:23.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/trash_purge_schedule"}]: dispatch 2024-09-16T09:46:23.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:23 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi114.xvotey/trash_purge_schedule"}]: dispatch 2024-09-16T09:46:23.688 INFO:tasks.workunit.client.0.smithi111.stdout:7/916: rename d1/d16/d17/d18/d1b/l3b to d1/d9/d53/dc0/l14b 0 2024-09-16T09:46:23.689 INFO:tasks.workunit.client.0.smithi111.stdout:7/917: write d1/d16/d17/d18/d4f/df5/da7/da8/f13a [32301,109434] 0 2024-09-16T09:46:23.689 INFO:tasks.workunit.client.0.smithi111.stdout:7/918: chown d1/d16/d17/d18/d4f/d88/ca0 4691 1 2024-09-16T09:46:23.689 INFO:tasks.workunit.client.0.smithi111.stdout:7/919: readlink d1/d16/l7b 0 2024-09-16T09:46:23.696 INFO:tasks.workunit.client.0.smithi111.stdout:6/908: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/f36 [0,4194304] 0 2024-09-16T09:46:23.698 INFO:tasks.workunit.client.0.smithi111.stdout:6/909: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/d93/d12e/l130 0 2024-09-16T09:46:23.704 INFO:tasks.workunit.client.0.smithi111.stdout:9/835: dwrite d0/d6/d8/de/d56/d8e/dcf/fe6 [0,4194304] 0 2024-09-16T09:46:23.706 INFO:tasks.workunit.client.0.smithi111.stdout:9/836: symlink d0/d6/d30/d81/l11c 0 2024-09-16T09:46:23.707 INFO:tasks.workunit.client.0.smithi111.stdout:9/837: getdents d0/d7b 0 2024-09-16T09:46:23.707 INFO:tasks.workunit.client.0.smithi111.stdout:9/838: fdatasync d0/d21/d22/d6e/d51/d76/dc0/fdc 0 2024-09-16T09:46:23.715 INFO:tasks.workunit.client.0.smithi111.stdout:9/839: dread d0/d6/d45/f4c [0,4194304] 0 2024-09-16T09:46:23.715 INFO:tasks.workunit.client.0.smithi111.stdout:7/920: dwrite d1/d9/f15 [4194304,4194304] 0 2024-09-16T09:46:23.716 INFO:tasks.workunit.client.0.smithi111.stdout:6/910: dwrite d0/f1a [0,4194304] 0 2024-09-16T09:46:23.717 INFO:tasks.workunit.client.0.smithi111.stdout:7/921: rmdir d1/d16/d17 39 2024-09-16T09:46:23.720 INFO:tasks.workunit.client.0.smithi111.stdout:6/911: rename d0/d57/db0/d47/d68/l103 to d0/d57/db0/d14/l131 0 2024-09-16T09:46:23.724 INFO:tasks.workunit.client.0.smithi111.stdout:7/922: rename d1/d16/db6/de4/d13e/c13f to d1/d16/d17/d18/c14c 0 2024-09-16T09:46:23.724 INFO:tasks.workunit.client.0.smithi111.stdout:7/923: chown d1/d16/d17/d18/d1d/d2f/f75 1 1 2024-09-16T09:46:23.724 INFO:tasks.workunit.client.0.smithi111.stdout:9/840: dread d0/d48/d9d/fa3 [0,4194304] 0 2024-09-16T09:46:23.724 INFO:tasks.workunit.client.0.smithi111.stdout:9/841: write d0/f1e [4090193,31785] 0 2024-09-16T09:46:23.725 INFO:tasks.workunit.client.0.smithi111.stdout:6/912: unlink d0/d57/db0/d14/d20/d42/d4e/fa3 0 2024-09-16T09:46:23.728 INFO:tasks.workunit.client.0.smithi111.stdout:7/924: symlink d1/d3e/d9e/l14d 0 2024-09-16T09:46:23.733 INFO:tasks.workunit.client.0.smithi111.stdout:6/913: symlink d0/d57/db0/d14/d20/d42/d4e/d62/dc9/l132 0 2024-09-16T09:46:23.735 INFO:tasks.workunit.client.0.smithi111.stdout:7/925: creat d1/d16/d17/d18/d1b/d79/da5/f14e x:0 0 0 2024-09-16T09:46:23.738 INFO:tasks.workunit.client.0.smithi111.stdout:6/914: link d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/da1/cfc d0/d57/db0/d47/c133 0 2024-09-16T09:46:23.738 INFO:tasks.workunit.client.0.smithi111.stdout:6/915: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/cc6 38710169 1 2024-09-16T09:46:23.741 INFO:tasks.workunit.client.0.smithi111.stdout:7/926: symlink d1/d20/da3/dfa/l14f 0 2024-09-16T09:46:23.741 INFO:tasks.workunit.client.0.smithi111.stdout:7/927: chown d1/d3e/d9e/fcc 232228072 1 2024-09-16T09:46:23.744 INFO:tasks.workunit.client.0.smithi111.stdout:6/916: truncate d0/d57/db0/d14/d20/d42/f55 3044918 0 2024-09-16T09:46:23.744 INFO:tasks.workunit.client.0.smithi111.stdout:6/917: fdatasync d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/ffb 0 2024-09-16T09:46:23.750 INFO:tasks.workunit.client.0.smithi111.stdout:9/842: dwrite d0/f1e [0,4194304] 0 2024-09-16T09:46:23.750 INFO:tasks.workunit.client.0.smithi111.stdout:9/843: write d0/d21/d22/d6e/d51/d76/dc0/fdc [770544,106419] 0 2024-09-16T09:46:23.754 INFO:tasks.workunit.client.0.smithi111.stdout:7/928: write d1/d16/f72 [229530,34975] 0 2024-09-16T09:46:23.757 INFO:tasks.workunit.client.0.smithi111.stdout:9/844: truncate d0/d7b/dac/fdf 696995 0 2024-09-16T09:46:23.771 INFO:tasks.workunit.client.0.smithi111.stdout:7/929: creat d1/d3e/f150 x:0 0 0 2024-09-16T09:46:23.779 INFO:tasks.workunit.client.0.smithi111.stdout:9/845: creat d0/d21/d22/d6e/dab/f11d x:0 0 0 2024-09-16T09:46:23.782 INFO:tasks.workunit.client.0.smithi111.stdout:7/930: rename d1/d3e/d9f/l109 to d1/d16/db6/de4/dd7/l151 0 2024-09-16T09:46:23.782 INFO:tasks.workunit.client.0.smithi111.stdout:7/931: chown d1/d59/l6a 338040 1 2024-09-16T09:46:23.783 INFO:tasks.workunit.client.0.smithi111.stdout:7/932: dread - d1/d9/d43/d82/f106 zero size 2024-09-16T09:46:23.785 INFO:tasks.workunit.client.0.smithi111.stdout:9/846: rmdir d0/d21/d22/d6e/d7d 39 2024-09-16T09:46:23.787 INFO:tasks.workunit.client.0.smithi111.stdout:7/933: unlink d1/d9/d43/f111 0 2024-09-16T09:46:23.788 INFO:tasks.workunit.client.0.smithi111.stdout:7/934: readlink d1/d16/d17/d18/d1d/l40 0 2024-09-16T09:46:23.790 INFO:tasks.workunit.client.0.smithi111.stdout:9/847: creat d0/d6/d8/de/d56/d8e/f11e x:0 0 0 2024-09-16T09:46:23.798 INFO:tasks.workunit.client.0.smithi111.stdout:9/848: dread d0/d21/d22/d6e/f97 [0,4194304] 0 2024-09-16T09:46:23.799 INFO:tasks.workunit.client.0.smithi111.stdout:9/849: stat d0/d21/d22/c2e 0 2024-09-16T09:46:23.799 INFO:tasks.workunit.client.0.smithi111.stdout:7/935: write d1/d9/f35 [2187630,63728] 0 2024-09-16T09:46:23.801 INFO:tasks.workunit.client.0.smithi111.stdout:9/850: creat d0/d21/d22/d6e/dab/f11f x:0 0 0 2024-09-16T09:46:23.802 INFO:tasks.workunit.client.0.smithi111.stdout:9/851: dread - d0/d6/d8/f93 zero size 2024-09-16T09:46:23.804 INFO:tasks.workunit.client.0.smithi111.stdout:9/852: symlink d0/d6/d75/l120 0 2024-09-16T09:46:23.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/853: unlink d0/d6c/d11a/f73 0 2024-09-16T09:46:23.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/854: fsync d0/d6/d30/d81/fb6 0 2024-09-16T09:46:23.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/855: dread - d0/d6/d75/fae zero size 2024-09-16T09:46:23.807 INFO:tasks.workunit.client.0.smithi111.stdout:9/856: dread - d0/d6/d45/db0/fdd zero size 2024-09-16T09:46:23.826 INFO:tasks.workunit.client.0.smithi111.stdout:7/936: dwrite d1/d16/d17/d18/d4f/df5/fb8 [0,4194304] 0 2024-09-16T09:46:23.835 INFO:tasks.workunit.client.0.smithi111.stdout:7/937: mkdir d1/d16/db6/de4/dd7/d152 0 2024-09-16T09:46:23.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/938: symlink d1/d16/db6/l153 0 2024-09-16T09:46:23.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/939: stat d1/d3e/d9e/dac 0 2024-09-16T09:46:23.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/940: fdatasync d1/d16/d17/d18/f11d 0 2024-09-16T09:46:23.838 INFO:tasks.workunit.client.0.smithi111.stdout:7/941: fsync d1/d16/d17/d18/d4f/df5/f8d 0 2024-09-16T09:46:23.839 INFO:tasks.workunit.client.0.smithi111.stdout:9/857: dwrite d0/d6/d8/f119 [0,4194304] 0 2024-09-16T09:46:23.840 INFO:tasks.workunit.client.0.smithi111.stdout:9/858: write d0/d48/d9d/fbe [705940,93313] 0 2024-09-16T09:46:23.850 INFO:tasks.workunit.client.0.smithi111.stdout:7/942: creat d1/d16/d17/d18/d1b/d79/da5/f154 x:0 0 0 2024-09-16T09:46:23.871 INFO:tasks.workunit.client.0.smithi111.stdout:7/943: symlink d1/d16/db6/de4/dd7/d135/l155 0 2024-09-16T09:46:23.877 INFO:tasks.workunit.client.0.smithi111.stdout:7/944: symlink d1/d16/l156 0 2024-09-16T09:46:23.877 INFO:tasks.workunit.client.0.smithi111.stdout:7/945: fdatasync d1/d16/d17/d18/d4f/f129 0 2024-09-16T09:46:23.877 INFO:tasks.workunit.client.0.smithi111.stdout:7/946: truncate d1/d16/d17/d18/d1d/d2f/f11a 1187802 0 2024-09-16T09:46:23.880 INFO:tasks.workunit.client.0.smithi111.stdout:7/947: mknod d1/d20/da3/dfa/dfc/d142/c157 0 2024-09-16T09:46:23.889 INFO:tasks.workunit.client.0.smithi111.stdout:7/948: dread d1/d16/d17/d18/d1d/d2f/f5c [0,4194304] 0 2024-09-16T09:46:23.892 INFO:tasks.workunit.client.0.smithi111.stdout:7/949: creat d1/d16/d17/d18/d4f/d88/f158 x:0 0 0 2024-09-16T09:46:23.895 INFO:tasks.workunit.client.0.smithi111.stdout:7/950: truncate d1/d16/d17/d18/d1d/d2f/f71 1047715 0 2024-09-16T09:46:23.914 INFO:tasks.workunit.client.0.smithi111.stdout:7/951: dwrite d1/d3e/f70 [0,4194304] 0 2024-09-16T09:46:23.929 INFO:tasks.workunit.client.0.smithi111.stdout:7/952: dwrite d1/d16/d17/d18/d4f/df5/da7/da8/f113 [0,4194304] 0 2024-09-16T09:46:23.937 INFO:tasks.workunit.client.0.smithi111.stdout:7/953: mkdir d1/d16/dd8/d159 0 2024-09-16T09:46:23.941 INFO:tasks.workunit.client.0.smithi111.stdout:7/954: rmdir d1/d9/d53 39 2024-09-16T09:46:23.959 INFO:tasks.workunit.client.0.smithi111.stdout:7/955: dwrite d1/d16/d124/f130 [0,4194304] 0 2024-09-16T09:46:23.961 INFO:tasks.workunit.client.0.smithi111.stdout:7/956: creat d1/d20/da3/dfa/dfc/f15a x:0 0 0 2024-09-16T09:46:23.962 INFO:tasks.workunit.client.0.smithi111.stdout:7/957: mkdir d1/d16/d17/d18/d1b/d79/da5/d15b 0 2024-09-16T09:46:23.962 INFO:tasks.workunit.client.0.smithi111.stdout:7/958: readlink d1/d9/d53/dc0/l112 0 2024-09-16T09:46:23.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/959: rename d1/d16/d17/d18/d1b/d79/d8c/l10f to d1/d16/d17/d18/d1b/d79/dce/l15c 0 2024-09-16T09:46:23.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/960: read - d1/d16/d17/f13d zero size 2024-09-16T09:46:23.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/961: read - d1/d20/da3/dfa/dfc/f10b zero size 2024-09-16T09:46:23.964 INFO:tasks.workunit.client.0.smithi111.stdout:7/962: truncate d1/d16/d17/d18/d4f/f129 838175 0 2024-09-16T09:46:23.965 INFO:tasks.workunit.client.0.smithi111.stdout:7/963: truncate d1/d16/d17/d18/f4c 4761038 0 2024-09-16T09:46:23.965 INFO:tasks.workunit.client.0.smithi111.stdout:7/964: creat d1/d9/d128/f15d x:0 0 0 2024-09-16T09:46:23.965 INFO:tasks.workunit.client.0.smithi111.stdout:7/965: write d1/dc7/de3/f121 [1008807,125271] 0 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/966: dread d1/d16/d17/d18/d4f/df5/f76 [0,4194304] 0 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/967: chown d1/d9/d128 3 1 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/968: write d1/f32 [3557818,56472] 0 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/969: write d1/d16/d17/d18/d1b/d79/da5/db2/f119 [260159,83846] 0 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/970: stat d1/d16/d124/fa1 0 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/971: write d1/d59/f136 [102964,124370] 0 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/972: chown d1/d16/d17/d18/d1d/d2f 0 1 2024-09-16T09:46:23.971 INFO:tasks.workunit.client.0.smithi111.stdout:7/973: readlink d1/d3e/d9e/l14d 0 2024-09-16T09:46:23.972 INFO:tasks.workunit.client.0.smithi111.stdout:7/974: rename d1/d16/d124/c11b to d1/d16/c15e 0 2024-09-16T09:46:23.972 INFO:tasks.workunit.client.0.smithi111.stdout:7/975: chown d1/d16/d17/d18/d4f/f129 60689 1 2024-09-16T09:46:23.972 INFO:tasks.workunit.client.0.smithi111.stdout:7/976: write d1/d16/d17/d18/d1b/d79/da5/f14e [273299,59918] 0 2024-09-16T09:46:23.973 INFO:tasks.workunit.client.0.smithi111.stdout:7/977: creat d1/d16/f15f x:0 0 0 2024-09-16T09:46:23.974 INFO:tasks.workunit.client.0.smithi111.stdout:7/978: dread d1/d16/d17/d18/d4f/f129 [0,4194304] 0 2024-09-16T09:46:23.975 INFO:tasks.workunit.client.0.smithi111.stdout:7/979: mkdir d1/d9/d53/dc0/de7/d160 0 2024-09-16T09:46:23.979 INFO:tasks.workunit.client.0.smithi111.stdout:7/980: dread d1/d3e/d9f/de2/f10e [0,4194304] 0 2024-09-16T09:46:23.987 INFO:tasks.workunit.client.0.smithi111.stdout:7/981: dread d1/d16/d17/d18/d1b/f10d [0,4194304] 0 2024-09-16T09:46:23.993 INFO:tasks.workunit.client.0.smithi111.stdout:7/982: rename d1/d20/da3/dfa/dfc/c102 to d1/d16/d17/d18/d1b/d79/d8c/d98/c161 0 2024-09-16T09:46:23.993 INFO:tasks.workunit.client.0.smithi111.stdout:7/983: fdatasync d1/d20/fd4 0 2024-09-16T09:46:23.993 INFO:tasks.workunit.client.0.smithi111.stdout:7/984: readlink d1/d9/d43/l110 0 2024-09-16T09:46:23.995 INFO:tasks.workunit.client.0.smithi111.stdout:7/985: mknod d1/d16/d17/d18/d4f/df5/da7/c162 0 2024-09-16T09:46:23.998 INFO:tasks.workunit.client.0.smithi111.stdout:7/986: creat d1/d16/d17/d18/f163 x:0 0 0 2024-09-16T09:46:24.009 INFO:tasks.workunit.client.0.smithi111.stdout:1/930: sync 2024-09-16T09:46:24.009 INFO:tasks.workunit.client.0.smithi111.stdout:6/918: sync 2024-09-16T09:46:24.009 INFO:tasks.workunit.client.0.smithi111.stdout:1/931: write d3/d24/d29/f37 [3875165,100622] 0 2024-09-16T09:46:24.010 INFO:tasks.workunit.client.0.smithi111.stdout:9/859: sync 2024-09-16T09:46:24.014 INFO:tasks.workunit.client.0.smithi111.stdout:6/919: dread d0/d57/d72/f65 [0,4194304] 0 2024-09-16T09:46:24.015 INFO:tasks.workunit.client.0.smithi111.stdout:1/932: mknod d3/d26/d63/d84/dd1/c135 0 2024-09-16T09:46:24.016 INFO:tasks.workunit.client.0.smithi111.stdout:1/933: write d3/d10/d23/d8e/df0/fc4 [436299,26600] 0 2024-09-16T09:46:24.017 INFO:tasks.workunit.client.0.smithi111.stdout:7/987: dwrite d1/d9/d53/f78 [0,4194304] 0 2024-09-16T09:46:24.017 INFO:tasks.workunit.client.0.smithi111.stdout:7/988: write d1/d16/d17/d18/d1b/d79/da5/f14e [273538,704] 0 2024-09-16T09:46:24.017 INFO:tasks.workunit.client.0.smithi111.stdout:1/934: symlink d3/d10/d57/l136 0 2024-09-16T09:46:24.021 INFO:tasks.workunit.client.0.smithi111.stdout:7/989: mknod d1/dc7/c164 0 2024-09-16T09:46:24.026 INFO:tasks.workunit.client.0.smithi111.stdout:6/920: dread d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f54 [0,4194304] 0 2024-09-16T09:46:24.027 INFO:tasks.workunit.client.0.smithi111.stdout:7/990: mknod d1/d3e/c165 0 2024-09-16T09:46:24.029 INFO:tasks.workunit.client.0.smithi111.stdout:6/921: mknod d0/d57/d72/c134 0 2024-09-16T09:46:24.030 INFO:tasks.workunit.client.0.smithi111.stdout:7/991: symlink d1/d9/d53/dc0/de7/d160/l166 0 2024-09-16T09:46:24.032 INFO:tasks.workunit.client.0.smithi111.stdout:6/922: mkdir d0/daf/d135 0 2024-09-16T09:46:24.034 INFO:tasks.workunit.client.0.smithi111.stdout:7/992: symlink d1/dc7/de3/l167 0 2024-09-16T09:46:24.036 INFO:tasks.workunit.client.0.smithi111.stdout:7/993: creat d1/d20/da3/dfa/f168 x:0 0 0 2024-09-16T09:46:24.036 INFO:tasks.workunit.client.0.smithi111.stdout:7/994: fdatasync d1/d16/d17/d18/f8b 0 2024-09-16T09:46:24.046 INFO:tasks.workunit.client.0.smithi111.stdout:9/860: dwrite d0/d21/d22/d6e/d51/d76/f83 [0,4194304] 0 2024-09-16T09:46:24.047 INFO:tasks.workunit.client.0.smithi111.stdout:1/935: dwrite d3/d10/d23/df6/d47/d65/d74/f7e [0,4194304] 0 2024-09-16T09:46:24.047 INFO:tasks.workunit.client.0.smithi111.stdout:1/936: dread - d3/d24/d62/db3/dbb/fff zero size 2024-09-16T09:46:24.050 INFO:tasks.workunit.client.0.smithi111.stdout:7/995: write d1/d16/d17/d18/f11d [2702078,107386] 0 2024-09-16T09:46:24.050 INFO:tasks.workunit.client.0.smithi111.stdout:6/923: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f98 [0,4194304] 0 2024-09-16T09:46:24.052 INFO:tasks.workunit.client.0.smithi111.stdout:9/861: mkdir d0/d6/d8/de/d105/d121 0 2024-09-16T09:46:24.054 INFO:tasks.workunit.client.0.smithi111.stdout:1/937: symlink d3/d10/d57/l137 0 2024-09-16T09:46:24.055 INFO:tasks.workunit.client.0.smithi111.stdout:7/996: mkdir d1/d9/d43/d82/d169 0 2024-09-16T09:46:24.058 INFO:tasks.workunit.client.0.smithi111.stdout:6/924: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/d136 0 2024-09-16T09:46:24.060 INFO:tasks.workunit.client.0.smithi111.stdout:1/938: mknod d3/d24/d4e/c138 0 2024-09-16T09:46:24.060 INFO:tasks.workunit.client.0.smithi111.stdout:1/939: read - d3/d10/d23/df6/d11a/f120 zero size 2024-09-16T09:46:24.065 INFO:tasks.workunit.client.0.smithi111.stdout:7/997: mknod d1/d16/d17/d18/d1b/c16a 0 2024-09-16T09:46:24.078 INFO:tasks.workunit.client.0.smithi111.stdout:9/862: dwrite d0/d21/f8f [0,4194304] 0 2024-09-16T09:46:24.081 INFO:tasks.workunit.client.0.smithi111.stdout:9/863: mkdir d0/d6/d8/da2/d106/d122 0 2024-09-16T09:46:24.082 INFO:tasks.workunit.client.0.smithi111.stdout:9/864: dread d0/d7b/fa5 [0,4194304] 0 2024-09-16T09:46:24.083 INFO:tasks.workunit.client.0.smithi111.stdout:9/865: mkdir d0/d6/d8/de/d56/d8e/d117/d123 0 2024-09-16T09:46:24.091 INFO:tasks.workunit.client.0.smithi111.stdout:6/925: dwrite d0/d57/db0/d47/d68/d6a/ff6 [0,4194304] 0 2024-09-16T09:46:24.091 INFO:tasks.workunit.client.0.smithi111.stdout:7/998: dwrite d1/d16/d17/d18/d1d/d2f/f75 [0,4194304] 0 2024-09-16T09:46:24.092 INFO:tasks.workunit.client.0.smithi111.stdout:1/940: dwrite d3/d10/d23/d8e/df0/f4c [0,4194304] 0 2024-09-16T09:46:24.097 INFO:tasks.workunit.client.0.smithi111.stdout:7/999: write d1/d16/d17/d18/d1d/d2f/f71 [430849,73532] 0 2024-09-16T09:46:24.098 INFO:tasks.workunit.client.0.smithi111.stdout:1/941: stat d3/d10/dd0/ld7 0 2024-09-16T09:46:24.108 INFO:tasks.workunit.client.0.smithi111.stdout:9/866: dwrite d0/d21/d22/d6e/d51/d76/dc0/fc6 [0,4194304] 0 2024-09-16T09:46:24.109 INFO:tasks.workunit.client.0.smithi111.stdout:9/867: fsync d0/d6/d8/de/d56/fde 0 2024-09-16T09:46:24.111 INFO:tasks.workunit.client.0.smithi111.stdout:6/926: dwrite d0/d57/db0/d47/d52/db3/f10a [4194304,4194304] 0 2024-09-16T09:46:24.111 INFO:tasks.workunit.client.0.smithi111.stdout:6/927: truncate d0/d57/db0/d47/d68/fce 2352973 0 2024-09-16T09:46:24.111 INFO:tasks.workunit.client.0.smithi111.stdout:6/928: fsync d0/d57/db0/d14/d20/d42/d4e/f127 0 2024-09-16T09:46:24.115 INFO:tasks.workunit.client.0.smithi111.stdout:9/868: rename d0/d48/f80 to d0/d6/d75/f124 0 2024-09-16T09:46:24.115 INFO:tasks.workunit.client.0.smithi111.stdout:9/869: stat d0/d6/d30/d81/ff5 0 2024-09-16T09:46:24.120 INFO:tasks.workunit.client.0.smithi111.stdout:6/929: unlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/d93/fe0 0 2024-09-16T09:46:24.132 INFO:tasks.workunit.client.0.smithi111.stdout:9/870: dwrite d0/d6/d45/f116 [0,4194304] 0 2024-09-16T09:46:24.134 INFO:tasks.workunit.client.0.smithi111.stdout:9/871: symlink d0/d21/d22/d6e/d51/d76/dc0/d114/l125 0 2024-09-16T09:46:24.136 INFO:tasks.workunit.client.0.smithi111.stdout:9/872: mknod d0/d6/d75/da9/c126 0 2024-09-16T09:46:24.138 INFO:tasks.workunit.client.0.smithi111.stdout:9/873: symlink d0/d21/d22/d6e/d51/l127 0 2024-09-16T09:46:24.138 INFO:tasks.workunit.client.0.smithi111.stdout:9/874: write d0/d6/d45/f4c [179783,9688] 0 2024-09-16T09:46:24.139 INFO:tasks.workunit.client.0.smithi111.stdout:9/875: creat d0/d6/d8/de/d56/d8e/dfa/f128 x:0 0 0 2024-09-16T09:46:24.141 INFO:tasks.workunit.client.0.smithi111.stdout:9/876: truncate d0/d21/d22/d6e/d51/d76/dc0/fc6 707049 0 2024-09-16T09:46:24.150 INFO:tasks.workunit.client.0.smithi111.stdout:9/877: write d0/d21/d22/fa6 [1421610,120225] 0 2024-09-16T09:46:24.156 INFO:tasks.workunit.client.0.smithi111.stdout:9/878: dread d0/d21/d22/d6e/d51/d76/dc0/fc6 [0,4194304] 0 2024-09-16T09:46:24.156 INFO:tasks.workunit.client.0.smithi111.stdout:9/879: creat d0/d6c/d11a/f129 x:0 0 0 2024-09-16T09:46:24.157 INFO:tasks.workunit.client.0.smithi111.stdout:9/880: mkdir d0/d21/d12a 0 2024-09-16T09:46:24.158 INFO:tasks.workunit.client.0.smithi111.stdout:9/881: chown d0/d6/d45/db0/dcb/dda/ce3 23 1 2024-09-16T09:46:24.158 INFO:tasks.workunit.client.0.smithi111.stdout:9/882: write d0/d21/d22/d6e/d51/d76/dc0/fc2 [3347781,123529] 0 2024-09-16T09:46:24.159 INFO:tasks.workunit.client.0.smithi111.stdout:9/883: mkdir d0/d6/d75/d12b 0 2024-09-16T09:46:24.175 INFO:tasks.workunit.client.0.smithi111.stdout:9/884: dwrite d0/d21/f66 [0,4194304] 0 2024-09-16T09:46:24.175 INFO:tasks.workunit.client.0.smithi111.stdout:9/885: write d0/d21/d22/d6e/dab/f11f [722263,58591] 0 2024-09-16T09:46:24.175 INFO:tasks.workunit.client.0.smithi111.stdout:9/886: write d0/d6/d45/f4c [6096713,20135] 0 2024-09-16T09:46:24.180 INFO:tasks.workunit.client.0.smithi111.stdout:9/887: dread d0/d6/d8/f72 [0,4194304] 0 2024-09-16T09:46:24.181 INFO:tasks.workunit.client.0.smithi111.stdout:9/888: rename d0/d6/d75/f124 to d0/d6/d75/d12b/f12c 0 2024-09-16T09:46:24.192 INFO:tasks.workunit.client.0.smithi111.stdout:9/889: dread d0/d6/d8/de/f2f [0,4194304] 0 2024-09-16T09:46:24.195 INFO:tasks.workunit.client.0.smithi111.stdout:9/890: read d0/d6/d8/de/f2f [224255,101027] 0 2024-09-16T09:46:24.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:24 smithi111 ceph-mon[27997]: Deploying cephadm binary to smithi111 2024-09-16T09:46:24.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:24 smithi111 ceph-mon[27997]: [16/Sep/2024:09:46:23] ENGINE Bus STARTING 2024-09-16T09:46:24.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:24 smithi111 ceph-mon[27997]: [16/Sep/2024:09:46:23] ENGINE Serving on https://172.21.15.114:7150 2024-09-16T09:46:24.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:24 smithi111 ceph-mon[27997]: [16/Sep/2024:09:46:23] ENGINE Error in HTTPServer.serve 2024-09-16T09:46:24.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-16T09:46:24.281 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:46:24.282 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-16T09:46:24.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:46:24.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-16T09:46:24.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:46:24.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:24 smithi111 ceph-mon[27997]: [16/Sep/2024:09:46:23] ENGINE Serving on http://172.21.15.114:8765 2024-09-16T09:46:24.283 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:24 smithi111 ceph-mon[27997]: [16/Sep/2024:09:46:23] ENGINE Bus STARTED 2024-09-16T09:46:24.384 INFO:tasks.workunit.client.0.smithi111.stdout:1/942: sync 2024-09-16T09:46:24.386 INFO:tasks.workunit.client.0.smithi111.stdout:1/943: mknod d3/d10/d23/de8/c139 0 2024-09-16T09:46:24.388 INFO:tasks.workunit.client.0.smithi111.stdout:1/944: link d3/d10/d72/da1/fe d3/d10/d23/df6/d47/f13a 0 2024-09-16T09:46:24.391 INFO:tasks.workunit.client.0.smithi111.stdout:1/945: write d3/d10/d72/da1/d28/d36/fce [2556071,83557] 0 2024-09-16T09:46:24.391 INFO:tasks.workunit.client.0.smithi111.stdout:1/946: getdents d3/d10/d23/df6/d47/d65/df7/d10d 0 2024-09-16T09:46:24.394 INFO:tasks.workunit.client.0.smithi111.stdout:1/947: creat d3/d10/d23/df6/d47/d65/f13b x:0 0 0 2024-09-16T09:46:24.394 INFO:tasks.workunit.client.0.smithi111.stdout:1/948: stat d3/d10/d23/df6/d47/d65/d74 0 2024-09-16T09:46:24.398 INFO:tasks.workunit.client.0.smithi111.stdout:1/949: rename d3/d10/d57/dcc/fd4 to d3/d10/d23/df6/d47/d65/df7/d10d/f13c 0 2024-09-16T09:46:24.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/950: creat d3/d10/d23/df6/d47/d65/f13d x:0 0 0 2024-09-16T09:46:24.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/951: stat d3/d10/d23/df6/d47/d65/df7/d117 0 2024-09-16T09:46:24.402 INFO:tasks.workunit.client.0.smithi111.stdout:1/952: readlink d3/d10/d23/df6/d47/d65/d74/l104 0 2024-09-16T09:46:24.410 INFO:tasks.workunit.client.0.smithi111.stdout:1/953: dread d3/d24/d62/f90 [0,4194304] 0 2024-09-16T09:46:24.411 INFO:tasks.workunit.client.0.smithi111.stdout:1/954: creat d3/d10/dd0/f13e x:0 0 0 2024-09-16T09:46:24.424 INFO:tasks.workunit.client.0.smithi111.stdout:1/955: dwrite d3/d10/d23/fd8 [0,4194304] 0 2024-09-16T09:46:24.427 INFO:tasks.workunit.client.0.smithi111.stdout:1/956: rename d3/d10/d72/da1/fc9 to d3/d10/d57/dcc/f13f 0 2024-09-16T09:46:24.429 INFO:tasks.workunit.client.0.smithi111.stdout:1/957: mknod d3/d10/d72/c140 0 2024-09-16T09:46:24.450 INFO:tasks.workunit.client.0.smithi111.stdout:1/958: dwrite d3/d26/d63/d84/dd1/f124 [0,4194304] 0 2024-09-16T09:46:24.453 INFO:tasks.workunit.client.0.smithi111.stdout:1/959: symlink d3/d10/d23/df6/d47/d65/d74/l141 0 2024-09-16T09:46:24.459 INFO:tasks.workunit.client.0.smithi111.stdout:1/960: rename d3/d10/d23/df6 to d3/d10/d72/d12e/d142 0 2024-09-16T09:46:24.461 INFO:tasks.workunit.client.0.smithi111.stdout:1/961: mkdir d3/d26/d63/d84/dd1/d143 0 2024-09-16T09:46:24.462 INFO:tasks.workunit.client.0.smithi111.stdout:1/962: getdents d3/d10/d57/dcc 0 2024-09-16T09:46:24.464 INFO:tasks.workunit.client.0.smithi111.stdout:1/963: creat d3/f144 x:0 0 0 2024-09-16T09:46:24.465 INFO:tasks.workunit.client.0.smithi111.stdout:1/964: creat d3/d10/d72/d12e/d142/d47/d65/d74/f145 x:0 0 0 2024-09-16T09:46:24.465 INFO:tasks.workunit.client.0.smithi111.stdout:1/965: dread - d3/d10/d57/d95/f125 zero size 2024-09-16T09:46:24.467 INFO:tasks.workunit.client.0.smithi111.stdout:1/966: rename d3/d24/d62/db3/dbb/fff to d3/d24/d29/dc8/de3/f146 0 2024-09-16T09:46:24.470 INFO:tasks.workunit.client.0.smithi111.stdout:1/967: link d3/d24/d4e/c9a d3/c147 0 2024-09-16T09:46:24.613 INFO:tasks.workunit.client.0.smithi111.stdout:6/930: sync 2024-09-16T09:46:24.613 INFO:tasks.workunit.client.0.smithi111.stdout:9/891: sync 2024-09-16T09:46:24.613 INFO:tasks.workunit.client.0.smithi111.stdout:9/892: stat d0/d6/d30/d81/l11c 0 2024-09-16T09:46:24.613 INFO:tasks.workunit.client.0.smithi111.stdout:9/893: mknod d0/d7b/c12d 0 2024-09-16T09:46:24.615 INFO:tasks.workunit.client.0.smithi111.stdout:9/894: mknod d0/d48/c12e 0 2024-09-16T09:46:24.615 INFO:tasks.workunit.client.0.smithi111.stdout:6/931: dread d0/d57/db0/d14/fb7 [0,4194304] 0 2024-09-16T09:46:24.615 INFO:tasks.workunit.client.0.smithi111.stdout:9/895: rmdir d0/d6/d45/db0/dcb 39 2024-09-16T09:46:24.617 INFO:tasks.workunit.client.0.smithi111.stdout:6/932: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d121/f137 x:0 0 0 2024-09-16T09:46:24.619 INFO:tasks.workunit.client.0.smithi111.stdout:9/896: rename d0/d21/d22/d6e/dab/fe1 to d0/d6/d75/da9/f12f 0 2024-09-16T09:46:24.619 INFO:tasks.workunit.client.0.smithi111.stdout:9/897: write d0/d6c/d11a/dc5/f102 [98512,66801] 0 2024-09-16T09:46:24.620 INFO:tasks.workunit.client.0.smithi111.stdout:6/933: creat d0/d57/db0/d47/d68/d6a/f138 x:0 0 0 2024-09-16T09:46:24.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/898: symlink d0/d6c/d11a/l130 0 2024-09-16T09:46:24.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/899: write d0/fcd [1428778,46564] 0 2024-09-16T09:46:24.622 INFO:tasks.workunit.client.0.smithi111.stdout:9/900: write d0/d7b/dac/f104 [391867,62217] 0 2024-09-16T09:46:24.624 INFO:tasks.workunit.client.0.smithi111.stdout:6/934: rename d0/d57/db0/d47/d88/da9 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/d139 0 2024-09-16T09:46:24.626 INFO:tasks.workunit.client.0.smithi111.stdout:9/901: mkdir d0/d6/d75/da9/d131 0 2024-09-16T09:46:24.626 INFO:tasks.workunit.client.0.smithi111.stdout:9/902: write d0/d6/d8/de/d56/d8e/d117/fa4 [1476433,116429] 0 2024-09-16T09:46:24.629 INFO:tasks.workunit.client.0.smithi111.stdout:9/903: mknod d0/d6/d8/de/d56/d8e/d117/c132 0 2024-09-16T09:46:24.631 INFO:tasks.workunit.client.0.smithi111.stdout:9/904: mknod d0/d6/d75/da9/c133 0 2024-09-16T09:46:24.636 INFO:tasks.workunit.client.0.smithi111.stdout:9/905: rename d0/d6/d75/da9/d131 to d0/d6/d8/de/d56/d134 0 2024-09-16T09:46:24.640 INFO:tasks.workunit.client.0.smithi111.stdout:6/935: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/f71 [0,4194304] 0 2024-09-16T09:46:24.652 INFO:tasks.workunit.client.0.smithi111.stdout:6/936: write d0/d57/db0/d47/d52/db3/fb6 [2512809,62038] 0 2024-09-16T09:46:24.653 INFO:tasks.workunit.client.0.smithi111.stdout:9/906: dwrite d0/d6/d8/de/d56/fff [0,4194304] 0 2024-09-16T09:46:24.655 INFO:tasks.workunit.client.0.smithi111.stdout:6/937: rename d0/d57/f75 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d121/f13a 0 2024-09-16T09:46:24.659 INFO:tasks.workunit.client.0.smithi111.stdout:6/938: creat d0/daf/f13b x:0 0 0 2024-09-16T09:46:24.659 INFO:tasks.workunit.client.0.smithi111.stdout:6/939: chown d0/daf 402 1 2024-09-16T09:46:24.668 INFO:tasks.workunit.client.0.smithi111.stdout:6/940: write d0/f19 [169213,126608] 0 2024-09-16T09:46:24.669 INFO:tasks.workunit.client.0.smithi111.stdout:6/941: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/l8a 391 1 2024-09-16T09:46:24.671 INFO:tasks.workunit.client.0.smithi111.stdout:6/942: rmdir d0/d57/db0/d14/d20/d42 39 2024-09-16T09:46:24.671 INFO:tasks.workunit.client.0.smithi111.stdout:6/943: write d0/d57/db0/d14/fcf [1040199,51251] 0 2024-09-16T09:46:24.671 INFO:tasks.workunit.client.0.smithi111.stdout:6/944: readlink d0/d57/ld9 0 2024-09-16T09:46:24.671 INFO:tasks.workunit.client.0.smithi111.stdout:6/945: write d0/d57/db0/d47/d52/db3/fb6 [4793954,88123] 0 2024-09-16T09:46:24.672 INFO:tasks.workunit.client.0.smithi111.stdout:9/907: dwrite d0/d6/d45/db0/fdd [0,4194304] 0 2024-09-16T09:46:24.672 INFO:tasks.workunit.client.0.smithi111.stdout:9/908: stat d0/d6/d30/d47/f52 0 2024-09-16T09:46:24.675 INFO:tasks.workunit.client.0.smithi111.stdout:6/946: symlink d0/d57/db0/d47/d68/l13c 0 2024-09-16T09:46:24.675 INFO:tasks.workunit.client.0.smithi111.stdout:6/947: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/fbf [5237809,34429] 0 2024-09-16T09:46:24.679 INFO:tasks.workunit.client.0.smithi111.stdout:6/948: truncate d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde/f120 1366272 0 2024-09-16T09:46:24.681 INFO:tasks.workunit.client.0.smithi111.stdout:6/949: mknod d0/d57/db0/c13d 0 2024-09-16T09:46:24.681 INFO:tasks.workunit.client.0.smithi111.stdout:6/950: stat d0/f12 0 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:24 smithi114 ceph-mon[35635]: Deploying cephadm binary to smithi111 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:24 smithi114 ceph-mon[35635]: [16/Sep/2024:09:46:23] ENGINE Bus STARTING 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:24 smithi114 ceph-mon[35635]: [16/Sep/2024:09:46:23] ENGINE Serving on https://172.21.15.114:7150 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:24 smithi114 ceph-mon[35635]: [16/Sep/2024:09:46:23] ENGINE Error in HTTPServer.serve 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Traceback (most recent call last): 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:46:24.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._run(expiration_interval) 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: s = self.context.wrap_socket( 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: return self.sslsocket_class._create( 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:46:24.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self.do_handshake() 2024-09-16T09:46:24.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:46:24.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._sslobj.do_handshake() 2024-09-16T09:46:24.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:46:24.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:24 smithi114 ceph-mon[35635]: [16/Sep/2024:09:46:23] ENGINE Serving on http://172.21.15.114:8765 2024-09-16T09:46:24.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:24 smithi114 ceph-mon[35635]: [16/Sep/2024:09:46:23] ENGINE Bus STARTED 2024-09-16T09:46:24.689 INFO:tasks.workunit.client.0.smithi111.stdout:6/951: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33/d11c/d5b/dfe/f13e x:0 0 0 2024-09-16T09:46:24.691 INFO:tasks.workunit.client.0.smithi111.stdout:6/952: mkdir d0/daf/d135/d13f 0 2024-09-16T09:46:24.692 INFO:tasks.workunit.client.0.smithi111.stdout:6/953: dread - d0/d57/db0/d47/d88/fd1 zero size 2024-09-16T09:46:24.692 INFO:tasks.workunit.client.0.smithi111.stdout:6/954: fsync d0/d57/db0/d14/d20/d42/d4e/d64/dcc/f106 0 2024-09-16T09:46:24.693 INFO:tasks.workunit.client.0.smithi111.stdout:6/955: getdents d0/d57/db0/d14/d20/d42/d4e/d64/dcc 0 2024-09-16T09:46:24.693 INFO:tasks.workunit.client.0.smithi111.stdout:6/956: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/f9f 8608314 1 2024-09-16T09:46:24.695 INFO:tasks.workunit.client.0.smithi111.stdout:6/957: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/d139/l140 0 2024-09-16T09:46:24.700 INFO:tasks.workunit.client.0.smithi111.stdout:9/909: dwrite d0/d6/f44 [0,4194304] 0 2024-09-16T09:46:24.709 INFO:tasks.workunit.client.0.smithi111.stdout:6/958: dread d0/f3a [0,4194304] 0 2024-09-16T09:46:24.714 INFO:tasks.workunit.client.0.smithi111.stdout:6/959: symlink d0/d57/d72/db2/l141 0 2024-09-16T09:46:24.717 INFO:tasks.workunit.client.0.smithi111.stdout:6/960: rmdir d0/daf/d135 39 2024-09-16T09:46:24.726 INFO:tasks.workunit.client.0.smithi111.stdout:9/910: dwrite d0/d21/d22/d6e/d51/d76/f5c [0,4194304] 0 2024-09-16T09:46:24.742 INFO:tasks.workunit.client.0.smithi111.stdout:9/911: mknod d0/d21/d22/d6e/d7d/c135 0 2024-09-16T09:46:24.744 INFO:tasks.workunit.client.0.smithi111.stdout:9/912: truncate d0/f1e 3880662 0 2024-09-16T09:46:24.744 INFO:tasks.workunit.client.0.smithi111.stdout:9/913: stat d0/d21/f115 0 2024-09-16T09:46:24.747 INFO:tasks.workunit.client.0.smithi111.stdout:9/914: creat d0/d6/d8/de/d56/d134/f136 x:0 0 0 2024-09-16T09:46:24.748 INFO:tasks.workunit.client.0.smithi111.stdout:9/915: write d0/d6/d8/de/d56/d8e/dcf/fe6 [6770637,110429] 0 2024-09-16T09:46:24.763 INFO:tasks.workunit.client.0.smithi111.stdout:9/916: dwrite d0/d6/d8/da2/feb [0,4194304] 0 2024-09-16T09:46:24.770 INFO:tasks.workunit.client.0.smithi111.stdout:9/917: creat d0/d6/d45/db0/dcb/dda/f137 x:0 0 0 2024-09-16T09:46:24.777 INFO:tasks.workunit.client.0.smithi111.stdout:9/918: read d0/d21/d22/d6e/f97 [1716308,22841] 0 2024-09-16T09:46:24.780 INFO:tasks.workunit.client.0.smithi111.stdout:9/919: creat d0/d21/d22/d6e/d51/f138 x:0 0 0 2024-09-16T09:46:24.781 INFO:tasks.workunit.client.0.smithi111.stdout:1/968: sync 2024-09-16T09:46:24.795 INFO:tasks.workunit.client.0.smithi111.stdout:1/969: write d3/d10/d72/da1/f35 [14484926,87676] 0 2024-09-16T09:46:24.802 INFO:tasks.workunit.client.0.smithi111.stdout:9/920: dwrite d0/d21/d22/d6e/d51/d76/dc0/fc2 [0,4194304] 0 2024-09-16T09:46:24.802 INFO:tasks.workunit.client.0.smithi111.stdout:9/921: stat d0/d6/d75/da9/ld7 0 2024-09-16T09:46:24.804 INFO:tasks.workunit.client.0.smithi111.stdout:9/922: truncate d0/d6/d8/de/f95 461474 0 2024-09-16T09:46:24.804 INFO:tasks.workunit.client.0.smithi111.stdout:9/923: dread - d0/d21/d22/d6e/d51/fb7 zero size 2024-09-16T09:46:24.805 INFO:tasks.workunit.client.0.smithi111.stdout:9/924: mkdir d0/d6/d8/de/d56/d134/d139 0 2024-09-16T09:46:24.812 INFO:tasks.workunit.client.0.smithi111.stdout:1/970: dwrite d3/d10/d23/fd8 [0,4194304] 0 2024-09-16T09:46:24.813 INFO:tasks.workunit.client.0.smithi111.stdout:9/925: read d0/d7b/dac/fdf [309709,85736] 0 2024-09-16T09:46:24.813 INFO:tasks.workunit.client.0.smithi111.stdout:1/971: dread d3/d10/d72/f9e [0,4194304] 0 2024-09-16T09:46:24.815 INFO:tasks.workunit.client.0.smithi111.stdout:9/926: creat d0/d21/dc3/de9/f13a x:0 0 0 2024-09-16T09:46:24.816 INFO:tasks.workunit.client.0.smithi111.stdout:1/972: creat d3/d10/d23/f148 x:0 0 0 2024-09-16T09:46:24.817 INFO:tasks.workunit.client.0.smithi111.stdout:9/927: creat d0/d21/f13b x:0 0 0 2024-09-16T09:46:24.818 INFO:tasks.workunit.client.0.smithi111.stdout:1/973: rmdir d3/d10/d72/d12e/d142/d47/d65/d85 39 2024-09-16T09:46:24.818 INFO:tasks.workunit.client.0.smithi111.stdout:1/974: truncate d3/d10/d23/de8/ff9 485329 0 2024-09-16T09:46:24.821 INFO:tasks.workunit.client.0.smithi111.stdout:9/928: mkdir d0/d6/df1/d13c 0 2024-09-16T09:46:24.825 INFO:tasks.workunit.client.0.smithi111.stdout:9/929: symlink d0/d6/df1/l13d 0 2024-09-16T09:46:24.826 INFO:tasks.workunit.client.0.smithi111.stdout:9/930: readlink d0/d6c/d11a/l130 0 2024-09-16T09:46:24.828 INFO:tasks.workunit.client.0.smithi111.stdout:9/931: creat d0/d6/d8/de/d56/d134/d139/f13e x:0 0 0 2024-09-16T09:46:24.829 INFO:tasks.workunit.client.0.smithi111.stdout:9/932: creat d0/d6/d8/de/d56/d8e/dcf/f13f x:0 0 0 2024-09-16T09:46:24.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/975: dwrite d3/d10/f4d [0,4194304] 0 2024-09-16T09:46:24.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/976: chown d3/d10/d23/d8e/df0/fc4 1958 1 2024-09-16T09:46:24.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/977: readlink d3/d10/d57/l137 0 2024-09-16T09:46:24.836 INFO:tasks.workunit.client.0.smithi111.stdout:1/978: chown d3/d10/d57/dcc/cfb 663123322 1 2024-09-16T09:46:24.860 INFO:tasks.workunit.client.0.smithi111.stdout:9/933: dwrite d0/d6/d8/de/d56/f5e [0,4194304] 0 2024-09-16T09:46:24.860 INFO:tasks.workunit.client.0.smithi111.stdout:1/979: dwrite d3/d10/d72/d12e/d142/d47/f13a [0,4194304] 0 2024-09-16T09:46:24.861 INFO:tasks.workunit.client.0.smithi111.stdout:9/934: mknod d0/d6/d45/db0/c140 0 2024-09-16T09:46:24.863 INFO:tasks.workunit.client.0.smithi111.stdout:1/980: symlink d3/d24/d62/db3/dbb/l149 0 2024-09-16T09:46:24.867 INFO:tasks.workunit.client.0.smithi111.stdout:9/935: rename d0/d48/fa1 to d0/d21/d22/d6e/d7d/f141 0 2024-09-16T09:46:24.868 INFO:tasks.workunit.client.0.smithi111.stdout:1/981: truncate d3/d10/f4d 3680614 0 2024-09-16T09:46:24.869 INFO:tasks.workunit.client.0.smithi111.stdout:9/936: symlink d0/d48/d9d/l142 0 2024-09-16T09:46:24.869 INFO:tasks.workunit.client.0.smithi111.stdout:9/937: getdents d0/d6/d8/da2/d106/d122 0 2024-09-16T09:46:24.871 INFO:tasks.workunit.client.0.smithi111.stdout:1/982: creat d3/d10/d57/d95/f14a x:0 0 0 2024-09-16T09:46:24.873 INFO:tasks.workunit.client.0.smithi111.stdout:1/983: unlink d3/d10/d23/c112 0 2024-09-16T09:46:24.876 INFO:tasks.workunit.client.0.smithi111.stdout:1/984: symlink d3/d26/l14b 0 2024-09-16T09:46:24.878 INFO:tasks.workunit.client.0.smithi111.stdout:9/938: write d0/d48/d9d/fcc [3201133,115153] 0 2024-09-16T09:46:24.878 INFO:tasks.workunit.client.0.smithi111.stdout:9/939: chown d0/d6/d75/d12b 11 1 2024-09-16T09:46:24.878 INFO:tasks.workunit.client.0.smithi111.stdout:9/940: chown d0/d21/d22/d6e/dab/fd8 65361155 1 2024-09-16T09:46:24.878 INFO:tasks.workunit.client.0.smithi111.stdout:9/941: truncate d0/d6/d8/de/d56/d8e/dcf/f13f 1029652 0 2024-09-16T09:46:24.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/942: rmdir d0/d6/d8/de/d56/d8e/d117 39 2024-09-16T09:46:24.880 INFO:tasks.workunit.client.0.smithi111.stdout:9/943: stat d0/d21/d22/d6e/d51/fb7 0 2024-09-16T09:46:24.882 INFO:tasks.workunit.client.0.smithi111.stdout:9/944: getdents d0/d6 0 2024-09-16T09:46:24.885 INFO:tasks.workunit.client.0.smithi111.stdout:9/945: mkdir d0/d6/d8/de/dca/d143 0 2024-09-16T09:46:24.888 INFO:tasks.workunit.client.0.smithi111.stdout:9/946: link d0/d6/d30/d81/fa8 d0/d6/d8/de/d56/d8e/dcf/f144 0 2024-09-16T09:46:24.893 INFO:tasks.workunit.client.0.smithi111.stdout:1/985: dwrite d3/d24/d29/f37 [8388608,4194304] 0 2024-09-16T09:46:24.893 INFO:tasks.workunit.client.0.smithi111.stdout:1/986: stat d3/d10/d72/d12e/d142/d47/f13a 0 2024-09-16T09:46:24.894 INFO:tasks.workunit.client.0.smithi111.stdout:9/947: rename d0/d6/df1/l10e to d0/d6/d8/da2/d106/d122/l145 0 2024-09-16T09:46:24.899 INFO:tasks.workunit.client.0.smithi111.stdout:9/948: read d0/d6/d8/de/f11 [91564,88066] 0 2024-09-16T09:46:24.908 INFO:tasks.workunit.client.0.smithi111.stdout:1/987: dwrite d3/f9 [0,4194304] 0 2024-09-16T09:46:24.908 INFO:tasks.workunit.client.0.smithi111.stdout:9/949: dread d0/d6/d8/de/d56/f5e [0,4194304] 0 2024-09-16T09:46:24.909 INFO:tasks.workunit.client.0.smithi111.stdout:1/988: mkdir d3/d10/d57/d95/d14c 0 2024-09-16T09:46:24.921 INFO:tasks.workunit.client.0.smithi111.stdout:1/989: write d3/d10/d72/da1/fe [3759354,100741] 0 2024-09-16T09:46:24.923 INFO:tasks.workunit.client.0.smithi111.stdout:1/990: mknod d3/d10/d72/da1/d28/d36/c14d 0 2024-09-16T09:46:24.924 INFO:tasks.workunit.client.0.smithi111.stdout:1/991: mknod d3/d24/d4e/c14e 0 2024-09-16T09:46:24.924 INFO:tasks.workunit.client.0.smithi111.stdout:1/992: chown d3/d10/d23/f2b 202 1 2024-09-16T09:46:24.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/950: dwrite d0/d6/d8/de/d56/fd9 [0,4194304] 0 2024-09-16T09:46:24.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/951: chown d0/f1e 124794 1 2024-09-16T09:46:24.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/952: fsync d0/d48/f96 0 2024-09-16T09:46:24.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/953: chown d0/d6/d30/f39 3433 1 2024-09-16T09:46:24.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/954: read d0/d6/d30/d47/f52 [828879,4144] 0 2024-09-16T09:46:24.926 INFO:tasks.workunit.client.0.smithi111.stdout:9/955: write d0/d6/d30/d81/fb6 [5120960,1863] 0 2024-09-16T09:46:24.927 INFO:tasks.workunit.client.0.smithi111.stdout:1/993: rename d3/d10/d72/d12e/d142/d47/d65/df7/d10d/f13c to d3/d24/d29/dc8/f14f 0 2024-09-16T09:46:24.930 INFO:tasks.workunit.client.0.smithi111.stdout:9/956: symlink d0/d21/d22/l146 0 2024-09-16T09:46:24.931 INFO:tasks.workunit.client.0.smithi111.stdout:1/994: rmdir d3/d10/d72/d12e 39 2024-09-16T09:46:24.931 INFO:tasks.workunit.client.0.smithi111.stdout:1/995: chown d3/d10/d72/d12e/d142/d47/c7b 1840922 1 2024-09-16T09:46:24.941 INFO:tasks.workunit.client.0.smithi111.stdout:1/996: dread d3/d10/d23/d8e/ff2 [0,4194304] 0 2024-09-16T09:46:24.943 INFO:tasks.workunit.client.0.smithi111.stdout:1/997: unlink d3/d24/d62/db3/fc6 0 2024-09-16T09:46:24.943 INFO:tasks.workunit.client.0.smithi111.stdout:1/998: truncate d3/d24/d29/dc8/f14f 618585 0 2024-09-16T09:46:24.944 INFO:tasks.workunit.client.0.smithi111.stdout:1/999: creat d3/d10/d23/de8/f150 x:0 0 0 2024-09-16T09:46:24.946 INFO:tasks.workunit.client.0.smithi111.stdout:9/957: dwrite d0/d6/d45/db0/dcb/dda/f137 [0,4194304] 0 2024-09-16T09:46:24.946 INFO:tasks.workunit.client.0.smithi111.stdout:9/958: write d0/d7b/fa5 [953646,72727] 0 2024-09-16T09:46:24.956 INFO:tasks.workunit.client.0.smithi111.stdout:9/959: symlink d0/d6c/d11a/d92/l147 0 2024-09-16T09:46:24.957 INFO:tasks.workunit.client.0.smithi111.stdout:9/960: creat d0/d21/f148 x:0 0 0 2024-09-16T09:46:24.960 INFO:tasks.workunit.client.0.smithi111.stdout:9/961: rename d0/d6/d75/lfd to d0/d6/d8/de/d56/d8e/d117/d123/l149 0 2024-09-16T09:46:24.965 INFO:tasks.workunit.client.0.smithi111.stdout:9/962: dread d0/d6c/fd5 [0,4194304] 0 2024-09-16T09:46:24.966 INFO:tasks.workunit.client.0.smithi111.stdout:9/963: symlink d0/d6c/d11a/l14a 0 2024-09-16T09:46:24.967 INFO:tasks.workunit.client.0.smithi111.stdout:9/964: mknod d0/d6/d75/da9/c14b 0 2024-09-16T09:46:24.968 INFO:tasks.workunit.client.0.smithi111.stdout:9/965: mknod d0/d6/d75/da9/c14c 0 2024-09-16T09:46:24.999 INFO:tasks.workunit.client.0.smithi111.stdout:9/966: dwrite d0/d6/d8/de/f11 [0,4194304] 0 2024-09-16T09:46:25.017 INFO:tasks.workunit.client.0.smithi111.stdout:9/967: dwrite d0/d6/d75/fae [0,4194304] 0 2024-09-16T09:46:25.144 INFO:tasks.workunit.client.0.smithi111.stdout:6/961: sync 2024-09-16T09:46:25.146 INFO:tasks.workunit.client.0.smithi111.stdout:6/962: creat d0/d57/db0/d14/d20/d42/d4e/d62/f142 x:0 0 0 2024-09-16T09:46:25.147 INFO:tasks.workunit.client.0.smithi111.stdout:6/963: symlink d0/d57/l143 0 2024-09-16T09:46:25.149 INFO:tasks.workunit.client.0.smithi111.stdout:6/964: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/d139/d144 0 2024-09-16T09:46:25.150 INFO:tasks.workunit.client.0.smithi111.stdout:6/965: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/c145 0 2024-09-16T09:46:25.152 INFO:tasks.workunit.client.0.smithi111.stdout:6/966: truncate d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde/f120 507159 0 2024-09-16T09:46:25.154 INFO:tasks.workunit.client.0.smithi111.stdout:6/967: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/d139/d144/f146 x:0 0 0 2024-09-16T09:46:25.162 INFO:tasks.workunit.client.0.smithi111.stdout:6/968: dread d0/d57/d72/f61 [0,4194304] 0 2024-09-16T09:46:25.165 INFO:tasks.workunit.client.0.smithi111.stdout:6/969: creat d0/d57/d72/db2/f147 x:0 0 0 2024-09-16T09:46:25.165 INFO:tasks.workunit.client.0.smithi111.stdout:6/970: write d0/d57/db0/d47/d68/f73 [540779,117202] 0 2024-09-16T09:46:25.170 INFO:tasks.workunit.client.0.smithi111.stdout:6/971: rename d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d33 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/d148 0 2024-09-16T09:46:25.170 INFO:tasks.workunit.client.0.smithi111.stdout:6/972: chown d0/daf/d135 58242261 1 2024-09-16T09:46:25.173 INFO:tasks.workunit.client.0.smithi111.stdout:6/973: mknod d0/d57/db0/d14/d20/d42/d4e/d62/d7b/c149 0 2024-09-16T09:46:25.185 INFO:tasks.workunit.client.0.smithi111.stdout:9/968: creat d0/d21/d22/d6e/f14d x:0 0 0 2024-09-16T09:46:25.185 INFO:tasks.workunit.client.0.smithi111.stdout:9/969: stat d0/d6/d45/db0/dcb/dda/ce3 0 2024-09-16T09:46:25.185 INFO:tasks.workunit.client.0.smithi111.stdout:9/970: truncate d0/d6c/d11a/dc5/f102 889697 0 2024-09-16T09:46:25.187 INFO:tasks.workunit.client.0.smithi111.stdout:9/971: dread d0/d21/d22/d6e/d7d/f141 [0,4194304] 0 2024-09-16T09:46:25.188 INFO:tasks.workunit.client.0.smithi111.stdout:6/974: dwrite d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/f11f [0,4194304] 0 2024-09-16T09:46:25.189 INFO:tasks.workunit.client.0.smithi111.stdout:9/972: mkdir d0/d6/d8/de/d56/d8e/d117/d14e 0 2024-09-16T09:46:25.194 INFO:tasks.workunit.client.0.smithi111.stdout:6/975: creat d0/d57/db0/d47/d52/db3/f14a x:0 0 0 2024-09-16T09:46:25.194 INFO:tasks.workunit.client.0.smithi111.stdout:9/973: truncate d0/d6c/d11a/d92/fb3 3914747 0 2024-09-16T09:46:25.195 INFO:tasks.workunit.client.0.smithi111.stdout:6/976: creat d0/d57/d72/db2/f14b x:0 0 0 2024-09-16T09:46:25.196 INFO:tasks.workunit.client.0.smithi111.stdout:9/974: truncate d0/d6c/fd5 2911543 0 2024-09-16T09:46:25.197 INFO:tasks.workunit.client.0.smithi111.stdout:6/977: creat d0/d57/db0/d47/d68/f14c x:0 0 0 2024-09-16T09:46:25.197 INFO:tasks.workunit.client.0.smithi111.stdout:6/978: write d0/d57/db0/d47/d88/f128 [959981,14420] 0 2024-09-16T09:46:25.197 INFO:tasks.workunit.client.0.smithi111.stdout:9/975: symlink d0/d6/d8/de/d105/d121/l14f 0 2024-09-16T09:46:25.199 INFO:tasks.workunit.client.0.smithi111.stdout:6/979: link d0/d57/d72/db2/l141 d0/d57/db0/d14/d20/d42/l14d 0 2024-09-16T09:46:25.199 INFO:tasks.workunit.client.0.smithi111.stdout:6/980: fsync d0/d57/db0/d14/d20/d42/f56 0 2024-09-16T09:46:25.200 INFO:tasks.workunit.client.0.smithi111.stdout:9/976: creat d0/d48/d9d/f150 x:0 0 0 2024-09-16T09:46:25.200 INFO:tasks.workunit.client.0.smithi111.stdout:9/977: write d0/d6/d8/de/f2f [5073253,90183] 0 2024-09-16T09:46:25.200 INFO:tasks.workunit.client.0.smithi111.stdout:6/981: getdents d0/d57/db0/d14/d20/d42/d4e/d64 0 2024-09-16T09:46:25.202 INFO:tasks.workunit.client.0.smithi111.stdout:9/978: creat d0/d6/d8/f151 x:0 0 0 2024-09-16T09:46:25.203 INFO:tasks.workunit.client.0.smithi111.stdout:9/979: mkdir d0/d6/d8/da2/d106/d122/d152 0 2024-09-16T09:46:25.203 INFO:tasks.workunit.client.0.smithi111.stdout:9/980: readlink d0/d6/d30/d81/l11c 0 2024-09-16T09:46:25.210 INFO:tasks.workunit.client.0.smithi111.stdout:6/982: write d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/f2e [3230532,31780] 0 2024-09-16T09:46:25.210 INFO:tasks.workunit.client.0.smithi111.stdout:6/983: fdatasync d0/d57/d72/f8b 0 2024-09-16T09:46:25.225 INFO:tasks.workunit.client.0.smithi111.stdout:6/984: dwrite d0/f13 [4194304,4194304] 0 2024-09-16T09:46:25.225 INFO:tasks.workunit.client.0.smithi111.stdout:6/985: chown d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/d139/l140 7 1 2024-09-16T09:46:25.233 INFO:tasks.workunit.client.0.smithi111.stdout:6/986: read d0/d57/db0/d47/d88/f101 [1229465,114874] 0 2024-09-16T09:46:25.237 INFO:tasks.workunit.client.0.smithi111.stdout:6/987: unlink d0/d57/db0/d47/d88/f128 0 2024-09-16T09:46:25.240 INFO:tasks.workunit.client.0.smithi111.stdout:6/988: mknod d0/d57/db0/d14/d20/d42/d4e/d62/dc9/c14e 0 2024-09-16T09:46:25.241 INFO:tasks.workunit.client.0.smithi111.stdout:6/989: mkdir d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d14f 0 2024-09-16T09:46:25.244 INFO:tasks.workunit.client.0.smithi111.stdout:6/990: link d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/d148/d11c/l6e d0/d57/db0/d14/d20/d42/d4e/d62/d7b/l150 0 2024-09-16T09:46:25.244 INFO:tasks.workunit.client.0.smithi111.stdout:6/991: write d0/d57/d72/db2/f14b [865751,62180] 0 2024-09-16T09:46:25.244 INFO:tasks.workunit.client.0.smithi111.stdout:6/992: chown d0/d57/db0/d14/c1c 280 1 2024-09-16T09:46:25.244 INFO:tasks.workunit.client.0.smithi111.stdout:6/993: readlink d0/d57/db0/l59 0 2024-09-16T09:46:25.244 INFO:tasks.workunit.client.0.smithi111.stdout:6/994: link d0/daf/c12d d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d121/c151 0 2024-09-16T09:46:25.245 INFO:tasks.workunit.client.0.smithi111.stdout:6/995: creat d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/dde/f152 x:0 0 0 2024-09-16T09:46:25.246 INFO:tasks.workunit.client.0.smithi111.stdout:6/996: getdents d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/d148/d11c/d5b/d93/d12e 0 2024-09-16T09:46:25.248 INFO:tasks.workunit.client.0.smithi111.stdout:6/997: truncate d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/d148/d11c/fd7 597353 0 2024-09-16T09:46:25.253 INFO:tasks.workunit.client.0.smithi111.stdout:6/998: rename d0/d57/db0/d47/d88 to d0/d57/db0/d14/d20/d42/d4e/d62/d7b/dc8/d41/d4f/d148/d11c/d153 0 2024-09-16T09:46:25.256 INFO:tasks.workunit.client.0.smithi111.stdout:6/999: symlink d0/d57/db0/d14/d20/d42/d4e/d62/d7b/d80/l154 0 2024-09-16T09:46:25.619 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:25 smithi111 ceph-mon[27997]: Deploying cephadm binary to smithi114 2024-09-16T09:46:25.619 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:25 smithi111 ceph-mon[27997]: pgmap v5: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:25.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.647+0000 7f75eaef4640 1 -- 172.21.15.111:0/1998422191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e40ffc00 msgr2=0x7f75e4100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:25.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.647+0000 7f75eaef4640 1 --2- 172.21.15.111:0/1998422191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e40ffc00 0x7f75e4100000 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009880 tx=0x7f75d802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.647+0000 7f75eaef4640 1 -- 172.21.15.111:0/1998422191 shutdown_connections 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.647+0000 7f75eaef4640 1 --2- 172.21.15.111:0/1998422191 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e4102be0 0x7f75e4103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.648+0000 7f75eaef4640 1 --2- 172.21.15.111:0/1998422191 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e40ffc00 0x7f75e4100000 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.648+0000 7f75eaef4640 1 -- 172.21.15.111:0/1998422191 >> 172.21.15.111:0/1998422191 conn(0x7f75e40fb750 msgr2=0x7f75e40fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.648+0000 7f75eaef4640 1 -- 172.21.15.111:0/1998422191 shutdown_connections 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.648+0000 7f75eaef4640 1 -- 172.21.15.111:0/1998422191 wait complete. 2024-09-16T09:46:25.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.649+0000 7f75eaef4640 1 Processor -- start 2024-09-16T09:46:25.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.649+0000 7f75eaef4640 1 -- start start 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75eaef4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e40ffc00 0x7f75e41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75eaef4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e4102be0 0x7f75e4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75eaef4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f75e410a790 con 0x7f75e4102be0 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75eaef4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f75e410a610 con 0x7f75e40ffc00 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75e8c90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e40ffc00 0x7f75e41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75e3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e4102be0 0x7f75e4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75e8c90640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e40ffc00 0x7f75e41974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:47338/0 (socket says 172.21.15.111:47338) 2024-09-16T09:46:25.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.650+0000 7f75e8c90640 1 -- 172.21.15.111:0/2475777473 learned_addr learned my addr 172.21.15.111:0/2475777473 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e3fff640 1 -- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e40ffc00 msgr2=0x7f75e41974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e3fff640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e40ffc00 0x7f75e41974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e3fff640 1 -- 172.21.15.111:0/2475777473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75e4198080 con 0x7f75e4102be0 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e3fff640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e4102be0 0x7f75e4197a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009b50 tx=0x7f75d000b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75d001e070 con 0x7f75e4102be0 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75e4100a30 con 0x7f75e4102be0 2024-09-16T09:46:25.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75d0009e50 con 0x7f75e4102be0 2024-09-16T09:46:25.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75d0003d30 con 0x7f75e4102be0 2024-09-16T09:46:25.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.651+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75e4100fc0 con 0x7f75e4102be0 2024-09-16T09:46:25.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.653+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75e4100000 con 0x7f75e4102be0 2024-09-16T09:46:25.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.653+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 23) ==== 51997+0+0 (secure 0 0 0) 0x7f75d0021070 con 0x7f75e4102be0 2024-09-16T09:46:25.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.653+0000 7f75e1ffb640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f75d403f9c0 0x7f75d4041e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:25.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.654+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f75d0016070 con 0x7f75e4102be0 2024-09-16T09:46:25.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.654+0000 7f75e8c90640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f75d403f9c0 0x7f75d4041e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:25.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.655+0000 7f75e8c90640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f75d403f9c0 0x7f75d4041e80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000c00 tx=0x7f75d80058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:25.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.667+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f75d00043f0 con 0x7f75e4102be0 2024-09-16T09:46:25.686 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:25 smithi114 ceph-mon[35635]: Deploying cephadm binary to smithi114 2024-09-16T09:46:25.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:25 smithi114 ceph-mon[35635]: pgmap v5: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:25.742 INFO:tasks.workunit.client.0.smithi111.stdout:9/981: sync 2024-09-16T09:46:25.744 INFO:tasks.workunit.client.0.smithi111.stdout:9/982: rmdir d0/d6/d8/de/d56/d8e/d117/d123 39 2024-09-16T09:46:25.744 INFO:tasks.workunit.client.0.smithi111.stdout:9/983: chown d0/d21/d22/d6e/d7d/d9a/d101 26893936 1 2024-09-16T09:46:25.746 INFO:tasks.workunit.client.0.smithi111.stdout:9/984: mknod d0/d48/d9d/c153 0 2024-09-16T09:46:25.794 INFO:tasks.workunit.client.0.smithi111.stdout:9/985: dwrite d0/d7b/dac/fdf [0,4194304] 0 2024-09-16T09:46:25.794 INFO:tasks.workunit.client.0.smithi111.stdout:9/986: fsync d0/d48/d9d/fd1 0 2024-09-16T09:46:25.799 INFO:tasks.workunit.client.0.smithi111.stdout:9/987: unlink d0/d21/d22/d6e/d51/l127 0 2024-09-16T09:46:25.801 INFO:tasks.workunit.client.0.smithi111.stdout:9/988: symlink d0/d6c/d11a/dc5/l154 0 2024-09-16T09:46:25.804 INFO:tasks.workunit.client.0.smithi111.stdout:9/989: creat d0/d7b/f155 x:0 0 0 2024-09-16T09:46:25.805 INFO:tasks.workunit.client.0.smithi111.stdout:9/990: write d0/d6/d30/d81/fb6 [4725536,103815] 0 2024-09-16T09:46:25.806 INFO:tasks.workunit.client.0.smithi111.stdout:9/991: write d0/d21/f13b [800312,90797] 0 2024-09-16T09:46:25.806 INFO:tasks.workunit.client.0.smithi111.stdout:9/992: write d0/d6/d30/fb1 [1083929,65802] 0 2024-09-16T09:46:25.809 INFO:tasks.workunit.client.0.smithi111.stdout:9/993: rename d0/d6/f3c to d0/d6/d8/de/d105/f156 0 2024-09-16T09:46:25.811 INFO:tasks.workunit.client.0.smithi111.stdout:9/994: link d0/d21/d22/d6e/d7d/c135 d0/d6/d30/d47/c157 0 2024-09-16T09:46:25.811 INFO:tasks.workunit.client.0.smithi111.stdout:9/995: fdatasync d0/fcd 0 2024-09-16T09:46:25.814 INFO:tasks.workunit.client.0.smithi111.stdout:9/996: mkdir d0/d6/d45/db0/dcb/dda/d158 0 2024-09-16T09:46:25.827 INFO:tasks.workunit.client.0.smithi111.stdout:9/997: dread d0/d6/d30/f39 [0,4194304] 0 2024-09-16T09:46:25.829 INFO:tasks.workunit.client.0.smithi111.stdout:9/998: unlink d0/d6/d75/d12b/f12c 0 2024-09-16T09:46:25.830 INFO:tasks.workunit.client.0.smithi111.stdout:9/999: truncate d0/d48/fe4 584421 0 2024-09-16T09:46:25.836 INFO:tasks.workunit.client.0.smithi111.stderr:+ rm -rf -- ./tmp.NMUTlfrAEY 2024-09-16T09:46:25.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.985+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f75e4062630 con 0x7f75d403f9c0 2024-09-16T09:46:25.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.986+0000 7f75e1ffb640 1 -- 172.21.15.111:0/2475777473 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f75e4062630 con 0x7f75d403f9c0 2024-09-16T09:46:25.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f75d403f9c0 msgr2=0x7f75d4041e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:25.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f75d403f9c0 0x7f75d4041e80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f75d8000c00 tx=0x7f75d80058d0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e4102be0 msgr2=0x7f75e4197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:25.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e4102be0 0x7f75e4197a00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f75d0009b50 tx=0x7f75d000b690 comp rx=0 tx=0).stop 2024-09-16T09:46:25.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 shutdown_connections 2024-09-16T09:46:25.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f75d403f9c0 0x7f75d4041e80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75e4102be0 0x7f75e4197a00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 --2- 172.21.15.111:0/2475777473 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75e40ffc00 0x7f75e41974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:25.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 >> 172.21.15.111:0/2475777473 conn(0x7f75e40fb750 msgr2=0x7f75e41060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:25.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 shutdown_connections 2024-09-16T09:46:25.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:25.990+0000 7f75eaef4640 1 -- 172.21.15.111:0/2475777473 wait complete. 2024-09-16T09:46:26.005 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:46:26.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.122+0000 7f5236e8b640 1 -- 172.21.15.111:0/403310563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 msgr2=0x7f5230101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.122+0000 7f5236e8b640 1 --2- 172.21.15.111:0/403310563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 0x7f5230101ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f521c009880 tx=0x7f521c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.122+0000 7f5236e8b640 1 -- 172.21.15.111:0/403310563 shutdown_connections 2024-09-16T09:46:26.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.122+0000 7f5236e8b640 1 --2- 172.21.15.111:0/403310563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 0x7f5230101ec0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.122+0000 7f5236e8b640 1 --2- 172.21.15.111:0/403310563 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f5230100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.122+0000 7f5236e8b640 1 -- 172.21.15.111:0/403310563 >> 172.21.15.111:0/403310563 conn(0x7f52300fbff0 msgr2=0x7f52300fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:26.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.123+0000 7f5236e8b640 1 -- 172.21.15.111:0/403310563 shutdown_connections 2024-09-16T09:46:26.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.123+0000 7f5236e8b640 1 -- 172.21.15.111:0/403310563 wait complete. 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.123+0000 7f5236e8b640 1 Processor -- start 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5236e8b640 1 -- start start 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5236e8b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f52301996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5236e8b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 0x7f5230199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5236e8b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5230108560 con 0x7f5230101a40 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5236e8b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f52301083e0 con 0x7f5230100840 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5234c27640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f52301996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5234c27640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f52301996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:47348/0 (socket says 172.21.15.111:47348) 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f5234c27640 1 -- 172.21.15.111:0/2934844170 learned_addr learned my addr 172.21.15.111:0/2934844170 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:26.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.124+0000 7f522ffff640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 0x7f5230199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.125+0000 7f5234c27640 1 -- 172.21.15.111:0/2934844170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 msgr2=0x7f5230199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.125+0000 7f5234c27640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 0x7f5230199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.125+0000 7f5234c27640 1 -- 172.21.15.111:0/2934844170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523019a260 con 0x7f5230100840 2024-09-16T09:46:26.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.125+0000 7f5234c27640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f52301996a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f522400e940 tx=0x7f522400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:26.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.125+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f522400cac0 con 0x7f5230100840 2024-09-16T09:46:26.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.126+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523019eca0 con 0x7f5230100840 2024-09-16T09:46:26.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.126+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523019f180 con 0x7f5230100840 2024-09-16T09:46:26.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.126+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f522400cc60 con 0x7f5230100840 2024-09-16T09:46:26.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.126+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5224003de0 con 0x7f5230100840 2024-09-16T09:46:26.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.127+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 23) ==== 51997+0+0 (secure 0 0 0) 0x7f52240104f0 con 0x7f5230100840 2024-09-16T09:46:26.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.128+0000 7f522dffb640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f522003fa40 0x7f5220041f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.128+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52140052c0 con 0x7f5230100840 2024-09-16T09:46:26.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.128+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f5224055c60 con 0x7f5230100840 2024-09-16T09:46:26.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.128+0000 7f522ffff640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f522003fa40 0x7f5220041f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.129+0000 7f522ffff640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f522003fa40 0x7f5220041f00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f523019ab50 tx=0x7f521c005a20 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:26.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.134+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f522400ce10 con 0x7f5230100840 2024-09-16T09:46:26.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.446+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5214000bf0 con 0x7f522003fa40 2024-09-16T09:46:26.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.448+0000 7f522dffb640 1 -- 172.21.15.111:0/2934844170 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f5214000bf0 con 0x7f522003fa40 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f522003fa40 msgr2=0x7f5220041f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f522003fa40 0x7f5220041f00 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f523019ab50 tx=0x7f521c005a20 comp rx=0 tx=0).stop 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 msgr2=0x7f52301996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f52301996a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f522400e940 tx=0x7f522400ee00 comp rx=0 tx=0).stop 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 shutdown_connections 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f522003fa40 0x7f5220041f00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5230101a40 0x7f5230199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 --2- 172.21.15.111:0/2934844170 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5230100840 0x7f52301996a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 >> 172.21.15.111:0/2934844170 conn(0x7f52300fbff0 msgr2=0x7f52300fc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:26.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 shutdown_connections 2024-09-16T09:46:26.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.451+0000 7f5236e8b640 1 -- 172.21.15.111:0/2934844170 wait complete. 2024-09-16T09:46:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.557+0000 7fd37ce3d640 1 -- 172.21.15.111:0/1345188966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 msgr2=0x7fd3781070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.557+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/1345188966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd3781070f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd36c0098b0 tx=0x7fd36c02a4d0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.561 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:26 smithi111 ceph-mon[27997]: mgrmap e23: smithi114.xvotey(active, since 5s) 2024-09-16T09:46:26.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.558+0000 7fd37ce3d640 1 -- 172.21.15.111:0/1345188966 shutdown_connections 2024-09-16T09:46:26.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.558+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/1345188966 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd3781070f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.558+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/1345188966 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 0x7fd3781047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.558+0000 7fd37ce3d640 1 -- 172.21.15.111:0/1345188966 >> 172.21.15.111:0/1345188966 conn(0x7fd3780fbff0 msgr2=0x7fd3780fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:26.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.559+0000 7fd37ce3d640 1 -- 172.21.15.111:0/1345188966 shutdown_connections 2024-09-16T09:46:26.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.559+0000 7fd37ce3d640 1 -- 172.21.15.111:0/1345188966 wait complete. 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37ce3d640 1 Processor -- start 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37ce3d640 1 -- start start 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37ce3d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 0x7fd378199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37ce3d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd378199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37ce3d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd37810a770 con 0x7fd378104d00 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37ce3d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd37810a5f0 con 0x7fd3781023d0 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd375d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd378199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd375d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd378199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35622/0 (socket says 172.21.15.111:35622) 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd375d9b640 1 -- 172.21.15.111:0/3867226425 learned_addr learned my addr 172.21.15.111:0/3867226425 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.560+0000 7fd37659c640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 0x7fd378199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd375d9b640 1 -- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 msgr2=0x7fd378199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd375d9b640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 0x7fd378199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd375d9b640 1 -- 172.21.15.111:0/3867226425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37819a2e0 con 0x7fd378104d00 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd37659c640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 0x7fd378199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd375d9b640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd378199c60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009880 tx=0x7fd36c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd36c03f070 con 0x7fd378104d00 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.561+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd36c0049d0 con 0x7fd378104d00 2024-09-16T09:46:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.562+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd37819ecc0 con 0x7fd378104d00 2024-09-16T09:46:26.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.563+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd36c035030 con 0x7fd378104d00 2024-09-16T09:46:26.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.563+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd37819f1a0 con 0x7fd378104d00 2024-09-16T09:46:26.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.563+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 23) ==== 51997+0+0 (secure 0 0 0) 0x7fd36c042070 con 0x7fd378104d00 2024-09-16T09:46:26.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.563+0000 7fd3677fe640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7fd36003f9c0 0x7fd360041e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.563+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7fd36c075560 con 0x7fd378104d00 2024-09-16T09:46:26.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.564+0000 7fd37659c640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7fd36003f9c0 0x7fd360041e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.564+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3781027b0 con 0x7fd378104d00 2024-09-16T09:46:26.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.564+0000 7fd37659c640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7fd36003f9c0 0x7fd360041e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd368009c20 tx=0x7fd368005f90 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:26.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.572+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fd36c003cd0 con 0x7fd378104d00 2024-09-16T09:46:26.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:26 smithi114 ceph-mon[35635]: mgrmap e23: smithi114.xvotey(active, since 5s) 2024-09-16T09:46:26.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.860+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd3780626f0 con 0x7fd36003f9c0 2024-09-16T09:46:26.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.870+0000 7fd3677fe640 1 -- 172.21.15.111:0/3867226425 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd3780626f0 con 0x7fd36003f9c0 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (6m) 2m ago 8m 26.4M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (8m) 2m ago 8m 8166k - 19.1.1-328-gad35db06 b5388489f99e 8786fd2f4c05 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (7m) 11s ago 7m 5263k - 19.1.1-328-gad35db06 b5388489f99e 7fe7397f669d 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (8m) 2m ago 8m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (7m) 11s ago 7m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 2m ago 8m 78.2M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:46:26.873 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (3m) 2m ago 3m 16.9M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (3m) 2m ago 3m 13.6M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (3m) 11s ago 3m 15.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (3m) 11s ago 3m 15.4M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:9283,8765,8443 running (9m) 2m ago 9m 498M - 19.1.1-328-gad35db06 b5388489f99e f32e13ae383f 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (15s) 11s ago 7m 68.5M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 5ee22e1bc55d 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (9m) 2m ago 9m 46.8M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (7m) 11s ago 7m 37.5M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (8m) 2m ago 8m 14.0M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (7m) 11s ago 7m 16.7M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (6m) 2m ago 6m 47.4M 3946M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (5m) 2m ago 5m 54.0M 3946M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (5m) 2m ago 5m 52.0M 3946M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:46:26.874 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (5m) 11s ago 5m 278M 4970M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:46:26.875 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (4m) 11s ago 4m 236M 4970M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:46:26.875 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (4m) 11s ago 4m 253M 4970M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:46:26.875 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 2m ago 7m 60.1M - 2.43.0 a07b618ecd1d ef0faa2f353d 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.872+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7fd36003f9c0 msgr2=0x7fd360041e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.872+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7fd36003f9c0 0x7fd360041e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd368009c20 tx=0x7fd368005f90 comp rx=0 tx=0).stop 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.872+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 msgr2=0x7fd378199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.872+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd378199c60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009880 tx=0x7fd36c0045e0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.872+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 shutdown_connections 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.873+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7fd36003f9c0 0x7fd360041e80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.873+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd378104d00 0x7fd378199c60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.873+0000 7fd37ce3d640 1 --2- 172.21.15.111:0/3867226425 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd3781023d0 0x7fd378199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.873+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 >> 172.21.15.111:0/3867226425 conn(0x7fd3780fbff0 msgr2=0x7fd378101940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:26.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.873+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 shutdown_connections 2024-09-16T09:46:26.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.873+0000 7fd37ce3d640 1 -- 172.21.15.111:0/3867226425 wait complete. 2024-09-16T09:46:26.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 -- 172.21.15.111:0/495992617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8101a80 msgr2=0x7f85b8101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/495992617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8101a80 0x7f85b8101f00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009880 tx=0x7f85a802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 -- 172.21.15.111:0/495992617 shutdown_connections 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/495992617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8101a80 0x7f85b8101f00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/495992617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b8100880 0x7f85b8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 -- 172.21.15.111:0/495992617 >> 172.21.15.111:0/495992617 conn(0x7f85b80fc010 msgr2=0x7f85b80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 -- 172.21.15.111:0/495992617 shutdown_connections 2024-09-16T09:46:26.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.965+0000 7f85bfbe2640 1 -- 172.21.15.111:0/495992617 wait complete. 2024-09-16T09:46:26.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bfbe2640 1 Processor -- start 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bfbe2640 1 -- start start 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bfbe2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 0x7f85b81963a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bfbe2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b8101a80 0x7f85b81968e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bfbe2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f85b81096c0 con 0x7f85b8100880 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bfbe2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f85b8109540 con 0x7f85b8101a80 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd97e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 0x7f85b81963a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd97e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 0x7f85b81963a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35630/0 (socket says 172.21.15.111:35630) 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd97e640 1 -- 172.21.15.111:0/3047359601 learned_addr learned my addr 172.21.15.111:0/3047359601 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd17d640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b8101a80 0x7f85b81968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd97e640 1 -- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b8101a80 msgr2=0x7f85b81968e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd97e640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b8101a80 0x7f85b81968e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.966+0000 7f85bd97e640 1 -- 172.21.15.111:0/3047359601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85b8196f60 con 0x7f85b8100880 2024-09-16T09:46:26.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.967+0000 7f85bd97e640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 0x7f85b81963a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f85b400ead0 tx=0x7f85b400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:26.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.967+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85b401c070 con 0x7f85b8100880 2024-09-16T09:46:26.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.967+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85b806a360 con 0x7f85b8100880 2024-09-16T09:46:26.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.967+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85b400bb50 con 0x7f85b8100880 2024-09-16T09:46:26.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.967+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85b806a8c0 con 0x7f85b8100880 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.968+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85b4003da0 con 0x7f85b8100880 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.968+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 23) ==== 51997+0+0 (secure 0 0 0) 0x7f85b401f070 con 0x7f85b8100880 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.969+0000 7f85aeffd640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f85a403f9c0 0x7f85a4041e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.969+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f85b4014070 con 0x7f85b8100880 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.969+0000 7f85bd17d640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f85a403f9c0 0x7f85a4041e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.969+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c0052c0 con 0x7f85b8100880 2024-09-16T09:46:26.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.969+0000 7f85bd17d640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f85a403f9c0 0x7f85a4041e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85a8000c00 tx=0x7f85a80058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:26.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:26.974+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f85b401b170 con 0x7f85b8100880 2024-09-16T09:46:27.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.302+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7f85b401fc70 con 0x7f85b8100880 2024-09-16T09:46:27.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.340+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f859c005880 con 0x7f85b8100880 2024-09-16T09:46:27.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.340+0000 7f85aeffd640 1 -- 172.21.15.111:0/3047359601 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f85b406ba60 con 0x7f85b8100880 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 1, 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:46:27.343 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 13, 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:46:27.344 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:46:27.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f85a403f9c0 msgr2=0x7f85a4041e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:27.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f85a403f9c0 0x7f85a4041e80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f85a8000c00 tx=0x7f85a80058d0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 msgr2=0x7f85b81963a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:27.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 0x7f85b81963a0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f85b400ead0 tx=0x7f85b400ef90 comp rx=0 tx=0).stop 2024-09-16T09:46:27.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 shutdown_connections 2024-09-16T09:46:27.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f85a403f9c0 0x7f85a4041e80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f85b8101a80 0x7f85b81968e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 --2- 172.21.15.111:0/3047359601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85b8100880 0x7f85b81963a0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 >> 172.21.15.111:0/3047359601 conn(0x7f85b80fc010 msgr2=0x7f85b8104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:27.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 shutdown_connections 2024-09-16T09:46:27.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.343+0000 7f85bfbe2640 1 -- 172.21.15.111:0/3047359601 wait complete. 2024-09-16T09:46:27.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: pgmap v6: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:27.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:27.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: Standby manager daemon smithi111.erxodt started 2024-09-16T09:46:27.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/crt"}]: dispatch 2024-09-16T09:46:27.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:46:27.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/key"}]: dispatch 2024-09-16T09:46:27.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:27 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:46:27.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 -- 172.21.15.111:0/3782925735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d10104d20 msgr2=0x7f2d10107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:27.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 --2- 172.21.15.111:0/3782925735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d10104d20 0x7f2d10107110 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2d040098b0 tx=0x7f2d0402a4d0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 -- 172.21.15.111:0/3782925735 shutdown_connections 2024-09-16T09:46:27.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 --2- 172.21.15.111:0/3782925735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d10104d20 0x7f2d10107110 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 --2- 172.21.15.111:0/3782925735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d101023f0 0x7f2d101047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 -- 172.21.15.111:0/3782925735 >> 172.21.15.111:0/3782925735 conn(0x7f2d100fbff0 msgr2=0x7f2d100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:27.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.430+0000 7f2d169c0640 1 -- 172.21.15.111:0/3782925735 shutdown_connections 2024-09-16T09:46:27.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.431+0000 7f2d169c0640 1 -- 172.21.15.111:0/3782925735 wait complete. 2024-09-16T09:46:27.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.431+0000 7f2d169c0640 1 Processor -- start 2024-09-16T09:46:27.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.431+0000 7f2d169c0640 1 -- start start 2024-09-16T09:46:27.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d169c0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 0x7f2d10197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:27.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d169c0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10104d20 0x7f2d10197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:27.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d169c0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010a7b0 con 0x7f2d101023f0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d169c0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1010a630 con 0x7f2d10104d20 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 0x7f2d10197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 0x7f2d10197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35650/0 (socket says 172.21.15.111:35650) 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 -- 172.21.15.111:0/1647751359 learned_addr learned my addr 172.21.15.111:0/1647751359 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0f7fe640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10104d20 0x7f2d10197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 -- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10104d20 msgr2=0x7f2d10197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10104d20 0x7f2d10197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 -- 172.21.15.111:0/1647751359 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d101980d0 con 0x7f2d101023f0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.432+0000 7f2d0ffff640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 0x7f2d10197510 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000d6f0 tx=0x7f2d0000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.433+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d00017070 con 0x7f2d101023f0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.433+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d1019cb10 con 0x7f2d101023f0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.433+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d0000de00 con 0x7f2d101023f0 2024-09-16T09:46:27.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.433+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d1019d070 con 0x7f2d101023f0 2024-09-16T09:46:27.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.433+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d00020060 con 0x7f2d101023f0 2024-09-16T09:46:27.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: pgmap v6: 65 pgs: 65 active+clean; 2.2 GiB data, 6.5 GiB used, 530 GiB / 536 GiB avail 2024-09-16T09:46:27.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: from='client.14680 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:27.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: Standby manager daemon smithi111.erxodt started 2024-09-16T09:46:27.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/crt"}]: dispatch 2024-09-16T09:46:27.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:46:27.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/key"}]: dispatch 2024-09-16T09:46:27.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:27 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/1243741195' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:46:27.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.434+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d101027d0 con 0x7f2d101023f0 2024-09-16T09:46:27.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.435+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7f2d00009a30 con 0x7f2d101023f0 2024-09-16T09:46:27.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.435+0000 7f2d0d7fa640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2cf8074890 0x7f2cf8076d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:27.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.436+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f2d00095e40 con 0x7f2d101023f0 2024-09-16T09:46:27.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.436+0000 7f2d0f7fe640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2cf8074890 0x7f2cf8076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:27.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.436+0000 7f2d0f7fe640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2cf8074890 0x7f2cf8076d50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009880 tx=0x7f2d040058d0 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:27.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.444+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f2d00061570 con 0x7f2d101023f0 2024-09-16T09:46:27.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.731+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2d10105740 con 0x7f2cf8074890 2024-09-16T09:46:27.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.733+0000 7f2d0d7fa640 1 -- 172.21.15.111:0/1647751359 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f2d10105740 con 0x7f2cf8074890 2024-09-16T09:46:27.735 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:46:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:46:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:46:27.735 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:46:27.736 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-16T09:46:27.736 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "1/2 daemons upgraded", 2024-09-16T09:46:27.736 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-16T09:46:27.736 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:46:27.736 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2cf8074890 msgr2=0x7f2cf8076d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2cf8074890 0x7f2cf8076d50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009880 tx=0x7f2d040058d0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 msgr2=0x7f2d10197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 0x7f2d10197510 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2d0000d6f0 tx=0x7f2d0000dbb0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 shutdown_connections 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2cf8074890 0x7f2cf8076d50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2d10104d20 0x7f2d10197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 --2- 172.21.15.111:0/1647751359 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d101023f0 0x7f2d10197510 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 >> 172.21.15.111:0/1647751359 conn(0x7f2d100fbff0 msgr2=0x7f2d100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 shutdown_connections 2024-09-16T09:46:27.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:27.735+0000 7f2d169c0640 1 -- 172.21.15.111:0/1647751359 wait complete. 2024-09-16T09:46:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:28 smithi114 ceph-mon[35635]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:28 smithi114 ceph-mon[35635]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:28 smithi114 ceph-mon[35635]: mgrmap e24: smithi114.xvotey(active, since 7s), standbys: smithi111.erxodt 2024-09-16T09:46:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:28 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:46:28.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:28 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3047359601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:46:28.598 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:28 smithi111 ceph-mon[27997]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:28.598 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:28 smithi111 ceph-mon[27997]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:28.599 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:28 smithi111 ceph-mon[27997]: mgrmap e24: smithi114.xvotey(active, since 7s), standbys: smithi111.erxodt 2024-09-16T09:46:28.599 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:28 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:46:28.599 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:28 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3047359601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:46:29.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:29 smithi111 ceph-mon[27997]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:29.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:29 smithi111 ceph-mon[27997]: pgmap v7: 65 pgs: 65 active+clean; 2.4 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 52 MiB/s rd, 72 MiB/s wr, 233 op/s 2024-09-16T09:46:29.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:29 smithi114 ceph-mon[35635]: from='client.14696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:29.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:29 smithi114 ceph-mon[35635]: pgmap v7: 65 pgs: 65 active+clean; 2.4 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 52 MiB/s rd, 72 MiB/s wr, 233 op/s 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: pgmap v8: 65 pgs: 65 active+clean; 2.4 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 40 MiB/s rd, 55 MiB/s wr, 180 op/s 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:30.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:30.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: pgmap v8: 65 pgs: 65 active+clean; 2.4 GiB data, 7.2 GiB used, 529 GiB / 536 GiB avail; 40 MiB/s rd, 55 MiB/s wr, 180 op/s 2024-09-16T09:46:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:32.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:31 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi111 to 1216M 2024-09-16T09:46:32.133 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:31 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi111 to 1216M 2024-09-16T09:46:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:32 smithi114 ceph-mon[35635]: pgmap v9: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 33 MiB/s rd, 46 MiB/s wr, 279 op/s 2024-09-16T09:46:33.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:32 smithi111 ceph-mon[27997]: pgmap v9: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 33 MiB/s rd, 46 MiB/s wr, 279 op/s 2024-09-16T09:46:34.364 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:34 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.364 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:34 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.364 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:34 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.364 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:34 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:34 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:34 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:34 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:34.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:34 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:35.372 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:35 smithi114 ceph-mon[35635]: pgmap v10: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 29 MiB/s rd, 41 MiB/s wr, 250 op/s 2024-09-16T09:46:35.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:35 smithi111 ceph-mon[27997]: pgmap v10: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 29 MiB/s rd, 41 MiB/s wr, 250 op/s 2024-09-16T09:46:37.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:37 smithi111 ceph-mon[27997]: pgmap v11: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 29 MiB/s rd, 41 MiB/s wr, 250 op/s 2024-09-16T09:46:37.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:37 smithi114 ceph-mon[35635]: pgmap v11: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 29 MiB/s rd, 41 MiB/s wr, 250 op/s 2024-09-16T09:46:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:38 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:38.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:38 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 42 MiB/s wr, 374 op/s 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.720 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:39.721 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:39 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:39.784 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: pgmap v12: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 29 MiB/s rd, 42 MiB/s wr, 374 op/s 2024-09-16T09:46:39.784 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.784 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.784 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.785 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:39.786 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:39.786 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:39.786 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:39 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:40.215 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-16T09:46:40.215 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-16T09:46:40.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Adjusting osd_memory_target on smithi114 to 2240M 2024-09-16T09:46:40.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:46:40.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:46:40.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:46:40.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:46:40.602 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:46:40.603 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:46:40.603 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:46:40.603 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:46:40.603 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Reconfiguring ceph-exporter.smithi111 (dependencies changed)... 2024-09-16T09:46:40.603 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:40 smithi111 ceph-mon[27997]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Adjusting osd_memory_target on smithi114 to 2240M 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:46:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:46:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:46:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Reconfiguring ceph-exporter.smithi111 (dependencies changed)... 2024-09-16T09:46:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:40 smithi114 ceph-mon[35635]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:46:41.596 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:41 smithi111 ceph-mon[27997]: pgmap v13: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-16T09:46:41.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:41 smithi114 ceph-mon[35635]: pgmap v13: 65 pgs: 65 active+clean; 1.0 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.5 MiB/s wr, 243 op/s 2024-09-16T09:46:42.416 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-16T09:46:42.416 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-16T09:46:42.604 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:42 smithi111 ceph-mon[27997]: pgmap v14: 65 pgs: 65 active+clean; 395 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 354 op/s 2024-09-16T09:46:42.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:42 smithi114 ceph-mon[35635]: pgmap v14: 65 pgs: 65 active+clean; 395 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.3 MiB/s wr, 354 op/s 2024-09-16T09:46:42.704 DEBUG:teuthology.parallel:result is None 2024-09-16T09:46:45.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:45 smithi111 ceph-mon[27997]: pgmap v15: 65 pgs: 65 active+clean; 395 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-16T09:46:45.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:45 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:45.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:45 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:45.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:45 smithi111 ceph-mon[27997]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-16T09:46:45.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:45 smithi111 ceph-mon[27997]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-16T09:46:45.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:45 smithi114 ceph-mon[35635]: pgmap v15: 65 pgs: 65 active+clean; 395 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-16T09:46:45.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:45 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:45.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:45 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:45.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:45 smithi114 ceph-mon[35635]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-16T09:46:45.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:45 smithi114 ceph-mon[35635]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-16T09:46:47.624 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:47 smithi111 ceph-mon[27997]: pgmap v16: 65 pgs: 65 active+clean; 395 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-16T09:46:47.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:47 smithi114 ceph-mon[35635]: pgmap v16: 65 pgs: 65 active+clean; 395 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 235 op/s 2024-09-16T09:46:49.597 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:49 smithi111 ceph-mon[27997]: pgmap v17: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 520 op/s 2024-09-16T09:46:49.625 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:49 smithi114 ceph-mon[35635]: pgmap v17: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 520 op/s 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: Reconfiguring ceph-exporter.smithi114 (dependencies changed)... 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:51.121 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: Deploying daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:46:51.122 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:50 smithi114 ceph-mon[35635]: pgmap v18: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 396 op/s 2024-09-16T09:46:51.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:51.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:51.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: Reconfiguring ceph-exporter.smithi114 (dependencies changed)... 2024-09-16T09:46:51.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:51.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-16T09:46:51.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:51.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: Deploying daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:46:51.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:50 smithi111 ceph-mon[27997]: pgmap v18: 65 pgs: 65 active+clean; 286 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 1.5 MiB/s wr, 396 op/s 2024-09-16T09:46:53.112 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:52 smithi114 ceph-mon[35635]: pgmap v19: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 852 op/s 2024-09-16T09:46:53.112 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:52 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:52 smithi111 ceph-mon[27997]: pgmap v19: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 852 op/s 2024-09-16T09:46:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:52 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: Upgrade: Need to upgrade myself (mgr.smithi114.xvotey) 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: Upgrade: Need to upgrade myself (mgr.smithi114.xvotey) 2024-09-16T09:46:54.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:54 smithi111 ceph-mon[27997]: pgmap v20: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 2.1 MiB/s wr, 741 op/s 2024-09-16T09:46:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:46:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:46:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:46:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: Upgrade: Need to upgrade myself (mgr.smithi114.xvotey) 2024-09-16T09:46:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: Upgrade: Need to upgrade myself (mgr.smithi114.xvotey) 2024-09-16T09:46:54.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:54 smithi114 ceph-mon[35635]: pgmap v20: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 2.1 MiB/s wr, 741 op/s 2024-09-16T09:46:56.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: Upgrade: Updating mgr.smithi111.erxodt 2024-09-16T09:46:56.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:56.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.erxodt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:46:56.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.erxodt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:46:56.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:46:56.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:56.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:56 smithi111 ceph-mon[27997]: Deploying daemon mgr.smithi111.erxodt on smithi111 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: Upgrade: Updating mgr.smithi111.erxodt 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.erxodt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi111.erxodt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:46:56.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:56 smithi114 ceph-mon[35635]: Deploying daemon mgr.smithi111.erxodt on smithi111 2024-09-16T09:46:57.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:57 smithi111 ceph-mon[27997]: pgmap v21: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 2.1 MiB/s wr, 741 op/s 2024-09-16T09:46:57.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:57 smithi114 ceph-mon[35635]: pgmap v21: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 2.1 MiB/s wr, 741 op/s 2024-09-16T09:46:57.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 -- 172.21.15.111:0/906068637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 msgr2=0x7f809c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 --2- 172.21.15.111:0/906068637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c101d60 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8090009880 tx=0x7f809002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 -- 172.21.15.111:0/906068637 shutdown_connections 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 --2- 172.21.15.111:0/906068637 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 0x7f809c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 --2- 172.21.15.111:0/906068637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c101d60 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 -- 172.21.15.111:0/906068637 >> 172.21.15.111:0/906068637 conn(0x7f809c0fd0f0 msgr2=0x7f809c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 -- 172.21.15.111:0/906068637 shutdown_connections 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.826+0000 7f80a313f640 1 -- 172.21.15.111:0/906068637 wait complete. 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a313f640 1 Processor -- start 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a313f640 1 -- start start 2024-09-16T09:46:57.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a313f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c1974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a313f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 0x7f809c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a313f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f809c10a800 con 0x7f809c101960 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a313f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f809c10a680 con 0x7f809c102b60 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a0edb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c1974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a0edb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c1974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55486/0 (socket says 172.21.15.111:55486) 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a0edb640 1 -- 172.21.15.111:0/1364928329 learned_addr learned my addr 172.21.15.111:0/1364928329 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f809bfff640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 0x7f809c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a0edb640 1 -- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 msgr2=0x7f809c197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a0edb640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 0x7f809c197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f80a0edb640 1 -- 172.21.15.111:0/1364928329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f809c1980a0 con 0x7f809c101960 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.827+0000 7f809bfff640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 0x7f809c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:46:57.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.828+0000 7f80a0edb640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c1974e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8090009230 tx=0x7f80900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.828+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f809003f070 con 0x7f809c101960 2024-09-16T09:46:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.828+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f80900044d0 con 0x7f809c101960 2024-09-16T09:46:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.828+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f809c19ca80 con 0x7f809c101960 2024-09-16T09:46:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.828+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8090035030 con 0x7f809c101960 2024-09-16T09:46:57.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.828+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f809c19d010 con 0x7f809c101960 2024-09-16T09:46:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.829+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f809c101d60 con 0x7f809c101960 2024-09-16T09:46:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.830+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7f8090042070 con 0x7f809c101960 2024-09-16T09:46:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.830+0000 7f8099ffb640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f808c0748e0 0x7f808c076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.830+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f80900b6d20 con 0x7f809c101960 2024-09-16T09:46:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.831+0000 7f809bfff640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f808c0748e0 0x7f808c076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:57.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.831+0000 7f809bfff640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f808c0748e0 0x7f808c076da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f809c198990 tx=0x7f8088008040 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:57.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:57.839+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f80900824d0 con 0x7f809c101960 2024-09-16T09:46:58.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.146+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f809c062630 con 0x7f808c0748e0 2024-09-16T09:46:58.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.148+0000 7f8099ffb640 1 -- 172.21.15.111:0/1364928329 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f809c062630 con 0x7f808c0748e0 2024-09-16T09:46:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f808c0748e0 msgr2=0x7f808c076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f808c0748e0 0x7f808c076da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f809c198990 tx=0x7f8088008040 comp rx=0 tx=0).stop 2024-09-16T09:46:58.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 msgr2=0x7f809c1974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c1974e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8090009230 tx=0x7f80900048f0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 shutdown_connections 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f808c0748e0 0x7f808c076da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f809c102b60 0x7f809c197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 --2- 172.21.15.111:0/1364928329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f809c101960 0x7f809c1974e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 >> 172.21.15.111:0/1364928329 conn(0x7f809c0fd0f0 msgr2=0x7f809c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 shutdown_connections 2024-09-16T09:46:58.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.150+0000 7f80a313f640 1 -- 172.21.15.111:0/1364928329 wait complete. 2024-09-16T09:46:58.163 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:46:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 -- 172.21.15.111:0/2392515001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 msgr2=0x7ff72c100000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 --2- 172.21.15.111:0/2392515001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c100000 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009880 tx=0x7ff71c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 -- 172.21.15.111:0/2392515001 shutdown_connections 2024-09-16T09:46:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 --2- 172.21.15.111:0/2392515001 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff72c102be0 0x7ff72c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 --2- 172.21.15.111:0/2392515001 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c100000 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 -- 172.21.15.111:0/2392515001 >> 172.21.15.111:0/2392515001 conn(0x7ff72c0fb750 msgr2=0x7ff72c0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 -- 172.21.15.111:0/2392515001 shutdown_connections 2024-09-16T09:46:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.238+0000 7ff7321ae640 1 -- 172.21.15.111:0/2392515001 wait complete. 2024-09-16T09:46:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff7321ae640 1 Processor -- start 2024-09-16T09:46:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff7321ae640 1 -- start start 2024-09-16T09:46:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff7321ae640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c1024d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff7321ae640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff72c102be0 0x7ff72c100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff7321ae640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c10a7e0 con 0x7ff72c0ffc00 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff7321ae640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c10a660 con 0x7ff72c102be0 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff72b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c1024d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff72b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c1024d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55500/0 (socket says 172.21.15.111:55500) 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.239+0000 7ff72b7fe640 1 -- 172.21.15.111:0/3346713086 learned_addr learned my addr 172.21.15.111:0/3346713086 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff72affd640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff72c102be0 0x7ff72c100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff72b7fe640 1 -- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff72c102be0 msgr2=0x7ff72c100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff72b7fe640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff72c102be0 0x7ff72c100b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff72b7fe640 1 -- 172.21.15.111:0/3346713086 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c1010d0 con 0x7ff72c0ffc00 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff72b7fe640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c1024d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff71c006010 tx=0x7ff71c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff71c03f070 con 0x7ff72c0ffc00 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c101360 con 0x7ff72c0ffc00 2024-09-16T09:46:58.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff71c0044d0 con 0x7ff72c0ffc00 2024-09-16T09:46:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff71c035030 con 0x7ff72c0ffc00 2024-09-16T09:46:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.240+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c101910 con 0x7ff72c0ffc00 2024-09-16T09:46:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.242+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72c100000 con 0x7ff72c0ffc00 2024-09-16T09:46:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.243+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7ff71c042070 con 0x7ff72c0ffc00 2024-09-16T09:46:58.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.243+0000 7ff728ff9640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7ff714074890 0x7ff714076d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.243+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7ff71c0b70d0 con 0x7ff72c0ffc00 2024-09-16T09:46:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.244+0000 7ff72affd640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7ff714074890 0x7ff714076d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:58.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.244+0000 7ff72affd640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7ff714074890 0x7ff714076d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff72c102250 tx=0x7ff720009110 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:58.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.250+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7ff71c082880 con 0x7ff72c0ffc00 2024-09-16T09:46:58.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.547+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff72c02db70 con 0x7ff714074890 2024-09-16T09:46:58.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.548+0000 7ff728ff9640 1 -- 172.21.15.111:0/3346713086 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7ff72c02db70 con 0x7ff714074890 2024-09-16T09:46:58.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7ff714074890 msgr2=0x7ff714076d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7ff714074890 0x7ff714076d50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff72c102250 tx=0x7ff720009110 comp rx=0 tx=0).stop 2024-09-16T09:46:58.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 msgr2=0x7ff72c1024d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c1024d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff71c006010 tx=0x7ff71c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 shutdown_connections 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7ff714074890 0x7ff714076d50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff72c102be0 0x7ff72c100b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 --2- 172.21.15.111:0/3346713086 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff72c0ffc00 0x7ff72c1024d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.550+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 >> 172.21.15.111:0/3346713086 conn(0x7ff72c0fb750 msgr2=0x7ff72c106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.551+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 shutdown_connections 2024-09-16T09:46:58.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.551+0000 7ff7321ae640 1 -- 172.21.15.111:0/3346713086 wait complete. 2024-09-16T09:46:58.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 -- 172.21.15.111:0/3337805388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 msgr2=0x7f119c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 --2- 172.21.15.111:0/3337805388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c101d60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f118c009880 tx=0x7f118c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 -- 172.21.15.111:0/3337805388 shutdown_connections 2024-09-16T09:46:58.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 --2- 172.21.15.111:0/3337805388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f119c102b60 0x7f119c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 --2- 172.21.15.111:0/3337805388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c101d60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 -- 172.21.15.111:0/3337805388 >> 172.21.15.111:0/3337805388 conn(0x7f119c0fd0f0 msgr2=0x7f119c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:58.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 -- 172.21.15.111:0/3337805388 shutdown_connections 2024-09-16T09:46:58.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.652+0000 7f11a0c61640 1 -- 172.21.15.111:0/3337805388 wait complete. 2024-09-16T09:46:58.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f11a0c61640 1 Processor -- start 2024-09-16T09:46:58.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f11a0c61640 1 -- start start 2024-09-16T09:46:58.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f11a0c61640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f11a0c61640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f119c102b60 0x7f119c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f11a0c61640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f119c10a7a0 con 0x7f119c101960 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f11a0c61640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f119c10a620 con 0x7f119c102b60 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55516/0 (socket says 172.21.15.111:55516) 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 -- 172.21.15.111:0/2818356142 learned_addr learned my addr 172.21.15.111:0/2818356142 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f1199d9b640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f119c102b60 0x7f119c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 -- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f119c102b60 msgr2=0x7f119c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f119c102b60 0x7f119c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 -- 172.21.15.111:0/2818356142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f119c1980f0 con 0x7f119c101960 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.653+0000 7f119a59c640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c197530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f118c006010 tx=0x7f118c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.654+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118c03f070 con 0x7f119c101960 2024-09-16T09:46:58.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.654+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f118c004a50 con 0x7f119c101960 2024-09-16T09:46:58.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.654+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f118c035030 con 0x7f119c101960 2024-09-16T09:46:58.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.654+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f119c19cad0 con 0x7f119c101960 2024-09-16T09:46:58.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.654+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119c19d060 con 0x7f119c101960 2024-09-16T09:46:58.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.655+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f119c101d60 con 0x7f119c101960 2024-09-16T09:46:58.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.655+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7f118c042070 con 0x7f119c101960 2024-09-16T09:46:58.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.656+0000 7f118b7fe640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f11840748e0 0x7f1184076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:58.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.656+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f118c0b6b50 con 0x7f119c101960 2024-09-16T09:46:58.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.656+0000 7f1199d9b640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f11840748e0 0x7f1184076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:58.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.656+0000 7f1199d9b640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f11840748e0 0x7f1184076da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f119c1989e0 tx=0x7f119000b390 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:58.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.660+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f118c082300 con 0x7f119c101960 2024-09-16T09:46:58.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.910+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f119c062630 con 0x7f11840748e0 2024-09-16T09:46:58.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.921+0000 7f118b7fe640 1 -- 172.21.15.111:0/2818356142 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f119c062630 con 0x7f11840748e0 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 29s ago 8m 24.9M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 starting - - - - 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 starting - - - - 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (9m) 29s ago 9m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (8m) 25s ago 8m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (7m) 29s ago 8m 78.8M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (3m) 29s ago 3m 209M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (3m) 29s ago 3m 15.5M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:46:58.923 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (3m) 25s ago 3m 16.1M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (3m) 25s ago 3m 15.9M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:9283,8765,8443 running (10m) 29s ago 10m 295M - 19.1.1-328-gad35db06 b5388489f99e f32e13ae383f 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (47s) 25s ago 8m 496M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 5ee22e1bc55d 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (10m) 29s ago 10m 53.0M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (8m) 25s ago 7m 38.5M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (8m) 29s ago 8m 14.8M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (8m) 25s ago 8m 16.5M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (6m) 29s ago 6m 240M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (6m) 29s ago 6m 267M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (5m) 29s ago 5m 221M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:46:58.924 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (5m) 25s ago 5m 311M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:46:58.925 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (5m) 25s ago 5m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:46:58.925 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (4m) 25s ago 4m 282M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:46:58.925 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 starting - - - - 2024-09-16T09:46:58.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f11840748e0 msgr2=0x7f1184076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f11840748e0 0x7f1184076da0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f119c1989e0 tx=0x7f119000b390 comp rx=0 tx=0).stop 2024-09-16T09:46:58.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 msgr2=0x7f119c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c197530 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f118c006010 tx=0x7f118c0045e0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 shutdown_connections 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f11840748e0 0x7f1184076da0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f119c102b60 0x7f119c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 --2- 172.21.15.111:0/2818356142 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f119c101960 0x7f119c197530 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 >> 172.21.15.111:0/2818356142 conn(0x7f119c0fd0f0 msgr2=0x7f119c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:58.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 shutdown_connections 2024-09-16T09:46:58.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:58.923+0000 7f11a0c61640 1 -- 172.21.15.111:0/2818356142 wait complete. 2024-09-16T09:46:59.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.018+0000 7f2077584640 1 -- 172.21.15.111:0/1664424655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070100840 msgr2=0x7f2070100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.018+0000 7f2077584640 1 --2- 172.21.15.111:0/1664424655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070100840 0x7f2070100c40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f206c009880 tx=0x7f206c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.018+0000 7f2077584640 1 -- 172.21.15.111:0/1664424655 shutdown_connections 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.018+0000 7f2077584640 1 --2- 172.21.15.111:0/1664424655 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070101a40 0x7f2070101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.018+0000 7f2077584640 1 --2- 172.21.15.111:0/1664424655 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070100840 0x7f2070100c40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.018+0000 7f2077584640 1 -- 172.21.15.111:0/1664424655 >> 172.21.15.111:0/1664424655 conn(0x7f20700fbff0 msgr2=0x7f20700fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.019+0000 7f2077584640 1 -- 172.21.15.111:0/1664424655 shutdown_connections 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.019+0000 7f2077584640 1 -- 172.21.15.111:0/1664424655 wait complete. 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.019+0000 7f2077584640 1 Processor -- start 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.019+0000 7f2077584640 1 -- start start 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2077584640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070100840 0x7f2070104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:59.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2077584640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 0x7f2070102e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2077584640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2070109660 con 0x7f2070101a40 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2077584640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f20701094e0 con 0x7f2070100840 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 0x7f2070102e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 0x7f2070102e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55536/0 (socket says 172.21.15.111:55536) 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 -- 172.21.15.111:0/2479439099 learned_addr learned my addr 172.21.15.111:0/2479439099 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2075320640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070100840 0x7f2070104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 -- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070100840 msgr2=0x7f2070104760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070100840 0x7f2070104760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 -- 172.21.15.111:0/2479439099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2070103360 con 0x7f2070101a40 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2075320640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070100840 0x7f2070104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2074b1f640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 0x7f2070102e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f206000c8a0 tx=0x7f206000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20600079b0 con 0x7f2070101a40 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2060007b50 con 0x7f2070101a40 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2070103650 con 0x7f2070101a40 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2060018700 con 0x7f2070101a40 2024-09-16T09:46:59.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.020+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2070103be0 con 0x7f2070101a40 2024-09-16T09:46:59.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.022+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2070100c40 con 0x7f2070101a40 2024-09-16T09:46:59.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.022+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7f2060007d00 con 0x7f2070101a40 2024-09-16T09:46:59.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.022+0000 7f20667fc640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f205c0748e0 0x7f205c076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:59.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.023+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f2060096300 con 0x7f2070101a40 2024-09-16T09:46:59.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.023+0000 7f2075320640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f205c0748e0 0x7f205c076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:59.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.023+0000 7f2075320640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f205c0748e0 0x7f205c076da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f206c000c00 tx=0x7f206c005a20 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:59.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.027+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f2060014030 con 0x7f2070101a40 2024-09-16T09:46:59.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.408+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f207019f540 con 0x7f2070101a40 2024-09-16T09:46:59.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.409+0000 7f20667fc640 1 -- 172.21.15.111:0/2479439099 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f2060061ab0 con 0x7f2070101a40 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 1, 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:46:59.411 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:46:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:46:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:46:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 13, 2024-09-16T09:46:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:46:59.412 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:46:59.412 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:46:59.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f205c0748e0 msgr2=0x7f205c076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f205c0748e0 0x7f205c076da0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f206c000c00 tx=0x7f206c005a20 comp rx=0 tx=0).stop 2024-09-16T09:46:59.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 msgr2=0x7f2070102e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 0x7f2070102e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f206000c8a0 tx=0x7f206000cd60 comp rx=0 tx=0).stop 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 shutdown_connections 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f205c0748e0 0x7f205c076da0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2070101a40 0x7f2070102e20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 --2- 172.21.15.111:0/2479439099 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2070100840 0x7f2070104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 >> 172.21.15.111:0/2479439099 conn(0x7f20700fbff0 msgr2=0x7f2070069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.411+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 shutdown_connections 2024-09-16T09:46:59.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.412+0000 7f2077584640 1 -- 172.21.15.111:0/2479439099 wait complete. 2024-09-16T09:46:59.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 -- 172.21.15.111:0/202652270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 msgr2=0x7f2e38101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/202652270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38101000 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2e28009880 tx=0x7f2e2802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 -- 172.21.15.111:0/202652270 shutdown_connections 2024-09-16T09:46:59.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:59 smithi111 ceph-mon[27997]: pgmap v22: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 1.16k op/s 2024-09-16T09:46:59.527 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:46:59 smithi111 ceph-mon[27997]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:59.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/202652270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38101000 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/202652270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 0x7f2e38100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 -- 172.21.15.111:0/202652270 >> 172.21.15.111:0/202652270 conn(0x7f2e380fc010 msgr2=0x7f2e380fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:59.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 -- 172.21.15.111:0/202652270 shutdown_connections 2024-09-16T09:46:59.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.525+0000 7f2e3fddd640 1 -- 172.21.15.111:0/202652270 wait complete. 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3fddd640 1 Processor -- start 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3fddd640 1 -- start start 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3fddd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 0x7f2e381996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3fddd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3fddd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3810ca10 con 0x7f2e38100ba0 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3fddd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3810c890 con 0x7f2e38100260 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3d378640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3d378640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55552/0 (socket says 172.21.15.111:55552) 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.526+0000 7f2e3d378640 1 -- 172.21.15.111:0/1096156793 learned_addr learned my addr 172.21.15.111:0/1096156793 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3db79640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 0x7f2e381996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3d378640 1 -- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 msgr2=0x7f2e381996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3d378640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 0x7f2e381996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3d378640 1 -- 172.21.15.111:0/1096156793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3819a2b0 con 0x7f2e38100ba0 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3db79640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 0x7f2e381996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3d378640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38199c30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2e28006010 tx=0x7f2e280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e2803f070 con 0x7f2e38100ba0 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3819ec90 con 0x7f2e38100ba0 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.527+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3819f240 con 0x7f2e38100ba0 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.528+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e280044d0 con 0x7f2e38100ba0 2024-09-16T09:46:59.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.528+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e28035030 con 0x7f2e38100ba0 2024-09-16T09:46:59.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.529+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e38100660 con 0x7f2e38100ba0 2024-09-16T09:46:59.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.529+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 24) ==== 97959+0+0 (secure 0 0 0) 0x7f2e28042070 con 0x7f2e38100ba0 2024-09-16T09:46:59.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.530+0000 7f2e2effd640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2e240748e0 0x7f2e24076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:46:59.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.530+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5726+0+0 (secure 0 0 0) 0x7f2e280b6d40 con 0x7f2e38100ba0 2024-09-16T09:46:59.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.530+0000 7f2e3db79640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2e240748e0 0x7f2e24076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:46:59.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.531+0000 7f2e3db79640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2e240748e0 0x7f2e24076da0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009930 tx=0x7f2e34008040 comp rx=0 tx=0).ready entity=mgr.24379 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:46:59.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.536+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f2e280824f0 con 0x7f2e38100ba0 2024-09-16T09:46:59.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:59 smithi114 ceph-mon[35635]: pgmap v22: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 1.16k op/s 2024-09-16T09:46:59.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:46:59 smithi114 ceph-mon[35635]: from='client.14704 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:46:59.746 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.745+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 --> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2e380626f0 con 0x7f2e240748e0 2024-09-16T09:46:59.747 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.746+0000 7f2e2effd640 1 -- 172.21.15.111:0/1096156793 <== mgr.24379 v2:172.21.15.114:6828/3778250509 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f2e380626f0 con 0x7f2e240748e0 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "1/2 daemons upgraded", 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mgr daemons", 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:46:59.748 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2e240748e0 msgr2=0x7f2e24076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2e240748e0 0x7f2e24076da0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2e34009930 tx=0x7f2e34008040 comp rx=0 tx=0).stop 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 msgr2=0x7f2e38199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38199c30 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2e28006010 tx=0x7f2e280048f0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 shutdown_connections 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:6828/3778250509,v1:172.21.15.114:6829/3778250509] conn(0x7f2e240748e0 0x7f2e24076da0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2e38100ba0 0x7f2e38199c30 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 --2- 172.21.15.111:0/1096156793 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2e38100260 0x7f2e381996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:46:59.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 >> 172.21.15.111:0/1096156793 conn(0x7f2e380fc010 msgr2=0x7f2e38108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:46:59.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 shutdown_connections 2024-09-16T09:46:59.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:46:59.748+0000 7f2e3fddd640 1 -- 172.21.15.111:0/1096156793 wait complete. 2024-09-16T09:47:00.577 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:00 smithi114 ceph-mon[35635]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:00.577 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:00 smithi114 ceph-mon[35635]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:00.577 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:00 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2479439099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:00.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:00 smithi111 ceph-mon[27997]: from='client.14708 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:00.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:00 smithi111 ceph-mon[27997]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:00 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2479439099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:01.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:01 smithi111 ceph-mon[27997]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:01.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:01 smithi111 ceph-mon[27997]: pgmap v23: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 878 op/s 2024-09-16T09:47:01.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:01 smithi114 ceph-mon[35635]: from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:01.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:01 smithi114 ceph-mon[35635]: pgmap v23: 65 pgs: 65 active+clean; 275 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 878 op/s 2024-09-16T09:47:03.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:03 smithi111 ceph-mon[27997]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.9 MiB/s wr, 1.02k op/s 2024-09-16T09:47:03.679 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:03 smithi114 ceph-mon[35635]: pgmap v24: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.9 MiB/s wr, 1.02k op/s 2024-09-16T09:47:05.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:05 smithi111 ceph-mon[27997]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 566 op/s 2024-09-16T09:47:05.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:05 smithi114 ceph-mon[35635]: pgmap v25: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 566 op/s 2024-09-16T09:47:07.578 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:07 smithi111 ceph-mon[27997]: pgmap v26: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 566 op/s 2024-09-16T09:47:07.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:07 smithi114 ceph-mon[35635]: pgmap v26: 65 pgs: 65 active+clean; 269 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 566 op/s 2024-09-16T09:47:08.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:08 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:08.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:08 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:09.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:09 smithi111 ceph-mon[27997]: pgmap v27: 65 pgs: 65 active+clean; 246 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 740 op/s 2024-09-16T09:47:09.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:09 smithi114 ceph-mon[35635]: pgmap v27: 65 pgs: 65 active+clean; 246 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 740 op/s 2024-09-16T09:47:11.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:11 smithi111 ceph-mon[27997]: pgmap v28: 65 pgs: 65 active+clean; 246 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-16T09:47:11.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:11 smithi114 ceph-mon[35635]: pgmap v28: 65 pgs: 65 active+clean; 246 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 318 op/s 2024-09-16T09:47:13.615 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:13 smithi111 ceph-mon[27997]: pgmap v29: 65 pgs: 65 active+clean; 248 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 777 op/s 2024-09-16T09:47:13.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:13 smithi114 ceph-mon[35635]: pgmap v29: 65 pgs: 65 active+clean; 248 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43 KiB/s rd, 2.2 MiB/s wr, 777 op/s 2024-09-16T09:47:15.478 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:15 smithi114 ceph-mon[35635]: pgmap v30: 65 pgs: 65 active+clean; 248 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 632 op/s 2024-09-16T09:47:15.478 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:15 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:15.478 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:15 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:15.478 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:15 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:15.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:15 smithi111 ceph-mon[27997]: pgmap v30: 65 pgs: 65 active+clean; 248 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 632 op/s 2024-09-16T09:47:15.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:15 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:15 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:15 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:17.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:17 smithi114 ceph-mon[35635]: pgmap v31: 65 pgs: 65 active+clean; 248 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 632 op/s 2024-09-16T09:47:17.565 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:17 smithi111 ceph-mon[27997]: pgmap v31: 65 pgs: 65 active+clean; 248 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.5 MiB/s wr, 632 op/s 2024-09-16T09:47:19.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:18 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:18 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:18 smithi111 ceph-mon[27997]: pgmap v32: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 909 op/s 2024-09-16T09:47:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:18 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:18 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:18 smithi114 ceph-mon[35635]: pgmap v32: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 2.1 MiB/s wr, 909 op/s 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: pgmap v33: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 736 op/s 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: Standby manager daemon smithi111.erxodt restarted 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: Standby manager daemon smithi111.erxodt started 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/crt"}]: dispatch 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/key"}]: dispatch 2024-09-16T09:47:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:20 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: pgmap v33: 65 pgs: 65 active+clean; 224 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 1.3 MiB/s wr, 736 op/s 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: Standby manager daemon smithi111.erxodt restarted 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: Standby manager daemon smithi111.erxodt started 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/crt"}]: dispatch 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi111.erxodt/key"}]: dispatch 2024-09-16T09:47:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:20 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:47:21.508 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-16T09:47:21.509 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-16T09:47:21.841 DEBUG:teuthology.parallel:result is None 2024-09-16T09:47:21.842 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T09:47:21.870 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-16T09:47:21.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-16T09:47:21.901 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-16T09:47:21.901 DEBUG:teuthology.parallel:result is None 2024-09-16T09:47:22.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:21 smithi111 ceph-mon[27997]: mgrmap e25: smithi114.xvotey(active, since 61s), standbys: smithi111.erxodt 2024-09-16T09:47:22.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:21 smithi114 ceph-mon[35635]: mgrmap e25: smithi114.xvotey(active, since 61s), standbys: smithi111.erxodt 2024-09-16T09:47:23.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:22 smithi111 ceph-mon[27997]: pgmap v34: 65 pgs: 65 active+clean; 223 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.0 MiB/s wr, 880 op/s 2024-09-16T09:47:23.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:22 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:22 smithi114 ceph-mon[35635]: pgmap v34: 65 pgs: 65 active+clean; 223 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 36 KiB/s rd, 2.0 MiB/s wr, 880 op/s 2024-09-16T09:47:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:22 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:25.062 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:24 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.063 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:24 smithi111 ceph-mon[27997]: pgmap v35: 65 pgs: 65 active+clean; 223 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 421 op/s 2024-09-16T09:47:25.063 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:24 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.063 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:24 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.063 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:24 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:24 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:24 smithi114 ceph-mon[35635]: pgmap v35: 65 pgs: 65 active+clean; 223 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 421 op/s 2024-09-16T09:47:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:24 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:24 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:24 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:27.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:26 smithi111 ceph-mon[27997]: pgmap v36: 65 pgs: 65 active+clean; 223 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 421 op/s 2024-09-16T09:47:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:26 smithi114 ceph-mon[35635]: pgmap v36: 65 pgs: 65 active+clean; 223 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.3 MiB/s wr, 421 op/s 2024-09-16T09:47:29.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:28 smithi111 ceph-mon[27997]: pgmap v37: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 473 op/s 2024-09-16T09:47:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:28 smithi114 ceph-mon[35635]: pgmap v37: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 473 op/s 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 -- 172.21.15.111:0/115430977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 msgr2=0x7f45b0100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/115430977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b0100c80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f45a4009880 tx=0x7f45a402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 -- 172.21.15.111:0/115430977 shutdown_connections 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/115430977 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 0x7f45b0101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/115430977 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b0100c80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 -- 172.21.15.111:0/115430977 >> 172.21.15.111:0/115430977 conn(0x7f45b00fc010 msgr2=0x7f45b00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 -- 172.21.15.111:0/115430977 shutdown_connections 2024-09-16T09:47:29.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.836+0000 7f45b6d8e640 1 -- 172.21.15.111:0/115430977 wait complete. 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b6d8e640 1 Processor -- start 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b6d8e640 1 -- start start 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b6d8e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b01963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b6d8e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 0x7f45b0196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b6d8e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f45b01096c0 con 0x7f45b0100880 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b6d8e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f45b0109540 con 0x7f45b0101a80 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b4b2a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b01963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b4b2a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b01963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45230/0 (socket says 172.21.15.111:45230) 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b4b2a640 1 -- 172.21.15.111:0/1646957975 learned_addr learned my addr 172.21.15.111:0/1646957975 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45affff640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 0x7f45b0196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b4b2a640 1 -- 172.21.15.111:0/1646957975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 msgr2=0x7f45b0196920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:29.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b4b2a640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 0x7f45b0196920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45b4b2a640 1 -- 172.21.15.111:0/1646957975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b0196fa0 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.837+0000 7f45affff640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 0x7f45b0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.838+0000 7f45b4b2a640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b01963e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f45a4006010 tx=0x7f45a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.838+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45a403f070 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.838+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b019b980 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.838+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45a4004a50 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.838+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45a4035030 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.838+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b019bf10 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.839+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 26) ==== 51574+0+0 (secure 0 0 0) 0x7f45a4042070 con 0x7f45b0100880 2024-09-16T09:47:29.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.839+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b0100c80 con 0x7f45b0100880 2024-09-16T09:47:29.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.839+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f45a4075a40 con 0x7f45b0100880 2024-09-16T09:47:29.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:29.844+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f45a4004c00 con 0x7f45b0100880 2024-09-16T09:47:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.647+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mgrmap(e 27) ==== 51701+0+0 (secure 0 0 0) 0x7f45a4042360 con 0x7f45b0100880 2024-09-16T09:47:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.647+0000 7f45adffb640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f45a0044760 0x7f45a0046b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.647+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f45a40054e0 con 0x7f45a0044760 2024-09-16T09:47:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.648+0000 7f45affff640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f45a0044760 0x7f45a0046b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:30.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.656+0000 7f45affff640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f45a0044760 0x7f45a0046b50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f45b0197890 tx=0x7f459c00b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:30.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.682+0000 7f45adffb640 1 -- 172.21.15.111:0/1646957975 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f45a40054e0 con 0x7f45a0044760 2024-09-16T09:47:30.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f45a0044760 msgr2=0x7f45a0046b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:30.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f45a0044760 0x7f45a0046b50 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f45b0197890 tx=0x7f459c00b390 comp rx=0 tx=0).stop 2024-09-16T09:47:30.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 msgr2=0x7f45b01963e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:30.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b01963e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f45a4006010 tx=0x7f45a40045e0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 shutdown_connections 2024-09-16T09:47:30.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f45a0044760 0x7f45a0046b50 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f45b0101a80 0x7f45b0196920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 --2- 172.21.15.111:0/1646957975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45b0100880 0x7f45b01963e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.684+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 >> 172.21.15.111:0/1646957975 conn(0x7f45b00fc010 msgr2=0x7f45b0104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:30.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.685+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 shutdown_connections 2024-09-16T09:47:30.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.685+0000 7f45b6d8e640 1 -- 172.21.15.111:0/1646957975 wait complete. 2024-09-16T09:47:30.696 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:47:30.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 -- 172.21.15.111:0/977468689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 msgr2=0x7f2a08104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:30.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/977468689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08104880 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29f8009880 tx=0x7f29f802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 -- 172.21.15.111:0/977468689 shutdown_connections 2024-09-16T09:47:30.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/977468689 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a08104dc0 0x7f2a081071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/977468689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08104880 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 -- 172.21.15.111:0/977468689 >> 172.21.15.111:0/977468689 conn(0x7f2a080fbff0 msgr2=0x7f2a080fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:30.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 -- 172.21.15.111:0/977468689 shutdown_connections 2024-09-16T09:47:30.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.773+0000 7f2a0dffb640 1 -- 172.21.15.111:0/977468689 wait complete. 2024-09-16T09:47:30.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.774+0000 7f2a0dffb640 1 Processor -- start 2024-09-16T09:47:30.776 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr fail", "who": "smithi114.xvotey"}]: dispatch 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr fail", "who": "smithi114.xvotey"}]: dispatch 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: Activating manager daemon smithi111.erxodt 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd='[{"prefix": "mgr fail", "who": "smithi114.xvotey"}]': finished 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: mgrmap e26: smithi111.erxodt(active, starting, since 0.00648188s) 2024-09-16T09:47:30.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:47:30.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:47:30.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:47:30.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.774+0000 7f2a0dffb640 1 -- start start 2024-09-16T09:47:30.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.774+0000 7f2a0dffb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:30.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.774+0000 7f2a0dffb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a08104dc0 0x7f2a08197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:30.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.774+0000 7f2a0dffb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0810a7b0 con 0x7f2a08102490 2024-09-16T09:47:30.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.774+0000 7f2a0dffb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0810a630 con 0x7f2a08104dc0 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45362/0 (socket says 172.21.15.111:45362) 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 -- 172.21.15.111:0/2381403082 learned_addr learned my addr 172.21.15.111:0/2381403082 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a06ffd640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a08104dc0 0x7f2a08197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 -- 172.21.15.111:0/2381403082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a08104dc0 msgr2=0x7f2a08197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a08104dc0 0x7f2a08197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 -- 172.21.15.111:0/2381403082 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081980c0 con 0x7f2a08102490 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a077fe640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08197500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006010 tx=0x7f29f8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29f803f070 con 0x7f2a08102490 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29f80049d0 con 0x7f2a08102490 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0819caa0 con 0x7f2a08102490 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.776+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0819d030 con 0x7f2a08102490 2024-09-16T09:47:30.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.775+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29f8035030 con 0x7f2a08102490 2024-09-16T09:47:30.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.777+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f40052c0 con 0x7f2a08102490 2024-09-16T09:47:30.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.777+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) ==== 51701+0+0 (secure 0 0 0) 0x7f29f8042070 con 0x7f2a08102490 2024-09-16T09:47:30.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.777+0000 7f2a04ff9640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f003f640 0x7f29f0041b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:30.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.777+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f29f8075ca0 con 0x7f2a08102490 2024-09-16T09:47:30.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.778+0000 7f2a06ffd640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f003f640 0x7f29f0041b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:30.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.778+0000 7f2a06ffd640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f003f640 0x7f29f0041b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2a081989b0 tx=0x7f29fc005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:30.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:30.786+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f29f8036260 con 0x7f2a08102490 2024-09-16T09:47:30.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:30.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 172.21.15.114:0/2918852114' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr fail", "who": "smithi114.xvotey"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "mgr fail", "who": "smithi114.xvotey"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: Activating manager daemon smithi111.erxodt 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.24379 ' entity='mgr.smithi114.xvotey' cmd='[{"prefix": "mgr fail", "who": "smithi114.xvotey"}]': finished 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: mgrmap e26: smithi111.erxodt(active, starting, since 0.00648188s) 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:47:30.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi111.erxodt", "id": "smithi111.erxodt"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-16T09:47:30.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-16T09:47:30.940 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: Manager daemon smithi111.erxodt is now available 2024-09-16T09:47:30.940 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:30.940 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:30.940 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:47:30.940 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/mirror_snapshot_schedule"}]: dispatch 2024-09-16T09:47:30.940 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi111.erxodt/trash_purge_schedule"}]: dispatch 2024-09-16T09:47:31.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.008+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f29f4000bf0 con 0x7f29f003f640 2024-09-16T09:47:31.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.010+0000 7f2a04ff9640 1 -- 172.21.15.111:0/2381403082 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f29f4000bf0 con 0x7f29f003f640 2024-09-16T09:47:31.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f003f640 msgr2=0x7f29f0041b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f003f640 0x7f29f0041b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f2a081989b0 tx=0x7f29fc005f90 comp rx=0 tx=0).stop 2024-09-16T09:47:31.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 msgr2=0x7f2a08197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08197500 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f29f8006010 tx=0x7f29f8004570 comp rx=0 tx=0).stop 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 shutdown_connections 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f003f640 0x7f29f0041b00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a08104dc0 0x7f2a08197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 --2- 172.21.15.111:0/2381403082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a08102490 0x7f2a08197500 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 >> 172.21.15.111:0/2381403082 conn(0x7f2a080fbff0 msgr2=0x7f2a080fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 shutdown_connections 2024-09-16T09:47:31.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.012+0000 7f2a0dffb640 1 -- 172.21.15.111:0/2381403082 wait complete. 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.095+0000 7f218ebfb640 1 -- 172.21.15.111:0/1245214209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 msgr2=0x7f21881070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.095+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1245214209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 0x7f21881070f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2174009880 tx=0x7f217402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 -- 172.21.15.111:0/1245214209 shutdown_connections 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1245214209 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 0x7f21881070f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1245214209 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 -- 172.21.15.111:0/1245214209 >> 172.21.15.111:0/1245214209 conn(0x7f21880fbff0 msgr2=0x7f21880fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 -- 172.21.15.111:0/1245214209 shutdown_connections 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 -- 172.21.15.111:0/1245214209 wait complete. 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 Processor -- start 2024-09-16T09:47:31.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.096+0000 7f218ebfb640 1 -- start start 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218ebfb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218ebfb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 0x7f2188197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218ebfb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f218810a790 con 0x7f21881023d0 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218ebfb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f218810a610 con 0x7f2188104d00 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45372/0 (socket says 172.21.15.111:45372) 2024-09-16T09:47:31.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 -- 172.21.15.111:0/1702590641 learned_addr learned my addr 172.21.15.111:0/1702590641 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f2187fff640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 0x7f2188197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 -- 172.21.15.111:0/1702590641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 msgr2=0x7f2188197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 0x7f2188197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 -- 172.21.15.111:0/1702590641 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21881980b0 con 0x7f21881023d0 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.097+0000 7f218c997640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881974f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f217c00e970 tx=0x7f217c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.098+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f217c00cac0 con 0x7f21881023d0 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.098+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218819caf0 con 0x7f21881023d0 2024-09-16T09:47:31.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.098+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f217c0054e0 con 0x7f21881023d0 2024-09-16T09:47:31.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.098+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f217c010430 con 0x7f21881023d0 2024-09-16T09:47:31.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.098+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f218819d050 con 0x7f21881023d0 2024-09-16T09:47:31.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.099+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) ==== 51701+0+0 (secure 0 0 0) 0x7f217c0106e0 con 0x7f21881023d0 2024-09-16T09:47:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.099+0000 7f2185ffb640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f217803f5f0 0x7f2178041ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.099+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f217c0550e0 con 0x7f21881023d0 2024-09-16T09:47:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.099+0000 7f2187fff640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f217803f5f0 0x7f2178041ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.099+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21881027b0 con 0x7f21881023d0 2024-09-16T09:47:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.100+0000 7f2187fff640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f217803f5f0 0x7f2178041ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2174009230 tx=0x7f2174004f30 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:31.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.105+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f217c01e2b0 con 0x7f21881023d0 2024-09-16T09:47:31.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.320+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2188105660 con 0x7f217803f5f0 2024-09-16T09:47:31.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.333+0000 7f2185ffb640 1 -- 172.21.15.111:0/1702590641 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2188105660 con 0x7f217803f5f0 2024-09-16T09:47:31.335 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:47:31.335 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 7s ago 9m 24.9M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:47:31.335 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (47s) 7s ago 9m 8438k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (38s) 13s ago 8m 7982k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (9m) 7s ago 9m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (8m) 13s ago 8m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (7m) 7s ago 9m 79.7M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (4m) 7s ago 4m 182M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (4m) 7s ago 4m 16.0M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (4m) 13s ago 4m 17.4M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (4m) 13s ago 4m 17.3M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (20s) 7s ago 10m 116M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (80s) 13s ago 8m 508M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 5ee22e1bc55d 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (10m) 7s ago 10m 53.9M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:47:31.336 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (8m) 13s ago 8m 40.0M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (9m) 7s ago 9m 14.5M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (8m) 13s ago 8m 17.0M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (7m) 7s ago 7m 224M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (7m) 7s ago 7m 246M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (6m) 7s ago 6m 209M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (6m) 13s ago 6m 295M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (5m) 13s ago 5m 240M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (5m) 13s ago 5m 233M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:47:31.337 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (42s) 7s ago 9m 44.8M - 2.43.0 a07b618ecd1d dd9917f6056f 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f217803f5f0 msgr2=0x7f2178041ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f217803f5f0 0x7f2178041ab0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f2174009230 tx=0x7f2174004f30 comp rx=0 tx=0).stop 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 msgr2=0x7f21881974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881974f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f217c00e970 tx=0x7f217c00ed70 comp rx=0 tx=0).stop 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 shutdown_connections 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f217803f5f0 0x7f2178041ab0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2188104d00 0x7f2188197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 --2- 172.21.15.111:0/1702590641 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21881023d0 0x7f21881974f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 >> 172.21.15.111:0/1702590641 conn(0x7f21880fbff0 msgr2=0x7f21880fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 shutdown_connections 2024-09-16T09:47:31.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.336+0000 7f218ebfb640 1 -- 172.21.15.111:0/1702590641 wait complete. 2024-09-16T09:47:31.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 -- 172.21.15.111:0/2680392472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 msgr2=0x7f9a48100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2680392472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48100c60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009880 tx=0x7f9a3c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 -- 172.21.15.111:0/2680392472 shutdown_connections 2024-09-16T09:47:31.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2680392472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a48101a60 0x7f9a48101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2680392472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48100c60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 -- 172.21.15.111:0/2680392472 >> 172.21.15.111:0/2680392472 conn(0x7f9a480fbff0 msgr2=0x7f9a480fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 -- 172.21.15.111:0/2680392472 shutdown_connections 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 -- 172.21.15.111:0/2680392472 wait complete. 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.421+0000 7f9a5067b640 1 Processor -- start 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a5067b640 1 -- start start 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a5067b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a5067b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a48101a60 0x7f9a48102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a5067b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48109680 con 0x7f9a48100860 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a5067b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9a48109500 con 0x7f9a48101a60 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45402/0 (socket says 172.21.15.111:45402) 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 -- 172.21.15.111:0/2416916238 learned_addr learned my addr 172.21.15.111:0/2416916238 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4dc16640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a48101a60 0x7f9a48102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 -- 172.21.15.111:0/2416916238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a48101a60 msgr2=0x7f9a48102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a48101a60 0x7f9a48102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 -- 172.21.15.111:0/2416916238 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a48103380 con 0x7f9a48100860 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a4e417640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48104780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006010 tx=0x7f9a3c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a3c03f070 con 0x7f9a48100860 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.422+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a3c004a50 con 0x7f9a48100860 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.423+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a48103610 con 0x7f9a48100860 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.423+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a3c035030 con 0x7f9a48100860 2024-09-16T09:47:31.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.423+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a48103b40 con 0x7f9a48100860 2024-09-16T09:47:31.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.423+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) ==== 51701+0+0 (secure 0 0 0) 0x7f9a3c042070 con 0x7f9a48100860 2024-09-16T09:47:31.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.424+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a48100c60 con 0x7f9a48100860 2024-09-16T09:47:31.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.424+0000 7f9a3b7fe640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9a3403f5f0 0x7f9a34041ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.424+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f9a3c075cd0 con 0x7f9a48100860 2024-09-16T09:47:31.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.424+0000 7f9a4dc16640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9a3403f5f0 0x7f9a34041ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.424+0000 7f9a4dc16640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9a3403f5f0 0x7f9a34041ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a48104500 tx=0x7f9a4400b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:31.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.429+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f9a3c004c00 con 0x7f9a48100860 2024-09-16T09:47:31.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.684+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9a4819faa0 con 0x7f9a48100860 2024-09-16T09:47:31.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.684+0000 7f9a3b7fe640 1 -- 172.21.15.111:0/2416916238 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f9a3c04c350 con 0x7f9a48100860 2024-09-16T09:47:31.687 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:31 smithi111 ceph-mon[27997]: mgrmap e27: smithi111.erxodt(active, since 1.01014s) 2024-09-16T09:47:31.687 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:31 smithi111 ceph-mon[27997]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:31.687 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:31 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:47:31.687 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:31 smithi111 ceph-mon[27997]: pgmap v3: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:31.687 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:31 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:31.687 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:31 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:31.687 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:47:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:47:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:47:31.687 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 12, 2024-09-16T09:47:31.688 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9a3403f5f0 msgr2=0x7f9a34041ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9a3403f5f0 0x7f9a34041ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9a48104500 tx=0x7f9a4400b390 comp rx=0 tx=0).stop 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 msgr2=0x7f9a48104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48104780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c006010 tx=0x7f9a3c0045e0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 shutdown_connections 2024-09-16T09:47:31.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9a3403f5f0 0x7f9a34041ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9a48101a60 0x7f9a48102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 --2- 172.21.15.111:0/2416916238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a48100860 0x7f9a48104780 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 >> 172.21.15.111:0/2416916238 conn(0x7f9a480fbff0 msgr2=0x7f9a4806a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 shutdown_connections 2024-09-16T09:47:31.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.687+0000 7f9a5067b640 1 -- 172.21.15.111:0/2416916238 wait complete. 2024-09-16T09:47:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 -- 172.21.15.111:0/2157796979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 msgr2=0x7fe3e0104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/2157796979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0104860 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8009880 tx=0x7fe3d802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 -- 172.21.15.111:0/2157796979 shutdown_connections 2024-09-16T09:47:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/2157796979 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3e0104da0 0x7fe3e0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/2157796979 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0104860 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 -- 172.21.15.111:0/2157796979 >> 172.21.15.111:0/2157796979 conn(0x7fe3e00fc010 msgr2=0x7fe3e00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 -- 172.21.15.111:0/2157796979 shutdown_connections 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.771+0000 7fe3e71f8640 1 -- 172.21.15.111:0/2157796979 wait complete. 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e71f8640 1 Processor -- start 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e71f8640 1 -- start start 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e71f8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e71f8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3e0104da0 0x7fe3e0197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e71f8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e010a770 con 0x7fe3e0102470 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e71f8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe3e010a5f0 con 0x7fe3e0104da0 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45418/0 (socket says 172.21.15.111:45418) 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 -- 172.21.15.111:0/3302217639 learned_addr learned my addr 172.21.15.111:0/3302217639 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3dffff640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3e0104da0 0x7fe3e0197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 -- 172.21.15.111:0/3302217639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3e0104da0 msgr2=0x7fe3e0197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3e0104da0 0x7fe3e0197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 -- 172.21.15.111:0/3302217639 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3e0197ff0 con 0x7fe3e0102470 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.772+0000 7fe3e4f94640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0197430 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8006010 tx=0x7fe3d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.773+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3d803f070 con 0x7fe3e0102470 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.773+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3d8004ac0 con 0x7fe3e0102470 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.773+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3e019ca30 con 0x7fe3e0102470 2024-09-16T09:47:31.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.773+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3d8035030 con 0x7fe3e0102470 2024-09-16T09:47:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.773+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3e019cfc0 con 0x7fe3e0102470 2024-09-16T09:47:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.774+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 27) ==== 51701+0+0 (secure 0 0 0) 0x7fe3d8042070 con 0x7fe3e0102470 2024-09-16T09:47:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.774+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3e0102850 con 0x7fe3e0102470 2024-09-16T09:47:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.774+0000 7fe3ddffb640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe3cc03f5f0 0x7fe3cc041ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:47:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.774+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fe3d8075cb0 con 0x7fe3e0102470 2024-09-16T09:47:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.774+0000 7fe3dffff640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe3cc03f5f0 0x7fe3cc041ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:47:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.775+0000 7fe3dffff640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe3cc03f5f0 0x7fe3cc041ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe3e01988e0 tx=0x7fe3d0009870 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:47:31.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.779+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fe3d804ad50 con 0x7fe3e0102470 2024-09-16T09:47:31.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:31 smithi114 ceph-mon[35635]: mgrmap e27: smithi111.erxodt(active, since 1.01014s) 2024-09-16T09:47:31.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:31 smithi114 ceph-mon[35635]: from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:31.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:31 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:47:31.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:31 smithi114 ceph-mon[35635]: pgmap v3: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:31.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:31 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:31.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:31 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:31.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.971+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe3e01056e0 con 0x7fe3cc03f5f0 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.972+0000 7fe3ddffb640 1 -- 172.21.15.111:0/3302217639 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fe3e01056e0 con 0x7fe3cc03f5f0 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-16T09:47:31.974 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:47:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T09:47:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-16T09:47:31.975 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:47:31.975 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:47:31.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.974+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe3cc03f5f0 msgr2=0x7fe3cc041ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.974+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe3cc03f5f0 0x7fe3cc041ab0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe3e01988e0 tx=0x7fe3d0009870 comp rx=0 tx=0).stop 2024-09-16T09:47:31.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.974+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 msgr2=0x7fe3e0197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.974+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0197430 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8006010 tx=0x7fe3d80046c0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 shutdown_connections 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe3cc03f5f0 0x7fe3cc041ab0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe3e0104da0 0x7fe3e0197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 --2- 172.21.15.111:0/3302217639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe3e0102470 0x7fe3e0197430 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 >> 172.21.15.111:0/3302217639 conn(0x7fe3e00fc010 msgr2=0x7fe3e00fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 shutdown_connections 2024-09-16T09:47:31.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:47:31.975+0000 7fe3e71f8640 1 -- 172.21.15.111:0/3302217639 wait complete. 2024-09-16T09:47:32.761 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: [16/Sep/2024:09:47:31] ENGINE Bus STARTING 2024-09-16T09:47:32.761 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: [16/Sep/2024:09:47:31] ENGINE Serving on http://172.21.15.111:8765 2024-09-16T09:47:32.761 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: [16/Sep/2024:09:47:31] ENGINE Serving on https://172.21.15.111:7150 2024-09-16T09:47:32.761 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: [16/Sep/2024:09:47:31] ENGINE Bus STARTED 2024-09-16T09:47:32.761 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: [16/Sep/2024:09:47:31] ENGINE Error in HTTPServer.serve 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Traceback (most recent call last): 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._run(expiration_interval) 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: s = self.context.wrap_socket( 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: return self.sslsocket_class._create( 2024-09-16T09:47:32.762 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:47:32.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self.do_handshake() 2024-09-16T09:47:32.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:47:32.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: self._sslobj.do_handshake() 2024-09-16T09:47:32.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:47:32.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: pgmap v4: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:32.763 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:32 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2416916238' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:32.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: [16/Sep/2024:09:47:31] ENGINE Bus STARTING 2024-09-16T09:47:32.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: [16/Sep/2024:09:47:31] ENGINE Serving on http://172.21.15.111:8765 2024-09-16T09:47:32.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: [16/Sep/2024:09:47:31] ENGINE Serving on https://172.21.15.111:7150 2024-09-16T09:47:32.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: [16/Sep/2024:09:47:31] ENGINE Bus STARTED 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: [16/Sep/2024:09:47:31] ENGINE Error in HTTPServer.serve 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Traceback (most recent call last): 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._connections.run(self.expiration_interval) 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._run(expiration_interval) 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-16T09:47:32.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: s = self.context.wrap_socket( 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: return self.sslsocket_class._create( 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self.do_handshake() 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: self._sslobj.do_handshake() 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: pgmap v4: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:32.939 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:32 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2416916238' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:33.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:33 smithi111 ceph-mon[27997]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:33.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:33 smithi111 ceph-mon[27997]: mgrmap e28: smithi111.erxodt(active, since 3s) 2024-09-16T09:47:33.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:33 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:33.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:33 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:33.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:33 smithi114 ceph-mon[35635]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:47:33.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:33 smithi114 ceph-mon[35635]: mgrmap e28: smithi111.erxodt(active, since 3s) 2024-09-16T09:47:33.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:33 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:33.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:33 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:34.930 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:34 smithi114 ceph-mon[35635]: pgmap v5: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:34.930 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:34 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:34.930 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:34 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:34 smithi111 ceph-mon[27997]: pgmap v5: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:34 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:34 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:35.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:47:35.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:47:35.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:47:35.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:47:35.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:47:35.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: mgrmap e29: smithi111.erxodt(active, since 5s), standbys: smithi114.xvotey 2024-09-16T09:47:35.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:35 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi114.xvotey", "id": "smithi114.xvotey"}]: dispatch 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3744743077' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: mgrmap e29: smithi111.erxodt(active, since 5s), standbys: smithi114.xvotey 2024-09-16T09:47:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:35 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr metadata", "who": "smithi114.xvotey", "id": "smithi114.xvotey"}]: dispatch 2024-09-16T09:47:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:36 smithi114 ceph-mon[35635]: pgmap v6: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:36 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:36 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:37.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:36 smithi111 ceph-mon[27997]: pgmap v6: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:37.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:36 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:37.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:36 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:37 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:37 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:38.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:37 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:38.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:37 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:38 smithi114 ceph-mon[35635]: pgmap v7: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T09:47:39.106 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:38 smithi111 ceph-mon[27997]: pgmap v7: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 10 op/s 2024-09-16T09:47:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: pgmap v8: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:47:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:40.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:47:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:40 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: pgmap v8: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-16T09:47:40.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:40.963 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:40 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:41.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:47:41.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:47:41.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:47:41.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:47:41.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:47:41.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:47:41.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:47:41.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:47:41.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-16T09:47:41.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:41 smithi114 ceph-mon[35635]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.conf 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.conf 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi114:/etc/ceph/ceph.client.admin.keyring 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:47:42.050 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Updating smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-16T09:47:42.051 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Reconfiguring prometheus.smithi111 (dependencies changed)... 2024-09-16T09:47:42.051 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:41 smithi111 ceph-mon[27997]: Reconfiguring daemon prometheus.smithi111 on smithi111 2024-09-16T09:47:42.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:42 smithi114 ceph-mon[35635]: pgmap v9: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T09:47:42.941 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:42 smithi111 ceph-mon[27997]: pgmap v9: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 16 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-16T09:47:44.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:44 smithi111 ceph-mon[27997]: pgmap v10: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T09:47:45.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:44 smithi114 ceph-mon[35635]: pgmap v10: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T09:47:45.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:45 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:46.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:45 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:47:46.961 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:46 smithi111 ceph-mon[27997]: pgmap v11: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T09:47:46.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:46 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:46.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:46 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:46.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:46 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:47:46.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:46 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:47:46.962 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:46 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:46.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:46 smithi114 ceph-mon[35635]: pgmap v11: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T09:47:46.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:46 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:46.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:46 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:46.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:46 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:47:46.994 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:46 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:47:46.994 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:46 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:47.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:47 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:47:47.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:47 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:47:47.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:47 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:48.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:47 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi114.xvotey", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-16T09:47:48.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:47 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-16T09:47:48.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:47 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:48.810 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:48 smithi114 ceph-mon[35635]: Upgrade: Updating mgr.smithi114.xvotey 2024-09-16T09:47:48.811 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:48 smithi114 ceph-mon[35635]: Deploying daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:47:48.811 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:48 smithi114 ceph-mon[35635]: pgmap v12: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T09:47:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:48 smithi111 ceph-mon[27997]: Upgrade: Updating mgr.smithi114.xvotey 2024-09-16T09:47:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:48 smithi111 ceph-mon[27997]: Deploying daemon mgr.smithi114.xvotey on smithi114 2024-09-16T09:47:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:48 smithi111 ceph-mon[27997]: pgmap v12: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 15 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-16T09:47:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:50 smithi111 ceph-mon[27997]: pgmap v13: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:50 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:50 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:50 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:50.997 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:50 smithi114 ceph-mon[35635]: pgmap v13: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:50.998 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:50 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:50.998 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:50 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:50.998 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:50 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:52.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:52 smithi111 ceph-mon[27997]: pgmap v14: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:52.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:52 smithi114 ceph-mon[35635]: pgmap v14: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:54 smithi111 ceph-mon[27997]: pgmap v15: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:54 smithi114 ceph-mon[35635]: pgmap v15: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:54.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: Standby manager daemon smithi114.xvotey restarted 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:47:56.536 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:47:56.537 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:47:56.537 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:56 smithi114 ceph-mon[35635]: pgmap v16: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: Standby manager daemon smithi114.xvotey restarted 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: Standby manager daemon smithi114.xvotey started 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/crt"}]: dispatch 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-16T09:47:56.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi114.xvotey/key"}]: dispatch 2024-09-16T09:47:56.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: from='mgr.? 172.21.15.114:0/3117783817' entity='mgr.smithi114.xvotey' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-16T09:47:56.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:56 smithi111 ceph-mon[27997]: pgmap v16: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:57.620 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: mgrmap e30: smithi111.erxodt(active, since 26s), standbys: smithi114.xvotey 2024-09-16T09:47:57.620 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.620 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.620 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:57.620 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.erxodt"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.erxodt"}]': finished 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi114.xvotey"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi114.xvotey"}]': finished 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.621 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.622 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:57 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: mgrmap e30: smithi111.erxodt(active, since 26s), standbys: smithi114.xvotey 2024-09-16T09:47:57.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.erxodt"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi111.erxodt"}]': finished 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi114.xvotey"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi114.xvotey"}]': finished 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:47:57.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:57 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all mgr 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all rgw 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all iscsi 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all nfs 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all nvmeof 2024-09-16T09:47:58.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:58 smithi111 ceph-mon[27997]: pgmap v17: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all mgr 2024-09-16T09:47:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all rgw 2024-09-16T09:47:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T09:47:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-16T09:47:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all iscsi 2024-09-16T09:47:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all nfs 2024-09-16T09:47:58.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all nvmeof 2024-09-16T09:47:58.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:58 smithi114 ceph-mon[35635]: pgmap v17: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:47:59.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:59 smithi111 ceph-mon[27997]: Upgrade: Updating node-exporter.smithi111 (1/2) 2024-09-16T09:47:59.557 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:47:59 smithi111 ceph-mon[27997]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-16T09:47:59.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:59 smithi114 ceph-mon[35635]: Upgrade: Updating node-exporter.smithi111 (1/2) 2024-09-16T09:47:59.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:47:59 smithi114 ceph-mon[35635]: Deploying daemon node-exporter.smithi111 on smithi111 2024-09-16T09:48:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:00 smithi111 ceph-mon[27997]: pgmap v18: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:00 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:00.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:00 smithi114 ceph-mon[35635]: pgmap v18: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:00.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:00 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1649380677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 msgr2=0x7ff7e4101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1649380677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e4101f00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009880 tx=0x7ff7d802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1649380677 shutdown_connections 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1649380677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e4101f00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1649380677 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1649380677 >> 172.21.15.111:0/1649380677 conn(0x7ff7e40fc010 msgr2=0x7ff7e40fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1649380677 shutdown_connections 2024-09-16T09:48:02.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1649380677 wait complete. 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.068+0000 7ff7e95fc640 1 Processor -- start 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e95fc640 1 -- start start 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e95fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e406ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e95fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e419c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e95fc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e41096a0 con 0x7ff7e4101a80 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e95fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e4109520 con 0x7ff7e4100880 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e406ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e2ffd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e406ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:38882/0 (socket says 172.21.15.111:38882) 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e2ffd640 1 -- 172.21.15.111:0/1192258197 learned_addr learned my addr 172.21.15.111:0/1192258197 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e2ffd640 1 -- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 msgr2=0x7ff7e419c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e27fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e419c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.069+0000 7ff7e2ffd640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e419c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7e2ffd640 1 -- 172.21.15.111:0/1192258197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e419c720 con 0x7ff7e4100880 2024-09-16T09:48:02.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7e27fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e419c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:48:02.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7e2ffd640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e406ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c8f0 tx=0x7ff7d400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7d4004020 con 0x7ff7e4100880 2024-09-16T09:48:02.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7d4007e10 con 0x7ff7e4100880 2024-09-16T09:48:02.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e419ca10 con 0x7ff7e4100880 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7d4003e40 con 0x7ff7e4100880 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.070+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e419cfa0 con 0x7ff7e4100880 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.071+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e4100c80 con 0x7ff7e4100880 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.072+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7ff7d4007950 con 0x7ff7e4100880 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.073+0000 7ff7cbfff640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff7cc07ad10 0x7ff7cc07d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.073+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7ff7d409e060 con 0x7ff7e4100880 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.073+0000 7ff7e27fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff7cc07ad10 0x7ff7cc07d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.073+0000 7ff7e27fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff7cc07ad10 0x7ff7cc07d1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80096c0 tx=0x7ff7d8009650 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.078+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7ff7d4069590 con 0x7ff7e4100880 2024-09-16T09:48:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.281+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff7e4062630 con 0x7ff7cc07ad10 2024-09-16T09:48:02.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.282+0000 7ff7cbfff640 1 -- 172.21.15.111:0/1192258197 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7ff7e4062630 con 0x7ff7cc07ad10 2024-09-16T09:48:02.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff7cc07ad10 msgr2=0x7ff7cc07d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff7cc07ad10 0x7ff7cc07d1d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff7d80096c0 tx=0x7ff7d8009650 comp rx=0 tx=0).stop 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 msgr2=0x7ff7e406ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e406ae40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7d400c8f0 tx=0x7ff7d400cdb0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 shutdown_connections 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff7cc07ad10 0x7ff7cc07d1d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff7e4101a80 0x7ff7e419c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 --2- 172.21.15.111:0/1192258197 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff7e4100880 0x7ff7e406ae40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 >> 172.21.15.111:0/1192258197 conn(0x7ff7e40fc010 msgr2=0x7ff7e4104ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 shutdown_connections 2024-09-16T09:48:02.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.284+0000 7ff7e95fc640 1 -- 172.21.15.111:0/1192258197 wait complete. 2024-09-16T09:48:02.294 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:48:02.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 -- 172.21.15.111:0/3755823576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674100200 msgr2=0x7f5674102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 --2- 172.21.15.111:0/3755823576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674100200 0x7f5674102610 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5670009880 tx=0x7f567002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 -- 172.21.15.111:0/3755823576 shutdown_connections 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 --2- 172.21.15.111:0/3755823576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674102b50 0x7f5674104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 --2- 172.21.15.111:0/3755823576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674100200 0x7f5674102610 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 -- 172.21.15.111:0/3755823576 >> 172.21.15.111:0/3755823576 conn(0x7f56740fc010 msgr2=0x7f56740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 -- 172.21.15.111:0/3755823576 shutdown_connections 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.367+0000 7f567be2e640 1 -- 172.21.15.111:0/3755823576 wait complete. 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f567be2e640 1 Processor -- start 2024-09-16T09:48:02.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f567be2e640 1 -- start start 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f567be2e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674100200 0x7f567419dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f567be2e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 0x7f567419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f567be2e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5674110e10 con 0x7f5674102b50 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f567be2e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5674110c90 con 0x7f5674100200 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f56793c9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 0x7f567419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f56793c9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 0x7f567419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53794/0 (socket says 172.21.15.111:53794) 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f56793c9640 1 -- 172.21.15.111:0/1969461623 learned_addr learned my addr 172.21.15.111:0/1969461623 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.368+0000 7f5679bca640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674100200 0x7f567419dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f56793c9640 1 -- 172.21.15.111:0/1969461623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674100200 msgr2=0x7f567419dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f56793c9640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674100200 0x7f567419dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f56793c9640 1 -- 172.21.15.111:0/1969461623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f567419e680 con 0x7f5674102b50 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f5679bca640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674100200 0x7f567419dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f56793c9640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 0x7f567419e000 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f566400b420 tx=0x7f566400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5664011630 con 0x7f5674102b50 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5664016070 con 0x7f5674102b50 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56741a30c0 con 0x7f5674102b50 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5664010d40 con 0x7f5674102b50 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.369+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56741a36d0 con 0x7f5674102b50 2024-09-16T09:48:02.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.370+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5674100600 con 0x7f5674102b50 2024-09-16T09:48:02.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.371+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7f566401b460 con 0x7f5674102b50 2024-09-16T09:48:02.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.371+0000 7f566affd640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f566007ad10 0x7f566007d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.371+0000 7f5679bca640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f566007ad10 0x7f566007d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.371+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f566409d620 con 0x7f5674102b50 2024-09-16T09:48:02.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.372+0000 7f5679bca640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f566007ad10 0x7f566007d1d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5670005ab0 tx=0x7f5670005a20 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.376+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f5664068bf0 con 0x7f5674102b50 2024-09-16T09:48:02.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.568+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5674103450 con 0x7f566007ad10 2024-09-16T09:48:02.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.570+0000 7f566affd640 1 -- 172.21.15.111:0/1969461623 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f5674103450 con 0x7f566007ad10 2024-09-16T09:48:02.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f566007ad10 msgr2=0x7f566007d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f566007ad10 0x7f566007d1d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5670005ab0 tx=0x7f5670005a20 comp rx=0 tx=0).stop 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 msgr2=0x7f567419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 0x7f567419e000 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f566400b420 tx=0x7f566400b8e0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 shutdown_connections 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f566007ad10 0x7f566007d1d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5674102b50 0x7f567419e000 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 --2- 172.21.15.111:0/1969461623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5674100200 0x7f567419dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 >> 172.21.15.111:0/1969461623 conn(0x7f56740fc010 msgr2=0x7f56740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 shutdown_connections 2024-09-16T09:48:02.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.572+0000 7f567be2e640 1 -- 172.21.15.111:0/1969461623 wait complete. 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/275044887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8101a80 msgr2=0x7fa4b8101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/275044887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8101a80 0x7fa4b8101f00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009880 tx=0x7fa4a002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/275044887 shutdown_connections 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/275044887 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8101a80 0x7fa4b8101f00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/275044887 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4b8100880 0x7fa4b8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/275044887 >> 172.21.15.111:0/275044887 conn(0x7fa4b80fc010 msgr2=0x7fa4b80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/275044887 shutdown_connections 2024-09-16T09:48:02.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.654+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/275044887 wait complete. 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4bcbbc640 1 Processor -- start 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4bcbbc640 1 -- start start 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4bcbbc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 0x7fa4b806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4bcbbc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4b8101a80 0x7fa4b819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4bcbbc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b8109740 con 0x7fa4b8100880 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4bcbbc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b81095c0 con 0x7fa4b8101a80 2024-09-16T09:48:02.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4b659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 0x7fa4b806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4b659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 0x7fa4b806adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53826/0 (socket says 172.21.15.111:53826) 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.655+0000 7fa4b659c640 1 -- 172.21.15.111:0/4184416690 learned_addr learned my addr 172.21.15.111:0/4184416690 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4b659c640 1 -- 172.21.15.111:0/4184416690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4b8101a80 msgr2=0x7fa4b819c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4add9b640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4b8101a80 0x7fa4b819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4b659c640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4b8101a80 0x7fa4b819c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4b659c640 1 -- 172.21.15.111:0/4184416690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b819c840 con 0x7fa4b8100880 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4b659c640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 0x7fa4b806adf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800b3d0 tx=0x7fa4a800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4a8015020 con 0x7fa4b8100880 2024-09-16T09:48:02.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4a8011af0 con 0x7fa4b8100880 2024-09-16T09:48:02.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b819cb30 con 0x7fa4b8100880 2024-09-16T09:48:02.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4a8010d90 con 0x7fa4b8100880 2024-09-16T09:48:02.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.656+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b819d0c0 con 0x7fa4b8100880 2024-09-16T09:48:02.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.657+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b8100c80 con 0x7fa4b8100880 2024-09-16T09:48:02.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.658+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7fa4a8018020 con 0x7fa4b8100880 2024-09-16T09:48:02.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.658+0000 7fa4affff640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa4a407ad10 0x7fa4a407d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.659+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fa4a809d930 con 0x7fa4b8100880 2024-09-16T09:48:02.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.659+0000 7fa4add9b640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa4a407ad10 0x7fa4a407d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.659+0000 7fa4add9b640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa4a407ad10 0x7fa4a407d1d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0006010 tx=0x7fa4a0000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.663+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fa4a801f020 con 0x7fa4b8100880 2024-09-16T09:48:02.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.847+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa4b8062630 con 0x7fa4a407ad10 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.856+0000 7fa4affff640 1 -- 172.21.15.111:0/4184416690 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa4b8062630 con 0x7fa4a407ad10 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (8m) 7s ago 9m 24.9M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (79s) 7s ago 10m 8484k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (69s) 9s ago 9m 8090k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (10m) 7s ago 10m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:48:02.858 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (9m) 9s ago 9m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (8m) 7s ago 9m 79.8M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (4m) 7s ago 4m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (4m) 7s ago 4m 16.6M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (4m) 9s ago 4m 17.9M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (4m) 9s ago 4m 17.8M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (52s) 7s ago 11m 505M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (12s) 9s ago 9m 66.4M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (11m) 7s ago 11m 58.0M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (9m) 9s ago 9m 45.0M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (10m) 7s ago 10m 14.6M - 1.5.0 0da6a335fe13 14ecd847449c 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (9m) 9s ago 9m 16.6M - 1.5.0 0da6a335fe13 9c5957e67dd1 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (8m) 7s ago 8m 229M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (7m) 7s ago 7m 247M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:48:02.859 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (7m) 7s ago 7m 211M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:48:02.860 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (6m) 9s ago 6m 302M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:48:02.860 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (6m) 9s ago 6m 243M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:48:02.860 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (5m) 9s ago 5m 234M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:48:02.860 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (17s) 7s ago 9m 37.7M - 2.43.0 a07b618ecd1d ec34171d141f 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.858+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa4a407ad10 msgr2=0x7fa4a407d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.858+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa4a407ad10 0x7fa4a407d1d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0006010 tx=0x7fa4a0000bc0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.858+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 msgr2=0x7fa4b806adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.858+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 0x7fa4b806adf0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800b3d0 tx=0x7fa4a800b890 comp rx=0 tx=0).stop 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.858+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 shutdown_connections 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.858+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa4a407ad10 0x7fa4a407d1d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.859+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa4b8101a80 0x7fa4b819c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.859+0000 7fa4bcbbc640 1 --2- 172.21.15.111:0/4184416690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4b8100880 0x7fa4b806adf0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.859+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 >> 172.21.15.111:0/4184416690 conn(0x7fa4b80fc010 msgr2=0x7fa4b8104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.859+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 shutdown_connections 2024-09-16T09:48:02.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.859+0000 7fa4bcbbc640 1 -- 172.21.15.111:0/4184416690 wait complete. 2024-09-16T09:48:02.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.937+0000 7ff56a10e640 1 -- 172.21.15.111:0/3426742165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 msgr2=0x7ff564100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.937+0000 7ff56a10e640 1 --2- 172.21.15.111:0/3426742165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff564100c80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff554009880 tx=0x7ff55402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.937+0000 7ff56a10e640 1 -- 172.21.15.111:0/3426742165 shutdown_connections 2024-09-16T09:48:02.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.937+0000 7ff56a10e640 1 --2- 172.21.15.111:0/3426742165 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff564101a80 0x7ff564101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.937+0000 7ff56a10e640 1 --2- 172.21.15.111:0/3426742165 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff564100c80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.937+0000 7ff56a10e640 1 -- 172.21.15.111:0/3426742165 >> 172.21.15.111:0/3426742165 conn(0x7ff5640fc010 msgr2=0x7ff5640fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:02.942 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:02 smithi111 ceph-mon[27997]: pgmap v19: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:02.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.938+0000 7ff56a10e640 1 -- 172.21.15.111:0/3426742165 shutdown_connections 2024-09-16T09:48:02.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.938+0000 7ff56a10e640 1 -- 172.21.15.111:0/3426742165 wait complete. 2024-09-16T09:48:02.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.938+0000 7ff56a10e640 1 Processor -- start 2024-09-16T09:48:02.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.938+0000 7ff56a10e640 1 -- start start 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff56a10e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff56406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff56a10e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff564101a80 0x7ff56419e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff56a10e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff5641096a0 con 0x7ff564100880 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff56a10e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff564109520 con 0x7ff564101a80 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff56406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff56406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53844/0 (socket says 172.21.15.111:53844) 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 -- 172.21.15.111:0/2379578306 learned_addr learned my addr 172.21.15.111:0/2379578306 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff55affd640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff564101a80 0x7ff56419e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 -- 172.21.15.111:0/2379578306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff564101a80 msgr2=0x7ff56419e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff564101a80 0x7ff56419e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 -- 172.21.15.111:0/2379578306 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff564197fd0 con 0x7ff564100880 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5637fe640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff56406adf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff5540048f0 tx=0x7ff554004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff55403f070 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5540044d0 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56419ebf0 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.939+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff554035030 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.940+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56419f0f0 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.941+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff564100c80 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.941+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7ff554042070 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.942+0000 7ff5617fa640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55007ad70 0x7ff55007d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.942+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7ff5540be960 con 0x7ff564100880 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.942+0000 7ff55affd640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55007ad70 0x7ff55007d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:02.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.942+0000 7ff55affd640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55007ad70 0x7ff55007d230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff56406ab70 tx=0x7ff54c00a2d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:02.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:02.946+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7ff554089fb0 con 0x7ff564100880 2024-09-16T09:48:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:02 smithi114 ceph-mon[35635]: pgmap v19: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:03.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.194+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff56419f490 con 0x7ff564100880 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.194+0000 7ff5617fa640 1 -- 172.21.15.111:0/2379578306 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7ff55408ee60 con 0x7ff564100880 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:03.196 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 12, 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:48:03.197 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:48:03.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55007ad70 msgr2=0x7ff55007d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:03.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55007ad70 0x7ff55007d230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff56406ab70 tx=0x7ff54c00a2d0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 msgr2=0x7ff56406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:03.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff56406adf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff5540048f0 tx=0x7ff554004920 comp rx=0 tx=0).stop 2024-09-16T09:48:03.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 shutdown_connections 2024-09-16T09:48:03.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55007ad70 0x7ff55007d230 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff564101a80 0x7ff56419e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 --2- 172.21.15.111:0/2379578306 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff564100880 0x7ff56406adf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 >> 172.21.15.111:0/2379578306 conn(0x7ff5640fc010 msgr2=0x7ff5640fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:03.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 shutdown_connections 2024-09-16T09:48:03.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.197+0000 7ff56a10e640 1 -- 172.21.15.111:0/2379578306 wait complete. 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 -- 172.21.15.111:0/380085885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44100880 msgr2=0x7fad44100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/380085885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44100880 0x7fad44100c80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fad34009880 tx=0x7fad3402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 -- 172.21.15.111:0/380085885 shutdown_connections 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/380085885 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44101a80 0x7fad44101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/380085885 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44100880 0x7fad44100c80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 -- 172.21.15.111:0/380085885 >> 172.21.15.111:0/380085885 conn(0x7fad440fc010 msgr2=0x7fad440fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 -- 172.21.15.111:0/380085885 shutdown_connections 2024-09-16T09:48:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.280+0000 7fad4a4a6640 1 -- 172.21.15.111:0/380085885 wait complete. 2024-09-16T09:48:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad4a4a6640 1 Processor -- start 2024-09-16T09:48:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad4a4a6640 1 -- start start 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad4a4a6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44100880 0x7fad4406ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad4a4a6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 0x7fad4419c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad4a4a6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fad44109720 con 0x7fad44101a80 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad4a4a6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad441095a0 con 0x7fad44100880 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad437fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 0x7fad4419c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad437fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 0x7fad4419c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53854/0 (socket says 172.21.15.111:53854) 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad437fe640 1 -- 172.21.15.111:0/3906665187 learned_addr learned my addr 172.21.15.111:0/3906665187 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad43fff640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44100880 0x7fad4406ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad437fe640 1 -- 172.21.15.111:0/3906665187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44100880 msgr2=0x7fad4406ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad437fe640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44100880 0x7fad4406ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad437fe640 1 -- 172.21.15.111:0/3906665187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad4419c820 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.281+0000 7fad43fff640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44100880 0x7fad4406ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.282+0000 7fad437fe640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 0x7fad4419c230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad3800b420 tx=0x7fad3800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.282+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad38011630 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.282+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad38016070 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.282+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad4419cb10 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.282+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad38010d40 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.282+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4419d120 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.283+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad44100c80 con 0x7fad44101a80 2024-09-16T09:48:03.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.283+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7fad3801b460 con 0x7fad44101a80 2024-09-16T09:48:03.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.284+0000 7fad417fa640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad2c07ad70 0x7fad2c07d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:03.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.284+0000 7fad43fff640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad2c07ad70 0x7fad2c07d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:03.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.284+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fad3809d5e0 con 0x7fad44101a80 2024-09-16T09:48:03.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.285+0000 7fad43fff640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad2c07ad70 0x7fad2c07d230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad340096c0 tx=0x7fad34009650 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:03.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.289+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fad38021250 con 0x7fad44101a80 2024-09-16T09:48:03.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.496+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fad44062630 con 0x7fad2c07ad70 2024-09-16T09:48:03.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.497+0000 7fad417fa640 1 -- 172.21.15.111:0/3906665187 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fad44062630 con 0x7fad2c07ad70 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:48:03.499 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:48:03.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad2c07ad70 msgr2=0x7fad2c07d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:03.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad2c07ad70 0x7fad2c07d230 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fad340096c0 tx=0x7fad34009650 comp rx=0 tx=0).stop 2024-09-16T09:48:03.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 msgr2=0x7fad4419c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 0x7fad4419c230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fad3800b420 tx=0x7fad3800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 shutdown_connections 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad2c07ad70 0x7fad2c07d230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad44101a80 0x7fad4419c230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 --2- 172.21.15.111:0/3906665187 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad44100880 0x7fad4406ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 >> 172.21.15.111:0/3906665187 conn(0x7fad440fc010 msgr2=0x7fad44104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 shutdown_connections 2024-09-16T09:48:03.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:03.499+0000 7fad4a4a6640 1 -- 172.21.15.111:0/3906665187 wait complete. 2024-09-16T09:48:03.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:03 smithi111 ceph-mon[27997]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:03.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:03 smithi111 ceph-mon[27997]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:03.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:03 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2379578306' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:03.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:03 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:03.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:03 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:04.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:03 smithi114 ceph-mon[35635]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:04.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:03 smithi114 ceph-mon[35635]: from='client.14780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:04.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:03 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2379578306' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:04.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:03 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:04.071 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:03 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:04.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:04 smithi114 ceph-mon[35635]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:04.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:04 smithi114 ceph-mon[35635]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:04.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:04 smithi114 ceph-mon[35635]: pgmap v20: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:04 smithi111 ceph-mon[27997]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:04 smithi111 ceph-mon[27997]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:04 smithi111 ceph-mon[27997]: pgmap v20: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:06.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:06 smithi114 ceph-mon[35635]: Upgrade: Updating node-exporter.smithi114 (2/2) 2024-09-16T09:48:06.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:06 smithi114 ceph-mon[35635]: Deploying daemon node-exporter.smithi114 on smithi114 2024-09-16T09:48:06.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:06 smithi114 ceph-mon[35635]: pgmap v21: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:06 smithi111 ceph-mon[27997]: Upgrade: Updating node-exporter.smithi114 (2/2) 2024-09-16T09:48:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:06 smithi111 ceph-mon[27997]: Deploying daemon node-exporter.smithi114 on smithi114 2024-09-16T09:48:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:06 smithi111 ceph-mon[27997]: pgmap v21: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:08 smithi111 ceph-mon[27997]: pgmap v22: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:09.160 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:08 smithi114 ceph-mon[35635]: pgmap v22: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:10.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:10 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:10.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:10 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:10.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:10 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:10.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:10 smithi111 ceph-mon[27997]: pgmap v23: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:10.890 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:10 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:10.890 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:10 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:10.890 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:10 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:10.890 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:10 smithi114 ceph-mon[35635]: pgmap v23: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:13.055 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:12 smithi111 ceph-mon[27997]: pgmap v24: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:13.055 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:12 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:13.056 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:12 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:12 smithi114 ceph-mon[35635]: pgmap v24: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:12 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:12 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:14.002 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:13 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:14.002 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:13 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:14.002 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:13 smithi111 ceph-mon[27997]: pgmap v25: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:14.186 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:13 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:14.186 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:13 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:14.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:13 smithi114 ceph-mon[35635]: pgmap v25: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:15.586 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.586 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.586 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.587 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.587 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:15.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:16 smithi111 ceph-mon[27997]: pgmap v26: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:16 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:16 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:16 smithi114 ceph-mon[35635]: pgmap v26: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:16 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:16 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:18.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: pgmap v27: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:18.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:18.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:18.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:18.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:18.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:18.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:18.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:18 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: pgmap v27: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:21.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:20 smithi111 ceph-mon[27997]: pgmap v28: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:21.048 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:20 smithi111 ceph-mon[27997]: Upgrade: Updating prometheus.smithi111 2024-09-16T09:48:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:20 smithi114 ceph-mon[35635]: pgmap v28: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:20 smithi114 ceph-mon[35635]: Upgrade: Updating prometheus.smithi111 2024-09-16T09:48:22.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:21 smithi111 ceph-mon[27997]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-16T09:48:22.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:21 smithi114 ceph-mon[35635]: Deploying daemon prometheus.smithi111 on smithi111 2024-09-16T09:48:23.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:22 smithi111 ceph-mon[27997]: pgmap v29: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:22 smithi114 ceph-mon[35635]: pgmap v29: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:25.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:24 smithi111 ceph-mon[27997]: pgmap v30: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:24 smithi114 ceph-mon[35635]: pgmap v30: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:27.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:26 smithi111 ceph-mon[27997]: pgmap v31: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:26 smithi114 ceph-mon[35635]: pgmap v31: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:28.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:28 smithi111 ceph-mon[27997]: pgmap v32: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:28 smithi114 ceph-mon[35635]: pgmap v32: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:30.851 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:30 smithi111 ceph-mon[27997]: pgmap v33: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:30.851 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:30 smithi114 ceph-mon[35635]: pgmap v33: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:32 smithi111 ceph-mon[27997]: pgmap v34: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:32 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:32 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:32 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:32 smithi114 ceph-mon[35635]: pgmap v34: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:32 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:32 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:32 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:33.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 -- 172.21.15.111:0/1469165112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 msgr2=0x7f2958101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:33.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 --2- 172.21.15.111:0/1469165112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958101f00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2948009880 tx=0x7f294802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 -- 172.21.15.111:0/1469165112 shutdown_connections 2024-09-16T09:48:33.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 --2- 172.21.15.111:0/1469165112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958101f00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 --2- 172.21.15.111:0/1469165112 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2958100880 0x7f2958100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 -- 172.21.15.111:0/1469165112 >> 172.21.15.111:0/1469165112 conn(0x7f29580fc010 msgr2=0x7f29580fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:33.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 -- 172.21.15.111:0/1469165112 shutdown_connections 2024-09-16T09:48:33.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.584+0000 7f295ff27640 1 -- 172.21.15.111:0/1469165112 wait complete. 2024-09-16T09:48:33.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295ff27640 1 Processor -- start 2024-09-16T09:48:33.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295ff27640 1 -- start start 2024-09-16T09:48:33.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295ff27640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2958100880 0x7f2958197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:33.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295ff27640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:33.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295ff27640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2958109740 con 0x7f2958101a80 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295ff27640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f29581095c0 con 0x7f2958100880 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958197ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52144/0 (socket says 172.21.15.111:52144) 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 -- 172.21.15.111:0/2645673168 learned_addr learned my addr 172.21.15.111:0/2645673168 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295dcc3640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2958100880 0x7f2958197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 -- 172.21.15.111:0/2645673168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2958100880 msgr2=0x7f2958197590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2958100880 0x7f2958197590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 -- 172.21.15.111:0/2645673168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2958198150 con 0x7f2958101a80 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.585+0000 7f295d4c2640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958197ad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2948006010 tx=0x7f29480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.586+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f294803f070 con 0x7f2958101a80 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.586+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29480044d0 con 0x7f2958101a80 2024-09-16T09:48:33.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.586+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295819cb30 con 0x7f2958101a80 2024-09-16T09:48:33.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.586+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2948035030 con 0x7f2958101a80 2024-09-16T09:48:33.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.586+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295819d140 con 0x7f2958101a80 2024-09-16T09:48:33.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.587+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2958100c60 con 0x7f2958101a80 2024-09-16T09:48:33.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.587+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7f2948042070 con 0x7f2958101a80 2024-09-16T09:48:33.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.588+0000 7f294effd640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f294407ad70 0x7f294407d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:33.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.588+0000 7f295dcc3640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f294407ad70 0x7f294407d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:33.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.588+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f29480beae0 con 0x7f2958101a80 2024-09-16T09:48:33.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.589+0000 7f295dcc3640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f294407ad70 0x7f294407d230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29581018e0 tx=0x7f2954008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:33.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.593+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f294808a130 con 0x7f2958101a80 2024-09-16T09:48:33.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.797+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f295806aac0 con 0x7f294407ad70 2024-09-16T09:48:33.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.798+0000 7f294effd640 1 -- 172.21.15.111:0/2645673168 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f295806aac0 con 0x7f294407ad70 2024-09-16T09:48:33.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f294407ad70 msgr2=0x7f294407d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:33.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f294407ad70 0x7f294407d230 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f29581018e0 tx=0x7f2954008040 comp rx=0 tx=0).stop 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 msgr2=0x7f2958197ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958197ad0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2948006010 tx=0x7f29480048f0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 shutdown_connections 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f294407ad70 0x7f294407d230 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2958101a80 0x7f2958197ad0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.800+0000 7f295ff27640 1 --2- 172.21.15.111:0/2645673168 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2958100880 0x7f2958197590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.801+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 >> 172.21.15.111:0/2645673168 conn(0x7f29580fc010 msgr2=0x7f295806a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.801+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 shutdown_connections 2024-09-16T09:48:33.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.801+0000 7f295ff27640 1 -- 172.21.15.111:0/2645673168 wait complete. 2024-09-16T09:48:33.811 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:48:33.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.884+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/2903708489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8101a40 msgr2=0x7f9ec8101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:33.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.884+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/2903708489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8101a40 0x7f9ec8101ec0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4009880 tx=0x7f9ec402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/2903708489 shutdown_connections 2024-09-16T09:48:33.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/2903708489 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8101a40 0x7f9ec8101ec0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/2903708489 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8100840 0x7f9ec8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/2903708489 >> 172.21.15.111:0/2903708489 conn(0x7f9ec80fbff0 msgr2=0x7f9ec80fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:33.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/2903708489 shutdown_connections 2024-09-16T09:48:33.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/2903708489 wait complete. 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 Processor -- start 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- start start 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 0x7f9ec806a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8101a40 0x7f9ec819c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec8109660 con 0x7f9ec8100840 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.885+0000 7f9ecf9e7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81094e0 con 0x7f9ec8101a40 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 0x7f9ec806a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:33.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 0x7f9ec806a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52166/0 (socket says 172.21.15.111:52166) 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 -- 172.21.15.111:0/4037457059 learned_addr learned my addr 172.21.15.111:0/4037457059 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9eccf82640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8101a40 0x7f9ec819c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 -- 172.21.15.111:0/4037457059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8101a40 msgr2=0x7f9ec819c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8101a40 0x7f9ec819c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 -- 172.21.15.111:0/4037457059 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec819c710 con 0x7f9ec8100840 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9eccf82640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8101a40 0x7f9ec819c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecd783640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 0x7f9ec806a620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00c920 tx=0x7f9ebc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ebc007a10 con 0x7f9ec8100840 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec819ca00 con 0x7f9ec8100840 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ebc007bb0 con 0x7f9ec8100840 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ebc00f450 con 0x7f9ec8100840 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.886+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec819cf90 con 0x7f9ec8100840 2024-09-16T09:48:33.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.887+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec8100c40 con 0x7f9ec8100840 2024-09-16T09:48:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.888+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7f9ebc003ea0 con 0x7f9ec8100840 2024-09-16T09:48:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.888+0000 7f9eba7fc640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9eb407ad10 0x7f9eb407d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.889+0000 7f9eccf82640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9eb407ad10 0x7f9eb407d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.889+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f9ebc09dff0 con 0x7f9ec8100840 2024-09-16T09:48:33.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.889+0000 7f9eccf82640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9eb407ad10 0x7f9eb407d1d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ec806a3a0 tx=0x7f9ec4005a20 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:33.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:33.893+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f9ebc0695c0 con 0x7f9ec8100840 2024-09-16T09:48:34.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.084+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ec8062630 con 0x7f9eb407ad10 2024-09-16T09:48:34.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.085+0000 7f9eba7fc640 1 -- 172.21.15.111:0/4037457059 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7f9ec8062630 con 0x7f9eb407ad10 2024-09-16T09:48:34.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9eb407ad10 msgr2=0x7f9eb407d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9eb407ad10 0x7f9eb407d1d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9ec806a3a0 tx=0x7f9ec4005a20 comp rx=0 tx=0).stop 2024-09-16T09:48:34.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 msgr2=0x7f9ec806a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 0x7f9ec806a620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00c920 tx=0x7f9ebc00cde0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 shutdown_connections 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9eb407ad10 0x7f9eb407d1d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9ec8101a40 0x7f9ec819c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 --2- 172.21.15.111:0/4037457059 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9ec8100840 0x7f9ec806a620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 >> 172.21.15.111:0/4037457059 conn(0x7f9ec80fbff0 msgr2=0x7f9ec8104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 shutdown_connections 2024-09-16T09:48:34.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.087+0000 7f9ecf9e7640 1 -- 172.21.15.111:0/4037457059 wait complete. 2024-09-16T09:48:34.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 -- 172.21.15.111:0/2371555858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 msgr2=0x7f0f10107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 --2- 172.21.15.111:0/2371555858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f10107190 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009880 tx=0x7f0f0402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 -- 172.21.15.111:0/2371555858 shutdown_connections 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 --2- 172.21.15.111:0/2371555858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f10107190 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 --2- 172.21.15.111:0/2371555858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f10102470 0x7f0f10104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 -- 172.21.15.111:0/2371555858 >> 172.21.15.111:0/2371555858 conn(0x7f0f100fc010 msgr2=0x7f0f100fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 -- 172.21.15.111:0/2371555858 shutdown_connections 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.170+0000 7f0f1652b640 1 -- 172.21.15.111:0/2371555858 wait complete. 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f1652b640 1 Processor -- start 2024-09-16T09:48:34.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f1652b640 1 -- start start 2024-09-16T09:48:34.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f1652b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f10102470 0x7f0f10197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f1652b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f101979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f1652b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1010a760 con 0x7f0f10104da0 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f1652b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0f1010a5e0 con 0x7f0f10102470 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f101979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f101979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52180/0 (socket says 172.21.15.111:52180) 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0f7fe640 1 -- 172.21.15.111:0/1452553276 learned_addr learned my addr 172.21.15.111:0/1452553276 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0ffff640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f10102470 0x7f0f10197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0f7fe640 1 -- 172.21.15.111:0/1452553276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f10102470 msgr2=0x7f0f10197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0f7fe640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f10102470 0x7f0f10197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.171+0000 7f0f0f7fe640 1 -- 172.21.15.111:0/1452553276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f10198020 con 0x7f0f10104da0 2024-09-16T09:48:34.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.172+0000 7f0f0f7fe640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f101979a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0f04006010 tx=0x7f0f040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:34.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.172+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f0403f070 con 0x7f0f10104da0 2024-09-16T09:48:34.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.172+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0f040044d0 con 0x7f0f10104da0 2024-09-16T09:48:34.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.172+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1019ca60 con 0x7f0f10104da0 2024-09-16T09:48:34.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.172+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0f04035030 con 0x7f0f10104da0 2024-09-16T09:48:34.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.172+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1019cff0 con 0x7f0f10104da0 2024-09-16T09:48:34.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.173+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f10102850 con 0x7f0f10104da0 2024-09-16T09:48:34.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.174+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7f0f04042070 con 0x7f0f10104da0 2024-09-16T09:48:34.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.174+0000 7f0f0d7fa640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0ef807ad10 0x7f0ef807d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.174+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f0f040bead0 con 0x7f0f10104da0 2024-09-16T09:48:34.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.174+0000 7f0f0ffff640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0ef807ad10 0x7f0ef807d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.174+0000 7f0f0ffff640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0ef807ad10 0x7f0ef807d1d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f00005fd0 tx=0x7f0f00005e20 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:34.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.178+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f0f0408a0a0 con 0x7f0f10104da0 2024-09-16T09:48:34.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.367+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0f1019d2b0 con 0x7f0ef807ad10 2024-09-16T09:48:34.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.377+0000 7f0f0d7fa640 1 -- 172.21.15.111:0/1452553276 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0f1019d2b0 con 0x7f0ef807ad10 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (9m) 19s ago 10m 24.9M - 0.25.0 c8568f914cd2 197c93b2bd85 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (110s) 19s ago 10m 8506k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (101s) 22s ago 9m 8116k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (10m) 19s ago 10m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (9m) 22s ago 9m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:48:34.379 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (8m) 19s ago 10m 79.9M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (5m) 19s ago 5m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (5m) 19s ago 5m 16.7M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (5m) 22s ago 5m 18.2M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (5m) 22s ago 5m 17.9M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (83s) 19s ago 11m 508M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (44s) 22s ago 9m 453M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (11m) 19s ago 11m 59.5M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (9m) 22s ago 9m 46.5M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (31s) 19s ago 10m 8048k - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:48:34.380 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (25s) 22s ago 9m 3225k - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (8m) 19s ago 8m 228M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (8m) 19s ago 8m 246M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (7m) 19s ago 7m 210M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (7m) 22s ago 7m 304M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (6m) 22s ago 6m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (6m) 22s ago 6m 234M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:48:34.381 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 starting - - - - 2024-09-16T09:48:34.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0ef807ad10 msgr2=0x7f0ef807d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0ef807ad10 0x7f0ef807d1d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0f00005fd0 tx=0x7f0f00005e20 comp rx=0 tx=0).stop 2024-09-16T09:48:34.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 msgr2=0x7f0f101979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f101979a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0f04006010 tx=0x7f0f040048f0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 shutdown_connections 2024-09-16T09:48:34.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0ef807ad10 0x7f0ef807d1d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f10104da0 0x7f0f101979a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 --2- 172.21.15.111:0/1452553276 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0f10102470 0x7f0f10197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 >> 172.21.15.111:0/1452553276 conn(0x7f0f100fc010 msgr2=0x7f0f100fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:34.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 shutdown_connections 2024-09-16T09:48:34.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.379+0000 7f0f1652b640 1 -- 172.21.15.111:0/1452553276 wait complete. 2024-09-16T09:48:34.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 -- 172.21.15.111:0/1056039541 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18100840 msgr2=0x7f1a18100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/1056039541 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18100840 0x7f1a18100c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c009880 tx=0x7f1a0c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 -- 172.21.15.111:0/1056039541 shutdown_connections 2024-09-16T09:48:34.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/1056039541 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a18101a40 0x7f1a18101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/1056039541 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18100840 0x7f1a18100c40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 -- 172.21.15.111:0/1056039541 >> 172.21.15.111:0/1056039541 conn(0x7f1a180fbff0 msgr2=0x7f1a180fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:34.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 -- 172.21.15.111:0/1056039541 shutdown_connections 2024-09-16T09:48:34.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.466+0000 7f1a1f00b640 1 -- 172.21.15.111:0/1056039541 wait complete. 2024-09-16T09:48:34.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.467+0000 7f1a1f00b640 1 Processor -- start 2024-09-16T09:48:34.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.467+0000 7f1a1f00b640 1 -- start start 2024-09-16T09:48:34.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.467+0000 7f1a1f00b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a18100840 0x7f1a18197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.467+0000 7f1a1f00b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 0x7f1a18197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.467+0000 7f1a1f00b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1a18109660 con 0x7f1a18101a40 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.467+0000 7f1a1f00b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1a181094e0 con 0x7f1a18100840 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 0x7f1a18197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 0x7f1a18197a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52198/0 (socket says 172.21.15.111:52198) 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 -- 172.21.15.111:0/2398286897 learned_addr learned my addr 172.21.15.111:0/2398286897 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a1cda7640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a18100840 0x7f1a18197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 -- 172.21.15.111:0/2398286897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a18100840 msgr2=0x7f1a18197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a18100840 0x7f1a18197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 -- 172.21.15.111:0/2398286897 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a18198080 con 0x7f1a18101a40 2024-09-16T09:48:34.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a17fff640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 0x7f1a18197a90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c8a0 tx=0x7f1a0400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:34.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a040079b0 con 0x7f1a18101a40 2024-09-16T09:48:34.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.468+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1819caf0 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.469+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a04007b50 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.469+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a04018700 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.469+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1819d050 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.470+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a18100c40 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.470+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7f1a0400f450 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.471+0000 7f1a15ffb640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1a0807ad70 0x7f1a0807d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.471+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f1a0409e050 con 0x7f1a18101a40 2024-09-16T09:48:34.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.471+0000 7f1a1cda7640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1a0807ad70 0x7f1a0807d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.472+0000 7f1a1cda7640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1a0807ad70 0x7f1a0807d230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c000c00 tx=0x7f1a0c004140 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:34.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.476+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f1a04014030 con 0x7f1a18101a40 2024-09-16T09:48:34.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.726+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1a1819d8b0 con 0x7f1a18101a40 2024-09-16T09:48:34.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.727+0000 7f1a15ffb640 1 -- 172.21.15.111:0/2398286897 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f1a040696a0 con 0x7f1a18101a40 2024-09-16T09:48:34.728 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:48:34.729 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:48:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:48:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 12, 2024-09-16T09:48:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:48:34.730 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:48:34.730 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:48:34.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1a0807ad70 msgr2=0x7f1a0807d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1a0807ad70 0x7f1a0807d230 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c000c00 tx=0x7f1a0c004140 comp rx=0 tx=0).stop 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 msgr2=0x7f1a18197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 0x7f1a18197a90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f1a0400c8a0 tx=0x7f1a0400cd60 comp rx=0 tx=0).stop 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 shutdown_connections 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1a0807ad70 0x7f1a0807d230 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a18101a40 0x7f1a18197a90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 --2- 172.21.15.111:0/2398286897 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1a18100840 0x7f1a18197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 >> 172.21.15.111:0/2398286897 conn(0x7f1a180fbff0 msgr2=0x7f1a18069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 shutdown_connections 2024-09-16T09:48:34.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.729+0000 7f1a1f00b640 1 -- 172.21.15.111:0/2398286897 wait complete. 2024-09-16T09:48:34.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 -- 172.21.15.111:0/3639102665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 msgr2=0x7fe478100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/3639102665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478100020 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009880 tx=0x7fe46c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 -- 172.21.15.111:0/3639102665 shutdown_connections 2024-09-16T09:48:34.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/3639102665 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe478102c00 0x7fe478103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/3639102665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478100020 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 -- 172.21.15.111:0/3639102665 >> 172.21.15.111:0/3639102665 conn(0x7fe4780fb770 msgr2=0x7fe4780fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 -- 172.21.15.111:0/3639102665 shutdown_connections 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.813+0000 7fe47f0f4640 1 -- 172.21.15.111:0/3639102665 wait complete. 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47f0f4640 1 Processor -- start 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47f0f4640 1 -- start start 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47f0f4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47f0f4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe478102c00 0x7fe4781979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47f0f4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe47810a780 con 0x7fe4780ffc20 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47f0f4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fe47810a600 con 0x7fe478102c00 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47ce90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47ce90640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52220/0 (socket says 172.21.15.111:52220) 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe47ce90640 1 -- 172.21.15.111:0/904763007 learned_addr learned my addr 172.21.15.111:0/904763007 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.814+0000 7fe477fff640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe478102c00 0x7fe4781979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe47ce90640 1 -- 172.21.15.111:0/904763007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe478102c00 msgr2=0x7fe4781979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe47ce90640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe478102c00 0x7fe4781979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:34.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe47ce90640 1 -- 172.21.15.111:0/904763007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe478197fb0 con 0x7fe4780ffc20 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe47ce90640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478197480 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009230 tx=0x7fe46c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe46c03f070 con 0x7fe4780ffc20 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe46c0044d0 con 0x7fe4780ffc20 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47819c9c0 con 0x7fe4780ffc20 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe46c035030 con 0x7fe4780ffc20 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.815+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47819cec0 con 0x7fe4780ffc20 2024-09-16T09:48:34.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.816+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe478100020 con 0x7fe4780ffc20 2024-09-16T09:48:34.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.817+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 30) ==== 103270+0+0 (secure 0 0 0) 0x7fe46c042070 con 0x7fe4780ffc20 2024-09-16T09:48:34.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.817+0000 7fe475ffb640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe46807ad60 0x7fe46807d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:48:34.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.817+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fe46c0bea60 con 0x7fe4780ffc20 2024-09-16T09:48:34.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.817+0000 7fe477fff640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe46807ad60 0x7fe46807d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:48:34.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.818+0000 7fe477fff640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe46807ad60 0x7fe46807d220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe478198930 tx=0x7fe46400a2d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:48:34.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:34.822+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fe46c08a0b0 con 0x7fe4780ffc20 2024-09-16T09:48:35.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.013+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe478062630 con 0x7fe46807ad60 2024-09-16T09:48:35.016 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:34 smithi111 ceph-mon[27997]: pgmap v35: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:35.016 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:34 smithi111 ceph-mon[27997]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:35.016 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:34 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2398286897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:35.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.015+0000 7fe475ffb640 1 -- 172.21.15.111:0/904763007 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fe478062630 con 0x7fe46807ad60 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:48:35.017 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:48:35.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe46807ad60 msgr2=0x7fe46807d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:35.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe46807ad60 0x7fe46807d220 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe478198930 tx=0x7fe46400a2d0 comp rx=0 tx=0).stop 2024-09-16T09:48:35.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 msgr2=0x7fe478197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478197480 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009230 tx=0x7fe46c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 shutdown_connections 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fe46807ad60 0x7fe46807d220 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fe478102c00 0x7fe4781979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 --2- 172.21.15.111:0/904763007 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe4780ffc20 0x7fe478197480 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 >> 172.21.15.111:0/904763007 conn(0x7fe4780fb770 msgr2=0x7fe478106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 shutdown_connections 2024-09-16T09:48:35.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:48:35.018+0000 7fe47f0f4640 1 -- 172.21.15.111:0/904763007 wait complete. 2024-09-16T09:48:35.129 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:34 smithi114 ceph-mon[35635]: pgmap v35: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:35.129 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:34 smithi114 ceph-mon[35635]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:35.129 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:34 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2398286897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:35.976 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:35 smithi111 ceph-mon[27997]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:35.976 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:35 smithi111 ceph-mon[27997]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:35 smithi114 ceph-mon[35635]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:35 smithi114 ceph-mon[35635]: from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:37.087 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:36 smithi111 ceph-mon[27997]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:37.087 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:36 smithi111 ceph-mon[27997]: pgmap v36: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:36 smithi114 ceph-mon[35635]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:48:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:36 smithi114 ceph-mon[35635]: pgmap v36: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:38 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:38 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:38 smithi111 ceph-mon[27997]: pgmap v37: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:38 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:38 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:38 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:38 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:38 smithi114 ceph-mon[35635]: pgmap v37: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:38 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:38.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:38 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:40.872 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:40 smithi111 ceph-mon[27997]: pgmap v38: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:40 smithi114 ceph-mon[35635]: pgmap v38: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:42.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:42 smithi111 ceph-mon[27997]: pgmap v39: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:42.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:42 smithi114 ceph-mon[35635]: pgmap v39: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:44.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:44.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:44.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:43 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:48:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:44.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:43 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:48:45.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:44 smithi111 ceph-mon[27997]: pgmap v40: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:45.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:44 smithi114 ceph-mon[35635]: pgmap v40: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:45 smithi111 ceph-mon[27997]: Upgrade: Updating alertmanager.smithi111 2024-09-16T09:48:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:45 smithi111 ceph-mon[27997]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-16T09:48:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:45 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:45 smithi114 ceph-mon[35635]: Upgrade: Updating alertmanager.smithi111 2024-09-16T09:48:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:45 smithi114 ceph-mon[35635]: Deploying daemon alertmanager.smithi111 on smithi111 2024-09-16T09:48:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:45 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:48:47.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:46 smithi111 ceph-mon[27997]: pgmap v41: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:46 smithi114 ceph-mon[35635]: pgmap v41: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:48.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:48 smithi111 ceph-mon[27997]: pgmap v42: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:48 smithi114 ceph-mon[35635]: pgmap v42: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:50.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:50 smithi111 ceph-mon[27997]: pgmap v43: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:51.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:50 smithi114 ceph-mon[35635]: pgmap v43: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:52 smithi111 ceph-mon[27997]: pgmap v44: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:52 smithi114 ceph-mon[35635]: pgmap v44: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:54.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:54.652 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:54 smithi111 ceph-mon[27997]: pgmap v45: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:54.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.653 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:54 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:48:54.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:54 smithi114 ceph-mon[35635]: pgmap v45: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:54.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:54.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:54 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:56.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:56 smithi114 ceph-mon[35635]: pgmap v46: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:56.979 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:56 smithi111 ceph-mon[27997]: pgmap v46: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:58.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:58 smithi114 ceph-mon[35635]: pgmap v47: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:58.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:58.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:58 smithi111 ceph-mon[27997]: pgmap v47: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:48:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:48:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:59 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:59 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:48:59 smithi114 ceph-mon[35635]: pgmap v48: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:00.232 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:59 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:00.232 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:59 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:00.232 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:48:59 smithi111 ceph-mon[27997]: pgmap v48: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:00 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:01.301 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:00 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:01 smithi114 ceph-mon[35635]: pgmap v49: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:02.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:01 smithi111 ceph-mon[27997]: pgmap v49: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:03.271 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.272 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.273 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.273 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.273 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.273 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.273 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:03.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:03.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:04.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:03 smithi111 ceph-mon[27997]: mgrmap e31: smithi111.erxodt(active, since 93s), standbys: smithi114.xvotey 2024-09-16T09:49:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:03 smithi111 ceph-mon[27997]: Upgrade: Updating grafana.smithi111 2024-09-16T09:49:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:03 smithi111 ceph-mon[27997]: Deploying daemon grafana.smithi111 on smithi111 2024-09-16T09:49:04.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:03 smithi111 ceph-mon[27997]: pgmap v50: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:03 smithi114 ceph-mon[35635]: mgrmap e31: smithi111.erxodt(active, since 93s), standbys: smithi114.xvotey 2024-09-16T09:49:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:03 smithi114 ceph-mon[35635]: Upgrade: Updating grafana.smithi111 2024-09-16T09:49:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:03 smithi114 ceph-mon[35635]: Deploying daemon grafana.smithi111 on smithi111 2024-09-16T09:49:04.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:03 smithi114 ceph-mon[35635]: pgmap v50: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:05.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3560581213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84101a80 msgr2=0x7f1d84101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3560581213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84101a80 0x7f1d84101f00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1d74009880 tx=0x7f1d7402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3560581213 shutdown_connections 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3560581213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84101a80 0x7f1d84101f00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3560581213 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84100880 0x7f1d84100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3560581213 >> 172.21.15.111:0/3560581213 conn(0x7f1d840fc010 msgr2=0x7f1d840fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3560581213 shutdown_connections 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.101+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3560581213 wait complete. 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8bb02640 1 Processor -- start 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8bb02640 1 -- start start 2024-09-16T09:49:05.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8bb02640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 0x7f1d8406adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8bb02640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84101a80 0x7f1d8419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8bb02640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1d841096c0 con 0x7f1d84100880 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8bb02640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1d84109540 con 0x7f1d84101a80 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 0x7f1d8406adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 0x7f1d8406adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33544/0 (socket says 172.21.15.111:33544) 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 -- 172.21.15.111:0/3448009739 learned_addr learned my addr 172.21.15.111:0/3448009739 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8909d640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84101a80 0x7f1d8419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 -- 172.21.15.111:0/3448009739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84101a80 msgr2=0x7f1d8419c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84101a80 0x7f1d8419c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 -- 172.21.15.111:0/3448009739 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8419c7d0 con 0x7f1d84100880 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8909d640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84101a80 0x7f1d8419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.102+0000 7f1d8989e640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 0x7f1d8406adf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000d8d0 tx=0x7f1d8000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.103+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d80017070 con 0x7f1d84100880 2024-09-16T09:49:05.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.103+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8419cac0 con 0x7f1d84100880 2024-09-16T09:49:05.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.103+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d8000be10 con 0x7f1d84100880 2024-09-16T09:49:05.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.103+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d8000f3c0 con 0x7f1d84100880 2024-09-16T09:49:05.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.103+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8419d050 con 0x7f1d84100880 2024-09-16T09:49:05.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.104+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d84100c80 con 0x7f1d84100880 2024-09-16T09:49:05.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.104+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1d8001a070 con 0x7f1d84100880 2024-09-16T09:49:05.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.105+0000 7f1d7affd640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1d7007abf0 0x7f1d7007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.105+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f1d8009d900 con 0x7f1d84100880 2024-09-16T09:49:05.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.105+0000 7f1d8909d640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1d7007abf0 0x7f1d7007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.105+0000 7f1d8909d640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1d7007abf0 0x7f1d7007d0b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d740096c0 tx=0x7f1d74009650 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.109+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f1d80068fc0 con 0x7f1d84100880 2024-09-16T09:49:05.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.305+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d84106000 con 0x7f1d7007abf0 2024-09-16T09:49:05.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.306+0000 7f1d7affd640 1 -- 172.21.15.111:0/3448009739 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f1d84106000 con 0x7f1d7007abf0 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1d7007abf0 msgr2=0x7f1d7007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1d7007abf0 0x7f1d7007d0b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1d740096c0 tx=0x7f1d74009650 comp rx=0 tx=0).stop 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 msgr2=0x7f1d8406adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 0x7f1d8406adf0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1d8000d8d0 tx=0x7f1d8000dd90 comp rx=0 tx=0).stop 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 shutdown_connections 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1d7007abf0 0x7f1d7007d0b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1d84101a80 0x7f1d8419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 --2- 172.21.15.111:0/3448009739 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d84100880 0x7f1d8406adf0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 >> 172.21.15.111:0/3448009739 conn(0x7f1d840fc010 msgr2=0x7f1d840fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 shutdown_connections 2024-09-16T09:49:05.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.308+0000 7f1d8bb02640 1 -- 172.21.15.111:0/3448009739 wait complete. 2024-09-16T09:49:05.319 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:49:05.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 -- 172.21.15.111:0/276625817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 msgr2=0x7f1574100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 --2- 172.21.15.111:0/276625817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f1574100c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1568009880 tx=0x7f156802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 -- 172.21.15.111:0/276625817 shutdown_connections 2024-09-16T09:49:05.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 --2- 172.21.15.111:0/276625817 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1574101a40 0x7f1574101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 --2- 172.21.15.111:0/276625817 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f1574100c40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 -- 172.21.15.111:0/276625817 >> 172.21.15.111:0/276625817 conn(0x7f15740fbff0 msgr2=0x7f15740fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 -- 172.21.15.111:0/276625817 shutdown_connections 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.391+0000 7f157ab02640 1 -- 172.21.15.111:0/276625817 wait complete. 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157ab02640 1 Processor -- start 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157ab02640 1 -- start start 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157ab02640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f157406a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157ab02640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1574101a40 0x7f157419c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157ab02640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1574109680 con 0x7f1574100840 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157ab02640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1574109500 con 0x7f1574101a40 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157889e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f157406a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157889e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f157406a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33562/0 (socket says 172.21.15.111:33562) 2024-09-16T09:49:05.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f157889e640 1 -- 172.21.15.111:0/846108975 learned_addr learned my addr 172.21.15.111:0/846108975 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:05.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.392+0000 7f1573fff640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1574101a40 0x7f157419c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f157889e640 1 -- 172.21.15.111:0/846108975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1574101a40 msgr2=0x7f157419c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f157889e640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1574101a40 0x7f157419c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f157889e640 1 -- 172.21.15.111:0/846108975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157419c7e0 con 0x7f1574100840 2024-09-16T09:49:05.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f157889e640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f157406a620 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1568006010 tx=0x7f15680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f156803f070 con 0x7f1574100840 2024-09-16T09:49:05.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15680049d0 con 0x7f1574100840 2024-09-16T09:49:05.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157419ca70 con 0x7f1574100840 2024-09-16T09:49:05.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1568035030 con 0x7f1574100840 2024-09-16T09:49:05.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.393+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157419cfa0 con 0x7f1574100840 2024-09-16T09:49:05.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.394+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1574100c40 con 0x7f1574100840 2024-09-16T09:49:05.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.395+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1568042070 con 0x7f1574100840 2024-09-16T09:49:05.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.395+0000 7f1571ffb640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f156407abf0 0x7f156407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.395+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f15680be720 con 0x7f1574100840 2024-09-16T09:49:05.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.395+0000 7f1573fff640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f156407abf0 0x7f156407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.396+0000 7f1573fff640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f156407abf0 0x7f156407d0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f157406a3a0 tx=0x7f1560005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.400+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f1568089e80 con 0x7f1574100840 2024-09-16T09:49:05.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.592+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1574062740 con 0x7f156407abf0 2024-09-16T09:49:05.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.593+0000 7f1571ffb640 1 -- 172.21.15.111:0/846108975 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f1574062740 con 0x7f156407abf0 2024-09-16T09:49:05.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f156407abf0 msgr2=0x7f156407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f156407abf0 0x7f156407d0b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f157406a3a0 tx=0x7f1560005f90 comp rx=0 tx=0).stop 2024-09-16T09:49:05.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 msgr2=0x7f157406a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f157406a620 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1568006010 tx=0x7f15680045e0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 shutdown_connections 2024-09-16T09:49:05.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f156407abf0 0x7f156407d0b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1574101a40 0x7f157419c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 --2- 172.21.15.111:0/846108975 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1574100840 0x7f157406a620 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.595+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 >> 172.21.15.111:0/846108975 conn(0x7f15740fbff0 msgr2=0x7f1574104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.596+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 shutdown_connections 2024-09-16T09:49:05.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.596+0000 7f157ab02640 1 -- 172.21.15.111:0/846108975 wait complete. 2024-09-16T09:49:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 -- 172.21.15.111:0/4175603536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290102b80 msgr2=0x7f7290103000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 --2- 172.21.15.111:0/4175603536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290102b80 0x7f7290103000 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7280009880 tx=0x7f728002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 -- 172.21.15.111:0/4175603536 shutdown_connections 2024-09-16T09:49:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 --2- 172.21.15.111:0/4175603536 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290102b80 0x7f7290103000 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 --2- 172.21.15.111:0/4175603536 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290101980 0x7f7290101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 -- 172.21.15.111:0/4175603536 >> 172.21.15.111:0/4175603536 conn(0x7f72900fd110 msgr2=0x7f72900ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 -- 172.21.15.111:0/4175603536 shutdown_connections 2024-09-16T09:49:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.682+0000 7f729739a640 1 -- 172.21.15.111:0/4175603536 wait complete. 2024-09-16T09:49:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f729739a640 1 Processor -- start 2024-09-16T09:49:05.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f729739a640 1 -- start start 2024-09-16T09:49:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f729739a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 0x7f7290199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f729739a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290102b80 0x7f7290199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f729739a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f729010a7a0 con 0x7f7290101980 2024-09-16T09:49:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f729739a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f729010a620 con 0x7f7290102b80 2024-09-16T09:49:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f7295136640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 0x7f7290199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f7295136640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 0x7f7290199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33580/0 (socket says 172.21.15.111:33580) 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f7295136640 1 -- 172.21.15.111:0/1728517274 learned_addr learned my addr 172.21.15.111:0/1728517274 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.683+0000 7f7294935640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290102b80 0x7f7290199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f7295136640 1 -- 172.21.15.111:0/1728517274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290102b80 msgr2=0x7f7290199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f7295136640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290102b80 0x7f7290199b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f7295136640 1 -- 172.21.15.111:0/1728517274 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f729019a1f0 con 0x7f7290101980 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f7294935640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290102b80 0x7f7290199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f7295136640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 0x7f7290199630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f728c00d6f0 tx=0x7f728c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f728c017070 con 0x7f7290101980 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f728c00de00 con 0x7f7290101980 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f729019ec30 con 0x7f7290101980 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f728c003bc0 con 0x7f7290101980 2024-09-16T09:49:05.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.684+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f729019f190 con 0x7f7290101980 2024-09-16T09:49:05.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.686+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7290101d80 con 0x7f7290101980 2024-09-16T09:49:05.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.687+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f728c009a30 con 0x7f7290101980 2024-09-16T09:49:05.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.687+0000 7f72867fc640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727c07ac40 0x7f727c07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.687+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f728c09d5b0 con 0x7f7290101980 2024-09-16T09:49:05.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.688+0000 7f7294935640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727c07ac40 0x7f727c07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.688+0000 7f7294935640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727c07ac40 0x7f727c07d100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7280000c00 tx=0x7f72800058d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.696+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f728c068e20 con 0x7f7290101980 2024-09-16T09:49:05.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.897+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7290062630 con 0x7f727c07ac40 2024-09-16T09:49:05.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.906+0000 7f72867fc640 1 -- 172.21.15.111:0/1728517274 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f7290062630 con 0x7f727c07ac40 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (13s) 7s ago 10m 16.9M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (2m) 7s ago 11m 8568k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (2m) 53s ago 10m 8116k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (11m) 7s ago 11m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (10m) 53s ago 10m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (9m) 7s ago 10m 79.9M - 9.4.12 2bacad6d85d8 afbe4ac80a2f 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (5m) 7s ago 5m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (5m) 7s ago 5m 17.0M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (5m) 53s ago 5m 18.2M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:49:05.909 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (5m) 53s ago 5m 17.9M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (115s) 7s ago 12m 511M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (76s) 53s ago 10m 453M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (12m) 7s ago 12m 58.6M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (10m) 53s ago 10m 46.5M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (62s) 7s ago 11m 10.0M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (56s) 53s ago 10m 3225k - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (9m) 7s ago 9m 228M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (8m) 7s ago 8m 247M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (8m) 7s ago 8m 210M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (7m) 53s ago 7m 304M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (7m) 53s ago 7m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (6m) 53s ago 6m 234M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:49:05.910 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (34s) 7s ago 10m 44.1M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:49:05.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727c07ac40 msgr2=0x7f727c07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727c07ac40 0x7f727c07d100 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7280000c00 tx=0x7f72800058d0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 msgr2=0x7f7290199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 0x7f7290199630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f728c00d6f0 tx=0x7f728c00dbb0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 shutdown_connections 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727c07ac40 0x7f727c07d100 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7290102b80 0x7f7290199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 --2- 172.21.15.111:0/1728517274 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7290101980 0x7f7290199630 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 >> 172.21.15.111:0/1728517274 conn(0x7f72900fd110 msgr2=0x7f7290103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 shutdown_connections 2024-09-16T09:49:05.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.909+0000 7f729739a640 1 -- 172.21.15.111:0/1728517274 wait complete. 2024-09-16T09:49:05.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 -- 172.21.15.111:0/1827102727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 msgr2=0x7ff56c107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 --2- 172.21.15.111:0/1827102727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c107130 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7ff5600098b0 tx=0x7ff56002a4d0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 -- 172.21.15.111:0/1827102727 shutdown_connections 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 --2- 172.21.15.111:0/1827102727 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c107130 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 --2- 172.21.15.111:0/1827102727 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56c102410 0x7ff56c104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 -- 172.21.15.111:0/1827102727 >> 172.21.15.111:0/1827102727 conn(0x7ff56c0fc010 msgr2=0x7ff56c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 -- 172.21.15.111:0/1827102727 shutdown_connections 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.988+0000 7ff572297640 1 -- 172.21.15.111:0/1827102727 wait complete. 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.989+0000 7ff572297640 1 Processor -- start 2024-09-16T09:49:05.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.989+0000 7ff572297640 1 -- start start 2024-09-16T09:49:05.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.989+0000 7ff572297640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56c102410 0x7ff56c197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.989+0000 7ff572297640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.989+0000 7ff572297640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c10a7b0 con 0x7ff56c104d40 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.989+0000 7ff572297640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff56c10a630 con 0x7ff56c102410 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c197a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33594/0 (socket says 172.21.15.111:33594) 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 -- 172.21.15.111:0/348333916 learned_addr learned my addr 172.21.15.111:0/348333916 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56bfff640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56c102410 0x7ff56c197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 -- 172.21.15.111:0/348333916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56c102410 msgr2=0x7ff56c197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56c102410 0x7ff56c197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 -- 172.21.15.111:0/348333916 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff56c198030 con 0x7ff56c104d40 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff56b7fe640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c197a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff560009230 tx=0x7ff5600048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff56003f070 con 0x7ff56c104d40 2024-09-16T09:49:05.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5600044d0 con 0x7ff56c104d40 2024-09-16T09:49:05.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff56c19ca40 con 0x7ff56c104d40 2024-09-16T09:49:05.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff560035030 con 0x7ff56c104d40 2024-09-16T09:49:05.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.990+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff56c19cf40 con 0x7ff56c104d40 2024-09-16T09:49:05.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.991+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff56c1027f0 con 0x7ff56c104d40 2024-09-16T09:49:05.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.992+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ff560042070 con 0x7ff56c104d40 2024-09-16T09:49:05.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.992+0000 7ff5697fa640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55407abf0 0x7ff55407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:05.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.992+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7ff5600be7f0 con 0x7ff56c104d40 2024-09-16T09:49:05.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.993+0000 7ff56bfff640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55407abf0 0x7ff55407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:05.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.993+0000 7ff56bfff640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55407abf0 0x7ff55407d0b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00abe0 tx=0x7ff55c00a2d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:05.997+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7ff560089f80 con 0x7ff56c104d40 2024-09-16T09:49:06.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.262+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff56c19d3b0 con 0x7ff56c104d40 2024-09-16T09:49:06.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.262+0000 7ff5697fa640 1 -- 172.21.15.111:0/348333916 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7ff56008ee30 con 0x7ff56c104d40 2024-09-16T09:49:06.265 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:49:06.265 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:49:06.265 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 12, 2024-09-16T09:49:06.266 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:49:06.267 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:49:06.267 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:49:06.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.264+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55407abf0 msgr2=0x7ff55407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:06.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.264+0000 7ff572297640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55407abf0 0x7ff55407d0b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00abe0 tx=0x7ff55c00a2d0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.264+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 msgr2=0x7ff56c197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.264+0000 7ff572297640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c197a40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff560009230 tx=0x7ff5600048f0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 shutdown_connections 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff55407abf0 0x7ff55407d0b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff56c104d40 0x7ff56c197a40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 --2- 172.21.15.111:0/348333916 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff56c102410 0x7ff56c197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 >> 172.21.15.111:0/348333916 conn(0x7ff56c0fc010 msgr2=0x7ff56c0fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 shutdown_connections 2024-09-16T09:49:06.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.265+0000 7ff572297640 1 -- 172.21.15.111:0/348333916 wait complete. 2024-09-16T09:49:06.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 -- 172.21.15.111:0/879760100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90101a40 msgr2=0x7fcc90101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:06.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 --2- 172.21.15.111:0/879760100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90101a40 0x7fcc90101ec0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcc80009880 tx=0x7fcc8002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 -- 172.21.15.111:0/879760100 shutdown_connections 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 --2- 172.21.15.111:0/879760100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90101a40 0x7fcc90101ec0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 --2- 172.21.15.111:0/879760100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc90100840 0x7fcc90100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 -- 172.21.15.111:0/879760100 >> 172.21.15.111:0/879760100 conn(0x7fcc900fbff0 msgr2=0x7fcc900fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 -- 172.21.15.111:0/879760100 shutdown_connections 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.352+0000 7fcc98596640 1 -- 172.21.15.111:0/879760100 wait complete. 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc98596640 1 Processor -- start 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc98596640 1 -- start start 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc98596640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 0x7fcc90196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc98596640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc90101a40 0x7fcc901968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:06.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc98596640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcc90109660 con 0x7fcc90100840 2024-09-16T09:49:06.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc98596640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcc901094e0 con 0x7fcc90101a40 2024-09-16T09:49:06.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc96332640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 0x7fcc90196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:06.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc96332640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 0x7fcc90196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33616/0 (socket says 172.21.15.111:33616) 2024-09-16T09:49:06.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc96332640 1 -- 172.21.15.111:0/2274677678 learned_addr learned my addr 172.21.15.111:0/2274677678 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:06.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc95b31640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc90101a40 0x7fcc901968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:06.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc96332640 1 -- 172.21.15.111:0/2274677678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc90101a40 msgr2=0x7fcc901968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc96332640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc90101a40 0x7fcc901968b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.353+0000 7fcc96332640 1 -- 172.21.15.111:0/2274677678 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc90196f30 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.354+0000 7fcc96332640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 0x7fcc90196370 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e940 tx=0x7fcc8c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.354+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc8c00cac0 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.354+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc8c00cc60 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.354+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9019b970 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.354+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc8c003de0 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.354+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9019bf00 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.355+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90100c40 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.356+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fcc8c003fa0 con 0x7fcc90100840 2024-09-16T09:49:06.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.356+0000 7fcc877fe640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcc7c07ac00 0x7fcc7c07d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:06.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.356+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fcc8c09e360 con 0x7fcc90100840 2024-09-16T09:49:06.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.356+0000 7fcc95b31640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcc7c07ac00 0x7fcc7c07d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:06.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.357+0000 7fcc95b31640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcc7c07ac00 0x7fcc7c07d0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc90197820 tx=0x7fcc80009620 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:06.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.361+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fcc8c069b50 con 0x7fcc90100840 2024-09-16T09:49:06.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.584+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcc90062630 con 0x7fcc7c07ac00 2024-09-16T09:49:06.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.586+0000 7fcc877fe640 1 -- 172.21.15.111:0/2274677678 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fcc90062630 con 0x7fcc7c07ac00 2024-09-16T09:49:06.588 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/2 daemons upgraded", 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading grafana daemons", 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:49:06.589 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcc7c07ac00 msgr2=0x7fcc7c07d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcc7c07ac00 0x7fcc7c07d0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcc90197820 tx=0x7fcc80009620 comp rx=0 tx=0).stop 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 msgr2=0x7fcc90196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 0x7fcc90196370 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c00e940 tx=0x7fcc8c00ee00 comp rx=0 tx=0).stop 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 shutdown_connections 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcc7c07ac00 0x7fcc7c07d0c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcc90101a40 0x7fcc901968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 --2- 172.21.15.111:0/2274677678 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcc90100840 0x7fcc90196370 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:06.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.588+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 >> 172.21.15.111:0/2274677678 conn(0x7fcc900fbff0 msgr2=0x7fcc90104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:06.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.589+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 shutdown_connections 2024-09-16T09:49:06.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:06.589+0000 7fcc98596640 1 -- 172.21.15.111:0/2274677678 wait complete. 2024-09-16T09:49:06.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:06 smithi111 ceph-mon[27997]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:06.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:06 smithi111 ceph-mon[27997]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:06.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:06 smithi111 ceph-mon[27997]: pgmap v51: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:06.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:06 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/348333916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:06 smithi114 ceph-mon[35635]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:06 smithi114 ceph-mon[35635]: from='client.14820 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:06 smithi114 ceph-mon[35635]: pgmap v51: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:06 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/348333916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:07 smithi111 ceph-mon[27997]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:07 smithi111 ceph-mon[27997]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:08.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:07 smithi114 ceph-mon[35635]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:08.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:07 smithi114 ceph-mon[35635]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:09.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:08 smithi111 ceph-mon[27997]: pgmap v52: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:08 smithi114 ceph-mon[35635]: pgmap v52: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:10 smithi114 ceph-mon[35635]: pgmap v53: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:11.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:10 smithi111 ceph-mon[27997]: pgmap v53: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:13.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:12 smithi111 ceph-mon[27997]: pgmap v54: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:12 smithi114 ceph-mon[35635]: pgmap v54: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-16T09:49:15.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:14 smithi111 ceph-mon[27997]: pgmap v55: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:14 smithi114 ceph-mon[35635]: pgmap v55: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:15.760 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:15.760 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:15.760 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:15.760 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:15 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:17.130 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:16 smithi111 ceph-mon[27997]: pgmap v56: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:17.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:16 smithi114 ceph-mon[35635]: pgmap v56: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:19.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:18 smithi111 ceph-mon[27997]: pgmap v57: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:18 smithi114 ceph-mon[35635]: pgmap v57: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:21.008 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:20 smithi114 ceph-mon[35635]: pgmap v58: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:21.008 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:20 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.008 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:20 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.008 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:20 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.008 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:20 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.117 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:20 smithi111 ceph-mon[27997]: pgmap v58: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:21.117 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:20 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.117 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:20 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.117 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:20 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:21.117 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:20 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:22.878 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:22 smithi111 ceph-mon[27997]: pgmap v59: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:22 smithi114 ceph-mon[35635]: pgmap v59: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: pgmap v60: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T09:49:25.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T09:49:25.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:25.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:25.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:25.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:25.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:25.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:24 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: pgmap v60: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-16T09:49:25.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-16T09:49:25.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:25.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:24 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:26.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:25 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:49:26.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:25 smithi111 ceph-mon[27997]: Upgrade: Finalizing container_image settings 2024-09-16T09:49:26.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:25 smithi111 ceph-mon[27997]: Upgrade: Complete! 2024-09-16T09:49:26.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:25 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:25 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-16T09:49:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:25 smithi114 ceph-mon[35635]: Upgrade: Finalizing container_image settings 2024-09-16T09:49:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:25 smithi114 ceph-mon[35635]: Upgrade: Complete! 2024-09-16T09:49:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:25 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:27.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:26 smithi111 ceph-mon[27997]: pgmap v61: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:26 smithi114 ceph-mon[35635]: pgmap v61: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:29.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:28 smithi111 ceph-mon[27997]: pgmap v62: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:28 smithi114 ceph-mon[35635]: pgmap v62: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:30 smithi111 ceph-mon[27997]: pgmap v63: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:30 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:30 smithi114 ceph-mon[35635]: pgmap v63: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:30 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:32 smithi111 ceph-mon[27997]: pgmap v64: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:32 smithi114 ceph-mon[35635]: pgmap v64: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:34 smithi111 ceph-mon[27997]: pgmap v65: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:34 smithi114 ceph-mon[35635]: pgmap v65: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:36.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 -- 172.21.15.111:0/88299436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 msgr2=0x7f6c940750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:36.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/88299436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c940750b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009880 tx=0x7f6c7c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 -- 172.21.15.111:0/88299436 shutdown_connections 2024-09-16T09:49:36.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/88299436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c940750b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/88299436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94076220 0x7f6c94074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 -- 172.21.15.111:0/88299436 >> 172.21.15.111:0/88299436 conn(0x7f6c940fd0f0 msgr2=0x7f6c940ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 -- 172.21.15.111:0/88299436 shutdown_connections 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.685+0000 7f6c98a9e640 1 -- 172.21.15.111:0/88299436 wait complete. 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c98a9e640 1 Processor -- start 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c98a9e640 1 -- start start 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c98a9e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c94199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c98a9e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94076220 0x7f6c94199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c98a9e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9410c9a0 con 0x7f6c94074c50 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c98a9e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9410c820 con 0x7f6c94076220 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c9259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c94199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:36.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c9259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c94199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52752/0 (socket says 172.21.15.111:52752) 2024-09-16T09:49:36.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c9259c640 1 -- 172.21.15.111:0/2598337553 learned_addr learned my addr 172.21.15.111:0/2598337553 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:36.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c8bfff640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94076220 0x7f6c94199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:36.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c9259c640 1 -- 172.21.15.111:0/2598337553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94076220 msgr2=0x7f6c94199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:36.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.686+0000 7f6c9259c640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94076220 0x7f6c94199bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c9259c640 1 -- 172.21.15.111:0/2598337553 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9419a1c0 con 0x7f6c94074c50 2024-09-16T09:49:36.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c9259c640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c94199690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c8f0 tx=0x7f6c8400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:36.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c84014070 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6c84007c60 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c9419ec30 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6c84003c30 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.687+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c9419f190 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.688+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c940750b0 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.689+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f6c84017070 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.689+0000 7f6c8b7fe640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6c8007abf0 0x7f6c8007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.689+0000 7f6c8bfff640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6c8007abf0 0x7f6c8007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.689+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f6c8409d960 con 0x7f6c94074c50 2024-09-16T09:49:36.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.690+0000 7f6c8bfff640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6c8007abf0 0x7f6c8007d0b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c9419ab40 tx=0x7f6c7c005a20 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:36.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.694+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f6c84069150 con 0x7f6c94074c50 2024-09-16T09:49:36.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.887+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6c94108a90 con 0x7f6c8007abf0 2024-09-16T09:49:36.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.888+0000 7f6c8b7fe640 1 -- 172.21.15.111:0/2598337553 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f6c94108a90 con 0x7f6c8007abf0 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6c8007abf0 msgr2=0x7f6c8007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6c8007abf0 0x7f6c8007d0b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6c9419ab40 tx=0x7f6c7c005a20 comp rx=0 tx=0).stop 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 msgr2=0x7f6c94199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c94199690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400c8f0 tx=0x7f6c8400cdb0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 shutdown_connections 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6c8007abf0 0x7f6c8007d0b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6c94076220 0x7f6c94199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 --2- 172.21.15.111:0/2598337553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c94074c50 0x7f6c94199690 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 >> 172.21.15.111:0/2598337553 conn(0x7f6c940fd0f0 msgr2=0x7f6c940ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 shutdown_connections 2024-09-16T09:49:36.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:36.890+0000 7f6c98a9e640 1 -- 172.21.15.111:0/2598337553 wait complete. 2024-09-16T09:49:37.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:36 smithi111 ceph-mon[27997]: pgmap v66: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:36 smithi114 ceph-mon[35635]: pgmap v66: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:37.697 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-16T09:49:37.948 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:38.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.393+0000 7f57fd5da640 1 -- 172.21.15.111:0/714265808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8102b70 msgr2=0x7f57f8102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.393+0000 7f57fd5da640 1 --2- 172.21.15.111:0/714265808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8102b70 0x7f57f8102f50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009880 tx=0x7f57e802a530 comp rx=0 tx=0).stop 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 -- 172.21.15.111:0/714265808 shutdown_connections 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 --2- 172.21.15.111:0/714265808 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8103490 0x7f57f810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 --2- 172.21.15.111:0/714265808 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8102b70 0x7f57f8102f50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 -- 172.21.15.111:0/714265808 >> 172.21.15.111:0/714265808 conn(0x7f57f80fc510 msgr2=0x7f57f80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 -- 172.21.15.111:0/714265808 shutdown_connections 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 -- 172.21.15.111:0/714265808 wait complete. 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 Processor -- start 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.394+0000 7f57fd5da640 1 -- start start 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57fd5da640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8102b70 0x7f57f81007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57fd5da640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 0x7f57f8100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:38.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57fd5da640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f57f810ee60 con 0x7f57f8103490 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57fd5da640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f57f810ece0 con 0x7f57f8102b70 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 0x7f57f8100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 0x7f57f8100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52778/0 (socket says 172.21.15.111:52778) 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 -- 172.21.15.111:0/2595683096 learned_addr learned my addr 172.21.15.111:0/2595683096 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 -- 172.21.15.111:0/2595683096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8102b70 msgr2=0x7f57f81007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f6ffd640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8102b70 0x7f57f81007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8102b70 0x7f57f81007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 -- 172.21.15.111:0/2595683096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f8101250 con 0x7f57f8103490 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f6ffd640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8102b70 0x7f57f81007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57f67fc640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 0x7f57f8100d10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00b420 tx=0x7f57ec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57ec011630 con 0x7f57f8103490 2024-09-16T09:49:38.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57ec016070 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57ec010d40 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f8101540 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.395+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f81a3eb0 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.397+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f806ab90 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.397+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f57ec01b460 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.398+0000 7f57dffff640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f57e007ac40 0x7f57e007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.398+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f57ec09d250 con 0x7f57f8103490 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.398+0000 7f57f6ffd640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f57e007ac40 0x7f57e007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.398+0000 7f57f6ffd640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f57e007ac40 0x7f57e007d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57e8006010 tx=0x7f57e80095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:38.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.402+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f57ec021250 con 0x7f57f8103490 2024-09-16T09:49:38.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.646+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f57f8105fd0 con 0x7f57f8103490 2024-09-16T09:49:38.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.647+0000 7f57dffff640 1 -- 172.21.15.111:0/2595683096 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f57ec068ac0 con 0x7f57f8103490 2024-09-16T09:49:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f57e007ac40 msgr2=0x7f57e007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f57e007ac40 0x7f57e007d100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f57e8006010 tx=0x7f57e80095f0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 msgr2=0x7f57f8100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 0x7f57f8100d10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f57ec00b420 tx=0x7f57ec00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 shutdown_connections 2024-09-16T09:49:38.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f57e007ac40 0x7f57e007d100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57f8103490 0x7f57f8100d10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 --2- 172.21.15.111:0/2595683096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f57f8102b70 0x7f57f81007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 >> 172.21.15.111:0/2595683096 conn(0x7f57f80fc510 msgr2=0x7f57f8108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 shutdown_connections 2024-09-16T09:49:38.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:38.649+0000 7f57fd5da640 1 -- 172.21.15.111:0/2595683096 wait complete. 2024-09-16T09:49:38.660 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:49:38.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:38 smithi111 ceph-mon[27997]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:38.978 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:38 smithi111 ceph-mon[27997]: pgmap v67: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:38.978 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:38 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2595683096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:38 smithi114 ceph-mon[35635]: from='client.14836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:38 smithi114 ceph-mon[35635]: pgmap v67: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:38 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2595683096' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:39.298 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-16T09:49:39.548 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:40.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 -- 172.21.15.111:0/1631739672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 msgr2=0x7fc80c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:40.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 --2- 172.21.15.111:0/1631739672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c106c00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc804009c20 tx=0x7fc80402a970 comp rx=0 tx=0).stop 2024-09-16T09:49:40.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 -- 172.21.15.111:0/1631739672 shutdown_connections 2024-09-16T09:49:40.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 --2- 172.21.15.111:0/1631739672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc80c100820 0x7fc80c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 --2- 172.21.15.111:0/1631739672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c106c00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 -- 172.21.15.111:0/1631739672 >> 172.21.15.111:0/1631739672 conn(0x7fc80c0fc520 msgr2=0x7fc80c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 -- 172.21.15.111:0/1631739672 shutdown_connections 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.018+0000 7fc8145a6640 1 -- 172.21.15.111:0/1631739672 wait complete. 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc8145a6640 1 Processor -- start 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc8145a6640 1 -- start start 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc8145a6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc80c100820 0x7fc80c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc8145a6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc8145a6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c10dcd0 con 0x7fc80c106820 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc8145a6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc80c10db50 con 0x7fc80c100820 2024-09-16T09:49:40.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc811b41640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc811b41640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52782/0 (socket says 172.21.15.111:52782) 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc811b41640 1 -- 172.21.15.111:0/2862943320 learned_addr learned my addr 172.21.15.111:0/2862943320 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc811b41640 1 -- 172.21.15.111:0/2862943320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc80c100820 msgr2=0x7fc80c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.019+0000 7fc812342640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc80c100820 0x7fc80c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc811b41640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc80c100820 0x7fc80c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc811b41640 1 -- 172.21.15.111:0/2862943320 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80c199290 con 0x7fc80c106820 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc811b41640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c198d20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00c8a0 tx=0x7fc7fc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7fc0079b0 con 0x7fc80c106820 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc7fc007b50 con 0x7fc80c106820 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc80c199580 con 0x7fc80c106820 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc7fc018700 con 0x7fc80c106820 2024-09-16T09:49:40.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.020+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc80c1a1b80 con 0x7fc80c106820 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.021+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc80c101f60 con 0x7fc80c106820 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.021+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fc7fc007d00 con 0x7fc80c106820 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.022+0000 7fc8037fe640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc7f807abf0 0x7fc7f807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.022+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fc7fc09dea0 con 0x7fc80c106820 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.022+0000 7fc812342640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc7f807abf0 0x7fc7f807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.022+0000 7fc812342640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc7f807abf0 0x7fc7f807d0b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc804006010 tx=0x7fc804009380 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:40.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.026+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fc7fc014030 con 0x7fc80c106820 2024-09-16T09:49:40.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.268+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc80c103a30 con 0x7fc80c106820 2024-09-16T09:49:40.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.269+0000 7fc8037fe640 1 -- 172.21.15.111:0/2862943320 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc7fc069690 con 0x7fc80c106820 2024-09-16T09:49:40.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc7f807abf0 msgr2=0x7fc7f807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:40.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc7f807abf0 0x7fc7f807d0b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc804006010 tx=0x7fc804009380 comp rx=0 tx=0).stop 2024-09-16T09:49:40.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 msgr2=0x7fc80c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c198d20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00c8a0 tx=0x7fc7fc00cd60 comp rx=0 tx=0).stop 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 shutdown_connections 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc7f807abf0 0x7fc7f807d0b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc80c106820 0x7fc80c198d20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 --2- 172.21.15.111:0/2862943320 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc80c100820 0x7fc80c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 >> 172.21.15.111:0/2862943320 conn(0x7fc80c0fc520 msgr2=0x7fc80c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 shutdown_connections 2024-09-16T09:49:40.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:40.272+0000 7fc8145a6640 1 -- 172.21.15.111:0/2862943320 wait complete. 2024-09-16T09:49:40.282 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)" 2024-09-16T09:49:40.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:40 smithi111 ceph-mon[27997]: pgmap v68: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:40.978 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:40 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2862943320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:41.007 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-16T09:49:41.140 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:40 smithi114 ceph-mon[35635]: pgmap v68: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:41.140 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:40 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2862943320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:41.257 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:41.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 -- 172.21.15.111:0/2757652343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30107910 msgr2=0x7f9d30107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:41.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 --2- 172.21.15.111:0/2757652343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30107910 0x7f9d30107cf0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d20009880 tx=0x7f9d2002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 -- 172.21.15.111:0/2757652343 shutdown_connections 2024-09-16T09:49:41.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 --2- 172.21.15.111:0/2757652343 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30101910 0x7f9d30101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 --2- 172.21.15.111:0/2757652343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30107910 0x7f9d30107cf0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 -- 172.21.15.111:0/2757652343 >> 172.21.15.111:0/2757652343 conn(0x7f9d300fd5f0 msgr2=0x7f9d300ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:41.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 -- 172.21.15.111:0/2757652343 shutdown_connections 2024-09-16T09:49:41.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.683+0000 7f9d34994640 1 -- 172.21.15.111:0/2757652343 wait complete. 2024-09-16T09:49:41.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d34994640 1 Processor -- start 2024-09-16T09:49:41.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d34994640 1 -- start start 2024-09-16T09:49:41.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d34994640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 0x7f9d300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:41.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d34994640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30107910 0x7f9d30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d34994640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3010ee40 con 0x7f9d30101910 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d34994640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3010ecc0 con 0x7f9d30107910 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d2e59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 0x7f9d300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d2e59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 0x7f9d300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52796/0 (socket says 172.21.15.111:52796) 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.684+0000 7f9d2e59c640 1 -- 172.21.15.111:0/1314093944 learned_addr learned my addr 172.21.15.111:0/1314093944 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d25d9b640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30107910 0x7f9d30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d2e59c640 1 -- 172.21.15.111:0/1314093944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30107910 msgr2=0x7f9d30074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d2e59c640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30107910 0x7f9d30074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d2e59c640 1 -- 172.21.15.111:0/1314093944 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d30074f70 con 0x7f9d30101910 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d25d9b640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30107910 0x7f9d30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d2e59c640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 0x7f9d300744f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d20031460 tx=0x7f9d200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:41.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d2003f070 con 0x7f9d30101910 2024-09-16T09:49:41.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d20004cf0 con 0x7f9d30101910 2024-09-16T09:49:41.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d30075200 con 0x7f9d30101910 2024-09-16T09:49:41.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d20035030 con 0x7f9d30101910 2024-09-16T09:49:41.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.685+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d301a3df0 con 0x7f9d30101910 2024-09-16T09:49:41.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.686+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d30103050 con 0x7f9d30101910 2024-09-16T09:49:41.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.687+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f9d20042070 con 0x7f9d30101910 2024-09-16T09:49:41.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.687+0000 7f9d27fff640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9d1c07abf0 0x7f9d1c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:41.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.688+0000 7f9d25d9b640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9d1c07abf0 0x7f9d1c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:41.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.688+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f9d200be700 con 0x7f9d30101910 2024-09-16T09:49:41.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.688+0000 7f9d25d9b640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9d1c07abf0 0x7f9d1c07d0b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006fd0 tx=0x7f9d18008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:41.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.693+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f9d20089ef0 con 0x7f9d30101910 2024-09-16T09:49:41.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.933+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9d30109e80 con 0x7f9d30101910 2024-09-16T09:49:41.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.934+0000 7f9d27fff640 1 -- 172.21.15.111:0/1314093944 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f9d2008eda0 con 0x7f9d30101910 2024-09-16T09:49:41.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9d1c07abf0 msgr2=0x7f9d1c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:41.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9d1c07abf0 0x7f9d1c07d0b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9d18006fd0 tx=0x7f9d18008040 comp rx=0 tx=0).stop 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 msgr2=0x7f9d300744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 0x7f9d300744f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d20031460 tx=0x7f9d200048f0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 shutdown_connections 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9d1c07abf0 0x7f9d1c07d0b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9d30107910 0x7f9d30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 --2- 172.21.15.111:0/1314093944 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d30101910 0x7f9d300744f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 >> 172.21.15.111:0/1314093944 conn(0x7f9d300fd5f0 msgr2=0x7f9d300fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 shutdown_connections 2024-09-16T09:49:41.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:41.936+0000 7f9d34994640 1 -- 172.21.15.111:0/1314093944 wait complete. 2024-09-16T09:49:41.947 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:49:42.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:42 smithi111 ceph-mon[27997]: pgmap v69: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:42.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:42 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1314093944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:43.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:42 smithi114 ceph-mon[35635]: pgmap v69: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:43.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:42 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1314093944' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:49:45.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:44 smithi111 ceph-mon[27997]: pgmap v70: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:45.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:44 smithi114 ceph-mon[35635]: pgmap v70: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:46.097 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:45 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:46.133 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-16T09:49:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:45 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:49:46.390 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 -- 172.21.15.111:0/3785929311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c103400 msgr2=0x7f5c5c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 --2- 172.21.15.111:0/3785929311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c103400 0x7f5c5c10b8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c009880 tx=0x7f5c4c02a540 comp rx=0 tx=0).stop 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 -- 172.21.15.111:0/3785929311 shutdown_connections 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 --2- 172.21.15.111:0/3785929311 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c103400 0x7f5c5c10b8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 --2- 172.21.15.111:0/3785929311 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 -- 172.21.15.111:0/3785929311 >> 172.21.15.111:0/3785929311 conn(0x7f5c5c0fc520 msgr2=0x7f5c5c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 -- 172.21.15.111:0/3785929311 shutdown_connections 2024-09-16T09:49:46.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.815+0000 7f5c640f7640 1 -- 172.21.15.111:0/3785929311 wait complete. 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c640f7640 1 Processor -- start 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c640f7640 1 -- start start 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c640f7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c640f7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c103400 0x7f5c5c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c640f7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c10ee70 con 0x7f5c5c102ae0 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c640f7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5c10ecf0 con 0x7f5c5c103400 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c61e93640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c61e93640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36002/0 (socket says 172.21.15.111:36002) 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c61e93640 1 -- 172.21.15.111:0/1671840272 learned_addr learned my addr 172.21.15.111:0/1671840272 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.816+0000 7f5c61692640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c103400 0x7f5c5c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c61e93640 1 -- 172.21.15.111:0/1671840272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c103400 msgr2=0x7f5c5c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c61e93640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c103400 0x7f5c5c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c61e93640 1 -- 172.21.15.111:0/1671840272 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c5c197880 con 0x7f5c5c102ae0 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c61692640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c103400 0x7f5c5c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c61e93640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c19d6c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b420 tx=0x7f5c5800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c58011630 con 0x7f5c5c102ae0 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5c197b70 con 0x7f5c5c102ae0 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c58016070 con 0x7f5c5c102ae0 2024-09-16T09:49:46.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c58010d40 con 0x7f5c5c102ae0 2024-09-16T09:49:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.817+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5c198100 con 0x7f5c5c102ae0 2024-09-16T09:49:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.818+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5c06abe0 con 0x7f5c5c102ae0 2024-09-16T09:49:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.819+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f5c5801b460 con 0x7f5c5c102ae0 2024-09-16T09:49:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.819+0000 7f5c52ffd640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5c4807abf0 0x7f5c4807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.819+0000 7f5c61692640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5c4807abf0 0x7f5c4807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.820+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f5c5809d2d0 con 0x7f5c5c102ae0 2024-09-16T09:49:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.820+0000 7f5c61692640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5c4807abf0 0x7f5c4807d0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c031460 tx=0x7f5c4c0095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:46.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:46.824+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f5c58021250 con 0x7f5c5c102ae0 2024-09-16T09:49:47.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:47.022+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "target": ["mon-mgr", ""]}) -- 0x7f5c5c198db0 con 0x7f5c4807abf0 2024-09-16T09:49:47.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:46 smithi111 ceph-mon[27997]: pgmap v71: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:46 smithi114 ceph-mon[35635]: pgmap v71: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:48.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.950+0000 7f5c52ffd640 1 -- 172.21.15.111:0/1671840272 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f5c5c198db0 con 0x7f5c4807abf0 2024-09-16T09:49:48.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5c4807abf0 msgr2=0x7f5c4807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:48.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5c4807abf0 0x7f5c4807d0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5c4c031460 tx=0x7f5c4c0095f0 comp rx=0 tx=0).stop 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 msgr2=0x7f5c5c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c19d6c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800b420 tx=0x7f5c5800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 shutdown_connections 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5c4807abf0 0x7f5c4807d0b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5c5c103400 0x7f5c5c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 --2- 172.21.15.111:0/1671840272 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5c5c102ae0 0x7f5c5c19d6c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 >> 172.21.15.111:0/1671840272 conn(0x7f5c5c0fc520 msgr2=0x7f5c5c108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 shutdown_connections 2024-09-16T09:49:48.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:48.953+0000 7f5c640f7640 1 -- 172.21.15.111:0/1671840272 wait complete. 2024-09-16T09:49:48.964 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:49:49.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:48 smithi111 ceph-mon[27997]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:48 smithi111 ceph-mon[27997]: pgmap v72: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:48 smithi114 ceph-mon[35635]: from='client.14852 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:48 smithi114 ceph-mon[35635]: pgmap v72: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:49.603 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch ps' 2024-09-16T09:49:49.853 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:50.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.263+0000 7f3a6fe78640 1 -- 172.21.15.111:0/683382472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 msgr2=0x7f3a68107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.263+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/683382472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68107d10 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3a64009880 tx=0x7f3a6402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.263+0000 7f3a6fe78640 1 -- 172.21.15.111:0/683382472 shutdown_connections 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.263+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/683382472 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a68101930 0x7f3a68101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.263+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/683382472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68107d10 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.263+0000 7f3a6fe78640 1 -- 172.21.15.111:0/683382472 >> 172.21.15.111:0/683382472 conn(0x7f3a680fd630 msgr2=0x7f3a680ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 -- 172.21.15.111:0/683382472 shutdown_connections 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 -- 172.21.15.111:0/683382472 wait complete. 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 Processor -- start 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 -- start start 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a68101930 0x7f3a680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:50.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810ee00 con 0x7f3a68107930 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.264+0000 7f3a6fe78640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810ec80 con 0x7f3a68101930 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36024/0 (socket says 172.21.15.111:36024) 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 -- 172.21.15.111:0/2442870838 learned_addr learned my addr 172.21.15.111:0/2442870838 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6dc14640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a68101930 0x7f3a680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 -- 172.21.15.111:0/2442870838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a68101930 msgr2=0x7f3a680744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a68101930 0x7f3a680744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 -- 172.21.15.111:0/2442870838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a68074f70 con 0x7f3a68107930 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6d413640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68074a30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800d6f0 tx=0x7f3a5800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:50.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a58017070 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a5800de00 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a68075260 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a58004bb0 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.265+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681a3e70 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.266+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a68103070 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.267+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f3a58004e60 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.267+0000 7f3a5effd640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3a5407abf0 0x7f3a5407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.267+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f3a5809d8a0 con 0x7f3a68107930 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.267+0000 7f3a6dc14640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3a5407abf0 0x7f3a5407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.268+0000 7f3a6dc14640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3a5407abf0 0x7f3a5407d0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3a640096c0 tx=0x7f3a64031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:50.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.272+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f3a58068ff0 con 0x7f3a68107930 2024-09-16T09:49:50.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.457+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3a68062630 con 0x7f3a5407abf0 2024-09-16T09:49:50.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.467+0000 7f3a5effd640 1 -- 172.21.15.111:0/2442870838 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f3a68062630 con 0x7f3a5407abf0 2024-09-16T09:49:50.469 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (57s) 30s ago 11m 19.0M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (3m) 30s ago 11m 8594k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (2m) 98s ago 11m 8116k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (11m) 30s ago 11m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (11m) 98s ago 11m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (35s) 30s ago 11m 42.0M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (6m) 30s ago 6m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (6m) 30s ago 6m 17.2M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (6m) 98s ago 6m 18.2M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (6m) 98s ago 6m 17.9M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (2m) 30s ago 12m 519M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:49:50.470 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (2m) 98s ago 10m 453M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (13m) 30s ago 13m 59.6M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (10m) 98s ago 10m 46.5M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (107s) 30s ago 11m 12.2M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (101s) 98s ago 10m 3225k - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (9m) 30s ago 9m 228M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (9m) 30s ago 9m 248M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (8m) 30s ago 8m 211M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (8m) 98s ago 8m 304M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (7m) 98s ago 7m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (7m) 98s ago 7m 234M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:49:50.471 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (78s) 30s ago 11m 45.9M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:49:50.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3a5407abf0 msgr2=0x7f3a5407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:50.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3a5407abf0 0x7f3a5407d0b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3a640096c0 tx=0x7f3a64031400 comp rx=0 tx=0).stop 2024-09-16T09:49:50.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 msgr2=0x7f3a68074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:50.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68074a30 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800d6f0 tx=0x7f3a5800dbb0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 shutdown_connections 2024-09-16T09:49:50.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3a5407abf0 0x7f3a5407d0b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a68107930 0x7f3a68074a30 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 --2- 172.21.15.111:0/2442870838 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3a68101930 0x7f3a680744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:50.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 >> 172.21.15.111:0/2442870838 conn(0x7f3a680fd630 msgr2=0x7f3a680fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:50.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 shutdown_connections 2024-09-16T09:49:50.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:50.469+0000 7f3a6fe78640 1 -- 172.21.15.111:0/2442870838 wait complete. 2024-09-16T09:49:51.082 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:50 smithi111 ceph-mon[27997]: pgmap v73: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:51.111 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T09:49:51.111 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:49:51.112 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-16T09:49:51.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:50 smithi114 ceph-mon[35635]: pgmap v73: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:51.362 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 -- 172.21.15.111:0/695371787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910100820 msgr2=0x7f4910100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 --2- 172.21.15.111:0/695371787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910100820 0x7f4910100c80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4900009880 tx=0x7f490002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 -- 172.21.15.111:0/695371787 shutdown_connections 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 --2- 172.21.15.111:0/695371787 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910100820 0x7f4910100c80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 --2- 172.21.15.111:0/695371787 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4910106820 0x7f4910106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 -- 172.21.15.111:0/695371787 >> 172.21.15.111:0/695371787 conn(0x7f49100fc520 msgr2=0x7f49100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 -- 172.21.15.111:0/695371787 shutdown_connections 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.881+0000 7f49174cd640 1 -- 172.21.15.111:0/695371787 wait complete. 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 Processor -- start 2024-09-16T09:49:51.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 -- start start 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4910100820 0x7f491019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 0x7f491019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f491010dd50 con 0x7f4910106820 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f491010dbd0 con 0x7f4910100820 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 0x7f491019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 0x7f491019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36052/0 (socket says 172.21.15.111:36052) 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 -- 172.21.15.111:0/2446946443 learned_addr learned my addr 172.21.15.111:0/2446946443 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4915269640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4910100820 0x7f491019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 -- 172.21.15.111:0/2446946443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4910100820 msgr2=0x7f491019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4910100820 0x7f491019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 -- 172.21.15.111:0/2446946443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4910197840 con 0x7f4910106820 2024-09-16T09:49:51.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f4914a68640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 0x7f491019dc00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4900031460 tx=0x7f49000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f490003f070 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4900004cf0 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4910197ad0 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.882+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4900035030 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.883+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4910198000 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.884+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4910101f60 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.884+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f4900042070 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.885+0000 7f49067fc640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f48fc07ac40 0x7f48fc07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.885+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f49000be5e0 con 0x7f4910106820 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.885+0000 7f4915269640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f48fc07ac40 0x7f48fc07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.885+0000 7f4915269640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f48fc07ac40 0x7f48fc07d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f490c009890 tx=0x7f490c008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:51.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:51.889+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f4900089e50 con 0x7f4910106820 2024-09-16T09:49:52.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.066+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f4910109dc0 con 0x7f4910106820 2024-09-16T09:49:52.069 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:51 smithi111 ceph-mon[27997]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:52.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.072+0000 7f49067fc640 1 -- 172.21.15.111:0/2446946443 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v65)=0 v65) ==== 125+0+0 (secure 0 0 0) 0x7f490008ed00 con 0x7f4910106820 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f48fc07ac40 msgr2=0x7f48fc07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f48fc07ac40 0x7f48fc07d100 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f490c009890 tx=0x7f490c008040 comp rx=0 tx=0).stop 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 msgr2=0x7f491019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 0x7f491019dc00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4900031460 tx=0x7f49000048f0 comp rx=0 tx=0).stop 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 shutdown_connections 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f48fc07ac40 0x7f48fc07d100 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4910106820 0x7f491019dc00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 --2- 172.21.15.111:0/2446946443 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4910100820 0x7f491019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:52.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 >> 172.21.15.111:0/2446946443 conn(0x7f49100fc520 msgr2=0x7f491006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:52.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 shutdown_connections 2024-09-16T09:49:52.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:52.074+0000 7f49174cd640 1 -- 172.21.15.111:0/2446946443 wait complete. 2024-09-16T09:49:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:51 smithi114 ceph-mon[35635]: from='client.14856 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:49:52.668 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T09:49:52.669 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:49:52.669 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-16T09:49:52.923 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:53.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: pgmap v74: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:53.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/2446946443' entity='client.admin' 2024-09-16T09:49:53.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:53.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:53.043 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:53.043 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:53.043 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:52 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:49:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: pgmap v74: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/2446946443' entity='client.admin' 2024-09-16T09:49:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:53.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:53.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:52 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:49:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 -- 172.21.15.111:0/569676772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200107930 msgr2=0x7f3200107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 --2- 172.21.15.111:0/569676772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200107930 0x7f3200107d10 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31f0009880 tx=0x7f31f002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 -- 172.21.15.111:0/569676772 shutdown_connections 2024-09-16T09:49:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 --2- 172.21.15.111:0/569676772 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3200101930 0x7f3200101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 --2- 172.21.15.111:0/569676772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200107930 0x7f3200107d10 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 -- 172.21.15.111:0/569676772 >> 172.21.15.111:0/569676772 conn(0x7f32000fd630 msgr2=0x7f32000ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 -- 172.21.15.111:0/569676772 shutdown_connections 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.385+0000 7f320655c640 1 -- 172.21.15.111:0/569676772 wait complete. 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f320655c640 1 Processor -- start 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f320655c640 1 -- start start 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f320655c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 0x7f320019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f320655c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3200107930 0x7f320019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f320655c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f320010ede0 con 0x7f3200101930 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f320655c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f320010ec60 con 0x7f3200107930 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f31fffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 0x7f320019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f31fffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 0x7f320019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41990/0 (socket says 172.21.15.111:41990) 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.386+0000 7f31fffff640 1 -- 172.21.15.111:0/2262671630 learned_addr learned my addr 172.21.15.111:0/2262671630 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:53.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fffff640 1 -- 172.21.15.111:0/2262671630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3200107930 msgr2=0x7f320019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:53.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fffff640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3200107930 0x7f320019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fffff640 1 -- 172.21.15.111:0/2262671630 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32001977d0 con 0x7f3200101930 2024-09-16T09:49:53.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fffff640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 0x7f320019d650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f31f0031460 tx=0x7f31f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31f003f070 con 0x7f3200101930 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31f0004cf0 con 0x7f3200101930 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3200197a60 con 0x7f3200101930 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f31f0035030 con 0x7f3200101930 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.387+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3200197f90 con 0x7f3200101930 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.388+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3200103070 con 0x7f3200101930 2024-09-16T09:49:53.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.389+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f31f0042070 con 0x7f3200101930 2024-09-16T09:49:53.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.389+0000 7f31fd7fa640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f31e807abf0 0x7f31e807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:53.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.389+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f31f00be600 con 0x7f3200101930 2024-09-16T09:49:53.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.389+0000 7f31ff7fe640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f31e807abf0 0x7f31e807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:53.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.390+0000 7f31ff7fe640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f31e807abf0 0x7f31e807d0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3200100d60 tx=0x7f31f4005c70 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:53.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.394+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f31f0089df0 con 0x7f3200101930 2024-09-16T09:49:53.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.569+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f3200104b40 con 0x7f3200101930 2024-09-16T09:49:53.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.569+0000 7f31fd7fa640 1 -- 172.21.15.111:0/2262671630 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v65)=0 v65) ==== 155+0+0 (secure 0 0 0) 0x7f31f008eca0 con 0x7f3200101930 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f31e807abf0 msgr2=0x7f31e807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f31e807abf0 0x7f31e807d0b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3200100d60 tx=0x7f31f4005c70 comp rx=0 tx=0).stop 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 msgr2=0x7f320019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 0x7f320019d650 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f31f0031460 tx=0x7f31f00048f0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 shutdown_connections 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f31e807abf0 0x7f31e807d0b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3200107930 0x7f320019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 --2- 172.21.15.111:0/2262671630 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3200101930 0x7f320019d650 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:53.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 >> 172.21.15.111:0/2262671630 conn(0x7f32000fd630 msgr2=0x7f32000fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:53.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 shutdown_connections 2024-09-16T09:49:53.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:53.571+0000 7f320655c640 1 -- 172.21.15.111:0/2262671630 wait complete. 2024-09-16T09:49:53.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:53 smithi111 ceph-mon[27997]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:49:54.186 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-16T09:49:54.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:53 smithi114 ceph-mon[35635]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:49:54.449 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 -- 172.21.15.111:0/583860474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 msgr2=0x7fccd8100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 --2- 172.21.15.111:0/583860474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd8100c40 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fcccc009880 tx=0x7fcccc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 -- 172.21.15.111:0/583860474 shutdown_connections 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 --2- 172.21.15.111:0/583860474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd8100c40 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 --2- 172.21.15.111:0/583860474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd81067e0 0x7fccd8106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 -- 172.21.15.111:0/583860474 >> 172.21.15.111:0/583860474 conn(0x7fccd80fc4c0 msgr2=0x7fccd80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 -- 172.21.15.111:0/583860474 shutdown_connections 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.918+0000 7fccdcba7640 1 -- 172.21.15.111:0/583860474 wait complete. 2024-09-16T09:49:54.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccdcba7640 1 Processor -- start 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccdcba7640 1 -- start start 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccdcba7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd81987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccdcba7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd81067e0 0x7fccd8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccdcba7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fccd810dcb0 con 0x7fccd81007e0 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccdcba7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fccd810db30 con 0x7fccd81067e0 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd81987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd81987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:41996/0 (socket says 172.21.15.111:41996) 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd659c640 1 -- 172.21.15.111:0/2087857734 learned_addr learned my addr 172.21.15.111:0/2087857734 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd5d9b640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd81067e0 0x7fccd8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd659c640 1 -- 172.21.15.111:0/2087857734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd81067e0 msgr2=0x7fccd8198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:54.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd659c640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd81067e0 0x7fccd8198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.919+0000 7fccd659c640 1 -- 172.21.15.111:0/2087857734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd8199320 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.920+0000 7fccd659c640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd81987e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d6f0 tx=0x7fccc800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.920+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccc8017070 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.920+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fccc800de00 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.920+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd8199610 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.920+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fccc8004bb0 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.920+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd81a1c10 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.921+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd8101f20 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.922+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fccc8009a30 con 0x7fccd81007e0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.923+0000 7fccc77fe640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fccc007ac40 0x7fccc007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.923+0000 7fccd5d9b640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fccc007ac40 0x7fccc007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:54.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.923+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fccc809d740 con 0x7fccd81007e0 2024-09-16T09:49:54.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.923+0000 7fccd5d9b640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fccc007ac40 0x7fccc007d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fccd806a680 tx=0x7fcccc031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:54.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:54.927+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fccd8199610 con 0x7fccd81007e0 2024-09-16T09:49:55.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.102+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fccd8108d50 con 0x7fccd81007e0 2024-09-16T09:49:55.105 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:54 smithi111 ceph-mon[27997]: pgmap v75: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:55.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.103+0000 7fccc77fe640 1 -- 172.21.15.111:0/2087857734 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v65)=0 v65) ==== 163+0+0 (secure 0 0 0) 0x7fccc8068fb0 con 0x7fccd81007e0 2024-09-16T09:49:55.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fccc007ac40 msgr2=0x7fccc007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fccc007ac40 0x7fccc007d100 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fccd806a680 tx=0x7fcccc031400 comp rx=0 tx=0).stop 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 msgr2=0x7fccd81987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd81987e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fccc800d6f0 tx=0x7fccc800dbb0 comp rx=0 tx=0).stop 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 shutdown_connections 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fccc007ac40 0x7fccc007d100 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fccd81067e0 0x7fccd8198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 --2- 172.21.15.111:0/2087857734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fccd81007e0 0x7fccd81987e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 >> 172.21.15.111:0/2087857734 conn(0x7fccd80fc4c0 msgr2=0x7fccd80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 shutdown_connections 2024-09-16T09:49:55.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:55.105+0000 7fccdcba7640 1 -- 172.21.15.111:0/2087857734 wait complete. 2024-09-16T09:49:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:54 smithi114 ceph-mon[35635]: pgmap v75: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:55.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-16T09:49:55.967 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:56.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 -- 172.21.15.111:0/2326206139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1067e0 msgr2=0x7f9fec106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:56.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 --2- 172.21.15.111:0/2326206139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1067e0 0x7f9fec106bc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc009880 tx=0x7f9fdc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 -- 172.21.15.111:0/2326206139 shutdown_connections 2024-09-16T09:49:56.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 --2- 172.21.15.111:0/2326206139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fec1007e0 0x7f9fec100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 --2- 172.21.15.111:0/2326206139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1067e0 0x7f9fec106bc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 -- 172.21.15.111:0/2326206139 >> 172.21.15.111:0/2326206139 conn(0x7f9fec0fc4c0 msgr2=0x7f9fec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 -- 172.21.15.111:0/2326206139 shutdown_connections 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 -- 172.21.15.111:0/2326206139 wait complete. 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 Processor -- start 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.420+0000 7f9ff108d640 1 -- start start 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9ff108d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 0x7f9fec107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9ff108d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fec1067e0 0x7f9fec107c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9ff108d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10dc90 con 0x7f9fec1007e0 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9ff108d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9fec10db10 con 0x7f9fec1067e0 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 0x7f9fec107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:56.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 0x7f9fec107710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42008/0 (socket says 172.21.15.111:42008) 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 -- 172.21.15.111:0/3425464122 learned_addr learned my addr 172.21.15.111:0/3425464122 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fe3fff640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fec1067e0 0x7f9fec107c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 -- 172.21.15.111:0/3425464122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fec1067e0 msgr2=0x7f9fec107c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fec1067e0 0x7f9fec107c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 -- 172.21.15.111:0/3425464122 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fec108190 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fead9d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 0x7f9fec107710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc031460 tx=0x7f9fdc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fdc03f070 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fec108420 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fdc0035f0 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fec1a3d10 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.421+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fdc035030 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.423+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fec101f20 con 0x7f9fec1007e0 2024-09-16T09:49:56.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.423+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f9fdc042070 con 0x7f9fec1007e0 2024-09-16T09:49:56.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.423+0000 7f9fe8d99640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9fd807abf0 0x7f9fd807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:56.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.424+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f9fdc0be4e0 con 0x7f9fec1007e0 2024-09-16T09:49:56.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.424+0000 7f9fe3fff640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9fd807abf0 0x7f9fd807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:56.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.424+0000 7f9fe3fff640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9fd807abf0 0x7f9fd807d0b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9fec1091a0 tx=0x7f9fd400b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:56.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.428+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f9fdc089cd0 con 0x7f9fec1007e0 2024-09-16T09:49:56.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.600+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f9fec1a4080 con 0x7f9fec1007e0 2024-09-16T09:49:56.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.601+0000 7f9fe8d99640 1 -- 172.21.15.111:0/3425464122 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v65)=0 v65) ==== 135+0+0 (secure 0 0 0) 0x7f9fdc08eb80 con 0x7f9fec1007e0 2024-09-16T09:49:56.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9fd807abf0 msgr2=0x7f9fd807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:56.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9fd807abf0 0x7f9fd807d0b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9fec1091a0 tx=0x7f9fd400b390 comp rx=0 tx=0).stop 2024-09-16T09:49:56.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 msgr2=0x7f9fec107710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:56.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 0x7f9fec107710 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc031460 tx=0x7f9fdc0045e0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 shutdown_connections 2024-09-16T09:49:56.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9fd807abf0 0x7f9fd807d0b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9fec1067e0 0x7f9fec107c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 --2- 172.21.15.111:0/3425464122 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9fec1007e0 0x7f9fec107710 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:56.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.603+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 >> 172.21.15.111:0/3425464122 conn(0x7f9fec0fc4c0 msgr2=0x7f9fec069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:56.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.604+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 shutdown_connections 2024-09-16T09:49:56.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:56.604+0000 7f9ff108d640 1 -- 172.21.15.111:0/3425464122 wait complete. 2024-09-16T09:49:56.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:56 smithi111 ceph-mon[27997]: pgmap v76: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:56 smithi114 ceph-mon[35635]: pgmap v76: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:57.244 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-16T09:49:57.495 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 -- 172.21.15.111:0/818136848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 msgr2=0x7f0b88107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 --2- 172.21.15.111:0/818136848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88107d10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009880 tx=0x7f0b7802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 -- 172.21.15.111:0/818136848 shutdown_connections 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 --2- 172.21.15.111:0/818136848 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b88101930 0x7f0b88101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 --2- 172.21.15.111:0/818136848 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88107d10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 -- 172.21.15.111:0/818136848 >> 172.21.15.111:0/818136848 conn(0x7f0b880fd630 msgr2=0x7f0b880ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:57.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 -- 172.21.15.111:0/818136848 shutdown_connections 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.954+0000 7f0b8e418640 1 -- 172.21.15.111:0/818136848 wait complete. 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b8e418640 1 Processor -- start 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b8e418640 1 -- start start 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b8e418640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b88101930 0x7f0b880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b8e418640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b8e418640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8810ee60 con 0x7f0b88107930 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b8e418640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8810ece0 con 0x7f0b88101930 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b877fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b877fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42034/0 (socket says 172.21.15.111:42034) 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.955+0000 7f0b877fe640 1 -- 172.21.15.111:0/3542485338 learned_addr learned my addr 172.21.15.111:0/3542485338 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b87fff640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b88101930 0x7f0b880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b877fe640 1 -- 172.21.15.111:0/3542485338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b88101930 msgr2=0x7f0b880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:57.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b877fe640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b88101930 0x7f0b880744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b877fe640 1 -- 172.21.15.111:0/3542485338 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b88074f70 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b877fe640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88074a30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00b420 tx=0x7f0b7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b7c011630 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b88075260 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b7c016070 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b7c010d40 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.956+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b881a3ef0 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.957+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b88103070 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.958+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f0b7c01b460 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.958+0000 7f0b857fa640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0b7007ac00 0x7f0b7007d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.958+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f0b7c09d2d0 con 0x7f0b88107930 2024-09-16T09:49:57.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.958+0000 7f0b87fff640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0b7007ac00 0x7f0b7007d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.959+0000 7f0b87fff640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0b7007ac00 0x7f0b7007d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b780096c0 tx=0x7f0b78000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:57.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:57.963+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f0b7c021250 con 0x7f0b88107930 2024-09-16T09:49:58.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.154+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "target": ["mon-mgr", ""]}) -- 0x7f0b88062630 con 0x7f0b7007ac00 2024-09-16T09:49:58.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.159+0000 7f0b857fa640 1 -- 172.21.15.111:0/3542485338 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f0b88062630 con 0x7f0b7007ac00 2024-09-16T09:49:58.162 INFO:teuthology.orchestra.run.smithi111.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:49:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.161+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0b7007ac00 msgr2=0x7f0b7007d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.161+0000 7f0b8e418640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0b7007ac00 0x7f0b7007d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0b780096c0 tx=0x7f0b78000bc0 comp rx=0 tx=0).stop 2024-09-16T09:49:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.161+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 msgr2=0x7f0b88074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:58.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.161+0000 7f0b8e418640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88074a30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c00b420 tx=0x7f0b7c00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 shutdown_connections 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0b7007ac00 0x7f0b7007d0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b88107930 0x7f0b88074a30 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 --2- 172.21.15.111:0/3542485338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0b88101930 0x7f0b880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 >> 172.21.15.111:0/3542485338 conn(0x7f0b880fd630 msgr2=0x7f0b880fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 shutdown_connections 2024-09-16T09:49:58.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:58.162+0000 7f0b8e418640 1 -- 172.21.15.111:0/3542485338 wait complete. 2024-09-16T09:49:58.774 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-16T09:49:58.775 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:49:58.775 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-16T09:49:59.030 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:49:59.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:58 smithi111 ceph-mon[27997]: pgmap v77: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:58 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:58 smithi114 ceph-mon[35635]: pgmap v77: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:49:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:49:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:49:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:49:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:58 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:49:59.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 -- 172.21.15.111:0/584326515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 msgr2=0x7f990c100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:59.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 --2- 172.21.15.111:0/584326515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c100c80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9908009880 tx=0x7f990802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 -- 172.21.15.111:0/584326515 shutdown_connections 2024-09-16T09:49:59.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 --2- 172.21.15.111:0/584326515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c100c80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 --2- 172.21.15.111:0/584326515 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 0x7f990c106c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 -- 172.21.15.111:0/584326515 >> 172.21.15.111:0/584326515 conn(0x7f990c0fc520 msgr2=0x7f990c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 -- 172.21.15.111:0/584326515 shutdown_connections 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.676+0000 7f9913594640 1 -- 172.21.15.111:0/584326515 wait complete. 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9913594640 1 Processor -- start 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9913594640 1 -- start start 2024-09-16T09:49:59.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9913594640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9913594640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 0x7f990c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9913594640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f990c10dd50 con 0x7f990c100820 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9913594640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f990c10dbd0 con 0x7f990c106820 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9911330640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9911330640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42052/0 (socket says 172.21.15.111:42052) 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9911330640 1 -- 172.21.15.111:0/1741194194 learned_addr learned my addr 172.21.15.111:0/1741194194 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9911330640 1 -- 172.21.15.111:0/1741194194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 msgr2=0x7f990c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:59.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9910b2f640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 0x7f990c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9911330640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 0x7f990c19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9911330640 1 -- 172.21.15.111:0/1741194194 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990c197870 con 0x7f990c100820 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.677+0000 7f9910b2f640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 0x7f990c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.678+0000 7f9911330640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c19d6b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f990000b420 tx=0x7f990000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.678+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9900011630 con 0x7f990c100820 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.678+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9900016070 con 0x7f990c100820 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.678+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f990c197b60 con 0x7f990c100820 2024-09-16T09:49:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.678+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9900010d40 con 0x7f990c100820 2024-09-16T09:49:59.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.678+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f990c1980f0 con 0x7f990c100820 2024-09-16T09:49:59.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.679+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f990c101f60 con 0x7f990c100820 2024-09-16T09:49:59.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.679+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f990001b460 con 0x7f990c100820 2024-09-16T09:49:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.680+0000 7f98fe7fc640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f98f807ac40 0x7f98f807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.680+0000 7f9910b2f640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f98f807ac40 0x7f98f807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.680+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f990009d2f0 con 0x7f990c100820 2024-09-16T09:49:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.681+0000 7f9910b2f640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f98f807ac40 0x7f98f807d100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9908031460 tx=0x7f99080095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.685+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f9900021250 con 0x7f990c100820 2024-09-16T09:49:59.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.881+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f990c198da0 con 0x7f98f807ac40 2024-09-16T09:49:59.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.882+0000 7f98fe7fc640 1 -- 172.21.15.111:0/1741194194 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f990c198da0 con 0x7f98f807ac40 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f98f807ac40 msgr2=0x7f98f807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f98f807ac40 0x7f98f807d100 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9908031460 tx=0x7f99080095f0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 msgr2=0x7f990c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c19d6b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f990000b420 tx=0x7f990000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 shutdown_connections 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f98f807ac40 0x7f98f807d100 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f990c106820 0x7f990c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 --2- 172.21.15.111:0/1741194194 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f990c100820 0x7f990c19d6b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 >> 172.21.15.111:0/1741194194 conn(0x7f990c0fc520 msgr2=0x7f990c06a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 shutdown_connections 2024-09-16T09:49:59.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.884+0000 7f9913594640 1 -- 172.21.15.111:0/1741194194 wait complete. 2024-09-16T09:49:59.894 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 -- 172.21.15.111:0/1608395654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 msgr2=0x7fc254101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 --2- 172.21.15.111:0/1608395654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc254101d70 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc240009880 tx=0x7fc24002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 -- 172.21.15.111:0/1608395654 shutdown_connections 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 --2- 172.21.15.111:0/1608395654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc254101d70 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 --2- 172.21.15.111:0/1608395654 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc254107910 0x7fc254107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 -- 172.21.15.111:0/1608395654 >> 172.21.15.111:0/1608395654 conn(0x7fc2540fd5f0 msgr2=0x7fc2540ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:49:59.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 -- 172.21.15.111:0/1608395654 shutdown_connections 2024-09-16T09:49:59.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 -- 172.21.15.111:0/1608395654 wait complete. 2024-09-16T09:49:59.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.969+0000 7fc25affe640 1 Processor -- start 2024-09-16T09:49:59.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc25affe640 1 -- start start 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc25affe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc25419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc25affe640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc254107910 0x7fc25419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc25affe640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc25410ede0 con 0x7fc254101910 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc25affe640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc25410ec60 con 0x7fc254107910 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc258d9a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc25419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc258d9a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc25419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42072/0 (socket says 172.21.15.111:42072) 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc258d9a640 1 -- 172.21.15.111:0/1974926484 learned_addr learned my addr 172.21.15.111:0/1974926484 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc253fff640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc254107910 0x7fc25419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:59.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc258d9a640 1 -- 172.21.15.111:0/1974926484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc254107910 msgr2=0x7fc25419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc258d9a640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc254107910 0x7fc25419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.970+0000 7fc258d9a640 1 -- 172.21.15.111:0/1974926484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc254197780 con 0x7fc254101910 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.971+0000 7fc258d9a640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc25419d600 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc24800d6f0 tx=0x7fc24800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.971+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc248017070 con 0x7fc254101910 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.971+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc24800de00 con 0x7fc254101910 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.971+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc248004bb0 con 0x7fc254101910 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.971+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc254197a70 con 0x7fc254101910 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.971+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc254197fd0 con 0x7fc254101910 2024-09-16T09:49:59.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.972+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc254103050 con 0x7fc254101910 2024-09-16T09:49:59.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.973+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fc248009a30 con 0x7fc254101910 2024-09-16T09:49:59.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.973+0000 7fc251ffb640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc24407ac40 0x7fc24407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:49:59.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.973+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fc24809d690 con 0x7fc254101910 2024-09-16T09:49:59.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.973+0000 7fc253fff640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc24407ac40 0x7fc24407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:49:59.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.974+0000 7fc253fff640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc24407ac40 0x7fc24407d100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc254198ad0 tx=0x7fc240031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:49:59.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:49:59.978+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fc248068f00 con 0x7fc254101910 2024-09-16T09:50:00.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:59 smithi111 ceph-mon[27997]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:00.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:59 smithi111 ceph-mon[27997]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:50:00.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:49:59 smithi111 ceph-mon[27997]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:50:00.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.181+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc254198280 con 0x7fc24407ac40 2024-09-16T09:50:00.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.182+0000 7fc251ffb640 1 -- 172.21.15.111:0/1974926484 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7fc254198280 con 0x7fc24407ac40 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc24407ac40 msgr2=0x7fc24407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc24407ac40 0x7fc24407d100 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc254198ad0 tx=0x7fc240031400 comp rx=0 tx=0).stop 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 msgr2=0x7fc25419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc25419d600 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc24800d6f0 tx=0x7fc24800dbb0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 shutdown_connections 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc24407ac40 0x7fc24407d100 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc254107910 0x7fc25419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 --2- 172.21.15.111:0/1974926484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc254101910 0x7fc25419d600 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 >> 172.21.15.111:0/1974926484 conn(0x7fc2540fd5f0 msgr2=0x7fc2540fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:00.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 shutdown_connections 2024-09-16T09:50:00.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.184+0000 7fc25affe640 1 -- 172.21.15.111:0/1974926484 wait complete. 2024-09-16T09:50:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:59 smithi114 ceph-mon[35635]: from='client.14876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:59 smithi114 ceph-mon[35635]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:50:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:49:59 smithi114 ceph-mon[35635]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:66e33d6af1496291b0602ee0a859e68145f17dad 2024-09-16T09:50:00.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 -- 172.21.15.111:0/3600646779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201067e0 msgr2=0x7f7f20106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 --2- 172.21.15.111:0/3600646779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201067e0 0x7f7f20106bc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7f10009880 tx=0x7f7f1002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 -- 172.21.15.111:0/3600646779 shutdown_connections 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 --2- 172.21.15.111:0/3600646779 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f201007e0 0x7f7f20100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 --2- 172.21.15.111:0/3600646779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201067e0 0x7f7f20106bc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 -- 172.21.15.111:0/3600646779 >> 172.21.15.111:0/3600646779 conn(0x7f7f200fc4c0 msgr2=0x7f7f200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.267+0000 7f7f2616c640 1 -- 172.21.15.111:0/3600646779 shutdown_connections 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 -- 172.21.15.111:0/3600646779 wait complete. 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 Processor -- start 2024-09-16T09:50:00.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 -- start start 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 0x7f7f200fcc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f201067e0 0x7f7f200fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2010dd10 con 0x7f7f201007e0 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.268+0000 7f7f2616c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2010db90 con 0x7f7f201067e0 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 0x7f7f200fcc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 0x7f7f200fcc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42092/0 (socket says 172.21.15.111:42092) 2024-09-16T09:50:00.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 -- 172.21.15.111:0/49760788 learned_addr learned my addr 172.21.15.111:0/49760788 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f16ffd640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f201067e0 0x7f7f200fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 -- 172.21.15.111:0/49760788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f201067e0 msgr2=0x7f7f200fd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f201067e0 0x7f7f200fd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 -- 172.21.15.111:0/49760788 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f200fd710 con 0x7f7f201007e0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1f7fe640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 0x7f7f200fcc90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7f10031460 tx=0x7f7f100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f1003f070 con 0x7f7f201007e0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f200fd9a0 con 0x7f7f201007e0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7f10004cf0 con 0x7f7f201007e0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7f10035030 con 0x7f7f201007e0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.269+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f201a3df0 con 0x7f7f201007e0 2024-09-16T09:50:00.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.270+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f20101f20 con 0x7f7f201007e0 2024-09-16T09:50:00.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.271+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f7f10042070 con 0x7f7f201007e0 2024-09-16T09:50:00.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.272+0000 7f7f1d7fa640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7f0c07abf0 0x7f7f0c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.272+0000 7f7f16ffd640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7f0c07abf0 0x7f7f0c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.272+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f7f100be700 con 0x7f7f201007e0 2024-09-16T09:50:00.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.272+0000 7f7f16ffd640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7f0c07abf0 0x7f7f0c07d0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f200fe720 tx=0x7f7f08008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:00.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.276+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f7f10089ef0 con 0x7f7f201007e0 2024-09-16T09:50:00.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.474+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7f20062630 con 0x7f7f0c07abf0 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.483+0000 7f7f1d7fa640 1 -- 172.21.15.111:0/49760788 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f7f20062630 con 0x7f7f0c07abf0 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (67s) 40s ago 11m 19.0M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (3m) 40s ago 12m 8594k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (3m) 108s ago 11m 8116k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (12m) 40s ago 12m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:50:00.485 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (11m) 108s ago 11m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (45s) 40s ago 11m 42.0M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (6m) 40s ago 6m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (6m) 40s ago 6m 17.2M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (6m) 108s ago 6m 18.2M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (6m) 108s ago 6m 17.9M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (2m) 40s ago 13m 519M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (2m) 108s ago 11m 453M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (13m) 40s ago 13m 59.6M 2048M 19.1.1-328-gad35db06 b5388489f99e 3d0ef6dc861c 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (11m) 108s ago 11m 46.5M 2048M 19.1.1-328-gad35db06 b5388489f99e cb7bdea83946 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (117s) 40s ago 12m 12.2M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (111s) 108s ago 11m 3225k - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (9m) 40s ago 9m 228M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (9m) 40s ago 9m 248M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (9m) 40s ago 9m 211M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:50:00.486 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (8m) 108s ago 8m 304M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:50:00.487 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (8m) 108s ago 8m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:50:00.487 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (7m) 108s ago 7m 234M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:50:00.487 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (88s) 40s ago 11m 45.9M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:50:00.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.485+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7f0c07abf0 msgr2=0x7f7f0c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.485+0000 7f7f2616c640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7f0c07abf0 0x7f7f0c07d0b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7f200fe720 tx=0x7f7f08008040 comp rx=0 tx=0).stop 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.485+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 msgr2=0x7f7f200fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.485+0000 7f7f2616c640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 0x7f7f200fcc90 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7f10031460 tx=0x7f7f100048f0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 shutdown_connections 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7f0c07abf0 0x7f7f0c07d0b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f201067e0 0x7f7f200fd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 --2- 172.21.15.111:0/49760788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f201007e0 0x7f7f200fcc90 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 >> 172.21.15.111:0/49760788 conn(0x7f7f200fc4c0 msgr2=0x7f7f20069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 shutdown_connections 2024-09-16T09:50:00.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.486+0000 7f7f2616c640 1 -- 172.21.15.111:0/49760788 wait complete. 2024-09-16T09:50:00.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/3116912200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 msgr2=0x7f6ee0107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/3116912200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee0107d10 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8009880 tx=0x7f6ed802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/3116912200 shutdown_connections 2024-09-16T09:50:00.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/3116912200 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 0x7f6ee0101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/3116912200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee0107d10 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/3116912200 >> 172.21.15.111:0/3116912200 conn(0x7f6ee00fd630 msgr2=0x7f6ee00ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/3116912200 shutdown_connections 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.566+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/3116912200 wait complete. 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.567+0000 7f6ee4fa6640 1 Processor -- start 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.567+0000 7f6ee4fa6640 1 -- start start 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.567+0000 7f6ee4fa6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 0x7f6ee019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.567+0000 7f6ee4fa6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.567+0000 7f6ee4fa6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee010ee60 con 0x7f6ee0107930 2024-09-16T09:50:00.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.567+0000 7f6ee4fa6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee010ece0 con 0x7f6ee0101930 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42110/0 (socket says 172.21.15.111:42110) 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 -- 172.21.15.111:0/28374403 learned_addr learned my addr 172.21.15.111:0/28374403 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ede59c640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 0x7f6ee019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 -- 172.21.15.111:0/28374403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 msgr2=0x7f6ee019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 0x7f6ee019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 -- 172.21.15.111:0/28374403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee0197870 con 0x7f6ee0107930 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ede59c640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 0x7f6ee019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6eddd9b640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee019dbf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800b420 tx=0x7f6ec800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ec8011630 con 0x7f6ee0107930 2024-09-16T09:50:00.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ec8016070 con 0x7f6ee0107930 2024-09-16T09:50:00.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ec8010d40 con 0x7f6ee0107930 2024-09-16T09:50:00.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee0197b60 con 0x7f6ee0107930 2024-09-16T09:50:00.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.568+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee01980f0 con 0x7f6ee0107930 2024-09-16T09:50:00.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.569+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee0103070 con 0x7f6ee0107930 2024-09-16T09:50:00.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.570+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f6ec801b460 con 0x7f6ee0107930 2024-09-16T09:50:00.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.571+0000 7f6ed77fe640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6ecc07abf0 0x7f6ecc07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.571+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f6ec809d2d0 con 0x7f6ee0107930 2024-09-16T09:50:00.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.571+0000 7f6ede59c640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6ecc07abf0 0x7f6ecc07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.571+0000 7f6ede59c640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6ecc07abf0 0x7f6ecc07d0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8031420 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:00.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.575+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f6ec8021250 con 0x7f6ee0107930 2024-09-16T09:50:00.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.826+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6ee0198da0 con 0x7f6ee0107930 2024-09-16T09:50:00.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.827+0000 7f6ed77fe640 1 -- 172.21.15.111:0/28374403 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f6ec8068ac0 con 0x7f6ee0107930 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:50:00.829 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 12, 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:50:00.830 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6ecc07abf0 msgr2=0x7f6ecc07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6ecc07abf0 0x7f6ecc07d0b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ed8000c00 tx=0x7f6ed8031420 comp rx=0 tx=0).stop 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 msgr2=0x7f6ee019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee019dbf0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800b420 tx=0x7f6ec800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 shutdown_connections 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6ecc07abf0 0x7f6ecc07d0b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6ee0107930 0x7f6ee019dbf0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 --2- 172.21.15.111:0/28374403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6ee0101930 0x7f6ee019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 >> 172.21.15.111:0/28374403 conn(0x7f6ee00fd630 msgr2=0x7f6ee00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 shutdown_connections 2024-09-16T09:50:00.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.829+0000 7f6ee4fa6640 1 -- 172.21.15.111:0/28374403 wait complete. 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 -- 172.21.15.111:0/551069667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc768102aa0 msgr2=0x7fc768102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/551069667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc768102aa0 0x7fc768102e80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fc758009880 tx=0x7fc75802a530 comp rx=0 tx=0).stop 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 -- 172.21.15.111:0/551069667 shutdown_connections 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/551069667 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc7681033c0 0x7fc76810b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/551069667 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc768102aa0 0x7fc768102e80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 -- 172.21.15.111:0/551069667 >> 172.21.15.111:0/551069667 conn(0x7fc7680fc4c0 msgr2=0x7fc7680fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 -- 172.21.15.111:0/551069667 shutdown_connections 2024-09-16T09:50:00.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.916+0000 7fc76e6ff640 1 -- 172.21.15.111:0/551069667 wait complete. 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc76e6ff640 1 Processor -- start 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc76e6ff640 1 -- start start 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc76e6ff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc768102aa0 0x7fc76819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc76e6ff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 0x7fc76819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc76e6ff640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc76810edb0 con 0x7fc7681033c0 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc76e6ff640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc76810ec30 con 0x7fc768102aa0 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc7677fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 0x7fc76819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc7677fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 0x7fc76819db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42130/0 (socket says 172.21.15.111:42130) 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc7677fe640 1 -- 172.21.15.111:0/3713839857 learned_addr learned my addr 172.21.15.111:0/3713839857 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:00.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc767fff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc768102aa0 0x7fc76819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc7677fe640 1 -- 172.21.15.111:0/3713839857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc768102aa0 msgr2=0x7fc76819d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc7677fe640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc768102aa0 0x7fc76819d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc7677fe640 1 -- 172.21.15.111:0/3713839857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7681977a0 con 0x7fc7681033c0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.917+0000 7fc767fff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc768102aa0 0x7fc76819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.918+0000 7fc7677fe640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 0x7fc76819db60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00e970 tx=0x7fc75c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.918+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc75c009590 con 0x7fc7681033c0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.918+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc75c010430 con 0x7fc7681033c0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.918+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc768197a90 con 0x7fc7681033c0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.918+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc75c018630 con 0x7fc7681033c0 2024-09-16T09:50:00.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.918+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc768198020 con 0x7fc7681033c0 2024-09-16T09:50:00.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.919+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc76806a410 con 0x7fc7681033c0 2024-09-16T09:50:00.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.920+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fc75c0105e0 con 0x7fc7681033c0 2024-09-16T09:50:00.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.920+0000 7fc7657fa640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc75007ac40 0x7fc75007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:00.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.920+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fc75c09e150 con 0x7fc7681033c0 2024-09-16T09:50:00.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.920+0000 7fc767fff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc75007ac40 0x7fc75007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:00.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.921+0000 7fc767fff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc75007ac40 0x7fc75007d100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc758006010 tx=0x7fc7580095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:00.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:00.925+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7fc75c0699c0 con 0x7fc7681033c0 2024-09-16T09:50:01.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:00 smithi111 ceph-mon[27997]: pgmap v78: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:00 smithi111 ceph-mon[27997]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:00 smithi111 ceph-mon[27997]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:00 smithi111 ceph-mon[27997]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:00 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:50:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.146+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc768105f70 con 0x7fc7681033c0 2024-09-16T09:50:01.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.147+0000 7fc7657fa640 1 -- 172.21.15.111:0/3713839857 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7fc75c06e870 con 0x7fc7681033c0 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:01.149 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:50:01.150 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:50:01.151 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:01.152 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:01.153 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:50:01.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc75007ac40 msgr2=0x7fc75007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc75007ac40 0x7fc75007d100 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc758006010 tx=0x7fc7580095f0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 msgr2=0x7fc76819db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 0x7fc76819db60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fc75c00e970 tx=0x7fc75c00ee30 comp rx=0 tx=0).stop 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 shutdown_connections 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc75007ac40 0x7fc75007d100 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc7681033c0 0x7fc76819db60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 --2- 172.21.15.111:0/3713839857 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc768102aa0 0x7fc76819d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 >> 172.21.15.111:0/3713839857 conn(0x7fc7680fc4c0 msgr2=0x7fc768108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 shutdown_connections 2024-09-16T09:50:01.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.149+0000 7fc76e6ff640 1 -- 172.21.15.111:0/3713839857 wait complete. 2024-09-16T09:50:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:00 smithi114 ceph-mon[35635]: pgmap v78: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:00 smithi114 ceph-mon[35635]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:00 smithi114 ceph-mon[35635]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:00 smithi114 ceph-mon[35635]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:01.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:00 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 -- 172.21.15.111:0/13086474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 msgr2=0x7f7b14100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/13086474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b14100c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009880 tx=0x7f7b0402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 -- 172.21.15.111:0/13086474 shutdown_connections 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/13086474 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b14100c40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/13086474 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 0x7f7b14106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 -- 172.21.15.111:0/13086474 >> 172.21.15.111:0/13086474 conn(0x7f7b140fc4c0 msgr2=0x7f7b140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 -- 172.21.15.111:0/13086474 shutdown_connections 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.232+0000 7f7b1c35f640 1 -- 172.21.15.111:0/13086474 wait complete. 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1c35f640 1 Processor -- start 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1c35f640 1 -- start start 2024-09-16T09:50:01.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1c35f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b1419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1c35f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 0x7f7b1419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1c35f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1410dd10 con 0x7f7b141007e0 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1c35f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1410db90 con 0x7f7b141067e0 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1a0fb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b1419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1a0fb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b1419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42150/0 (socket says 172.21.15.111:42150) 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.233+0000 7f7b1a0fb640 1 -- 172.21.15.111:0/1246179911 learned_addr learned my addr 172.21.15.111:0/1246179911 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b198fa640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 0x7f7b1419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b1a0fb640 1 -- 172.21.15.111:0/1246179911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 msgr2=0x7f7b1419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b1a0fb640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 0x7f7b1419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b1a0fb640 1 -- 172.21.15.111:0/1246179911 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b14197820 con 0x7f7b141007e0 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b198fa640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 0x7f7b1419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:50:01.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b1a0fb640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b1419d6a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000b420 tx=0x7f7b1000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:01.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b10011630 con 0x7f7b141007e0 2024-09-16T09:50:01.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b14197b10 con 0x7f7b141007e0 2024-09-16T09:50:01.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b10016070 con 0x7f7b141007e0 2024-09-16T09:50:01.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b10010d40 con 0x7f7b141007e0 2024-09-16T09:50:01.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.234+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b141980a0 con 0x7f7b141007e0 2024-09-16T09:50:01.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.235+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b14101f20 con 0x7f7b141007e0 2024-09-16T09:50:01.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.236+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f7b1001b460 con 0x7f7b141007e0 2024-09-16T09:50:01.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.236+0000 7f7b0b7fe640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7b0007abf0 0x7f7b0007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:01.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.236+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f7b1009d2d0 con 0x7f7b141007e0 2024-09-16T09:50:01.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.236+0000 7f7b198fa640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7b0007abf0 0x7f7b0007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:01.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.237+0000 7f7b198fa640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7b0007abf0 0x7f7b0007d0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b04031460 tx=0x7f7b040095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:01.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.241+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f7b10021250 con 0x7f7b141007e0 2024-09-16T09:50:01.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.436+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7b141983b0 con 0x7f7b0007abf0 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.437+0000 7f7b0b7fe640 1 -- 172.21.15.111:0/1246179911 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f7b141983b0 con 0x7f7b0007abf0 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr" 2024-09-16T09:50:01.439 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:50:01.440 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "2/23 daemons upgraded", 2024-09-16T09:50:01.440 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mon daemons", 2024-09-16T09:50:01.440 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:50:01.440 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:50:01.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7b0007abf0 msgr2=0x7f7b0007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7b0007abf0 0x7f7b0007d0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7b04031460 tx=0x7f7b040095f0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 msgr2=0x7f7b1419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b1419d6a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000b420 tx=0x7f7b1000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 shutdown_connections 2024-09-16T09:50:01.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7b0007abf0 0x7f7b0007d0b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7b141067e0 0x7f7b1419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 --2- 172.21.15.111:0/1246179911 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b141007e0 0x7f7b1419d6a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 >> 172.21.15.111:0/1246179911 conn(0x7f7b140fc4c0 msgr2=0x7f7b14069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:01.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 shutdown_connections 2024-09-16T09:50:01.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.439+0000 7f7b1c35f640 1 -- 172.21.15.111:0/1246179911 wait complete. 2024-09-16T09:50:01.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 -- 172.21.15.111:0/953564805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1007e0 msgr2=0x7f365c100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 --2- 172.21.15.111:0/953564805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1007e0 0x7f365c100c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f3650009880 tx=0x7f365002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 -- 172.21.15.111:0/953564805 shutdown_connections 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 --2- 172.21.15.111:0/953564805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1007e0 0x7f365c100c40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 --2- 172.21.15.111:0/953564805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c1067e0 0x7f365c106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 -- 172.21.15.111:0/953564805 >> 172.21.15.111:0/953564805 conn(0x7f365c0fc4c0 msgr2=0x7f365c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 -- 172.21.15.111:0/953564805 shutdown_connections 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 -- 172.21.15.111:0/953564805 wait complete. 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.523+0000 7f3660843640 1 Processor -- start 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3660843640 1 -- start start 2024-09-16T09:50:01.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3660843640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c1007e0 0x7f365c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3660843640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 0x7f365c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3660843640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f365c10dc90 con 0x7f365c1067e0 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3660843640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f365c10db10 con 0x7f365c1007e0 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 0x7f365c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f365a59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c1007e0 0x7f365c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 0x7f365c19fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42160/0 (socket says 172.21.15.111:42160) 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 -- 172.21.15.111:0/1753248903 learned_addr learned my addr 172.21.15.111:0/1753248903 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 -- 172.21.15.111:0/1753248903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c1007e0 msgr2=0x7f365c19f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c1007e0 0x7f365c19f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 -- 172.21.15.111:0/1753248903 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f365c1999a0 con 0x7f365c1067e0 2024-09-16T09:50:01.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.524+0000 7f3659d9b640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 0x7f365c19fd20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3650031460 tx=0x7f36500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:01.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.525+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f365003f070 con 0x7f365c1067e0 2024-09-16T09:50:01.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.525+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36500035f0 con 0x7f365c1067e0 2024-09-16T09:50:01.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.525+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f365c199c30 con 0x7f365c1067e0 2024-09-16T09:50:01.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.525+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3650035030 con 0x7f365c1067e0 2024-09-16T09:50:01.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.525+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f365c19a160 con 0x7f365c1067e0 2024-09-16T09:50:01.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.526+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f365c101f20 con 0x7f365c1067e0 2024-09-16T09:50:01.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.527+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f3650042070 con 0x7f365c1067e0 2024-09-16T09:50:01.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.528+0000 7f364b7fe640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f364407ac40 0x7f364407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:01.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.528+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f36500bdf10 con 0x7f365c1067e0 2024-09-16T09:50:01.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.528+0000 7f365a59c640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f364407ac40 0x7f364407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:01.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.528+0000 7f365a59c640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f364407ac40 0x7f364407d100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f365c19aae0 tx=0x7f364c00b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:01.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.532+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195619 (secure 0 0 0) 0x7f3650049020 con 0x7f365c1067e0 2024-09-16T09:50:01.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.783+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f365c19af60 con 0x7f365c1067e0 2024-09-16T09:50:01.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.783+0000 7f364b7fe640 1 -- 172.21.15.111:0/1753248903 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f3650089780 con 0x7f365c1067e0 2024-09-16T09:50:01.785 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:01.786 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:01.786 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:01.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f364407ac40 msgr2=0x7f364407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f364407ac40 0x7f364407d100 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f365c19aae0 tx=0x7f364c00b390 comp rx=0 tx=0).stop 2024-09-16T09:50:01.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 msgr2=0x7f365c19fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:01.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 0x7f365c19fd20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3650031460 tx=0x7f36500045e0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 shutdown_connections 2024-09-16T09:50:01.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f364407ac40 0x7f364407d100 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f365c1067e0 0x7f365c19fd20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 --2- 172.21.15.111:0/1753248903 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f365c1007e0 0x7f365c19f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:01.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.785+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 >> 172.21.15.111:0/1753248903 conn(0x7f365c0fc4c0 msgr2=0x7f365c0fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:01.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.786+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 shutdown_connections 2024-09-16T09:50:01.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:01.786+0000 7f3660843640 1 -- 172.21.15.111:0/1753248903 wait complete. 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/28374403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:02.122 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:50:02.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:02.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T09:50:02.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/3713839857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T09:50:02.123 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:01 smithi111 ceph-mon[27997]: from='client.? 172.21.15.111:0/1753248903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T09:50:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='client.14884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='client.14888 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/28374403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:50:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:02.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:02.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:50:02.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:02.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T09:50:02.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/3713839857' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-16T09:50:02.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:01 smithi114 ceph-mon[35635]: from='client.? 172.21.15.111:0/1753248903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: Upgrade: Target is version 19.3.0-4882-g66e33d6a (squid) 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f'] 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: Upgrade: Setting container_image for all mgr 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: pgmap v79: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:50:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:02 smithi111 ceph-mon[27997]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: Upgrade: Target is version 19.3.0-4882-g66e33d6a (squid) 2024-09-16T09:50:03.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f'] 2024-09-16T09:50:03.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: Upgrade: Setting container_image for all mgr 2024-09-16T09:50:03.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: from='client.14900 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:03.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: pgmap v79: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:03.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:03.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:50:03.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:50:03.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:02 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:03.833 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:03 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:50:04.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:03 smithi114 ceph-mon[35635]: Upgrade: Updating mon.smithi111 2024-09-16T09:50:04.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:03 smithi114 ceph-mon[35635]: Deploying daemon mon.smithi111 on smithi111 2024-09-16T09:50:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:03 smithi111 ceph-mon[27997]: Upgrade: Updating mon.smithi111 2024-09-16T09:50:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:03 smithi111 ceph-mon[27997]: Deploying daemon mon.smithi111 on smithi111 2024-09-16T09:50:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:03 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[27993]: 2024-09-16T09:50:03.982+0000 7f62775ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:50:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:03 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[27993]: 2024-09-16T09:50:03.982+0000 7f62775ad640 -1 mon.smithi111@0(leader) e2 *** Got Signal Terminated *** 2024-09-16T09:50:04.459 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 podman[109715]: 2024-09-16 09:50:04.19745358 +0000 UTC m=+0.310831474 container died 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ad35db0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:50:04.826 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 podman[109715]: 2024-09-16 09:50:04.549370193 +0000 UTC m=+0.662748093 container cleanup 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ad35db0) 2024-09-16T09:50:04.827 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 bash[109715]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111 2024-09-16T09:50:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 podman[109738]: 2024-09-16 09:50:04.825809248 +0000 UTC m=+0.630489197 container remove 3d0ef6dc861ccbc25bf6f5fa658ab6c81e5515dddad197ef5ae72929c2ad3aee (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-ad35db0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:50:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service: Deactivated successfully. 2024-09-16T09:50:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 systemd[1]: Stopped Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:50:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:04 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service: Consumed 12.813s CPU time. 2024-09-16T09:50:05.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 systemd[1]: Starting Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:50:05.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 podman[109867]: 2024-09-16 09:50:05.394241752 +0000 UTC m=+0.112765405 container create b551614a9fe4e00361b439e2aa4fd75d1189721002b7d460458164ddd7105cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:50:05.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 podman[109867]: 2024-09-16 09:50:05.298349192 +0000 UTC m=+0.016872808 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:50:05.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 podman[109867]: 2024-09-16 09:50:05.646869147 +0000 UTC m=+0.365392756 container init b551614a9fe4e00361b439e2aa4fd75d1189721002b7d460458164ddd7105cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-16T09:50:05.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 podman[109867]: 2024-09-16 09:50:05.650131991 +0000 UTC m=+0.368655600 container start b551614a9fe4e00361b439e2aa4fd75d1189721002b7d460458164ddd7105cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T09:50:05.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T09:50:05.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev), process ceph-mon, pid 2 2024-09-16T09:50:05.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: pidfile_write: ignore empty --pid-file 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: load: jerasure load: lrc 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: RocksDB version: 7.9.2 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Git sha 0 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Compile date 2024-09-12 18:19:39 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: DB SUMMARY 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: DB Session ID: 1Q3FHUP8I5M742MRWLN5 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: CURRENT file: CURRENT 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1507 Bytes 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi111/store.db dir, Total Num: 1, files: 000032.sst 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi111/store.db: 000030.log size: 1968312 ; 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.error_if_exists: 0 2024-09-16T09:50:05.682 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.create_if_missing: 0 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.paranoid_checks: 1 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.env: 0x55d3bf31e120 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.info_log: 0x55d3bfc3f8e0 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.statistics: (nil) 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.use_fsync: 0 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_log_file_size: 0 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T09:50:05.683 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.allow_fallocate: 1 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.use_direct_reads: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.db_log_dir: 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.wal_dir: 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T09:50:05.684 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T09:50:05.685 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T09:50:05.685 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T09:50:05.685 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.write_buffer_manager: 0x55d3bfc43b80 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T09:50:05.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.unordered_write: 0 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.row_cache: None 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.wal_filter: None 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.two_write_queues: 0 2024-09-16T09:50:05.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.wal_compression: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.atomic_flush: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.log_readahead_size: 0 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T09:50:05.885 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_background_jobs: 2 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_background_compactions: -1 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_subcompactions: 1 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T09:50:05.889 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_open_files: -1 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T09:50:05.890 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_background_flushes: -1 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Compression algorithms supported: 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kZSTD supported: 0 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kXpressCompression supported: 0 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kBZip2Compression supported: 0 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kLZ4Compression supported: 1 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kZlibCompression supported: 1 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: kSnappyCompression supported: 1 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000015 2024-09-16T09:50:05.891 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.merge_operator: 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_filter: None 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d3bfc3f540) 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks: 1 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: pin_top_level_index_and_filter: 1 2024-09-16T09:50:05.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_type: 0 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_index_type: 0 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_shortening: 1 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: checksum: 4 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: no_block_cache: 0 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache: 0x55d3bfc33610 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_name: BinnedLRUCache 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_options: 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: capacity : 536870912 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_shard_bits : 4 2024-09-16T09:50:05.893 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: strict_capacity_limit : 0 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: high_pri_pool_ratio: 0.000 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_cache_compressed: (nil) 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: persistent_cache: (nil) 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size: 4096 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_size_deviation: 10 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_restart_interval: 16 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: index_block_restart_interval: 1 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_block_size: 4096 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: partition_filters: 0 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: use_delta_encoding: 1 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: filter_policy: bloomfilter 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: whole_key_filtering: 1 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: verify_compression: 0 2024-09-16T09:50:05.894 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: read_amp_bytes_per_bit: 0 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: format_version: 5 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_index_compression: 1 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: block_align: 0 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_auto_readahead_size: 262144 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: prepopulate_block_cache: 0 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: initial_auto_readahead_size: 8192 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression: NoCompression 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T09:50:05.895 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.num_levels: 7 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T09:50:05.896 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:50:05.897 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T09:50:05.898 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T09:50:05.899 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T09:50:05.900 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.inplace_update_support: 0 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T09:50:05.901 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.bloom_locality: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.max_successive_merges: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.ttl: 2592000 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.enable_blob_files: false 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.min_blob_size: 0 2024-09-16T09:50:05.902 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi111/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12022, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e8e913ce-6df6-4418-9962-2999ad9c6782 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726480205676910, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-16T09:50:05.903 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726480205683644, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 1749347, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12023, "largest_seqno": 13512, "table_properties": {"data_size": 1742185, "index_size": 4393, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1733, "raw_key_size": 15837, "raw_average_key_size": 23, "raw_value_size": 1727811, "raw_average_value_size": 2571, "num_data_blocks": 200, "num_entries": 672, "num_filter_entries": 672, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726480205, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e8e913ce-6df6-4418-9962-2999ad9c6782", "db_session_id": "1Q3FHUP8I5M742MRWLN5", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726480205683793, "job": 1, "event": "recovery_finished"} 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi111/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d3bfc62e00 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: DB pointer 0x55d3bfd64000 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** DB Stats ** 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:50:05.904 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L0 1/0 1.67 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 525.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: L6 1/0 7.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Sum 2/0 8.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 525.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T09:50:05.905 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 525.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** Compaction Stats [default] ** 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 525.3 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T09:50:05.906 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Cumulative compaction: 0.00 GB write, 182.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Interval compaction: 0.00 GB write, 182.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache BinnedLRUCache@0x55d3bfc33610#2 capacity: 512.00 MB usage: 6.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.58 KB,0.000873208%) Misc(1,0.00 KB,0%) 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: starting mon.smithi111 rank 0 at public addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] at bind addrs [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi111 fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???) e2 preinit fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).mds e14 new map 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).mds e14 print_map 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: e14 2024-09-16T09:50:05.907 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: legacy client fscid: 1 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Filesystem 'cephfs' (1) 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: fs_name cephfs 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: epoch 11 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: tableserver 0 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: root 0 2024-09-16T09:50:05.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: session_timeout 60 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: session_autoclose 300 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_file_size 1099511627776 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_xattr_size 65536 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: required_client_features {} 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: last_failure 0 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: last_failure_osd_epoch 0 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: max_mds 1 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: in 0 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: up {0=14550} 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: failed 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: damaged 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: stopped 2024-09-16T09:50:05.909 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: data_pools [3] 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: metadata_pool 2 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: inline_data enabled 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: balancer 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: bal_rank_mask -1 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: standby_count_wanted 1 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: qdb_cluster leader: 14550 members: 14550 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: Standby daemons: 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:05.910 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout: [mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 ceph-mon[109885]: mon.smithi111@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 bash[109867]: b551614a9fe4e00361b439e2aa4fd75d1189721002b7d460458164ddd7105cb9 2024-09-16T09:50:05.911 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:05 smithi111 systemd[1]: Started Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:50:07.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:50:07.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: pgmap v81: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: mon.smithi111 calling monitor election 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: mon.smithi111 is new leader, mons smithi111,smithi114 in quorum (ranks 0,1) 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: monmap epoch 2 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: last_changed 2024-09-16T09:38:58.929938+0000 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: min_mon_release 19 (squid) 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: election_strategy: 1 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:50:07.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: 1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.smithi114 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: mgrmap e31: smithi111.erxodt(active, since 2m), standbys: smithi114.xvotey 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='' 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:07.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:07 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:07.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi111"}]: dispatch 2024-09-16T09:50:07.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "mon metadata", "id": "smithi114"}]: dispatch 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: pgmap v81: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: mon.smithi111 calling monitor election 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: mon.smithi111 is new leader, mons smithi111,smithi114 in quorum (ranks 0,1) 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: monmap epoch 2 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: last_changed 2024-09-16T09:38:58.929938+0000 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: min_mon_release 19 (squid) 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: election_strategy: 1 2024-09-16T09:50:07.633 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: 1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.smithi114 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: mgrmap e31: smithi111.erxodt(active, since 2m), standbys: smithi114.xvotey 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='' 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:07.634 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:07 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:08 smithi114 ceph-mon[35635]: pgmap v82: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:08.506 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:08 smithi111 ceph-mon[109885]: pgmap v82: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:10.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:10 smithi111 ceph-mon[109885]: pgmap v83: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:10 smithi114 ceph-mon[35635]: pgmap v83: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:13.057 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:12 smithi111 ceph-mon[109885]: pgmap v84: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:13.057 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:12 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.057 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:12 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.057 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:12 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.057 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:12 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:12 smithi114 ceph-mon[35635]: pgmap v84: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:12 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:12 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:12 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:13.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:12 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:14 smithi111 ceph-mon[109885]: pgmap v85: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:14 smithi114 ceph-mon[35635]: pgmap v85: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:50:16.055 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:15 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T09:50:16.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "versions"}]: dispatch 2024-09-16T09:50:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-16T09:50:16.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:16 smithi114 ceph-mon[35635]: pgmap v86: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:17.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:16 smithi111 ceph-mon[109885]: pgmap v86: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: Upgrade: Updating mon.smithi114 2024-09-16T09:50:18.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:50:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:50:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: Deploying daemon mon.smithi114 on smithi114 2024-09-16T09:50:18.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-mon[35635]: pgmap v87: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: Upgrade: Updating mon.smithi114 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: from='mgr.14724 ' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: Deploying daemon mon.smithi114 on smithi114 2024-09-16T09:50:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:18 smithi111 ceph-mon[109885]: pgmap v87: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:18.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 systemd[1]: Stopping Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:50:18.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114[35631]: 2024-09-16T09:50:18.989+0000 7f3d6cbb2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi114 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:50:18.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:18 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114[35631]: 2024-09-16T09:50:18.989+0000 7f3d6cbb2640 -1 mon.smithi114@1(peon) e2 *** Got Signal Terminated *** 2024-09-16T09:50:19.400 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 podman[79570]: 2024-09-16 09:50:19.112365344 +0000 UTC m=+0.226900451 container died cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-ad35db0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-16T09:50:19.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 podman[79570]: 2024-09-16 09:50:19.506044802 +0000 UTC m=+0.620579906 container cleanup cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ad35db0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T09:50:19.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 bash[79570]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114 2024-09-16T09:50:20.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 podman[79582]: 2024-09-16 09:50:19.732418464 +0000 UTC m=+0.614481006 container remove cb7bdea83946503e1d92987e73973aa4d031a2252eab494d2809d3d559435dba (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-ad35db0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T09:50:20.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi114.service: Deactivated successfully. 2024-09-16T09:50:20.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 systemd[1]: Stopped Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:50:20.054 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:19 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi114.service: Consumed 6.788s CPU time. 2024-09-16T09:50:20.366 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 systemd[1]: Starting Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:50:20.366 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 podman[79712]: 2024-09-16 09:50:20.164039201 +0000 UTC m=+0.015593760 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:50:20.366 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 podman[79712]: 2024-09-16 09:50:20.28383448 +0000 UTC m=+0.135389064 container create 1890a098e70d09465ae0e7ec108127683d02a7e22e7ba4b9842e7ef739d246ff (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 podman[79712]: 2024-09-16 09:50:20.470194701 +0000 UTC m=+0.321749253 container init 1890a098e70d09465ae0e7ec108127683d02a7e22e7ba4b9842e7ef739d246ff (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 podman[79712]: 2024-09-16 09:50:20.473453358 +0000 UTC m=+0.325007907 container start 1890a098e70d09465ae0e7ec108127683d02a7e22e7ba4b9842e7ef739d246ff (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: set uid:gid to 167:167 (ceph:ceph) 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev), process ceph-mon, pid 2 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: pidfile_write: ignore empty --pid-file 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: load: jerasure load: lrc 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: RocksDB version: 7.9.2 2024-09-16T09:50:20.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Git sha 0 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Compile date 2024-09-12 18:19:39 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: DB SUMMARY 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: DB Session ID: UU8384YP4H8IZ3DPBK00 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: CURRENT file: CURRENT 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: IDENTITY file: IDENTITY 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1400 Bytes 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi114/store.db dir, Total Num: 1, files: 000027.sst 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi114/store.db: 000025.log size: 3506400 ; 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.error_if_exists: 0 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.create_if_missing: 0 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.paranoid_checks: 1 2024-09-16T09:50:20.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.env: 0x558f2131c120 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.fs: PosixFileSystem 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.info_log: 0x558f235e38e0 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_file_opening_threads: 16 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.statistics: (nil) 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.use_fsync: 0 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_log_file_size: 0 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-16T09:50:20.690 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.keep_log_file_num: 1000 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.recycle_log_file_num: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.allow_fallocate: 1 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.allow_mmap_reads: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.allow_mmap_writes: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.use_direct_reads: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.create_missing_column_families: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.db_log_dir: 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.wal_dir: 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-16T09:50:20.691 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.advise_random_on_open: 1 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.db_write_buffer_size: 0 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.write_buffer_manager: 0x558f235e7b80 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.rate_limiter: (nil) 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.wal_recovery_mode: 2 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.enable_thread_tracking: 0 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.enable_pipelined_write: 0 2024-09-16T09:50:20.692 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.unordered_write: 0 2024-09-16T09:50:20.693 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-16T09:50:20.693 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-16T09:50:20.693 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-16T09:50:20.693 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-16T09:50:20.693 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.row_cache: None 2024-09-16T09:50:20.693 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.wal_filter: None 2024-09-16T09:50:20.694 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-16T09:50:20.694 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.allow_ingest_behind: 0 2024-09-16T09:50:20.694 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.two_write_queues: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.manual_wal_flush: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.wal_compression: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.atomic_flush: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.log_readahead_size: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.best_efforts_recovery: 0 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-16T09:50:20.695 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.allow_data_in_errors: 0 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.db_host_id: __hostname__ 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_background_jobs: 2 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_background_compactions: -1 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_subcompactions: 1 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_total_wal_size: 0 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-16T09:50:20.696 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_open_files: -1 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bytes_per_sync: 0 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_readahead_size: 0 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_background_flushes: -1 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Compression algorithms supported: 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kZSTD supported: 0 2024-09-16T09:50:20.697 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kXpressCompression supported: 0 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kBZip2Compression supported: 0 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kLZ4Compression supported: 1 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kZlibCompression supported: 1 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kLZ4HCCompression supported: 1 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: kSnappyCompression supported: 1 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-16T09:50:20.698 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi114/store.db/MANIFEST-000010 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.merge_operator: 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_filter: None 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_filter_factory: None 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.sst_partitioner_factory: None 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558f235e3540) 2024-09-16T09:50:20.699 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: cache_index_and_filter_blocks: 1 2024-09-16T09:50:20.700 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-16T09:50:20.700 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-16T09:50:20.700 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: pin_top_level_index_and_filter: 1 2024-09-16T09:50:20.700 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: index_type: 0 2024-09-16T09:50:20.700 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: data_block_index_type: 0 2024-09-16T09:50:20.700 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: index_shortening: 1 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: checksum: 4 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: no_block_cache: 0 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache: 0x558f235d7610 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache_name: BinnedLRUCache 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache_options: 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: capacity : 536870912 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: num_shard_bits : 4 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: strict_capacity_limit : 0 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: high_pri_pool_ratio: 0.000 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_cache_compressed: (nil) 2024-09-16T09:50:20.701 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: persistent_cache: (nil) 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_size: 4096 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_size_deviation: 10 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_restart_interval: 16 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: index_block_restart_interval: 1 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: metadata_block_size: 4096 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: partition_filters: 0 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: use_delta_encoding: 1 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: filter_policy: bloomfilter 2024-09-16T09:50:20.702 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: whole_key_filtering: 1 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: verify_compression: 0 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: read_amp_bytes_per_bit: 0 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: format_version: 5 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: enable_index_compression: 1 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: block_align: 0 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: max_auto_readahead_size: 262144 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: prepopulate_block_cache: 0 2024-09-16T09:50:20.703 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: initial_auto_readahead_size: 8192 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: num_file_reads_for_auto_readahead: 2 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.write_buffer_size: 33554432 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_write_buffer_number: 2 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression: NoCompression 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression: Disabled 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.prefix_extractor: nullptr 2024-09-16T09:50:20.704 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.num_levels: 7 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-16T09:50:20.705 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.level: 32767 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.strategy: 0 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-16T09:50:20.706 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.enabled: false 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.target_file_size_base: 67108864 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-16T09:50:20.707 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-16T09:50:20.708 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.arena_block_size: 1048576 2024-09-16T09:50:20.709 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-16T09:50:20.709 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-16T09:50:20.709 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.disable_auto_compactions: 0 2024-09-16T09:50:20.709 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-16T09:50:20.709 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-16T09:50:20.709 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-16T09:50:20.710 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.inplace_update_support: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.bloom_locality: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.max_successive_merges: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.paranoid_file_checks: 0 2024-09-16T09:50:20.711 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.force_consistency_checks: 1 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.report_bg_io_stats: 0 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.ttl: 2592000 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.enable_blob_files: false 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.min_blob_size: 0 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.blob_file_size: 268435456 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-16T09:50:20.712 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.blob_file_starting_level: 0 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi114/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12228, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9ba833ca-e058-48b2-b679-fb7ca8393600 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726480220500160, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-16T09:50:20.713 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726480220508882, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2054563, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12233, "largest_seqno": 14165, "table_properties": {"data_size": 2046447, "index_size": 5090, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 18454, "raw_average_key_size": 23, "raw_value_size": 2029732, "raw_average_value_size": 2592, "num_data_blocks": 233, "num_entries": 783, "num_filter_entries": 783, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726480220, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9ba833ca-e058-48b2-b679-fb7ca8393600", "db_session_id": "UU8384YP4H8IZ3DPBK00", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726480220509005, "job": 1, "event": "recovery_finished"} 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi114/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x558f23606e00 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: DB pointer 0x558f23708000 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-16T09:50:20.714 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** DB Stats ** 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** Compaction Stats [default] ** 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: L0 1/0 1.96 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 544.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T09:50:20.715 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: L6 1/0 7.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Sum 2/0 9.09 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 544.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 544.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** Compaction Stats [default] ** 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 544.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-16T09:50:20.716 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Cumulative compaction: 0.00 GB write, 151.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Interval compaction: 0.00 GB write, 151.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Block cache BinnedLRUCache@0x558f235d7610#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-16T09:50:20.717 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: starting mon.smithi114 rank 1 at public addrs [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] at bind addrs [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi114 fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???) e2 preinit fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).mds e14 new map 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).mds e14 print_map 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: e14 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: legacy client fscid: 1 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Filesystem 'cephfs' (1) 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: fs_name cephfs 2024-09-16T09:50:20.718 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: epoch 11 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: tableserver 0 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: root 0 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: session_timeout 60 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: session_autoclose 300 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: max_file_size 1099511627776 2024-09-16T09:50:20.719 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: max_xattr_size 65536 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: required_client_features {} 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: last_failure 0 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: last_failure_osd_epoch 0 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: max_mds 1 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: in 0 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: up {0=14550} 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: failed 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: damaged 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: stopped 2024-09-16T09:50:20.720 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: data_pools [3] 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: metadata_pool 2 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: inline_data enabled 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: balancer 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: bal_rank_mask -1 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: standby_count_wanted 1 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: qdb_cluster leader: 14550 members: 14550 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: [mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: Standby daemons: 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: [mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: [mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:20.721 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout: [mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).osd e45 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).osd e45 crush map has features 288514051259236352, adjusting msgr requires 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 ceph-mon[79732]: mon.smithi114@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 bash[79712]: 1890a098e70d09465ae0e7ec108127683d02a7e22e7ba4b9842e7ef739d246ff 2024-09-16T09:50:20.722 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:20 smithi114 systemd[1]: Started Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:50:22.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mon metadata", "id": "smithi111"} : dispatch 2024-09-16T09:50:22.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mon metadata", "id": "smithi114"} : dispatch 2024-09-16T09:50:22.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-16T09:50:22.403 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mon metadata", "id": "smithi111"} : dispatch 2024-09-16T09:50:22.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mon metadata", "id": "smithi114"} : dispatch 2024-09-16T09:50:22.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: pgmap v88: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: pgmap v89: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: mon.smithi114 calling monitor election 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: mon.smithi111 calling monitor election 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: mon.smithi111 is new leader, mons smithi111,smithi114 in quorum (ranks 0,1) 2024-09-16T09:50:23.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: monmap epoch 2 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: last_changed 2024-09-16T09:38:58.929938+0000 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: min_mon_release 19 (squid) 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: election_strategy: 1 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: 1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.smithi114 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: mgrmap e31: smithi111.erxodt(active, since 2m), standbys: smithi114.xvotey 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:23.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:23.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:23.384 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:23 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: pgmap v88: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: pgmap v89: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: mon.smithi114 calling monitor election 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: mon.smithi111 calling monitor election 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: mon.smithi111 is new leader, mons smithi111,smithi114 in quorum (ranks 0,1) 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: monmap epoch 2 2024-09-16T09:50:23.404 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: fsid 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: last_changed 2024-09-16T09:38:58.929938+0000 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: created 2024-09-16T09:36:33.786442+0000 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: min_mon_release 19 (squid) 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: election_strategy: 1 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: 0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.smithi111 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: 1: [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] mon.smithi114 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: osdmap e45: 6 total, 6 up, 6 in 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: mgrmap e31: smithi111.erxodt(active, since 2m), standbys: smithi114.xvotey 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:23.405 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:23.406 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:23 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:24.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:24 smithi111 ceph-mon[109885]: pgmap v90: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:24.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:24 smithi114 ceph-mon[79732]: pgmap v90: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:26.029 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:25 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.029 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:25 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.029 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:25 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.029 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:25 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:25 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:25 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:25 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:26.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:25 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:27.073 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:26 smithi114 ceph-mon[79732]: pgmap v91: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:27.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:26 smithi111 ceph-mon[109885]: pgmap v91: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:29.126 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: pgmap v92: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]': finished 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi114"} : dispatch 2024-09-16T09:50:29.127 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi114"}]': finished 2024-09-16T09:50:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: pgmap v92: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"} : dispatch 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi111"}]': finished 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi114"} : dispatch 2024-09-16T09:50:29.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi114"}]': finished 2024-09-16T09:50:30.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:29 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all mon 2024-09-16T09:50:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:29 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all mon 2024-09-16T09:50:30.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:30 smithi111 ceph-mon[109885]: pgmap v93: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-16T09:50:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:30.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:50:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:30 smithi114 ceph-mon[79732]: pgmap v93: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi111", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-16T09:50:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:50:31.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 -- 172.21.15.111:0/2457235167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150101930 msgr2=0x7f5150101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:31.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 --2- 172.21.15.111:0/2457235167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150101930 0x7f5150101d90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5138009880 tx=0x7f513802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:31.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 -- 172.21.15.111:0/2457235167 shutdown_connections 2024-09-16T09:50:31.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 --2- 172.21.15.111:0/2457235167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150101930 0x7f5150101d90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 --2- 172.21.15.111:0/2457235167 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150107930 0x7f5150107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 -- 172.21.15.111:0/2457235167 >> 172.21.15.111:0/2457235167 conn(0x7f51500fd630 msgr2=0x7f51500ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 -- 172.21.15.111:0/2457235167 shutdown_connections 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.876+0000 7f5154eaf640 1 -- 172.21.15.111:0/2457235167 wait complete. 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.877+0000 7f5154eaf640 1 Processor -- start 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.877+0000 7f5154eaf640 1 -- start start 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.877+0000 7f5154eaf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150101930 0x7f51500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.877+0000 7f5154eaf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 0x7f5150074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.877+0000 7f5154eaf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f515010ee00 con 0x7f5150107930 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.877+0000 7f5154eaf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f515010ec80 con 0x7f5150101930 2024-09-16T09:50:31.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 0x7f5150074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 0x7f5150074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50420/0 (socket says 172.21.15.111:50420) 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 -- 172.21.15.111:0/1199993756 learned_addr learned my addr 172.21.15.111:0/1199993756 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f514e59c640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150101930 0x7f51500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 -- 172.21.15.111:0/1199993756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150101930 msgr2=0x7f51500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150101930 0x7f51500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 -- 172.21.15.111:0/1199993756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5150074f70 con 0x7f5150107930 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f514e59c640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150101930 0x7f51500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:50:31.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5147fff640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 0x7f5150074a30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5138031460 tx=0x7f51380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:31.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f513803f070 con 0x7f5150107930 2024-09-16T09:50:31.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f51380035f0 con 0x7f5150107930 2024-09-16T09:50:31.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5150075200 con 0x7f5150107930 2024-09-16T09:50:31.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5138035030 con 0x7f5150107930 2024-09-16T09:50:31.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.878+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51501a3dd0 con 0x7f5150107930 2024-09-16T09:50:31.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.880+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5150103070 con 0x7f5150107930 2024-09-16T09:50:31.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.881+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f5138042070 con 0x7f5150107930 2024-09-16T09:50:31.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.881+0000 7f51477fe640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f513c07ac40 0x7f513c07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:31.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.881+0000 7f514e59c640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f513c07ac40 0x7f513c07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:31.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.881+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f51380beb10 con 0x7f5150107930 2024-09-16T09:50:31.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.881+0000 7f514e59c640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f513c07ac40 0x7f513c07d100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51400058c0 tx=0x7f5140005850 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:31.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:31.885+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f513808a420 con 0x7f5150107930 2024-09-16T09:50:32.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.083+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5150109f10 con 0x7f513c07ac40 2024-09-16T09:50:32.085 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:31 smithi111 ceph-mon[109885]: Upgrade: Updating crash.smithi111 (1/2) 2024-09-16T09:50:32.085 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:31 smithi111 ceph-mon[109885]: Deploying daemon crash.smithi111 on smithi111 2024-09-16T09:50:32.085 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.084+0000 7f51477fe640 1 -- 172.21.15.111:0/1199993756 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f514000bca0 con 0x7f513c07ac40 2024-09-16T09:50:32.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f513c07ac40 msgr2=0x7f513c07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f513c07ac40 0x7f513c07d100 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f51400058c0 tx=0x7f5140005850 comp rx=0 tx=0).stop 2024-09-16T09:50:32.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 msgr2=0x7f5150074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 0x7f5150074a30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5138031460 tx=0x7f51380045e0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 shutdown_connections 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f513c07ac40 0x7f513c07d100 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5150107930 0x7f5150074a30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 --2- 172.21.15.111:0/1199993756 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5150101930 0x7f51500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.086+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 >> 172.21.15.111:0/1199993756 conn(0x7f51500fd630 msgr2=0x7f51500fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.087+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 shutdown_connections 2024-09-16T09:50:32.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.087+0000 7f5154eaf640 1 -- 172.21.15.111:0/1199993756 wait complete. 2024-09-16T09:50:32.097 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:50:32.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 -- 172.21.15.111:0/3394341409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 msgr2=0x7ffbdc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/3394341409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc100c40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009880 tx=0x7ffbcc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 -- 172.21.15.111:0/3394341409 shutdown_connections 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/3394341409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc100c40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/3394341409 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc1067e0 0x7ffbdc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 -- 172.21.15.111:0/3394341409 >> 172.21.15.111:0/3394341409 conn(0x7ffbdc0fc4c0 msgr2=0x7ffbdc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 -- 172.21.15.111:0/3394341409 shutdown_connections 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 -- 172.21.15.111:0/3394341409 wait complete. 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 Processor -- start 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.172+0000 7ffbe33bb640 1 -- start start 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe33bb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe33bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc1067e0 0x7ffbdc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe33bb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc10dc90 con 0x7ffbdc1007e0 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe33bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffbdc10db10 con 0x7ffbdc1067e0 2024-09-16T09:50:32.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50434/0 (socket says 172.21.15.111:50434) 2024-09-16T09:50:32.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 -- 172.21.15.111:0/1402968735 learned_addr learned my addr 172.21.15.111:0/1402968735 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:32.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe0956640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc1067e0 0x7ffbdc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 -- 172.21.15.111:0/1402968735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc1067e0 msgr2=0x7ffbdc19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc1067e0 0x7ffbdc19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 -- 172.21.15.111:0/1402968735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbdc1977d0 con 0x7ffbdc1007e0 2024-09-16T09:50:32.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe1157640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc19d650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800d8d0 tx=0x7ffbd800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:32.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbd8017030 con 0x7ffbdc1007e0 2024-09-16T09:50:32.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffbd8004020 con 0x7ffbdc1007e0 2024-09-16T09:50:32.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffbd80047a0 con 0x7ffbdc1007e0 2024-09-16T09:50:32.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbdc197ac0 con 0x7ffbdc1007e0 2024-09-16T09:50:32.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.173+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbdc198020 con 0x7ffbdc1007e0 2024-09-16T09:50:32.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.174+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbdc101f20 con 0x7ffbdc1007e0 2024-09-16T09:50:32.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.175+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ffbd80041d0 con 0x7ffbdc1007e0 2024-09-16T09:50:32.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.175+0000 7ffbd27fc640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffbc807abf0 0x7ffbc807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.176+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7ffbd8018070 con 0x7ffbdc1007e0 2024-09-16T09:50:32.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.176+0000 7ffbe0956640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffbc807abf0 0x7ffbc807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.176+0000 7ffbe0956640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffbc807abf0 0x7ffbc807d0b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc198b20 tx=0x7ffbcc031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:32.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.180+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ffbd8069100 con 0x7ffbdc1007e0 2024-09-16T09:50:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:31 smithi114 ceph-mon[79732]: Upgrade: Updating crash.smithi111 (1/2) 2024-09-16T09:50:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:31 smithi114 ceph-mon[79732]: Deploying daemon crash.smithi111 on smithi111 2024-09-16T09:50:32.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.371+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffbdc198330 con 0x7ffbc807abf0 2024-09-16T09:50:32.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.372+0000 7ffbd27fc640 1 -- 172.21.15.111:0/1402968735 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7ffbdc198330 con 0x7ffbc807abf0 2024-09-16T09:50:32.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffbc807abf0 msgr2=0x7ffbc807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffbc807abf0 0x7ffbc807d0b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc198b20 tx=0x7ffbcc031400 comp rx=0 tx=0).stop 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 msgr2=0x7ffbdc19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc19d650 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ffbd800d8d0 tx=0x7ffbd800dd90 comp rx=0 tx=0).stop 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 shutdown_connections 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffbc807abf0 0x7ffbc807d0b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffbdc1067e0 0x7ffbdc19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 --2- 172.21.15.111:0/1402968735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffbdc1007e0 0x7ffbdc19d650 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.374+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 >> 172.21.15.111:0/1402968735 conn(0x7ffbdc0fc4c0 msgr2=0x7ffbdc069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.375+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 shutdown_connections 2024-09-16T09:50:32.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.375+0000 7ffbe33bb640 1 -- 172.21.15.111:0/1402968735 wait complete. 2024-09-16T09:50:32.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 -- 172.21.15.111:0/1689765970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 msgr2=0x7fb35c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1689765970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c10b8f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb350009880 tx=0x7fb35002a530 comp rx=0 tx=0).stop 2024-09-16T09:50:32.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 -- 172.21.15.111:0/1689765970 shutdown_connections 2024-09-16T09:50:32.460 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1689765970 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c10b8f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1689765970 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb35c102ae0 0x7fb35c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 -- 172.21.15.111:0/1689765970 >> 172.21.15.111:0/1689765970 conn(0x7fb35c0fc520 msgr2=0x7fb35c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 -- 172.21.15.111:0/1689765970 shutdown_connections 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.456+0000 7fb361cf0640 1 -- 172.21.15.111:0/1689765970 wait complete. 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb361cf0640 1 Processor -- start 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb361cf0640 1 -- start start 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb361cf0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb35c102ae0 0x7fb35c19f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb361cf0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c19fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb361cf0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c10ee10 con 0x7fb35c103400 2024-09-16T09:50:32.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb361cf0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c10ec90 con 0x7fb35c102ae0 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.457+0000 7fb35affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c19fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c19fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50460/0 (socket says 172.21.15.111:50460) 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35affd640 1 -- 172.21.15.111:0/1470687440 learned_addr learned my addr 172.21.15.111:0/1470687440 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35b7fe640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb35c102ae0 0x7fb35c19f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35affd640 1 -- 172.21.15.111:0/1470687440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb35c102ae0 msgr2=0x7fb35c19f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35affd640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb35c102ae0 0x7fb35c19f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35affd640 1 -- 172.21.15.111:0/1470687440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c199a90 con 0x7fb35c103400 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb35affd640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c19fe10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb350031460 tx=0x7fb3500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb35003f070 con 0x7fb35c103400 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c199d20 con 0x7fb35c103400 2024-09-16T09:50:32.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb350004ac0 con 0x7fb35c103400 2024-09-16T09:50:32.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb350035030 con 0x7fb35c103400 2024-09-16T09:50:32.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.458+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35c19a250 con 0x7fb35c103400 2024-09-16T09:50:32.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.460+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35c06abe0 con 0x7fb35c103400 2024-09-16T09:50:32.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.461+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fb350042070 con 0x7fb35c103400 2024-09-16T09:50:32.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.461+0000 7fb358ff9640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb34407abf0 0x7fb34407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.461+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7fb3500be5c0 con 0x7fb35c103400 2024-09-16T09:50:32.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.461+0000 7fb35b7fe640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb34407abf0 0x7fb34407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.462+0000 7fb35b7fe640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb34407abf0 0x7fb34407d0b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005fd0 tx=0x7fb34c005e20 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:32.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.466+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fb350089db0 con 0x7fb35c103400 2024-09-16T09:50:32.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.655+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb35c19afc0 con 0x7fb34407abf0 2024-09-16T09:50:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.665+0000 7fb358ff9640 1 -- 172.21.15.111:0/1470687440 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb35c19afc0 con 0x7fb34407abf0 2024-09-16T09:50:32.667 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:50:32.667 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (99s) 20s ago 12m 21.2M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:50:32.667 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (3m) 20s ago 12m 8660k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (3m) 7s ago 11m 8304k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (12m) 20s ago 12m 6891k - 19.1.1-328-gad35db06 b5388489f99e ebc2bfb1c633 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (11m) 7s ago 11m 6895k - 19.1.1-328-gad35db06 b5388489f99e 29f5d9502429 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (77s) 20s ago 12m 74.7M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (7m) 20s ago 7m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (7m) 20s ago 7m 17.7M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (7m) 7s ago 7m 19.5M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (7m) 7s ago 7m 19.3M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (3m) 20s ago 13m 521M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (2m) 7s ago 11m 455M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (27s) 20s ago 13m 25.5M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:50:32.668 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (12s) 7s ago 11m 20.7M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (2m) 20s ago 12m 10.4M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (2m) 7s ago 11m 10.3M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (10m) 20s ago 10m 229M 1216M 19.1.1-328-gad35db06 b5388489f99e 99bb8c285f21 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (10m) 20s ago 10m 248M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (9m) 20s ago 9m 211M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (9m) 7s ago 9m 305M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (8m) 7s ago 8m 246M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (8m) 7s ago 8m 236M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:50:32.669 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (2m) 20s ago 12m 48.2M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb34407abf0 msgr2=0x7fb34407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb34407abf0 0x7fb34407d0b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb34c005fd0 tx=0x7fb34c005e20 comp rx=0 tx=0).stop 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 msgr2=0x7fb35c19fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c19fe10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb350031460 tx=0x7fb3500046c0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 shutdown_connections 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb34407abf0 0x7fb34407d0b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb35c103400 0x7fb35c19fe10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 --2- 172.21.15.111:0/1470687440 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb35c102ae0 0x7fb35c19f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 >> 172.21.15.111:0/1470687440 conn(0x7fb35c0fc520 msgr2=0x7fb35c100bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:32.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 shutdown_connections 2024-09-16T09:50:32.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.668+0000 7fb361cf0640 1 -- 172.21.15.111:0/1470687440 wait complete. 2024-09-16T09:50:32.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 -- 172.21.15.111:0/1518232728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 msgr2=0x7f8a84100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/1518232728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a84100c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009880 tx=0x7f8a7402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 -- 172.21.15.111:0/1518232728 shutdown_connections 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/1518232728 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a84100c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/1518232728 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a841067e0 0x7f8a84106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 -- 172.21.15.111:0/1518232728 >> 172.21.15.111:0/1518232728 conn(0x7f8a840fc4c0 msgr2=0x7f8a840fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 -- 172.21.15.111:0/1518232728 shutdown_connections 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 -- 172.21.15.111:0/1518232728 wait complete. 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.755+0000 7f8a8b34e640 1 Processor -- start 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a8b34e640 1 -- start start 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a8b34e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a8419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a8b34e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a841067e0 0x7f8a8419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a8b34e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8410dcb0 con 0x7f8a841007e0 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a8b34e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8410db30 con 0x7f8a841067e0 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a8419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a8419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50484/0 (socket says 172.21.15.111:50484) 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 -- 172.21.15.111:0/2257930930 learned_addr learned my addr 172.21.15.111:0/2257930930 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a888e9640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a841067e0 0x7f8a8419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 -- 172.21.15.111:0/2257930930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a841067e0 msgr2=0x7f8a8419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a841067e0 0x7f8a8419dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 -- 172.21.15.111:0/2257930930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a84197830 con 0x7f8a841007e0 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a890ea640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a8419d6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000d6f0 tx=0x7f8a8000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.756+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a80017070 con 0x7f8a841007e0 2024-09-16T09:50:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.757+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8a8000de00 con 0x7f8a841007e0 2024-09-16T09:50:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.757+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a84197b20 con 0x7f8a841007e0 2024-09-16T09:50:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.757+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8a80004bb0 con 0x7f8a841007e0 2024-09-16T09:50:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.757+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a841980b0 con 0x7f8a841007e0 2024-09-16T09:50:32.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.758+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a84101f20 con 0x7f8a841007e0 2024-09-16T09:50:32.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.758+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f8a80004e60 con 0x7f8a841007e0 2024-09-16T09:50:32.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.759+0000 7f8a7a7fc640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8a7007ac00 0x7f8a7007d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:32.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.759+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f8a8009d7e0 con 0x7f8a841007e0 2024-09-16T09:50:32.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.759+0000 7f8a888e9640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8a7007ac00 0x7f8a7007d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:32.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.759+0000 7f8a888e9640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8a7007ac00 0x7f8a7007d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a74031460 tx=0x7f8a74000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:32.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:32.763+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f8a80068fd0 con 0x7f8a841007e0 2024-09-16T09:50:32.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:32 smithi111 ceph-mon[109885]: pgmap v94: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:33.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.044+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8a84109d60 con 0x7f8a841007e0 2024-09-16T09:50:33.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.044+0000 7f8a7a7fc640 1 -- 172.21.15.111:0/2257930930 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f8a8006de80 con 0x7f8a841007e0 2024-09-16T09:50:33.046 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:50:33.047 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:50:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 10, 2024-09-16T09:50:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 4 2024-09-16T09:50:33.048 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:50:33.048 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8a7007ac00 msgr2=0x7f8a7007d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8a7007ac00 0x7f8a7007d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8a74031460 tx=0x7f8a74000bc0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 msgr2=0x7f8a8419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a8419d6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8a8000d6f0 tx=0x7f8a8000dbb0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 shutdown_connections 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8a7007ac00 0x7f8a7007d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8a841067e0 0x7f8a8419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 --2- 172.21.15.111:0/2257930930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a841007e0 0x7f8a8419d6b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 >> 172.21.15.111:0/2257930930 conn(0x7f8a840fc4c0 msgr2=0x7f8a84069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 shutdown_connections 2024-09-16T09:50:33.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.047+0000 7f8a8b34e640 1 -- 172.21.15.111:0/2257930930 wait complete. 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 -- 172.21.15.111:0/3310372229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101067e0 msgr2=0x7f2110106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 --2- 172.21.15.111:0/3310372229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101067e0 0x7f2110106bc0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2100009880 tx=0x7f210002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 -- 172.21.15.111:0/3310372229 shutdown_connections 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 --2- 172.21.15.111:0/3310372229 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21101007e0 0x7f2110100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 --2- 172.21.15.111:0/3310372229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101067e0 0x7f2110106bc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 -- 172.21.15.111:0/3310372229 >> 172.21.15.111:0/3310372229 conn(0x7f21100fc4c0 msgr2=0x7f21100fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 -- 172.21.15.111:0/3310372229 shutdown_connections 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.131+0000 7f2116584640 1 -- 172.21.15.111:0/3310372229 wait complete. 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.132+0000 7f2116584640 1 Processor -- start 2024-09-16T09:50:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.132+0000 7f2116584640 1 -- start start 2024-09-16T09:50:33.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.132+0000 7f2116584640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 0x7f211019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.132+0000 7f2116584640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21101067e0 0x7f211019cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.132+0000 7f2116584640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f211010dd10 con 0x7f21101007e0 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.132+0000 7f2116584640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f211010db90 con 0x7f21101067e0 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 0x7f211019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 0x7f211019c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50496/0 (socket says 172.21.15.111:50496) 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 -- 172.21.15.111:0/2507884393 learned_addr learned my addr 172.21.15.111:0/2507884393 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210f7fe640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21101067e0 0x7f211019cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 -- 172.21.15.111:0/2507884393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21101067e0 msgr2=0x7f211019cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21101067e0 0x7f211019cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 -- 172.21.15.111:0/2507884393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2110196740 con 0x7f21101007e0 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210ffff640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 0x7f211019c670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2100031460 tx=0x7f21000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:33.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f210003f070 con 0x7f21101007e0 2024-09-16T09:50:33.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2100004cf0 con 0x7f21101007e0 2024-09-16T09:50:33.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21101969d0 con 0x7f21101007e0 2024-09-16T09:50:33.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2100035030 con 0x7f21101007e0 2024-09-16T09:50:33.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.133+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2110196ed0 con 0x7f21101007e0 2024-09-16T09:50:33.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.134+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2110101f20 con 0x7f21101007e0 2024-09-16T09:50:33.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.135+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f2100042070 con 0x7f21101007e0 2024-09-16T09:50:33.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.136+0000 7f210d7fa640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f20f807ac40 0x7f20f807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.136+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f21000be6a0 con 0x7f21101007e0 2024-09-16T09:50:33.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.136+0000 7f210f7fe640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f20f807ac40 0x7f20f807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.136+0000 7f210f7fe640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f20f807ac40 0x7f20f807d100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2110197f90 tx=0x7f2104008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:33.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.141+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f2100089f10 con 0x7f21101007e0 2024-09-16T09:50:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:32 smithi114 ceph-mon[79732]: pgmap v94: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.372+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2110197c70 con 0x7f21101007e0 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.372+0000 7f210d7fa640 1 -- 172.21.15.111:0/2507884393 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7f210008edc0 con 0x7f21101007e0 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:33.374 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:50:33.375 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:50:33.376 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:33.377 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:50:33.378 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:50:33.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f20f807ac40 msgr2=0x7f20f807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f20f807ac40 0x7f20f807d100 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2110197f90 tx=0x7f2104008040 comp rx=0 tx=0).stop 2024-09-16T09:50:33.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 msgr2=0x7f211019c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 0x7f211019c670 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2100031460 tx=0x7f21000048f0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 shutdown_connections 2024-09-16T09:50:33.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f20f807ac40 0x7f20f807d100 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f21101067e0 0x7f211019cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 --2- 172.21.15.111:0/2507884393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21101007e0 0x7f211019c670 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.374+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 >> 172.21.15.111:0/2507884393 conn(0x7f21100fc4c0 msgr2=0x7f21100fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:33.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.375+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 shutdown_connections 2024-09-16T09:50:33.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.375+0000 7f2116584640 1 -- 172.21.15.111:0/2507884393 wait complete. 2024-09-16T09:50:33.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 -- 172.21.15.111:0/4018888439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 msgr2=0x7f641810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 --2- 172.21.15.111:0/4018888439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641810b910 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f64040098b0 tx=0x7f640402a560 comp rx=0 tx=0).stop 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 -- 172.21.15.111:0/4018888439 shutdown_connections 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 --2- 172.21.15.111:0/4018888439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641810b910 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 --2- 172.21.15.111:0/4018888439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6418102b00 0x7f6418102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 -- 172.21.15.111:0/4018888439 >> 172.21.15.111:0/4018888439 conn(0x7f64180fc4c0 msgr2=0x7f64180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 -- 172.21.15.111:0/4018888439 shutdown_connections 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.461+0000 7f641efeb640 1 -- 172.21.15.111:0/4018888439 wait complete. 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641efeb640 1 Processor -- start 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641efeb640 1 -- start start 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641efeb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6418102b00 0x7f641819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641efeb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641819dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641efeb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f641810edd0 con 0x7f6418103420 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641efeb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f641810ec50 con 0x7f6418102b00 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f6417fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641819dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f6417fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641819dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54194/0 (socket says 172.21.15.111:54194) 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f6417fff640 1 -- 172.21.15.111:0/1608949026 learned_addr learned my addr 172.21.15.111:0/1608949026 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f641cd87640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6418102b00 0x7f641819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.462+0000 7f6417fff640 1 -- 172.21.15.111:0/1608949026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6418102b00 msgr2=0x7f641819d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f6417fff640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6418102b00 0x7f641819d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f6417fff640 1 -- 172.21.15.111:0/1608949026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64181978a0 con 0x7f6418103420 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f6417fff640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641819dc20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6404031460 tx=0x7f64040045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f640403f070 con 0x7f6418103420 2024-09-16T09:50:33.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64040035f0 con 0x7f6418103420 2024-09-16T09:50:33.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6418197b30 con 0x7f6418103420 2024-09-16T09:50:33.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6404035030 con 0x7f6418103420 2024-09-16T09:50:33.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.463+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6418198060 con 0x7f6418103420 2024-09-16T09:50:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.464+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f641806a3b0 con 0x7f6418103420 2024-09-16T09:50:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.465+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f6404042070 con 0x7f6418103420 2024-09-16T09:50:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.465+0000 7f6415ffb640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f640807ac40 0x7f640807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.466+0000 7f641cd87640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f640807ac40 0x7f640807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.466+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f64040be430 con 0x7f6418103420 2024-09-16T09:50:33.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.466+0000 7f641cd87640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f640807ac40 0x7f640807d100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64181989e0 tx=0x7f640c00b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:33.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.470+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f6404089c40 con 0x7f6418103420 2024-09-16T09:50:33.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.680+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6418198e70 con 0x7f640807ac40 2024-09-16T09:50:33.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.682+0000 7f6415ffb640 1 -- 172.21.15.111:0/1608949026 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f6418198e70 con 0x7f640807ac40 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "mon" 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "4/23 daemons upgraded", 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading crash daemons", 2024-09-16T09:50:33.684 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:50:33.685 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:50:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f640807ac40 msgr2=0x7f640807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f640807ac40 0x7f640807d100 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f64181989e0 tx=0x7f640c00b390 comp rx=0 tx=0).stop 2024-09-16T09:50:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 msgr2=0x7f641819dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641819dc20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6404031460 tx=0x7f64040045c0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 shutdown_connections 2024-09-16T09:50:33.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f640807ac40 0x7f640807d100 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6418103420 0x7f641819dc20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 --2- 172.21.15.111:0/1608949026 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6418102b00 0x7f641819d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.684+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 >> 172.21.15.111:0/1608949026 conn(0x7f64180fc4c0 msgr2=0x7f6418103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:33.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.685+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 shutdown_connections 2024-09-16T09:50:33.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.685+0000 7f641efeb640 1 -- 172.21.15.111:0/1608949026 wait complete. 2024-09-16T09:50:33.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 -- 172.21.15.111:0/3918427100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064101040 msgr2=0x7f406410dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 --2- 172.21.15.111:0/3918427100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064101040 0x7f406410dd00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4058009880 tx=0x7f405802a490 comp rx=0 tx=0).stop 2024-09-16T09:50:33.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 -- 172.21.15.111:0/3918427100 shutdown_connections 2024-09-16T09:50:33.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 --2- 172.21.15.111:0/3918427100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064101040 0x7f406410dd00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 --2- 172.21.15.111:0/3918427100 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4064100690 0x7f4064100a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 -- 172.21.15.111:0/3918427100 >> 172.21.15.111:0/3918427100 conn(0x7f40640fc4c0 msgr2=0x7f40640fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:33.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 -- 172.21.15.111:0/3918427100 shutdown_connections 2024-09-16T09:50:33.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.774+0000 7f406944b640 1 -- 172.21.15.111:0/3918427100 wait complete. 2024-09-16T09:50:33.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.775+0000 7f406944b640 1 Processor -- start 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.775+0000 7f406944b640 1 -- start start 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.775+0000 7f406944b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 0x7f406419f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.775+0000 7f406944b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4064101040 0x7f406419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.775+0000 7f406944b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4064110f10 con 0x7f4064100690 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.775+0000 7f406944b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f4064110d90 con 0x7f4064101040 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 0x7f406419f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 0x7f406419f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54224/0 (socket says 172.21.15.111:54224) 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 -- 172.21.15.111:0/2011996329 learned_addr learned my addr 172.21.15.111:0/2011996329 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f40627fc640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4064101040 0x7f406419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 -- 172.21.15.111:0/2011996329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4064101040 msgr2=0x7f406419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4064101040 0x7f406419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 -- 172.21.15.111:0/2011996329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4064199960 con 0x7f4064100690 2024-09-16T09:50:33.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f4062ffd640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 0x7f406419f7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f405400e970 tx=0x7f405400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:33.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f405400cac0 con 0x7f4064100690 2024-09-16T09:50:33.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f405400cc60 con 0x7f4064100690 2024-09-16T09:50:33.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4064199c50 con 0x7f4064100690 2024-09-16T09:50:33.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4054018720 con 0x7f4064100690 2024-09-16T09:50:33.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.776+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f406419a1b0 con 0x7f4064100690 2024-09-16T09:50:33.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.777+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f406406a3b0 con 0x7f4064100690 2024-09-16T09:50:33.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.778+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f4054010430 con 0x7f4064100690 2024-09-16T09:50:33.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.779+0000 7f404bfff640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f404c07ac40 0x7f404c07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:50:33.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.779+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6070+0+0 (secure 0 0 0) 0x7f405409e0e0 con 0x7f4064100690 2024-09-16T09:50:33.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.779+0000 7f40627fc640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f404c07ac40 0x7f404c07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:50:33.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.779+0000 7f40627fc640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f404c07ac40 0x7f404c07d100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f406419b150 tx=0x7f4058031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:50:33.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:33.783+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f4054069950 con 0x7f4064100690 2024-09-16T09:50:34.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.026+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f406410b3e0 con 0x7f4064100690 2024-09-16T09:50:34.028 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.029 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.029 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.029 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2257930930' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:34.029 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2507884393' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:50:34.029 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:34.029 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:33 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:34.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.027+0000 7f404bfff640 1 -- 172.21.15.111:0/2011996329 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f405406e800 con 0x7f4064100690 2024-09-16T09:50:34.030 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:34.030 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:50:34.030 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f404c07ac40 msgr2=0x7f404c07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f404c07ac40 0x7f404c07d100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f406419b150 tx=0x7f4058031400 comp rx=0 tx=0).stop 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 msgr2=0x7f406419f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 0x7f406419f7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f405400e970 tx=0x7f405400ee30 comp rx=0 tx=0).stop 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 shutdown_connections 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f404c07ac40 0x7f404c07d100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4064101040 0x7f406419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 --2- 172.21.15.111:0/2011996329 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4064100690 0x7f406419f7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 >> 172.21.15.111:0/2011996329 conn(0x7f40640fc4c0 msgr2=0x7f40640fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:50:34.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 shutdown_connections 2024-09-16T09:50:34.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:50:34.029+0000 7f406944b640 1 -- 172.21.15.111:0/2011996329 wait complete. 2024-09-16T09:50:34.125 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.126 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.126 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:34.126 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2257930930' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:34.126 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2507884393' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:50:34.126 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:34.126 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:33 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:34 smithi111 ceph-mon[109885]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:34 smithi111 ceph-mon[109885]: pgmap v95: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:34 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2011996329' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:50:35.158 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:34 smithi114 ceph-mon[79732]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:50:35.158 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:34 smithi114 ceph-mon[79732]: pgmap v95: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:35.158 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:34 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2011996329' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:50:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:36 smithi111 ceph-mon[109885]: Upgrade: Updating crash.smithi114 (2/2) 2024-09-16T09:50:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-16T09:50:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:36 smithi111 ceph-mon[109885]: Deploying daemon crash.smithi114 on smithi114 2024-09-16T09:50:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:36 smithi111 ceph-mon[109885]: pgmap v96: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:36.287 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:36 smithi114 ceph-mon[79732]: Upgrade: Updating crash.smithi114 (2/2) 2024-09-16T09:50:36.287 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:36.288 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi114", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-16T09:50:36.288 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:36.288 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:36 smithi114 ceph-mon[79732]: Deploying daemon crash.smithi114 on smithi114 2024-09-16T09:50:36.288 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:36 smithi114 ceph-mon[79732]: pgmap v96: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:38 smithi111 ceph-mon[109885]: pgmap v97: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:38.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:38.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:38 smithi114 ceph-mon[79732]: pgmap v97: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:38.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:38.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:38.993 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:40 smithi111 ceph-mon[109885]: pgmap v98: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:40 smithi114 ceph-mon[79732]: pgmap v98: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:42 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:42 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:42 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:42 smithi111 ceph-mon[109885]: pgmap v99: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:42.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:42 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.392 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:42 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.392 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:42 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.393 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:42 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:42.393 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:42 smithi114 ceph-mon[79732]: pgmap v99: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:42.393 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:42 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:44 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:44 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:44 smithi114 ceph-mon[79732]: pgmap v100: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:44.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:44 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:44 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:44 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:44 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:44 smithi111 ceph-mon[109885]: pgmap v100: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:44.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:44 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:44.730 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:44 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:50:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:50:47.092 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:46 smithi111 ceph-mon[109885]: pgmap v101: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:47.138 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:46 smithi114 ceph-mon[79732]: pgmap v101: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:50:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all crash 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]': finished 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi114"} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi114"}]': finished 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: Upgrade: osd.0 is safe to restart 2024-09-16T09:50:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:48 smithi111 ceph-mon[109885]: pgmap v102: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all crash 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi111"}]': finished 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi114"} : dispatch 2024-09-16T09:50:48.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi114"}]': finished 2024-09-16T09:50:48.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-16T09:50:48.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-16T09:50:48.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: Upgrade: osd.0 is safe to restart 2024-09-16T09:50:48.439 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:48 smithi114 ceph-mon[79732]: pgmap v102: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:49.723 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:49 smithi111 ceph-mon[109885]: Upgrade: Updating osd.0 2024-09-16T09:50:49.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:49 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:49.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:49 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-16T09:50:49.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:49 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:49.724 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:49 smithi111 ceph-mon[109885]: Deploying daemon osd.0 on smithi111 2024-09-16T09:50:49.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:49 smithi114 ceph-mon[79732]: Upgrade: Updating osd.0 2024-09-16T09:50:49.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:49 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:49.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:49 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-16T09:50:49.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:49 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:50:49.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:49 smithi114 ceph-mon[79732]: Deploying daemon osd.0 on smithi111 2024-09-16T09:50:50.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:50 smithi111 ceph-mon[109885]: pgmap v103: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:50.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:50 smithi114 ceph-mon[79732]: pgmap v103: 65 pgs: 65 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:51.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:51 smithi111 systemd[1]: Stopping Ceph osd.0 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:50:51.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:51 smithi111 ceph-mon[109885]: osd.0 marked itself down and dead 2024-09-16T09:50:51.882 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:51 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[49125]: 2024-09-16T09:50:51.559+0000 7feaa4970640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:50:51.882 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:51 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[49125]: 2024-09-16T09:50:51.559+0000 7feaa4970640 -1 osd.0 45 *** Got signal Terminated *** 2024-09-16T09:50:51.882 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:51 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[49125]: 2024-09-16T09:50:51.559+0000 7feaa4970640 -1 osd.0 45 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:50:51.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:51 smithi114 ceph-mon[79732]: osd.0 marked itself down and dead 2024-09-16T09:50:52.362 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:52 smithi111 podman[117574]: 2024-09-16 09:50:52.091315037 +0000 UTC m=+0.638736216 container died 99bb8c285f21d830e873ca5236eb1b38f25498e8c1fffbfb7cdfeb389daabca0 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ad35db0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T09:50:52.631 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:52 smithi111 podman[117574]: 2024-09-16 09:50:52.451783179 +0000 UTC m=+0.999204349 container cleanup 99bb8c285f21d830e873ca5236eb1b38f25498e8c1fffbfb7cdfeb389daabca0 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-ad35db0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T09:50:52.631 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:52 smithi111 bash[117574]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0 2024-09-16T09:50:52.882 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:52 smithi111 podman[117589]: 2024-09-16 09:50:52.736549422 +0000 UTC m=+0.646433521 container remove 99bb8c285f21d830e873ca5236eb1b38f25498e8c1fffbfb7cdfeb389daabca0 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-ad35db0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-16T09:50:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:52 smithi111 ceph-mon[109885]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:50:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:52 smithi111 ceph-mon[109885]: osdmap e46: 6 total, 5 up, 6 in 2024-09-16T09:50:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:52 smithi111 ceph-mon[109885]: pgmap v105: 65 pgs: 9 stale+active+clean, 56 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:52 smithi111 ceph-mon[109885]: osdmap e47: 6 total, 5 up, 6 in 2024-09-16T09:50:52.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:52 smithi114 ceph-mon[79732]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:50:52.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:52 smithi114 ceph-mon[79732]: osdmap e46: 6 total, 5 up, 6 in 2024-09-16T09:50:52.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:52 smithi114 ceph-mon[79732]: pgmap v105: 65 pgs: 9 stale+active+clean, 56 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:52.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:52 smithi114 ceph-mon[79732]: osdmap e47: 6 total, 5 up, 6 in 2024-09-16T09:50:53.350 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:53 smithi111 podman[117678]: 2024-09-16 09:50:53.054104878 +0000 UTC m=+0.100200825 container create 04a0c2e27052921ad6e87faed5096ed324716cdcf8f2f0e61ee3e8ebacc2008c (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-16T09:50:53.350 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:53 smithi111 podman[117678]: 2024-09-16 09:50:52.970291995 +0000 UTC m=+0.016387948 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:50:53.350 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:53 smithi111 podman[117678]: 2024-09-16 09:50:53.257099094 +0000 UTC m=+0.303195041 container init 04a0c2e27052921ad6e87faed5096ed324716cdcf8f2f0e61ee3e8ebacc2008c (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:50:53.350 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:53 smithi111 podman[117678]: 2024-09-16 09:50:53.260932979 +0000 UTC m=+0.307028927 container start 04a0c2e27052921ad6e87faed5096ed324716cdcf8f2f0e61ee3e8ebacc2008c (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-16T09:50:53.350 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:53 smithi111 podman[117678]: 2024-09-16 09:50:53.348881965 +0000 UTC m=+0.394977916 container attach 04a0c2e27052921ad6e87faed5096ed324716cdcf8f2f0e61ee3e8ebacc2008c (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T09:50:53.632 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:53 smithi111 podman[117678]: 2024-09-16 09:50:53.453107335 +0000 UTC m=+0.499203290 container died 04a0c2e27052921ad6e87faed5096ed324716cdcf8f2f0e61ee3e8ebacc2008c (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-16T09:50:54.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 podman[117701]: 2024-09-16 09:50:54.086064475 +0000 UTC m=+0.627103072 container remove 04a0c2e27052921ad6e87faed5096ed324716cdcf8f2f0e61ee3e8ebacc2008c (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:50:54.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-16T09:50:54.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 systemd[1]: Stopped Ceph osd.0 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:50:54.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.0.service: Consumed 55.976s CPU time. 2024-09-16T09:50:54.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 systemd[1]: Starting Ceph osd.0 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:50:54.874 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:54 smithi111 ceph-mon[109885]: pgmap v107: 65 pgs: 9 stale+active+clean, 56 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:54.874 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 podman[117803]: 2024-09-16 09:50:54.439580183 +0000 UTC m=+0.015974622 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:50:54.874 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 podman[117803]: 2024-09-16 09:50:54.545572867 +0000 UTC m=+0.121967311 container create f1f9535121641705ab687eb653daf6ff6f29db9b951fecc72dd2f607d6874573 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:50:54.874 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 podman[117803]: 2024-09-16 09:50:54.773016697 +0000 UTC m=+0.349411138 container init f1f9535121641705ab687eb653daf6ff6f29db9b951fecc72dd2f607d6874573 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T09:50:54.874 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 podman[117803]: 2024-09-16 09:50:54.776889379 +0000 UTC m=+0.353283826 container start f1f9535121641705ab687eb653daf6ff6f29db9b951fecc72dd2f607d6874573 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-16T09:50:54.874 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 podman[117803]: 2024-09-16 09:50:54.873034965 +0000 UTC m=+0.449429409 container attach f1f9535121641705ab687eb653daf6ff6f29db9b951fecc72dd2f607d6874573 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-16T09:50:55.131 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:50:55.132 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 bash[117803]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:50:55.132 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:50:55.132 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:54 smithi111 bash[117803]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:50:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:54 smithi114 ceph-mon[79732]: pgmap v107: 65 pgs: 9 stale+active+clean, 56 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:50:55.923 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-mon[109885]: Health check failed: Degraded data redundancy: 44/234 objects degraded (18.803%), 16 pgs degraded (PG_DEGRADED) 2024-09-16T09:50:55.923 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T09:50:55.923 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T09:50:55.923 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T09:50:55.923 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T09:50:56.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:55 smithi114 ceph-mon[79732]: Health check failed: Degraded data redundancy: 44/234 objects degraded (18.803%), 16 pgs degraded (PG_DEGRADED) 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-16T09:50:56.346 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate[117819]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-16T09:50:56.347 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 bash[117803]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-16T09:50:56.347 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:55 smithi111 podman[117803]: 2024-09-16 09:50:55.984022412 +0000 UTC m=+1.560416853 container died f1f9535121641705ab687eb653daf6ff6f29db9b951fecc72dd2f607d6874573 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True) 2024-09-16T09:50:56.929 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:56 smithi111 ceph-mon[109885]: pgmap v108: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:50:56.930 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:56 smithi111 podman[117955]: 2024-09-16 09:50:56.66892346 +0000 UTC m=+0.679023842 container remove f1f9535121641705ab687eb653daf6ff6f29db9b951fecc72dd2f607d6874573 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-16T09:50:56.930 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:56 smithi111 podman[118022]: 2024-09-16 09:50:56.789188874 +0000 UTC m=+0.016415447 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:50:56.930 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:56 smithi111 podman[118022]: 2024-09-16 09:50:56.903285081 +0000 UTC m=+0.130511649 container create 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-16T09:50:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:56 smithi114 ceph-mon[79732]: pgmap v108: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:50:57.232 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:57 smithi111 podman[118022]: 2024-09-16 09:50:57.131141399 +0000 UTC m=+0.358367969 container init 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T09:50:57.232 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:57 smithi111 podman[118022]: 2024-09-16 09:50:57.134489281 +0000 UTC m=+0.361715849 container start 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-16T09:50:57.232 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:57 smithi111 ceph-osd[118043]: -- 172.21.15.111:0/1338567557 <== mon.0 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560c85a721e0 con 0x560c85a02000 2024-09-16T09:50:57.632 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:57 smithi111 bash[118022]: 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e 2024-09-16T09:50:57.632 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:57 smithi111 systemd[1]: Started Ceph osd.0 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:50:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:58 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:58 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:58 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:58.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:50:58 smithi111 ceph-mon[109885]: pgmap v109: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:50:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:58 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:58 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:50:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:58 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:50:58.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:50:58 smithi114 ceph-mon[79732]: pgmap v109: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:50:58.881 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:50:58 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[118039]: 2024-09-16T09:50:58.765+0000 7f5a95cc8640 -1 Falling back to public interface 2024-09-16T09:51:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:00 smithi111 ceph-mon[109885]: pgmap v110: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:01.133 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:00 smithi114 ceph-mon[79732]: pgmap v110: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:01.133 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:01.133 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:03.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:02 smithi111 ceph-mon[109885]: pgmap v111: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:03.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:02 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:02 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:02 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:02 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:02 smithi114 ceph-mon[79732]: pgmap v111: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:02 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:02 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:02 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:02 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:04.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 -- 172.21.15.111:0/2641619186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad90106900 msgr2=0x7fad90106ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 --2- 172.21.15.111:0/2641619186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad90106900 0x7fad90106ce0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad80009880 tx=0x7fad8002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 -- 172.21.15.111:0/2641619186 shutdown_connections 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 --2- 172.21.15.111:0/2641619186 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad900ffd20 0x7fad90100180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 --2- 172.21.15.111:0/2641619186 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad90106900 0x7fad90106ce0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 -- 172.21.15.111:0/2641619186 >> 172.21.15.111:0/2641619186 conn(0x7fad900fbc10 msgr2=0x7fad900fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 -- 172.21.15.111:0/2641619186 shutdown_connections 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.122+0000 7fad95437640 1 -- 172.21.15.111:0/2641619186 wait complete. 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.123+0000 7fad95437640 1 Processor -- start 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.123+0000 7fad95437640 1 -- start start 2024-09-16T09:51:04.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.123+0000 7fad95437640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 0x7fad9019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.123+0000 7fad95437640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad90106900 0x7fad9019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.123+0000 7fad95437640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fad9010ee80 con 0x7fad900ffd20 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.123+0000 7fad95437640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fad9010ed00 con 0x7fad90106900 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 0x7fad9019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 0x7fad9019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52206/0 (socket says 172.21.15.111:52206) 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 -- 172.21.15.111:0/2285837980 learned_addr learned my addr 172.21.15.111:0/2285837980 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8e7fc640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad90106900 0x7fad9019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 -- 172.21.15.111:0/2285837980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad90106900 msgr2=0x7fad9019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad90106900 0x7fad9019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 -- 172.21.15.111:0/2285837980 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad90197850 con 0x7fad900ffd20 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad8effd640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 0x7fad9019d6d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad80031460 tx=0x7fad800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:04.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad8003f070 con 0x7fad900ffd20 2024-09-16T09:51:04.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.124+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90197ae0 con 0x7fad900ffd20 2024-09-16T09:51:04.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.125+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad800035f0 con 0x7fad900ffd20 2024-09-16T09:51:04.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.125+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad90198010 con 0x7fad900ffd20 2024-09-16T09:51:04.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.125+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad80035030 con 0x7fad900ffd20 2024-09-16T09:51:04.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.126+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90100180 con 0x7fad900ffd20 2024-09-16T09:51:04.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.127+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fad80042070 con 0x7fad900ffd20 2024-09-16T09:51:04.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.127+0000 7fad77fff640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad7807adf0 0x7fad7807d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.127+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7fad800be2b0 con 0x7fad900ffd20 2024-09-16T09:51:04.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.127+0000 7fad8e7fc640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad7807adf0 0x7fad7807d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.128+0000 7fad8e7fc640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad7807adf0 0x7fad7807d2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad901080c0 tx=0x7fad8400b410 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:04.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.132+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fad80089aa0 con 0x7fad900ffd20 2024-09-16T09:51:04.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.340+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fad90198330 con 0x7fad7807adf0 2024-09-16T09:51:04.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.341+0000 7fad77fff640 1 -- 172.21.15.111:0/2285837980 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fad90198330 con 0x7fad7807adf0 2024-09-16T09:51:04.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.343+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad7807adf0 msgr2=0x7fad7807d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.343+0000 7fad95437640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad7807adf0 0x7fad7807d2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fad901080c0 tx=0x7fad8400b410 comp rx=0 tx=0).stop 2024-09-16T09:51:04.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.343+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 msgr2=0x7fad9019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.343+0000 7fad95437640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 0x7fad9019d6d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fad80031460 tx=0x7fad800045e0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 shutdown_connections 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad7807adf0 0x7fad7807d2b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fad90106900 0x7fad9019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 --2- 172.21.15.111:0/2285837980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad900ffd20 0x7fad9019d6d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 >> 172.21.15.111:0/2285837980 conn(0x7fad900fbc10 msgr2=0x7fad900fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 shutdown_connections 2024-09-16T09:51:04.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.344+0000 7fad95437640 1 -- 172.21.15.111:0/2285837980 wait complete. 2024-09-16T09:51:04.355 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:51:04.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 -- 172.21.15.111:0/3119271813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 msgr2=0x7f538c102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 --2- 172.21.15.111:0/3119271813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c102e80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5388009880 tx=0x7f538802a530 comp rx=0 tx=0).stop 2024-09-16T09:51:04.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 -- 172.21.15.111:0/3119271813 shutdown_connections 2024-09-16T09:51:04.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 --2- 172.21.15.111:0/3119271813 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c1033c0 0x7f538c10b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 --2- 172.21.15.111:0/3119271813 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c102e80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 -- 172.21.15.111:0/3119271813 >> 172.21.15.111:0/3119271813 conn(0x7f538c0fc4c0 msgr2=0x7f538c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:04.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 -- 172.21.15.111:0/3119271813 shutdown_connections 2024-09-16T09:51:04.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.431+0000 7f53942f0640 1 -- 172.21.15.111:0/3119271813 wait complete. 2024-09-16T09:51:04.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.432+0000 7f53942f0640 1 Processor -- start 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.432+0000 7f53942f0640 1 -- start start 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f53942f0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f53942f0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c1033c0 0x7f538c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f53942f0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f538c10edd0 con 0x7f538c102aa0 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f53942f0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f538c10ec50 con 0x7f538c1033c0 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52228/0 (socket says 172.21.15.111:52228) 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 -- 172.21.15.111:0/2118520921 learned_addr learned my addr 172.21.15.111:0/2118520921 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539188b640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c1033c0 0x7f538c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 -- 172.21.15.111:0/2118520921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c1033c0 msgr2=0x7f538c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c1033c0 0x7f538c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 -- 172.21.15.111:0/2118520921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538c197800 con 0x7f538c102aa0 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.433+0000 7f539208c640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c19d680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5388031460 tx=0x7f53880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.434+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f538803f070 con 0x7f538c102aa0 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.434+0000 7f53942f0640 1 -- 172.21.15.111:0/2118520921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538c197a90 con 0x7f538c102aa0 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.434+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f53880035f0 con 0x7f538c102aa0 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.434+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5388035030 con 0x7f538c102aa0 2024-09-16T09:51:04.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.434+0000 7f53942f0640 1 -- 172.21.15.111:0/2118520921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538c197fc0 con 0x7f538c102aa0 2024-09-16T09:51:04.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.435+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538c06a410 con 0x7f538c102aa0 2024-09-16T09:51:04.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.437+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f5388042070 con 0x7f538c102aa0 2024-09-16T09:51:04.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.438+0000 7f53837fe640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f537807abf0 0x7f537807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.438+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6070+0+0 (secure 0 0 0) 0x7f53880beac0 con 0x7f538c102aa0 2024-09-16T09:51:04.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.438+0000 7f539188b640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f537807abf0 0x7f537807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.438+0000 7f539188b640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f537807abf0 0x7f537807d0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f538c1088e0 tx=0x7f537c00b2e0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:04.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.441+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f538808a2d0 con 0x7f538c102aa0 2024-09-16T09:51:04.617 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:51:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[118039]: 2024-09-16T09:51:04.499+0000 7f5a95cc8640 -1 osd.0 45 log_to_monitors true 2024-09-16T09:51:04.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.667+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f538c198d30 con 0x7f537807abf0 2024-09-16T09:51:04.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.669+0000 7f53837fe640 1 -- 172.21.15.111:0/2118520921 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f538c198d30 con 0x7f537807abf0 2024-09-16T09:51:04.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f537807abf0 msgr2=0x7f537807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f537807abf0 0x7f537807d0b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f538c1088e0 tx=0x7f537c00b2e0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 msgr2=0x7f538c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c19d680 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5388031460 tx=0x7f53880045e0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 shutdown_connections 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f537807abf0 0x7f537807d0b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f538c1033c0 0x7f538c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 --2- 172.21.15.111:0/2118520921 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f538c102aa0 0x7f538c19d680 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 >> 172.21.15.111:0/2118520921 conn(0x7f538c0fc4c0 msgr2=0x7f538c108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 shutdown_connections 2024-09-16T09:51:04.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.671+0000 7f53817fa640 1 -- 172.21.15.111:0/2118520921 wait complete. 2024-09-16T09:51:04.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 -- 172.21.15.111:0/3463856606 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8106820 msgr2=0x7fbac8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3463856606 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8106820 0x7fbac8106c00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009880 tx=0x7fbab802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 -- 172.21.15.111:0/3463856606 shutdown_connections 2024-09-16T09:51:04.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3463856606 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac8100820 0x7fbac8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3463856606 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8106820 0x7fbac8106c00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 -- 172.21.15.111:0/3463856606 >> 172.21.15.111:0/3463856606 conn(0x7fbac80fc520 msgr2=0x7fbac80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:04.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 -- 172.21.15.111:0/3463856606 shutdown_connections 2024-09-16T09:51:04.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 -- 172.21.15.111:0/3463856606 wait complete. 2024-09-16T09:51:04.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.754+0000 7fbacd83b640 1 Processor -- start 2024-09-16T09:51:04.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbacd83b640 1 -- start start 2024-09-16T09:51:04.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbacd83b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 0x7fbac819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbacd83b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac8106820 0x7fbac819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbacd83b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbac810dcd0 con 0x7fbac8100820 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbacd83b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbac810db50 con 0x7fbac8106820 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbac6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 0x7fbac819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbac6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 0x7fbac819d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52256/0 (socket says 172.21.15.111:52256) 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbac6ffd640 1 -- 172.21.15.111:0/3847438107 learned_addr learned my addr 172.21.15.111:0/3847438107 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.755+0000 7fbac67fc640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac8106820 0x7fbac819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbac6ffd640 1 -- 172.21.15.111:0/3847438107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac8106820 msgr2=0x7fbac819db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbac6ffd640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac8106820 0x7fbac819db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbac6ffd640 1 -- 172.21.15.111:0/3847438107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac8197790 con 0x7fbac8100820 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbac6ffd640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 0x7fbac819d610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbab8031460 tx=0x7fbab80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbab803f070 con 0x7fbac8100820 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbab80035f0 con 0x7fbac8100820 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbab8035030 con 0x7fbac8100820 2024-09-16T09:51:04.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac8197a20 con 0x7fbac8100820 2024-09-16T09:51:04.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.756+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac8197f50 con 0x7fbac8100820 2024-09-16T09:51:04.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.757+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac8101f60 con 0x7fbac8100820 2024-09-16T09:51:04.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.762+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fbab8042070 con 0x7fbac8100820 2024-09-16T09:51:04.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.762+0000 7fbacc839640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbab007ac40 0x7fbab007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:04.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.763+0000 7fbac67fc640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbab007ac40 0x7fbab007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:04.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.764+0000 7fbac67fc640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbab007ac40 0x7fbab007d100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbac80ffb50 tx=0x7fbabc00b590 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:04.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.765+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7fbab8003ca0 con 0x7fbac8100820 2024-09-16T09:51:04.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.769+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fbab808a420 con 0x7fbac8100820 2024-09-16T09:51:04.881 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:51:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[118039]: 2024-09-16T09:51:04.787+0000 7f5a8da72640 -1 osd.0 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:51:04.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:04 smithi111 ceph-mon[109885]: pgmap v112: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:04.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:04 smithi111 ceph-mon[109885]: from='osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-16T09:51:04.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.965+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbac81982c0 con 0x7fbab007ac40 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.975+0000 7fbacc839640 1 -- 172.21.15.111:0/3847438107 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fbac81982c0 con 0x7fbab007ac40 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (2m) 2s ago 12m 21.2M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (4m) 2s ago 13m 8728k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (4m) 23s ago 12m 8326k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (31s) 2s ago 13m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (26s) 23s ago 12m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (110s) 2s ago 12m 74.2M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (7m) 2s ago 7m 149M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:51:04.977 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (7m) 2s ago 7m 18.5M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (7m) 23s ago 7m 19.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (7m) 23s ago 7m 19.4M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (3m) 2s ago 14m 521M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (3m) 23s ago 12m 455M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (59s) 2s ago 14m 41.2M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (44s) 23s ago 12m 25.7M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (3m) 2s ago 13m 11.0M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (2m) 23s ago 12m 10.6M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (8s) 2s ago 11m 12.1M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (10m) 2s ago 10m 248M 1216M 19.1.1-328-gad35db06 b5388489f99e 44d748073b83 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (10m) 2s ago 10m 211M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (9m) 23s ago 9m 305M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (9m) 23s ago 9m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:51:04.978 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (8m) 23s ago 8m 236M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:51:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (2m) 2s ago 12m 50.3M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:51:04.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.977+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbab007ac40 msgr2=0x7fbab007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.977+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbab007ac40 0x7fbab007d100 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbac80ffb50 tx=0x7fbabc00b590 comp rx=0 tx=0).stop 2024-09-16T09:51:04.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.977+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 msgr2=0x7fbac819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.977+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 0x7fbac819d610 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbab8031460 tx=0x7fbab80045e0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 shutdown_connections 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbab007ac40 0x7fbab007d100 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbac8106820 0x7fbac819db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 --2- 172.21.15.111:0/3847438107 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbac8100820 0x7fbac819d610 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 >> 172.21.15.111:0/3847438107 conn(0x7fbac80fc520 msgr2=0x7fbac806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 shutdown_connections 2024-09-16T09:51:04.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:04.978+0000 7fbacd83b640 1 -- 172.21.15.111:0/3847438107 wait complete. 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 -- 172.21.15.111:0/2823688549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 msgr2=0x7feeac100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 --2- 172.21.15.111:0/2823688549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac100c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009880 tx=0x7fee9c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 -- 172.21.15.111:0/2823688549 shutdown_connections 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 --2- 172.21.15.111:0/2823688549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac100c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 --2- 172.21.15.111:0/2823688549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 0x7feeac106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 -- 172.21.15.111:0/2823688549 >> 172.21.15.111:0/2823688549 conn(0x7feeac0fc4c0 msgr2=0x7feeac0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 -- 172.21.15.111:0/2823688549 shutdown_connections 2024-09-16T09:51:05.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.061+0000 7feeb43d9640 1 -- 172.21.15.111:0/2823688549 wait complete. 2024-09-16T09:51:05.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb43d9640 1 Processor -- start 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb43d9640 1 -- start start 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb43d9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb43d9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 0x7feeac198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb43d9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7feeac10dcb0 con 0x7feeac1007e0 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb43d9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7feeac10db30 con 0x7feeac1067e0 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb2175640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb2175640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52272/0 (socket says 172.21.15.111:52272) 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb2175640 1 -- 172.21.15.111:0/1623252215 learned_addr learned my addr 172.21.15.111:0/1623252215 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb1974640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 0x7feeac198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb2175640 1 -- 172.21.15.111:0/1623252215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 msgr2=0x7feeac198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.062+0000 7feeb2175640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 0x7feeac198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feeb2175640 1 -- 172.21.15.111:0/1623252215 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeac199320 con 0x7feeac1007e0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feeb1974640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 0x7feeac198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feeb2175640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac1987e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feea800e970 tx=0x7feea800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feea800cac0 con 0x7feeac1007e0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feea80054e0 con 0x7feeac1007e0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeac199610 con 0x7feeac1007e0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feea8010430 con 0x7feeac1007e0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.063+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeac1a1c10 con 0x7feeac1007e0 2024-09-16T09:51:05.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.064+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeac101f20 con 0x7feeac1007e0 2024-09-16T09:51:05.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.065+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7feea8004ec0 con 0x7feeac1007e0 2024-09-16T09:51:05.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.066+0000 7feea37fe640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee9807ac40 0x7fee9807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.066+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7feea809e440 con 0x7feeac1007e0 2024-09-16T09:51:05.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.066+0000 7feeb1974640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee9807ac40 0x7fee9807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.066+0000 7feeb1974640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee9807ac40 0x7fee9807d100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feeac06a680 tx=0x7fee9c031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:05.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.069+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7feeac199610 con 0x7feeac1007e0 2024-09-16T09:51:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:04 smithi114 ceph-mon[79732]: pgmap v112: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:04 smithi114 ceph-mon[79732]: from='osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-16T09:51:05.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.324+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7feeac108d50 con 0x7feeac1007e0 2024-09-16T09:51:05.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.325+0000 7feea37fe640 1 -- 172.21.15.111:0/1623252215 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7feea8069cd0 con 0x7feeac1007e0 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 5 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:51:05.327 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:51:05.328 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:05.328 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:51:05.328 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 9, 2024-09-16T09:51:05.328 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 4 2024-09-16T09:51:05.328 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:51:05.328 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:51:05.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee9807ac40 msgr2=0x7fee9807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee9807ac40 0x7fee9807d100 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7feeac06a680 tx=0x7fee9c031400 comp rx=0 tx=0).stop 2024-09-16T09:51:05.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 msgr2=0x7feeac1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac1987e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feea800e970 tx=0x7feea800ed70 comp rx=0 tx=0).stop 2024-09-16T09:51:05.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 shutdown_connections 2024-09-16T09:51:05.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee9807ac40 0x7fee9807d100 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7feeac1067e0 0x7feeac198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 --2- 172.21.15.111:0/1623252215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feeac1007e0 0x7feeac1987e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 >> 172.21.15.111:0/1623252215 conn(0x7feeac0fc4c0 msgr2=0x7feeac0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:05.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 shutdown_connections 2024-09-16T09:51:05.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.327+0000 7feeb43d9640 1 -- 172.21.15.111:0/1623252215 wait complete. 2024-09-16T09:51:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 -- 172.21.15.111:0/2886274177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4107910 msgr2=0x7f86c4107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/2886274177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4107910 0x7f86c4107cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f86b4009880 tx=0x7f86b402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 -- 172.21.15.111:0/2886274177 shutdown_connections 2024-09-16T09:51:05.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/2886274177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86c4101910 0x7f86c4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/2886274177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4107910 0x7f86c4107cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 -- 172.21.15.111:0/2886274177 >> 172.21.15.111:0/2886274177 conn(0x7f86c40fd5f0 msgr2=0x7f86c40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 -- 172.21.15.111:0/2886274177 shutdown_connections 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.410+0000 7f86c9a7b640 1 -- 172.21.15.111:0/2886274177 wait complete. 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c9a7b640 1 Processor -- start 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c9a7b640 1 -- start start 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c9a7b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 0x7f86c419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c9a7b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86c4107910 0x7f86c419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c9a7b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f86c410edc0 con 0x7f86c4101910 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c9a7b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f86c410ec40 con 0x7f86c4107910 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 0x7f86c419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c37fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 0x7f86c419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52280/0 (socket says 172.21.15.111:52280) 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c37fe640 1 -- 172.21.15.111:0/4030429208 learned_addr learned my addr 172.21.15.111:0/4030429208 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86bbfff640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86c4107910 0x7f86c419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c37fe640 1 -- 172.21.15.111:0/4030429208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86c4107910 msgr2=0x7f86c419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c37fe640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86c4107910 0x7f86c419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.411+0000 7f86c37fe640 1 -- 172.21.15.111:0/4030429208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c4197780 con 0x7f86c4101910 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.412+0000 7f86c37fe640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 0x7f86c419d600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86b4031460 tx=0x7f86b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.412+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86b403f070 con 0x7f86c4101910 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.412+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86b40035f0 con 0x7f86c4101910 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.412+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c4197a10 con 0x7f86c4101910 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.412+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86b4035030 con 0x7f86c4101910 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.412+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c4197f40 con 0x7f86c4101910 2024-09-16T09:51:05.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.413+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c4103050 con 0x7f86c4101910 2024-09-16T09:51:05.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.413+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f86b4042070 con 0x7f86c4101910 2024-09-16T09:51:05.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.414+0000 7f86c17fa640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f86b007ac40 0x7f86b007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.414+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7f86b40be3e0 con 0x7f86c4101910 2024-09-16T09:51:05.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.414+0000 7f86bbfff640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f86b007ac40 0x7f86b007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.414+0000 7f86bbfff640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f86b007ac40 0x7f86b007d100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86c4100d60 tx=0x7f86ac00b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:05.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.418+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f86b4089c50 con 0x7f86c4101910 2024-09-16T09:51:05.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.638+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f86c4104b20 con 0x7f86c4101910 2024-09-16T09:51:05.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.639+0000 7f86c17fa640 1 -- 172.21.15.111:0/4030429208 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7f86b408eb00 con 0x7f86c4101910 2024-09-16T09:51:05.641 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:51:05.641 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:51:05.641 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:51:05.641 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:51:05.641 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:51:05.642 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:51:05.643 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:05.644 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:05.646 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:51:05.646 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:05.646 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:05.646 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:05.646 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f86b007ac40 msgr2=0x7f86b007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f86b007ac40 0x7f86b007d100 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f86c4100d60 tx=0x7f86ac00b390 comp rx=0 tx=0).stop 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 msgr2=0x7f86c419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 0x7f86c419d600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f86b4031460 tx=0x7f86b40045e0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 shutdown_connections 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f86b007ac40 0x7f86b007d100 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f86c4107910 0x7f86c419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 --2- 172.21.15.111:0/4030429208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c4101910 0x7f86c419d600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 >> 172.21.15.111:0/4030429208 conn(0x7f86c40fd5f0 msgr2=0x7f86c40fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:05.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 shutdown_connections 2024-09-16T09:51:05.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.642+0000 7f86c9a7b640 1 -- 172.21.15.111:0/4030429208 wait complete. 2024-09-16T09:51:05.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 -- 172.21.15.111:0/163670136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 msgr2=0x7f353c106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 --2- 172.21.15.111:0/163670136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c106bc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3538009880 tx=0x7f353802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 -- 172.21.15.111:0/163670136 shutdown_connections 2024-09-16T09:51:05.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 --2- 172.21.15.111:0/163670136 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f353c1007e0 0x7f353c100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 --2- 172.21.15.111:0/163670136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c106bc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 -- 172.21.15.111:0/163670136 >> 172.21.15.111:0/163670136 conn(0x7f353c0fc4c0 msgr2=0x7f353c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:05.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 -- 172.21.15.111:0/163670136 shutdown_connections 2024-09-16T09:51:05.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.727+0000 7f3543ac3640 1 -- 172.21.15.111:0/163670136 wait complete. 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f3543ac3640 1 Processor -- start 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f3543ac3640 1 -- start start 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f3543ac3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f353c1007e0 0x7f353c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f3543ac3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f3543ac3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10dd10 con 0x7f353c1067e0 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f3543ac3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f353c10db90 con 0x7f353c1007e0 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354105e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354105e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52292/0 (socket says 172.21.15.111:52292) 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354105e640 1 -- 172.21.15.111:0/670772914 learned_addr learned my addr 172.21.15.111:0/670772914 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354185f640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f353c1007e0 0x7f353c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354105e640 1 -- 172.21.15.111:0/670772914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f353c1007e0 msgr2=0x7f353c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354105e640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f353c1007e0 0x7f353c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.728+0000 7f354105e640 1 -- 172.21.15.111:0/670772914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353c197800 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.729+0000 7f354105e640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c19dbc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f353000b420 tx=0x7f353000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.729+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3530011630 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.729+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f353c197af0 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.729+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3530016070 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.729+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3530010d40 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.729+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f353c198080 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.730+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353c101f20 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.731+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f353001b460 con 0x7f353c1067e0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.731+0000 7f352effd640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f352807abf0 0x7f352807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.731+0000 7f354185f640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f352807abf0 0x7f352807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:05.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.731+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6070+0+0 (secure 0 0 0) 0x7f353009d240 con 0x7f353c1067e0 2024-09-16T09:51:05.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.732+0000 7f354185f640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f352807abf0 0x7f352807d0b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f35380096c0 tx=0x7f3538031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:05.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.736+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f3530068a30 con 0x7f353c1067e0 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: from='osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: osdmap e48: 6 total, 5 up, 6 in 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: from='osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1623252215' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:05 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/4030429208' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:51:05.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.948+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f353c198390 con 0x7f352807abf0 2024-09-16T09:51:05.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.950+0000 7f352effd640 1 -- 172.21.15.111:0/670772914 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f353c198390 con 0x7f352807abf0 2024-09-16T09:51:05.951 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:51:05.951 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "7/23 daemons upgraded", 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:51:05.952 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:51:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f352807abf0 msgr2=0x7f352807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f352807abf0 0x7f352807d0b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f35380096c0 tx=0x7f3538031400 comp rx=0 tx=0).stop 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 msgr2=0x7f353c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c19dbc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f353000b420 tx=0x7f353000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 shutdown_connections 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f352807abf0 0x7f352807d0b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f353c1067e0 0x7f353c19dbc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 --2- 172.21.15.111:0/670772914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f353c1007e0 0x7f353c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 >> 172.21.15.111:0/670772914 conn(0x7f353c0fc4c0 msgr2=0x7f353c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 shutdown_connections 2024-09-16T09:51:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:05.952+0000 7f3543ac3640 1 -- 172.21.15.111:0/670772914 wait complete. 2024-09-16T09:51:06.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 -- 172.21.15.111:0/1051992860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69481033c0 msgr2=0x7f694810b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:06.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 --2- 172.21.15.111:0/1051992860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69481033c0 0x7f694810b8b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6938009880 tx=0x7f693802a530 comp rx=0 tx=0).stop 2024-09-16T09:51:06.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 -- 172.21.15.111:0/1051992860 shutdown_connections 2024-09-16T09:51:06.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 --2- 172.21.15.111:0/1051992860 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69481033c0 0x7f694810b8b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:06.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 --2- 172.21.15.111:0/1051992860 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6948102aa0 0x7f6948102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:06.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 -- 172.21.15.111:0/1051992860 >> 172.21.15.111:0/1051992860 conn(0x7f69480fc4c0 msgr2=0x7f69480fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:06.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 -- 172.21.15.111:0/1051992860 shutdown_connections 2024-09-16T09:51:06.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.042+0000 7f694f4bc640 1 -- 172.21.15.111:0/1051992860 wait complete. 2024-09-16T09:51:06.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.043+0000 7f694f4bc640 1 Processor -- start 2024-09-16T09:51:06.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.043+0000 7f694f4bc640 1 -- start start 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694f4bc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 0x7f694819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694f4bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69481033c0 0x7f694819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694f4bc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f694810edd0 con 0x7f6948102aa0 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694f4bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f694810ec50 con 0x7f69481033c0 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 0x7f694819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 0x7f694819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52314/0 (socket says 172.21.15.111:52314) 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 -- 172.21.15.111:0/3565592768 learned_addr learned my addr 172.21.15.111:0/3565592768 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694ca57640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69481033c0 0x7f694819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 -- 172.21.15.111:0/3565592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69481033c0 msgr2=0x7f694819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69481033c0 0x7f694819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 -- 172.21.15.111:0/3565592768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948197800 con 0x7f6948102aa0 2024-09-16T09:51:06.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694ca57640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69481033c0 0x7f694819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:51:06.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694d258640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 0x7f694819d680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f694400e970 tx=0x7f694400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:06.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f694400cac0 con 0x7f6948102aa0 2024-09-16T09:51:06.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69440054e0 con 0x7f6948102aa0 2024-09-16T09:51:06.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6948197af0 con 0x7f6948102aa0 2024-09-16T09:51:06.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.044+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6944010430 con 0x7f6948102aa0 2024-09-16T09:51:06.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.045+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6948198050 con 0x7f6948102aa0 2024-09-16T09:51:06.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.046+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694806a410 con 0x7f6948102aa0 2024-09-16T09:51:06.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.046+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f6944004e80 con 0x7f6948102aa0 2024-09-16T09:51:06.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.047+0000 7f693e7fc640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f693407abf0 0x7f693407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:06.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.047+0000 7f694ca57640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f693407abf0 0x7f693407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:06.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.047+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6070+0+0 (secure 0 0 0) 0x7f694409e2d0 con 0x7f6948102aa0 2024-09-16T09:51:06.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.047+0000 7f694ca57640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f693407abf0 0x7f693407d0b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6948198b50 tx=0x7f6938031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:06.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.051+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f6944069ac0 con 0x7f6948102aa0 2024-09-16T09:51:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: from='osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-16T09:51:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: osdmap e48: 6 total, 5 up, 6 in 2024-09-16T09:51:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: from='osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-16T09:51:06.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1623252215' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:06.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:05 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/4030429208' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:51:06.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.302+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6948105f40 con 0x7f6948102aa0 2024-09-16T09:51:06.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.303+0000 7f693e7fc640 1 -- 172.21.15.111:0/3565592768 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1262 (secure 0 0 0) 0x7f694406e970 con 0x7f6948102aa0 2024-09-16T09:51:06.305 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; Degraded data redundancy: 44/234 objects degraded (18.803%), 16 pgs degraded 2024-09-16T09:51:06.309 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:51:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:51:06.309 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 44/234 objects degraded (18.803%), 16 pgs degraded 2024-09-16T09:51:06.309 INFO:teuthology.orchestra.run.smithi111.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-16T09:51:06.310 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-16T09:51:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-16T09:51:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-16T09:51:06.311 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-16T09:51:06.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f693407abf0 msgr2=0x7f693407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f693407abf0 0x7f693407d0b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6948198b50 tx=0x7f6938031400 comp rx=0 tx=0).stop 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 msgr2=0x7f694819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 0x7f694819d680 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f694400e970 tx=0x7f694400ed70 comp rx=0 tx=0).stop 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 shutdown_connections 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f693407abf0 0x7f693407d0b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f69481033c0 0x7f694819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 --2- 172.21.15.111:0/3565592768 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6948102aa0 0x7f694819d680 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 >> 172.21.15.111:0/3565592768 conn(0x7f69480fc4c0 msgr2=0x7f6948108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 shutdown_connections 2024-09-16T09:51:06.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:06.305+0000 7f694f4bc640 1 -- 172.21.15.111:0/3565592768 wait complete. 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: pgmap v114: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634] boot 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3565592768' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:51:07.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:06 smithi111 ceph-mon[109885]: osdmap e50: 6 total, 6 up, 6 in 2024-09-16T09:51:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: pgmap v114: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:51:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: osd.0 [v2:172.21.15.111:6802/1450824634,v1:172.21.15.111:6803/1450824634] boot 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: osdmap e49: 6 total, 6 up, 6 in 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:07.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-16T09:51:07.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3565592768' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:51:07.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:06 smithi114 ceph-mon[79732]: osdmap e50: 6 total, 6 up, 6 in 2024-09-16T09:51:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:07 smithi111 ceph-mon[109885]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:07 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T09:51:08.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:07 smithi111 ceph-mon[109885]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-16T09:51:08.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:07 smithi114 ceph-mon[79732]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:08.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:07 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T09:51:08.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:07 smithi114 ceph-mon[79732]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-16T09:51:09.054 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:08 smithi111 ceph-mon[109885]: pgmap v117: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:08 smithi114 ceph-mon[79732]: pgmap v117: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:10 smithi111 ceph-mon[109885]: pgmap v118: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:10 smithi114 ceph-mon[79732]: pgmap v118: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 44/234 objects degraded (18.803%) 2024-09-16T09:51:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:11 smithi111 ceph-mon[109885]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/234 objects degraded (18.803%), 16 pgs degraded) 2024-09-16T09:51:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:11 smithi114 ceph-mon[79732]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 44/234 objects degraded (18.803%), 16 pgs degraded) 2024-09-16T09:51:13.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:12 smithi111 ceph-mon[109885]: pgmap v119: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:12 smithi114 ceph-mon[79732]: pgmap v119: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:14 smithi111 ceph-mon[109885]: pgmap v120: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:14 smithi114 ceph-mon[79732]: pgmap v120: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:16 smithi111 ceph-mon[109885]: pgmap v121: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:16 smithi114 ceph-mon[79732]: pgmap v121: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:18 smithi111 ceph-mon[109885]: pgmap v122: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:18 smithi114 ceph-mon[79732]: pgmap v122: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:21.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:20 smithi111 ceph-mon[109885]: pgmap v123: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:20 smithi114 ceph-mon[79732]: pgmap v123: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:22.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:21 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-16T09:51:22.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:21 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-16T09:51:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:22 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T09:51:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:22 smithi114 ceph-mon[79732]: Upgrade: osd.1 is safe to restart 2024-09-16T09:51:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:22 smithi114 ceph-mon[79732]: pgmap v124: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-16T09:51:22.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:23.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:22 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-16T09:51:23.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:22 smithi111 ceph-mon[109885]: Upgrade: osd.1 is safe to restart 2024-09-16T09:51:23.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:22 smithi111 ceph-mon[109885]: pgmap v124: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:23.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:23.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-16T09:51:23.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:24.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:23 smithi111 ceph-mon[109885]: Upgrade: Updating osd.1 2024-09-16T09:51:24.073 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:23 smithi111 ceph-mon[109885]: Deploying daemon osd.1 on smithi111 2024-09-16T09:51:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:23 smithi114 ceph-mon[79732]: Upgrade: Updating osd.1 2024-09-16T09:51:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:23 smithi114 ceph-mon[79732]: Deploying daemon osd.1 on smithi111 2024-09-16T09:51:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:24 smithi111 ceph-mon[109885]: pgmap v125: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:24 smithi114 ceph-mon[79732]: pgmap v125: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:25.448 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:25 smithi111 systemd[1]: Stopping Ceph osd.1 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:51:25.784 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:25 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[57110]: 2024-09-16T09:51:25.446+0000 7f2ec8d32640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:51:25.784 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:25 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[57110]: 2024-09-16T09:51:25.446+0000 7f2ec8d32640 -1 osd.1 50 *** Got signal Terminated *** 2024-09-16T09:51:25.784 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:25 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[57110]: 2024-09-16T09:51:25.446+0000 7f2ec8d32640 -1 osd.1 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:51:26.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:25 smithi111 ceph-mon[109885]: osd.1 marked itself down and dead 2024-09-16T09:51:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:25 smithi114 ceph-mon[79732]: osd.1 marked itself down and dead 2024-09-16T09:51:26.583 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:26 smithi111 podman[122726]: 2024-09-16 09:51:26.314752737 +0000 UTC m=+0.989220688 container died 44d748073b8397ea6fb820efd3f6c122a70719a2f7cb420598b3cd55d4b5e149 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-ad35db0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:51:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:26 smithi111 ceph-mon[109885]: pgmap v126: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:26 smithi111 ceph-mon[109885]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:51:26.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:26 smithi111 ceph-mon[109885]: osdmap e51: 6 total, 5 up, 6 in 2024-09-16T09:51:26.883 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:26 smithi111 podman[122726]: 2024-09-16 09:51:26.672315395 +0000 UTC m=+1.346783345 container cleanup 44d748073b8397ea6fb820efd3f6c122a70719a2f7cb420598b3cd55d4b5e149 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ad35db0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-16T09:51:26.883 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:26 smithi111 bash[122726]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1 2024-09-16T09:51:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:26 smithi114 ceph-mon[79732]: pgmap v126: 65 pgs: 65 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:26 smithi114 ceph-mon[79732]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:51:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:26 smithi114 ceph-mon[79732]: osdmap e51: 6 total, 5 up, 6 in 2024-09-16T09:51:27.296 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:26 smithi111 podman[122744]: 2024-09-16 09:51:26.9575007 +0000 UTC m=+0.644019376 container remove 44d748073b8397ea6fb820efd3f6c122a70719a2f7cb420598b3cd55d4b5e149 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, RELEASE=squid-ad35db0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-16T09:51:27.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:27 smithi111 podman[122830]: 2024-09-16 09:51:27.197917646 +0000 UTC m=+0.016260029 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:51:27.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:27 smithi111 podman[122830]: 2024-09-16 09:51:27.300208909 +0000 UTC m=+0.118551319 container create 637e1e347d43f1d76711671e5a375f62091e404b3ae2a5ef245c6732d4b68af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-16T09:51:27.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:27 smithi111 podman[122830]: 2024-09-16 09:51:27.536017022 +0000 UTC m=+0.354359391 container init 637e1e347d43f1d76711671e5a375f62091e404b3ae2a5ef245c6732d4b68af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True) 2024-09-16T09:51:27.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:27 smithi111 podman[122830]: 2024-09-16 09:51:27.539685333 +0000 UTC m=+0.358027703 container start 637e1e347d43f1d76711671e5a375f62091e404b3ae2a5ef245c6732d4b68af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:51:28.007 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:27 smithi111 ceph-mon[109885]: osdmap e52: 6 total, 5 up, 6 in 2024-09-16T09:51:28.008 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:27 smithi111 podman[122830]: 2024-09-16 09:51:27.635935126 +0000 UTC m=+0.454277505 container attach 637e1e347d43f1d76711671e5a375f62091e404b3ae2a5ef245c6732d4b68af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2) 2024-09-16T09:51:28.008 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:27 smithi111 podman[122830]: 2024-09-16 09:51:27.727985763 +0000 UTC m=+0.546328144 container died 637e1e347d43f1d76711671e5a375f62091e404b3ae2a5ef245c6732d4b68af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-16T09:51:28.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:27 smithi114 ceph-mon[79732]: osdmap e52: 6 total, 5 up, 6 in 2024-09-16T09:51:28.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 podman[122853]: 2024-09-16 09:51:28.273013385 +0000 UTC m=+0.538851201 container remove 637e1e347d43f1d76711671e5a375f62091e404b3ae2a5ef245c6732d4b68af1 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-16T09:51:28.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-16T09:51:28.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 systemd[1]: Stopped Ceph osd.1 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:51:28.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1.service: Consumed 1min 4.298s CPU time. 2024-09-16T09:51:28.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 systemd[1]: Starting Ceph osd.1 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:51:29.011 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:28 smithi111 ceph-mon[109885]: pgmap v129: 65 pgs: 12 stale+active+clean, 53 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:29.011 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 podman[122949]: 2024-09-16 09:51:28.715912332 +0000 UTC m=+0.100496387 container create ecc3931caeeff51f5a6ce8aa3626b6b13126d29af42a4827464ad837627fe423 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T09:51:29.011 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 podman[122949]: 2024-09-16 09:51:28.631388674 +0000 UTC m=+0.015972752 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:51:29.011 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 podman[122949]: 2024-09-16 09:51:28.935561063 +0000 UTC m=+0.320145129 container init ecc3931caeeff51f5a6ce8aa3626b6b13126d29af42a4827464ad837627fe423 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:51:29.011 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:28 smithi111 podman[122949]: 2024-09-16 09:51:28.939162966 +0000 UTC m=+0.323747032 container start ecc3931caeeff51f5a6ce8aa3626b6b13126d29af42a4827464ad837627fe423 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-16T09:51:29.012 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 podman[122949]: 2024-09-16 09:51:29.009999604 +0000 UTC m=+0.394583664 container attach ecc3931caeeff51f5a6ce8aa3626b6b13126d29af42a4827464ad837627fe423 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-16T09:51:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:28 smithi114 ceph-mon[79732]: pgmap v129: 65 pgs: 12 stale+active+clean, 53 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:29.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:51:29.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 bash[122949]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:51:29.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:51:29.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 bash[122949]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:51:30.106 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T09:51:30.106 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 bash[122949]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T09:51:30.106 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T09:51:30.106 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:29 smithi111 bash[122949]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 bash[122949]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 bash[122949]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 bash[122949]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-16T09:51:30.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T09:51:30.383 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 bash[122949]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-16T09:51:30.383 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate[122964]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-16T09:51:30.383 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 bash[122949]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-16T09:51:30.383 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 podman[122949]: 2024-09-16 09:51:30.133190234 +0000 UTC m=+1.517774416 container died ecc3931caeeff51f5a6ce8aa3626b6b13126d29af42a4827464ad837627fe423 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:51:31.080 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 podman[123100]: 2024-09-16 09:51:30.763908161 +0000 UTC m=+0.620015701 container remove ecc3931caeeff51f5a6ce8aa3626b6b13126d29af42a4827464ad837627fe423 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:51:31.080 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 podman[123159]: 2024-09-16 09:51:30.973394739 +0000 UTC m=+0.107712721 container create 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-09-16T09:51:31.080 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:30 smithi111 podman[123159]: 2024-09-16 09:51:30.882119272 +0000 UTC m=+0.016437214 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:51:31.080 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: pgmap v130: 65 pgs: 12 stale+active+clean, 53 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:31.080 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]} : dispatch 2024-09-16T09:51:31.080 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 1]} : dispatch 2024-09-16T09:51:31.080 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 1]} : dispatch 2024-09-16T09:51:31.080 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 1]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 1]} : dispatch 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:31.081 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: pgmap v130: 65 pgs: 12 stale+active+clean, 53 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:51:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 1]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 1]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 1]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]} : dispatch 2024-09-16T09:51:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]} : dispatch 2024-09-16T09:51:31.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 1]} : dispatch 2024-09-16T09:51:31.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:31.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:31.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:31 smithi111 podman[123159]: 2024-09-16 09:51:31.192579504 +0000 UTC m=+0.326897445 container init 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T09:51:31.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:31 smithi111 podman[123159]: 2024-09-16 09:51:31.19586499 +0000 UTC m=+0.330182931 container start 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-16T09:51:31.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-osd[123177]: -- 172.21.15.111:0/1072924689 <== mon.0 v2:172.21.15.111:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5560c7ae01e0 con 0x5560c7adc000 2024-09-16T09:51:31.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:31 smithi111 bash[123159]: 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec 2024-09-16T09:51:31.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:31 smithi111 systemd[1]: Started Ceph osd.1 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:51:32.114 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]}]': finished 2024-09-16T09:51:32.114 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 1]}]': finished 2024-09-16T09:51:32.114 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 1]}]': finished 2024-09-16T09:51:32.114 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-09-16T09:51:32.114 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]': finished 2024-09-16T09:51:32.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]}]': finished 2024-09-16T09:51:32.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 1]}]': finished 2024-09-16T09:51:32.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]}]': finished 2024-09-16T09:51:32.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]': finished 2024-09-16T09:51:32.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 1]}]': finished 2024-09-16T09:51:32.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: osdmap e53: 6 total, 5 up, 6 in 2024-09-16T09:51:32.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:32.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:32.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:51:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [0, 5]}]': finished 2024-09-16T09:51:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [0, 1]}]': finished 2024-09-16T09:51:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [0, 1]}]': finished 2024-09-16T09:51:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [3, 2]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.15", "id": [3, 2]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [3, 1]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.5", "id": [3, 1]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.7", "id": [4, 0]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.9", "id": [4, 1]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [3, 1]}]': finished 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: osdmap e53: 6 total, 5 up, 6 in 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:32.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:51:32.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:32 smithi111 ceph-mon[109885]: pgmap v132: 65 pgs: 23 active+undersized, 11 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/234 objects degraded (12.393%) 2024-09-16T09:51:32.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:32 smithi111 ceph-mon[109885]: osdmap e54: 6 total, 5 up, 6 in 2024-09-16T09:51:32.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:32 smithi111 ceph-mon[109885]: Health check failed: Degraded data redundancy: 29/234 objects degraded (12.393%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T09:51:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:32 smithi114 ceph-mon[79732]: pgmap v132: 65 pgs: 23 active+undersized, 11 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/234 objects degraded (12.393%) 2024-09-16T09:51:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:32 smithi114 ceph-mon[79732]: osdmap e54: 6 total, 5 up, 6 in 2024-09-16T09:51:33.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:32 smithi114 ceph-mon[79732]: Health check failed: Degraded data redundancy: 29/234 objects degraded (12.393%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T09:51:33.381 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:33 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[123173]: 2024-09-16T09:51:33.076+0000 7f850b81d640 -1 Falling back to public interface 2024-09-16T09:51:34.083 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:33 smithi111 ceph-mon[109885]: osdmap e55: 6 total, 5 up, 6 in 2024-09-16T09:51:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:33 smithi114 ceph-mon[79732]: osdmap e55: 6 total, 5 up, 6 in 2024-09-16T09:51:35.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:34 smithi111 ceph-mon[109885]: pgmap v135: 65 pgs: 23 active+undersized, 11 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/234 objects degraded (12.393%) 2024-09-16T09:51:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:34 smithi111 ceph-mon[109885]: osdmap e56: 6 total, 5 up, 6 in 2024-09-16T09:51:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:34 smithi114 ceph-mon[79732]: pgmap v135: 65 pgs: 23 active+undersized, 11 active+undersized+degraded, 31 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 29/234 objects degraded (12.393%) 2024-09-16T09:51:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:34 smithi114 ceph-mon[79732]: osdmap e56: 6 total, 5 up, 6 in 2024-09-16T09:51:35.983 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:35 smithi111 ceph-mon[109885]: osdmap e57: 6 total, 5 up, 6 in 2024-09-16T09:51:35.983 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:35 smithi111 ceph-mon[109885]: osdmap e58: 6 total, 5 up, 6 in 2024-09-16T09:51:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:35 smithi114 ceph-mon[79732]: osdmap e57: 6 total, 5 up, 6 in 2024-09-16T09:51:36.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:35 smithi114 ceph-mon[79732]: osdmap e58: 6 total, 5 up, 6 in 2024-09-16T09:51:36.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 -- 172.21.15.111:0/2307162610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00107910 msgr2=0x7fda00107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 --2- 172.21.15.111:0/2307162610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00107910 0x7fda00107cf0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009880 tx=0x7fd9f002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 -- 172.21.15.111:0/2307162610 shutdown_connections 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 --2- 172.21.15.111:0/2307162610 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda00101910 0x7fda00101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 --2- 172.21.15.111:0/2307162610 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00107910 0x7fda00107cf0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 -- 172.21.15.111:0/2307162610 >> 172.21.15.111:0/2307162610 conn(0x7fda000fd5f0 msgr2=0x7fda000ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 -- 172.21.15.111:0/2307162610 shutdown_connections 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.397+0000 7fda04a41640 1 -- 172.21.15.111:0/2307162610 wait complete. 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fda04a41640 1 Processor -- start 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fda04a41640 1 -- start start 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fda04a41640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 0x7fda0019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fda04a41640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda00107910 0x7fda0019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fda04a41640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fda0010ede0 con 0x7fda00101910 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fda04a41640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fda0010ec60 con 0x7fda00107910 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fd9fe59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 0x7fda0019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fd9fe59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 0x7fda0019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49302/0 (socket says 172.21.15.111:49302) 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fd9fe59c640 1 -- 172.21.15.111:0/2187357753 learned_addr learned my addr 172.21.15.111:0/2187357753 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.398+0000 7fd9fdd9b640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda00107910 0x7fda0019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9fe59c640 1 -- 172.21.15.111:0/2187357753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda00107910 msgr2=0x7fda0019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9fe59c640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda00107910 0x7fda0019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9fe59c640 1 -- 172.21.15.111:0/2187357753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda001977d0 con 0x7fda00101910 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9fe59c640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 0x7fda0019d650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0031460 tx=0x7fd9f0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f003f070 con 0x7fda00101910 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda00197a60 con 0x7fda00101910 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda00197f90 con 0x7fda00101910 2024-09-16T09:51:36.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9f00035f0 con 0x7fda00101910 2024-09-16T09:51:36.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.399+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f0035030 con 0x7fda00101910 2024-09-16T09:51:36.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.401+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e0005290 con 0x7fda00101910 2024-09-16T09:51:36.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.401+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fd9f0042070 con 0x7fda00101910 2024-09-16T09:51:36.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.402+0000 7fd9ef7fe640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd9e807abf0 0x7fd9e807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:36.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.402+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7fd9f00be660 con 0x7fda00101910 2024-09-16T09:51:36.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.402+0000 7fd9fdd9b640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd9e807abf0 0x7fd9e807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:36.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.403+0000 7fd9fdd9b640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd9e807abf0 0x7fd9e807d0b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda000ffbf0 tx=0x7fd9f4005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:36.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.407+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fd9f0089be0 con 0x7fda00101910 2024-09-16T09:51:36.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.617+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd9e0000bc0 con 0x7fd9e807abf0 2024-09-16T09:51:36.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.618+0000 7fd9ef7fe640 1 -- 172.21.15.111:0/2187357753 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fd9e0000bc0 con 0x7fd9e807abf0 2024-09-16T09:51:36.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd9e807abf0 msgr2=0x7fd9e807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd9e807abf0 0x7fd9e807d0b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fda000ffbf0 tx=0x7fd9f4005f90 comp rx=0 tx=0).stop 2024-09-16T09:51:36.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 msgr2=0x7fda0019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 0x7fda0019d650 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0031460 tx=0x7fd9f0004530 comp rx=0 tx=0).stop 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 shutdown_connections 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd9e807abf0 0x7fd9e807d0b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fda00107910 0x7fda0019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 --2- 172.21.15.111:0/2187357753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fda00101910 0x7fda0019d650 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 >> 172.21.15.111:0/2187357753 conn(0x7fda000fd5f0 msgr2=0x7fda000fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 shutdown_connections 2024-09-16T09:51:36.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.621+0000 7fda04a41640 1 -- 172.21.15.111:0/2187357753 wait complete. 2024-09-16T09:51:36.635 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 -- 172.21.15.111:0/4179962672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654103460 msgr2=0x7ff65410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 --2- 172.21.15.111:0/4179962672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654103460 0x7ff65410b950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff640009880 tx=0x7ff64002a530 comp rx=0 tx=0).stop 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 -- 172.21.15.111:0/4179962672 shutdown_connections 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 --2- 172.21.15.111:0/4179962672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654103460 0x7ff65410b950 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 --2- 172.21.15.111:0/4179962672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654102b40 0x7ff654102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 -- 172.21.15.111:0/4179962672 >> 172.21.15.111:0/4179962672 conn(0x7ff6540fc4c0 msgr2=0x7ff6540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 -- 172.21.15.111:0/4179962672 shutdown_connections 2024-09-16T09:51:36.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.714+0000 7ff65b20b640 1 -- 172.21.15.111:0/4179962672 wait complete. 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff65b20b640 1 Processor -- start 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff65b20b640 1 -- start start 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff65b20b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 0x7ff6541007a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff65b20b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654103460 0x7ff654100ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff65b20b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff65410edd0 con 0x7ff654102b40 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff65b20b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff65410ec50 con 0x7ff654103460 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff658fa7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 0x7ff6541007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:36.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff658fa7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 0x7ff6541007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49320/0 (socket says 172.21.15.111:49320) 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff658fa7640 1 -- 172.21.15.111:0/3162187130 learned_addr learned my addr 172.21.15.111:0/3162187130 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.715+0000 7ff653fff640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654103460 0x7ff654100ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff658fa7640 1 -- 172.21.15.111:0/3162187130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654103460 msgr2=0x7ff654100ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff658fa7640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654103460 0x7ff654100ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff658fa7640 1 -- 172.21.15.111:0/3162187130 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff654101220 con 0x7ff654102b40 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff653fff640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654103460 0x7ff654100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff658fa7640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 0x7ff6541007a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e970 tx=0x7ff64800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff64800cac0 con 0x7ff654102b40 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff6480054e0 con 0x7ff654102b40 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff648010430 con 0x7ff654102b40 2024-09-16T09:51:36.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff654101510 con 0x7ff654102b40 2024-09-16T09:51:36.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.716+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6541a3e40 con 0x7ff654102b40 2024-09-16T09:51:36.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.718+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65406a370 con 0x7ff654102b40 2024-09-16T09:51:36.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.718+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ff648004e80 con 0x7ff654102b40 2024-09-16T09:51:36.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.719+0000 7ff651ffb640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff64407abf0 0x7ff64407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:36.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.719+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7ff64809e560 con 0x7ff654102b40 2024-09-16T09:51:36.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.719+0000 7ff653fff640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff64407abf0 0x7ff64407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:36.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.720+0000 7ff653fff640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff64407abf0 0x7ff64407d0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff654102230 tx=0x7ff640004f30 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:36.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.724+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ff648069ae0 con 0x7ff654102b40 2024-09-16T09:51:36.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.942+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff654062630 con 0x7ff64407abf0 2024-09-16T09:51:36.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.944+0000 7ff651ffb640 1 -- 172.21.15.111:0/3162187130 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff654062630 con 0x7ff64407abf0 2024-09-16T09:51:36.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.946+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff64407abf0 msgr2=0x7ff64407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.946+0000 7ff65b20b640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff64407abf0 0x7ff64407d0b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff654102230 tx=0x7ff640004f30 comp rx=0 tx=0).stop 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.946+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 msgr2=0x7ff6541007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.946+0000 7ff65b20b640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 0x7ff6541007a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e970 tx=0x7ff64800ed70 comp rx=0 tx=0).stop 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 shutdown_connections 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff64407abf0 0x7ff64407d0b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff654103460 0x7ff654100ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 --2- 172.21.15.111:0/3162187130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff654102b40 0x7ff6541007a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 >> 172.21.15.111:0/3162187130 conn(0x7ff6540fc4c0 msgr2=0x7ff654103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 shutdown_connections 2024-09-16T09:51:36.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:36.947+0000 7ff65b20b640 1 -- 172.21.15.111:0/3162187130 wait complete. 2024-09-16T09:51:37.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.034+0000 7fa1cd972640 1 -- 172.21.15.111:0/934035623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8102b00 msgr2=0x7fa1c8102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.034+0000 7fa1cd972640 1 --2- 172.21.15.111:0/934035623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8102b00 0x7fa1c8102ee0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098b0 tx=0x7fa1b802a560 comp rx=0 tx=0).stop 2024-09-16T09:51:37.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.034+0000 7fa1cd972640 1 -- 172.21.15.111:0/934035623 shutdown_connections 2024-09-16T09:51:37.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.034+0000 7fa1cd972640 1 --2- 172.21.15.111:0/934035623 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c8103420 0x7fa1c810b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.034+0000 7fa1cd972640 1 --2- 172.21.15.111:0/934035623 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8102b00 0x7fa1c8102ee0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.034+0000 7fa1cd972640 1 -- 172.21.15.111:0/934035623 >> 172.21.15.111:0/934035623 conn(0x7fa1c80fc4c0 msgr2=0x7fa1c80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:37.038 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:36 smithi111 ceph-mon[109885]: pgmap v138: 65 pgs: 1 remapped+peering, 9 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%); 5.0 MiB/s, 188 objects/s recovering 2024-09-16T09:51:37.038 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:37.039 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:37.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.035+0000 7fa1cd972640 1 -- 172.21.15.111:0/934035623 shutdown_connections 2024-09-16T09:51:37.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.035+0000 7fa1cd972640 1 -- 172.21.15.111:0/934035623 wait complete. 2024-09-16T09:51:37.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.035+0000 7fa1cd972640 1 Processor -- start 2024-09-16T09:51:37.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1cd972640 1 -- start start 2024-09-16T09:51:37.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1cd972640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c8102b00 0x7fa1c819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1cd972640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 0x7fa1c819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1cd972640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c810edd0 con 0x7fa1c8103420 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1cd972640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c810ec50 con 0x7fa1c8102b00 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 0x7fa1c819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c67fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 0x7fa1c819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49344/0 (socket says 172.21.15.111:49344) 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c67fc640 1 -- 172.21.15.111:0/2539597013 learned_addr learned my addr 172.21.15.111:0/2539597013 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c6ffd640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c8102b00 0x7fa1c819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c67fc640 1 -- 172.21.15.111:0/2539597013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c8102b00 msgr2=0x7fa1c819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c67fc640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c8102b00 0x7fa1c819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.036+0000 7fa1c67fc640 1 -- 172.21.15.111:0/2539597013 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c81977e0 con 0x7fa1c8103420 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.037+0000 7fa1c67fc640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 0x7fa1c819dba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00e970 tx=0x7fa1bc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:37.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.037+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1bc00cac0 con 0x7fa1c8103420 2024-09-16T09:51:37.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.037+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c8197ad0 con 0x7fa1c8103420 2024-09-16T09:51:37.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.037+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa1bc0054e0 con 0x7fa1c8103420 2024-09-16T09:51:37.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.037+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c8198060 con 0x7fa1c8103420 2024-09-16T09:51:37.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.037+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa1bc010430 con 0x7fa1c8103420 2024-09-16T09:51:37.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.038+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1c806a3b0 con 0x7fa1c8103420 2024-09-16T09:51:37.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.039+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fa1bc004f00 con 0x7fa1c8103420 2024-09-16T09:51:37.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.039+0000 7fa1cc970640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa1b007abf0 0x7fa1b007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.039+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7fa1bc09e4e0 con 0x7fa1c8103420 2024-09-16T09:51:37.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.040+0000 7fa1c6ffd640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa1b007abf0 0x7fa1b007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.040+0000 7fa1c6ffd640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa1b007abf0 0x7fa1b007d0b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8000c00 tx=0x7fa1b8031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:37.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.044+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fa1bc069a60 con 0x7fa1c8103420 2024-09-16T09:51:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:36 smithi114 ceph-mon[79732]: pgmap v138: 65 pgs: 1 remapped+peering, 9 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%); 5.0 MiB/s, 188 objects/s recovering 2024-09-16T09:51:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:37.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.240+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa1c81983d0 con 0x7fa1b007abf0 2024-09-16T09:51:37.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.250+0000 7fa1cc970640 1 -- 172.21.15.111:0/2539597013 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa1c81983d0 con 0x7fa1b007abf0 2024-09-16T09:51:37.253 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:51:37.253 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (2m) 0s ago 13m 21.2M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:51:37.253 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (4m) 0s ago 13m 8883k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:51:37.253 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (4m) 56s ago 12m 8326k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:51:37.253 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (63s) 0s ago 13m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (59s) 56s ago 12m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (2m) 0s ago 13m 76.2M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (8m) 0s ago 8m 148M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (8m) 0s ago 8m 18.7M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (8m) 56s ago 8m 19.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (8m) 56s ago 8m 19.4M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (4m) 0s ago 14m 522M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (3m) 56s ago 12m 455M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (91s) 0s ago 15m 43.4M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (77s) 56s ago 12m 25.7M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (3m) 0s ago 13m 11.4M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (3m) 56s ago 12m 10.6M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (40s) 0s ago 11m 91.2M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:51:37.254 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (6s) 0s ago 11m 11.2M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:51:37.255 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (10m) 0s ago 10m 209M 1216M 19.1.1-328-gad35db06 b5388489f99e a7d79891126a 2024-09-16T09:51:37.255 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (10m) 56s ago 10m 305M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:51:37.255 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (9m) 56s ago 9m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:51:37.255 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (9m) 56s ago 9m 236M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:51:37.255 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (3m) 0s ago 13m 52.5M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:51:37.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa1b007abf0 msgr2=0x7fa1b007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa1b007abf0 0x7fa1b007d0b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8000c00 tx=0x7fa1b8031400 comp rx=0 tx=0).stop 2024-09-16T09:51:37.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 msgr2=0x7fa1c819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 0x7fa1c819dba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00e970 tx=0x7fa1bc00ed70 comp rx=0 tx=0).stop 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 shutdown_connections 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa1b007abf0 0x7fa1b007d0b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa1c8103420 0x7fa1c819dba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 --2- 172.21.15.111:0/2539597013 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa1c8102b00 0x7fa1c819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 >> 172.21.15.111:0/2539597013 conn(0x7fa1c80fc4c0 msgr2=0x7fa1c8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.253+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 shutdown_connections 2024-09-16T09:51:37.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.254+0000 7fa1cd972640 1 -- 172.21.15.111:0/2539597013 wait complete. 2024-09-16T09:51:37.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 -- 172.21.15.111:0/3090882875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 msgr2=0x7f8f80104bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 --2- 172.21.15.111:0/3090882875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f80104bb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8f6800a990 tx=0x7f8f6802b7d0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 -- 172.21.15.111:0/3090882875 shutdown_connections 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 --2- 172.21.15.111:0/3090882875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f80104bb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 --2- 172.21.15.111:0/3090882875 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f80100590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 -- 172.21.15.111:0/3090882875 >> 172.21.15.111:0/3090882875 conn(0x7f8f800fbc10 msgr2=0x7f8f800fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 -- 172.21.15.111:0/3090882875 shutdown_connections 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 -- 172.21.15.111:0/3090882875 wait complete. 2024-09-16T09:51:37.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 Processor -- start 2024-09-16T09:51:37.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.353+0000 7f8f8527e640 1 -- start start 2024-09-16T09:51:37.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f8527e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f8019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f8527e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f8019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f8527e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010cb10 con 0x7f8f80100b60 2024-09-16T09:51:37.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f8527e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8010c990 con 0x7f8f801001b0 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f7effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f8019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f77fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f8019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f7effd640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f8019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:56330/0 (socket says 172.21.15.111:56330) 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.354+0000 7f8f7effd640 1 -- 172.21.15.111:0/2667057795 learned_addr learned my addr 172.21.15.111:0/2667057795 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f77fff640 1 -- 172.21.15.111:0/2667057795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 msgr2=0x7f8f8019d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f77fff640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f8019d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f77fff640 1 -- 172.21.15.111:0/2667057795 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f80197710 con 0x7f8f80100b60 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f7effd640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f8019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f77fff640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f8019db80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f68000c00 tx=0x7f8f68004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f68044020 con 0x7f8f80100b60 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f801979a0 con 0x7f8f80100b60 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f68004b80 con 0x7f8f80100b60 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f680035f0 con 0x7f8f80100b60 2024-09-16T09:51:37.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.355+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f80197f30 con 0x7f8f80100b60 2024-09-16T09:51:37.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.357+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f80101690 con 0x7f8f80100b60 2024-09-16T09:51:37.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.357+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f8f68047020 con 0x7f8f80100b60 2024-09-16T09:51:37.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.358+0000 7f8f7cff9640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8f6c07ac90 0x7f8f6c07d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.358+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7f8f680bef80 con 0x7f8f80100b60 2024-09-16T09:51:37.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.358+0000 7f8f7effd640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8f6c07ac90 0x7f8f6c07d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.359+0000 7f8f7effd640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8f6c07ac90 0x7f8f6c07d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000f4d0 tx=0x7f8f7000a380 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:37.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.363+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f8f6804e020 con 0x7f8f80100b60 2024-09-16T09:51:37.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.645+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8f80198c70 con 0x7f8f80100b60 2024-09-16T09:51:37.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.646+0000 7f8f7cff9640 1 -- 172.21.15.111:0/2667057795 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f8f80198c70 con 0x7f8f80100b60 2024-09-16T09:51:37.649 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:51:37.649 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:51:37.649 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4, 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 8, 2024-09-16T09:51:37.650 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 5 2024-09-16T09:51:37.651 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:51:37.651 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:51:37.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8f6c07ac90 msgr2=0x7f8f6c07d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8f6c07ac90 0x7f8f6c07d150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8f7000f4d0 tx=0x7f8f7000a380 comp rx=0 tx=0).stop 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 msgr2=0x7f8f8019db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f8019db80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f68000c00 tx=0x7f8f68004270 comp rx=0 tx=0).stop 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 shutdown_connections 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8f6c07ac90 0x7f8f6c07d150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8f80100b60 0x7f8f8019db80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 --2- 172.21.15.111:0/2667057795 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8f801001b0 0x7f8f8019d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 >> 172.21.15.111:0/2667057795 conn(0x7f8f800fbc10 msgr2=0x7f8f801045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 shutdown_connections 2024-09-16T09:51:37.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.648+0000 7f8f8527e640 1 -- 172.21.15.111:0/2667057795 wait complete. 2024-09-16T09:51:37.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 -- 172.21.15.111:0/2560852298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9141033c0 msgr2=0x7fc91410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 --2- 172.21.15.111:0/2560852298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9141033c0 0x7fc91410b8b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc009880 tx=0x7fc8fc02a530 comp rx=0 tx=0).stop 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 -- 172.21.15.111:0/2560852298 shutdown_connections 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 --2- 172.21.15.111:0/2560852298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc9141033c0 0x7fc91410b8b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 --2- 172.21.15.111:0/2560852298 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc914102aa0 0x7fc914102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 -- 172.21.15.111:0/2560852298 >> 172.21.15.111:0/2560852298 conn(0x7fc9140fc4c0 msgr2=0x7fc9140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 -- 172.21.15.111:0/2560852298 shutdown_connections 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 -- 172.21.15.111:0/2560852298 wait complete. 2024-09-16T09:51:37.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.737+0000 7fc919702640 1 Processor -- start 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc919702640 1 -- start start 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc919702640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 0x7fc914100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc919702640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9141033c0 0x7fc914100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc919702640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc91410edd0 con 0x7fc914102aa0 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc919702640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc91410ec50 con 0x7fc9141033c0 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc912ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 0x7fc914100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc912ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 0x7fc914100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49386/0 (socket says 172.21.15.111:49386) 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc912ffd640 1 -- 172.21.15.111:0/2492220593 learned_addr learned my addr 172.21.15.111:0/2492220593 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc90a7fc640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9141033c0 0x7fc914100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc912ffd640 1 -- 172.21.15.111:0/2492220593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9141033c0 msgr2=0x7fc914100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc912ffd640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9141033c0 0x7fc914100c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.738+0000 7fc912ffd640 1 -- 172.21.15.111:0/2492220593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914101180 con 0x7fc914102aa0 2024-09-16T09:51:37.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.739+0000 7fc912ffd640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 0x7fc914100700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc90400d6f0 tx=0x7fc90400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:37.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.739+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc904017070 con 0x7fc914102aa0 2024-09-16T09:51:37.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.739+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc914101470 con 0x7fc914102aa0 2024-09-16T09:51:37.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.739+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9141a3e80 con 0x7fc914102aa0 2024-09-16T09:51:37.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.739+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc90400de00 con 0x7fc914102aa0 2024-09-16T09:51:37.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.739+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc904004bb0 con 0x7fc914102aa0 2024-09-16T09:51:37.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.740+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91406a410 con 0x7fc914102aa0 2024-09-16T09:51:37.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.741+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fc904004e60 con 0x7fc914102aa0 2024-09-16T09:51:37.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.742+0000 7fc910ff9640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc90007abf0 0x7fc90007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:37.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.742+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7fc90409d9c0 con 0x7fc914102aa0 2024-09-16T09:51:37.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.742+0000 7fc90a7fc640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc90007abf0 0x7fc90007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:37.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.742+0000 7fc90a7fc640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc90007abf0 0x7fc90007d0b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc914102190 tx=0x7fc8fc031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:37.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.746+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fc904068f40 con 0x7fc914102aa0 2024-09-16T09:51:37.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.967+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc914102e80 con 0x7fc914102aa0 2024-09-16T09:51:37.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:37 smithi111 ceph-mon[109885]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:37.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:37 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:37.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:37 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:37.970 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:37 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2667057795' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:37.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.967+0000 7fc910ff9640 1 -- 172.21.15.111:0/2492220593 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7fc90406ddf0 con 0x7fc914102aa0 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:51:37.971 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:51:37.972 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:51:37.973 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:37.974 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.969+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc90007abf0 msgr2=0x7fc90007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.969+0000 7fc919702640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc90007abf0 0x7fc90007d0b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc914102190 tx=0x7fc8fc031400 comp rx=0 tx=0).stop 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.969+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 msgr2=0x7fc914100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.969+0000 7fc919702640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 0x7fc914100700 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc90400d6f0 tx=0x7fc90400dbb0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 shutdown_connections 2024-09-16T09:51:37.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc90007abf0 0x7fc90007d0b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc9141033c0 0x7fc914100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 --2- 172.21.15.111:0/2492220593 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc914102aa0 0x7fc914100700 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:37.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 >> 172.21.15.111:0/2492220593 conn(0x7fc9140fc4c0 msgr2=0x7fc914108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:37.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 shutdown_connections 2024-09-16T09:51:37.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:37.970+0000 7fc919702640 1 -- 172.21.15.111:0/2492220593 wait complete. 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 -- 172.21.15.111:0/84479034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101007e0 msgr2=0x7f8110100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 --2- 172.21.15.111:0/84479034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101007e0 0x7f8110100c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8100009880 tx=0x7f810002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 -- 172.21.15.111:0/84479034 shutdown_connections 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 --2- 172.21.15.111:0/84479034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101007e0 0x7f8110100c40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 --2- 172.21.15.111:0/84479034 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81101067e0 0x7f8110106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 -- 172.21.15.111:0/84479034 >> 172.21.15.111:0/84479034 conn(0x7f81100fc4c0 msgr2=0x7f81100fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:38.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 -- 172.21.15.111:0/84479034 shutdown_connections 2024-09-16T09:51:38.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.055+0000 7f8116bbb640 1 -- 172.21.15.111:0/84479034 wait complete. 2024-09-16T09:51:38.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8116bbb640 1 Processor -- start 2024-09-16T09:51:38.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8116bbb640 1 -- start start 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8116bbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81101007e0 0x7f81100fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8116bbb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 0x7f81100fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8116bbb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f811010dc90 con 0x7f81101067e0 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8116bbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f811010db10 con 0x7f81101007e0 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 0x7f81100fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 0x7f81100fd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49404/0 (socket says 172.21.15.111:49404) 2024-09-16T09:51:38.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 -- 172.21.15.111:0/270197815 learned_addr learned my addr 172.21.15.111:0/270197815 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8114957640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81101007e0 0x7f81100fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 -- 172.21.15.111:0/270197815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81101007e0 msgr2=0x7f81100fcbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81101007e0 0x7f81100fcbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 -- 172.21.15.111:0/270197815 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81100fd670 con 0x7f81101067e0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.056+0000 7f8107fff640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 0x7f81100fd130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8100031460 tx=0x7f81000048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.057+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f810003f070 con 0x7f81101067e0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.057+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8100004cf0 con 0x7f81101067e0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.057+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8100035030 con 0x7f81101067e0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.057+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81100fd900 con 0x7f81101067e0 2024-09-16T09:51:38.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.057+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81101a3d10 con 0x7f81101067e0 2024-09-16T09:51:38.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.058+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8110101f20 con 0x7f81101067e0 2024-09-16T09:51:38.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.059+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f8100042070 con 0x7f81101067e0 2024-09-16T09:51:38.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.059+0000 7f8105ffb640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f80f807ac40 0x7f80f807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:38.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.059+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7f81000be730 con 0x7f81101067e0 2024-09-16T09:51:38.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.060+0000 7f8114957640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f80f807ac40 0x7f80f807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:38.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.060+0000 7f8114957640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f80f807ac40 0x7f80f807d100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f810c007ec0 tx=0x7f810c0075b0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:38.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.064+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f8100089cd0 con 0x7f81101067e0 2024-09-16T09:51:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:37 smithi114 ceph-mon[79732]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:37 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:37 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:37 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2667057795' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:38.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.267+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8110062630 con 0x7f80f807ac40 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.268+0000 7f8105ffb640 1 -- 172.21.15.111:0/270197815 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f8110062630 con 0x7f80f807ac40 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:51:38.271 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:51:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "8/23 daemons upgraded", 2024-09-16T09:51:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T09:51:38.272 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:51:38.272 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:51:38.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.270+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f80f807ac40 msgr2=0x7f80f807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.270+0000 7f8116bbb640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f80f807ac40 0x7f80f807d100 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f810c007ec0 tx=0x7f810c0075b0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.270+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 msgr2=0x7f81100fd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.270+0000 7f8116bbb640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 0x7f81100fd130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8100031460 tx=0x7f81000048f0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 shutdown_connections 2024-09-16T09:51:38.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f80f807ac40 0x7f80f807d100 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f81101067e0 0x7f81100fd130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 --2- 172.21.15.111:0/270197815 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f81101007e0 0x7f81100fcbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 >> 172.21.15.111:0/270197815 conn(0x7f81100fc4c0 msgr2=0x7f8110069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:38.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 shutdown_connections 2024-09-16T09:51:38.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.271+0000 7f8116bbb640 1 -- 172.21.15.111:0/270197815 wait complete. 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 -- 172.21.15.111:0/11046820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 msgr2=0x7fbddc102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 --2- 172.21.15.111:0/11046820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc102f20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc009880 tx=0x7fbdcc02a530 comp rx=0 tx=0).stop 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 -- 172.21.15.111:0/11046820 shutdown_connections 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 --2- 172.21.15.111:0/11046820 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc103460 0x7fbddc10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 --2- 172.21.15.111:0/11046820 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc102f20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 -- 172.21.15.111:0/11046820 >> 172.21.15.111:0/11046820 conn(0x7fbddc0fc4c0 msgr2=0x7fbddc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 -- 172.21.15.111:0/11046820 shutdown_connections 2024-09-16T09:51:38.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.355+0000 7fbde1b52640 1 -- 172.21.15.111:0/11046820 wait complete. 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbde1b52640 1 Processor -- start 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbde1b52640 1 -- start start 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbde1b52640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbde1b52640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc103460 0x7fbddc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbde1b52640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc10edd0 con 0x7fbddc102b40 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbde1b52640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc10ec50 con 0x7fbddc103460 2024-09-16T09:51:38.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddb7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddb7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:49432/0 (socket says 172.21.15.111:49432) 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddb7fe640 1 -- 172.21.15.111:0/397032449 learned_addr learned my addr 172.21.15.111:0/397032449 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddaffd640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc103460 0x7fbddc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddb7fe640 1 -- 172.21.15.111:0/397032449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc103460 msgr2=0x7fbddc19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddb7fe640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc103460 0x7fbddc19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.356+0000 7fbddb7fe640 1 -- 172.21.15.111:0/397032449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc1977c0 con 0x7fbddc102b40 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.357+0000 7fbddb7fe640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc19d640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc004f90 tx=0x7fbdcc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.357+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdcc03f070 con 0x7fbddc102b40 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.357+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc197a50 con 0x7fbddc102b40 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.357+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdcc004ac0 con 0x7fbddc102b40 2024-09-16T09:51:38.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.357+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdcc035030 con 0x7fbddc102b40 2024-09-16T09:51:38.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.357+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc197f80 con 0x7fbddc102b40 2024-09-16T09:51:38.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.358+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbddc06a370 con 0x7fbddc102b40 2024-09-16T09:51:38.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.359+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fbdcc042070 con 0x7fbddc102b40 2024-09-16T09:51:38.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.359+0000 7fbdd8ff9640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbdc407abf0 0x7fbdc407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:51:38.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.359+0000 7fbddaffd640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbdc407abf0 0x7fbdc407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:51:38.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.360+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 6690+0+0 (secure 0 0 0) 0x7fbdcc0be700 con 0x7fbddc102b40 2024-09-16T09:51:38.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.360+0000 7fbddaffd640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbdc407abf0 0x7fbdc407d0b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbddc108980 tx=0x7fbdd0005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:51:38.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.364+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fbdcc089c20 con 0x7fbddc102b40 2024-09-16T09:51:38.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.691+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbddc106010 con 0x7fbddc102b40 2024-09-16T09:51:38.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.691+0000 7fbdd8ff9640 1 -- 172.21.15.111:0/397032449 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+956 (secure 0 0 0) 0x7fbdcc08ead0 con 0x7fbddc102b40 2024-09-16T09:51:38.694 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 22/234 objects degraded (9.402%), 9 pgs degraded 2024-09-16T09:51:38.694 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: osd.1 (root=default,host=smithi111) is down 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 22/234 objects degraded (9.402%), 9 pgs degraded 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-16T09:51:38.695 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-16T09:51:38.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.693+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbdc407abf0 msgr2=0x7fbdc407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.696 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.693+0000 7fbde1b52640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbdc407abf0 0x7fbdc407d0b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbddc108980 tx=0x7fbdd0005f90 comp rx=0 tx=0).stop 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.693+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 msgr2=0x7fbddc19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.693+0000 7fbde1b52640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc19d640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdcc004f90 tx=0x7fbdcc0046c0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.693+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 shutdown_connections 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.694+0000 7fbde1b52640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbdc407abf0 0x7fbdc407d0b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.694+0000 7fbde1b52640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbddc103460 0x7fbddc19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.694+0000 7fbde1b52640 1 --2- 172.21.15.111:0/397032449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbddc102b40 0x7fbddc19d640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.694+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 >> 172.21.15.111:0/397032449 conn(0x7fbddc0fc4c0 msgr2=0x7fbddc103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:51:38.697 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.694+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 shutdown_connections 2024-09-16T09:51:38.698 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:51:38.694+0000 7fbde1b52640 1 -- 172.21.15.111:0/397032449 wait complete. 2024-09-16T09:51:38.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:38 smithi111 ceph-mon[109885]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:38.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:38 smithi111 ceph-mon[109885]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:38.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:38 smithi111 ceph-mon[109885]: pgmap v140: 65 pgs: 1 remapped+peering, 9 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%); 4.1 MiB/s, 153 objects/s recovering 2024-09-16T09:51:38.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:38 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2492220593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:51:38.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:38 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/397032449' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:51:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:38 smithi114 ceph-mon[79732]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:38 smithi114 ceph-mon[79732]: from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:38 smithi114 ceph-mon[79732]: pgmap v140: 65 pgs: 1 remapped+peering, 9 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%); 4.1 MiB/s, 153 objects/s recovering 2024-09-16T09:51:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:38 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2492220593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:51:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:38 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/397032449' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:51:39.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:38 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[123173]: 2024-09-16T09:51:38.977+0000 7f850b81d640 -1 osd.1 50 log_to_monitors true 2024-09-16T09:51:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:39 smithi111 ceph-mon[109885]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:39 smithi111 ceph-mon[109885]: from='osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-16T09:51:40.132 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:51:39 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[123173]: 2024-09-16T09:51:39.859+0000 7f84ff5bf640 -1 osd.1 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:51:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:39 smithi114 ceph-mon[79732]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:51:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:39 smithi114 ceph-mon[79732]: from='osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-16T09:51:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: pgmap v141: 65 pgs: 1 remapped+peering, 9 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%); 3.3 MiB/s, 125 objects/s recovering 2024-09-16T09:51:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T09:51:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: osdmap e59: 6 total, 5 up, 6 in 2024-09-16T09:51:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-16T09:51:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-16T09:51:41.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:40 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 22/234 objects degraded (9.402%), 9 pgs degraded (PG_DEGRADED) 2024-09-16T09:51:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: pgmap v141: 65 pgs: 1 remapped+peering, 9 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%); 3.3 MiB/s, 125 objects/s recovering 2024-09-16T09:51:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-16T09:51:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: osdmap e59: 6 total, 5 up, 6 in 2024-09-16T09:51:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-16T09:51:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-16T09:51:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:40 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 22/234 objects degraded (9.402%), 9 pgs degraded (PG_DEGRADED) 2024-09-16T09:51:42.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T09:51:42.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-16T09:51:42.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:51:42.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747] boot 2024-09-16T09:51:42.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: osdmap e60: 6 total, 6 up, 6 in 2024-09-16T09:51:42.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-16T09:51:42.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:41 smithi111 ceph-mon[109885]: osdmap e61: 6 total, 6 up, 6 in 2024-09-16T09:51:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T09:51:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-16T09:51:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:51:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: osd.1 [v2:172.21.15.111:6810/3317484747,v1:172.21.15.111:6811/3317484747] boot 2024-09-16T09:51:42.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: osdmap e60: 6 total, 6 up, 6 in 2024-09-16T09:51:42.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-16T09:51:42.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:41 smithi114 ceph-mon[79732]: osdmap e61: 6 total, 6 up, 6 in 2024-09-16T09:51:43.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:42 smithi111 ceph-mon[109885]: pgmap v144: 65 pgs: 10 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%) 2024-09-16T09:51:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:42 smithi111 ceph-mon[109885]: osdmap e62: 6 total, 6 up, 6 in 2024-09-16T09:51:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:42 smithi114 ceph-mon[79732]: pgmap v144: 65 pgs: 10 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%) 2024-09-16T09:51:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:42 smithi114 ceph-mon[79732]: osdmap e62: 6 total, 6 up, 6 in 2024-09-16T09:51:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:43 smithi114 ceph-mon[79732]: pgmap v147: 65 pgs: 10 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%) 2024-09-16T09:51:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:43 smithi114 ceph-mon[79732]: osdmap e63: 6 total, 6 up, 6 in 2024-09-16T09:51:44.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:43 smithi111 ceph-mon[109885]: pgmap v147: 65 pgs: 10 active+clean+remapped, 21 active+undersized, 9 active+undersized+degraded, 25 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 22/234 objects degraded (9.402%); 16/234 objects misplaced (6.838%) 2024-09-16T09:51:44.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:43 smithi111 ceph-mon[109885]: osdmap e63: 6 total, 6 up, 6 in 2024-09-16T09:51:46.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:45 smithi111 ceph-mon[109885]: osdmap e64: 6 total, 6 up, 6 in 2024-09-16T09:51:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:45 smithi111 ceph-mon[109885]: osdmap e65: 6 total, 6 up, 6 in 2024-09-16T09:51:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:45 smithi111 ceph-mon[109885]: pgmap v151: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 62 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.3 MiB/s, 268 objects/s recovering 2024-09-16T09:51:46.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:45 smithi114 ceph-mon[79732]: osdmap e64: 6 total, 6 up, 6 in 2024-09-16T09:51:46.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:46.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:51:46.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:45 smithi114 ceph-mon[79732]: osdmap e65: 6 total, 6 up, 6 in 2024-09-16T09:51:46.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:45 smithi114 ceph-mon[79732]: pgmap v151: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 62 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.3 MiB/s, 268 objects/s recovering 2024-09-16T09:51:47.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:46 smithi111 ceph-mon[109885]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/234 objects degraded (9.402%), 9 pgs degraded) 2024-09-16T09:51:47.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:46 smithi111 ceph-mon[109885]: osdmap e66: 6 total, 6 up, 6 in 2024-09-16T09:51:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:46 smithi114 ceph-mon[79732]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/234 objects degraded (9.402%), 9 pgs degraded) 2024-09-16T09:51:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:46 smithi114 ceph-mon[79732]: osdmap e66: 6 total, 6 up, 6 in 2024-09-16T09:51:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:48 smithi111 ceph-mon[109885]: pgmap v153: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 62 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s, 258 objects/s recovering 2024-09-16T09:51:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:48 smithi111 ceph-mon[109885]: osdmap e67: 6 total, 6 up, 6 in 2024-09-16T09:51:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:48 smithi114 ceph-mon[79732]: pgmap v153: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 62 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 7.0 MiB/s, 258 objects/s recovering 2024-09-16T09:51:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:48 smithi114 ceph-mon[79732]: osdmap e67: 6 total, 6 up, 6 in 2024-09-16T09:51:50.989 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:50 smithi114 ceph-mon[79732]: pgmap v155: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 62 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.8 MiB/s, 213 objects/s recovering 2024-09-16T09:51:51.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:50 smithi111 ceph-mon[109885]: pgmap v155: 65 pgs: 1 active+recovering+undersized+remapped, 1 active+undersized+remapped, 1 active+clean+remapped, 62 active+clean; 219 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 5.8 MiB/s, 213 objects/s recovering 2024-09-16T09:51:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:52 smithi111 ceph-mon[109885]: pgmap v156: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 82 objects/s recovering 2024-09-16T09:51:53.160 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:52 smithi114 ceph-mon[79732]: pgmap v156: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 82 objects/s recovering 2024-09-16T09:51:55.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:54 smithi111 ceph-mon[109885]: pgmap v157: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 61 objects/s recovering 2024-09-16T09:51:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:54 smithi114 ceph-mon[79732]: pgmap v157: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 61 objects/s recovering 2024-09-16T09:51:56.004 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:55 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-16T09:51:56.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:55 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-16T09:51:57.125 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:56 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T09:51:57.125 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:56 smithi111 ceph-mon[109885]: Upgrade: osd.2 is safe to restart 2024-09-16T09:51:57.125 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:56 smithi111 ceph-mon[109885]: pgmap v158: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 54 objects/s recovering 2024-09-16T09:51:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:56 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-16T09:51:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:56 smithi114 ceph-mon[79732]: Upgrade: osd.2 is safe to restart 2024-09-16T09:51:57.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:56 smithi114 ceph-mon[79732]: pgmap v158: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 54 objects/s recovering 2024-09-16T09:51:58.115 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:57 smithi111 ceph-mon[109885]: Upgrade: Updating osd.2 2024-09-16T09:51:58.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:58.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-16T09:51:58.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:58.116 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:57 smithi111 ceph-mon[109885]: Deploying daemon osd.2 on smithi111 2024-09-16T09:51:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:57 smithi114 ceph-mon[79732]: Upgrade: Updating osd.2 2024-09-16T09:51:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:51:58.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-16T09:51:58.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:51:58.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:57 smithi114 ceph-mon[79732]: Deploying daemon osd.2 on smithi111 2024-09-16T09:51:59.097 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:58 smithi111 ceph-mon[109885]: pgmap v159: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 49 objects/s recovering 2024-09-16T09:51:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:58 smithi114 ceph-mon[79732]: pgmap v159: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 49 objects/s recovering 2024-09-16T09:51:59.814 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:51:59 smithi111 systemd[1]: Stopping Ceph osd.2 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:51:59.815 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:51:59 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[64715]: 2024-09-16T09:51:59.691+0000 7f8b8966b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:51:59.815 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:51:59 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[64715]: 2024-09-16T09:51:59.691+0000 7f8b8966b640 -1 osd.2 67 *** Got signal Terminated *** 2024-09-16T09:51:59.815 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:51:59 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[64715]: 2024-09-16T09:51:59.691+0000 7f8b8966b640 -1 osd.2 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:52:00.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:51:59 smithi111 ceph-mon[109885]: osd.2 marked itself down and dead 2024-09-16T09:52:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:51:59 smithi114 ceph-mon[79732]: osd.2 marked itself down and dead 2024-09-16T09:52:00.609 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:00 smithi111 podman[127885]: 2024-09-16 09:52:00.314929654 +0000 UTC m=+0.726859323 container died a7d79891126ab8b63ada95a043499010c904386946c107498842eb0be31a2079 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-ad35db0, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-16T09:52:00.882 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:00 smithi111 podman[127885]: 2024-09-16 09:52:00.608624672 +0000 UTC m=+1.020554337 container cleanup a7d79891126ab8b63ada95a043499010c904386946c107498842eb0be31a2079 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, RELEASE=squid-ad35db0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:52:00.882 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:00 smithi111 bash[127885]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2 2024-09-16T09:52:00.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:00 smithi111 ceph-mon[109885]: pgmap v160: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 41 objects/s recovering 2024-09-16T09:52:00.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:00 smithi111 ceph-mon[109885]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:52:00.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:00 smithi111 ceph-mon[109885]: osdmap e68: 6 total, 5 up, 6 in 2024-09-16T09:52:00.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:00.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:00.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:00 smithi114 ceph-mon[79732]: pgmap v160: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 41 objects/s recovering 2024-09-16T09:52:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:00 smithi114 ceph-mon[79732]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:52:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:00 smithi114 ceph-mon[79732]: osdmap e68: 6 total, 5 up, 6 in 2024-09-16T09:52:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:01.227 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:00 smithi111 podman[127900]: 2024-09-16 09:52:00.902026113 +0000 UTC m=+0.583343693 container remove a7d79891126ab8b63ada95a043499010c904386946c107498842eb0be31a2079 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-ad35db0, org.label-schema.schema-version=1.0) 2024-09-16T09:52:01.494 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:01 smithi111 podman[127990]: 2024-09-16 09:52:01.129950182 +0000 UTC m=+0.016220959 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:52:01.494 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:01 smithi111 podman[127990]: 2024-09-16 09:52:01.244863704 +0000 UTC m=+0.131134469 container create d11b14eebe914e36f3dd7c35fbed01f6248cfe0e1b71b149dcc70bcedb2a4196 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T09:52:01.826 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:01 smithi111 podman[127990]: 2024-09-16 09:52:01.493320636 +0000 UTC m=+0.379591413 container init d11b14eebe914e36f3dd7c35fbed01f6248cfe0e1b71b149dcc70bcedb2a4196 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:52:01.826 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:01 smithi111 podman[127990]: 2024-09-16 09:52:01.497263946 +0000 UTC m=+0.383534712 container start d11b14eebe914e36f3dd7c35fbed01f6248cfe0e1b71b149dcc70bcedb2a4196 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-16T09:52:01.826 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:01 smithi111 podman[127990]: 2024-09-16 09:52:01.572521957 +0000 UTC m=+0.458792724 container attach d11b14eebe914e36f3dd7c35fbed01f6248cfe0e1b71b149dcc70bcedb2a4196 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-16T09:52:01.826 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:01 smithi111 podman[127990]: 2024-09-16 09:52:01.692597967 +0000 UTC m=+0.578868733 container died d11b14eebe914e36f3dd7c35fbed01f6248cfe0e1b71b149dcc70bcedb2a4196 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-16T09:52:02.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:01 smithi111 ceph-mon[109885]: osdmap e69: 6 total, 5 up, 6 in 2024-09-16T09:52:02.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:01 smithi114 ceph-mon[79732]: osdmap e69: 6 total, 5 up, 6 in 2024-09-16T09:52:02.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 podman[128013]: 2024-09-16 09:52:02.268031196 +0000 UTC m=+0.564553402 container remove d11b14eebe914e36f3dd7c35fbed01f6248cfe0e1b71b149dcc70bcedb2a4196 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-16T09:52:02.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-16T09:52:02.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 systemd[1]: Stopped Ceph osd.2 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:52:02.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.2.service: Consumed 54.206s CPU time. 2024-09-16T09:52:02.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 systemd[1]: Starting Ceph osd.2 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:52:03.006 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:02 smithi111 ceph-mon[109885]: pgmap v163: 65 pgs: 22 peering, 2 stale+active+clean, 41 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:03.006 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:02 smithi111 ceph-mon[109885]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-16T09:52:03.006 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 podman[128113]: 2024-09-16 09:52:02.677208099 +0000 UTC m=+0.095279314 container create a0828e7c28c8d130d81af22fa6ee95a61a816005588d02aa84a9b7a75522ad49 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:52:03.006 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 podman[128113]: 2024-09-16 09:52:02.598307829 +0000 UTC m=+0.016379058 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:52:03.006 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 podman[128113]: 2024-09-16 09:52:02.921494697 +0000 UTC m=+0.339565911 container init a0828e7c28c8d130d81af22fa6ee95a61a816005588d02aa84a9b7a75522ad49 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T09:52:03.006 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:02 smithi111 podman[128113]: 2024-09-16 09:52:02.925032356 +0000 UTC m=+0.343103579 container start a0828e7c28c8d130d81af22fa6ee95a61a816005588d02aa84a9b7a75522ad49 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T09:52:03.006 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 podman[128113]: 2024-09-16 09:52:03.00495127 +0000 UTC m=+0.423022485 container attach a0828e7c28c8d130d81af22fa6ee95a61a816005588d02aa84a9b7a75522ad49 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T09:52:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:02 smithi114 ceph-mon[79732]: pgmap v163: 65 pgs: 22 peering, 2 stale+active+clean, 41 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:02 smithi114 ceph-mon[79732]: Health check failed: Reduced data availability: 7 pgs peering (PG_AVAILABILITY) 2024-09-16T09:52:03.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:03.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 bash[128113]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:03.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:03.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 bash[128113]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:04.083 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T09:52:04.083 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 bash[128113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T09:52:04.084 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T09:52:04.084 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:03 smithi111 bash[128113]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 bash[128113]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 bash[128113]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 bash[128113]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 bash[128113]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-16T09:52:04.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate[128128]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-16T09:52:04.383 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 bash[128113]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-16T09:52:04.383 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 podman[128113]: 2024-09-16 09:52:04.110952095 +0000 UTC m=+1.529023321 container died a0828e7c28c8d130d81af22fa6ee95a61a816005588d02aa84a9b7a75522ad49 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-16T09:52:05.121 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:04 smithi111 ceph-mon[109885]: pgmap v164: 65 pgs: 22 peering, 2 stale+active+clean, 41 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:05.122 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:04 smithi111 podman[128273]: 2024-09-16 09:52:04.800791753 +0000 UTC m=+0.679074666 container remove a0828e7c28c8d130d81af22fa6ee95a61a816005588d02aa84a9b7a75522ad49 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-16T09:52:05.122 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:05 smithi111 podman[128334]: 2024-09-16 09:52:05.001774822 +0000 UTC m=+0.105236056 container create 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-16T09:52:05.122 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:05 smithi111 podman[128334]: 2024-09-16 09:52:04.912617618 +0000 UTC m=+0.016078857 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:52:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:04 smithi114 ceph-mon[79732]: pgmap v164: 65 pgs: 22 peering, 2 stale+active+clean, 41 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:05.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:05 smithi111 podman[128334]: 2024-09-16 09:52:05.229312685 +0000 UTC m=+0.332773926 container init 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T09:52:05.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:05 smithi111 podman[128334]: 2024-09-16 09:52:05.232456877 +0000 UTC m=+0.335918111 container start 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0) 2024-09-16T09:52:05.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:05 smithi111 bash[128334]: 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 2024-09-16T09:52:05.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:05 smithi111 systemd[1]: Started Ceph osd.2 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:52:06.394 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:06.394 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:06.394 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:06.394 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:06 smithi111 ceph-mon[109885]: pgmap v165: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:06.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:06.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:06.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:06.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:06 smithi114 ceph-mon[79732]: pgmap v165: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:06.772 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:06 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[128349]: 2024-09-16T09:52:06.392+0000 7f20fb6e4640 -1 Falling back to public interface 2024-09-16T09:52:07.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:07 smithi111 ceph-mon[109885]: Health check failed: Degraded data redundancy: 37/234 objects degraded (15.812%), 13 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:07.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:07 smithi111 ceph-mon[109885]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-16T09:52:07.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:07 smithi114 ceph-mon[79732]: Health check failed: Degraded data redundancy: 37/234 objects degraded (15.812%), 13 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:07.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:07 smithi114 ceph-mon[79732]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 7 pgs peering) 2024-09-16T09:52:08.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:08 smithi114 ceph-mon[79732]: pgmap v166: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:08.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 -- 172.21.15.111:0/4127125870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8100800 msgr2=0x7f1be8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:08.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 --2- 172.21.15.111:0/4127125870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8100800 0x7f1be8100c60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0009880 tx=0x7f1bd002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:08.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 -- 172.21.15.111:0/4127125870 shutdown_connections 2024-09-16T09:52:08.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 --2- 172.21.15.111:0/4127125870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8100800 0x7f1be8100c60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:08.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 --2- 172.21.15.111:0/4127125870 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8106800 0x7f1be8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:08.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 -- 172.21.15.111:0/4127125870 >> 172.21.15.111:0/4127125870 conn(0x7f1be80fc4e0 msgr2=0x7f1be80fe900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:08.782 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:08 smithi111 ceph-mon[109885]: pgmap v166: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:08.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 -- 172.21.15.111:0/4127125870 shutdown_connections 2024-09-16T09:52:08.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.780+0000 7f1becc2b640 1 -- 172.21.15.111:0/4127125870 wait complete. 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1becc2b640 1 Processor -- start 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1becc2b640 1 -- start start 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1becc2b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8100800 0x7f1be819b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1becc2b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 0x7f1be819b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1becc2b640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1be810cbe0 con 0x7f1be8106800 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1becc2b640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1be810ca60 con 0x7f1be8100800 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 0x7f1be819b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1bdffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 0x7f1be819b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54680/0 (socket says 172.21.15.111:54680) 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.781+0000 7f1bdffff640 1 -- 172.21.15.111:0/3069072548 learned_addr learned my addr 172.21.15.111:0/3069072548 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1be659c640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8100800 0x7f1be819b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:08.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdffff640 1 -- 172.21.15.111:0/3069072548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8100800 msgr2=0x7f1be819b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdffff640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8100800 0x7f1be819b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdffff640 1 -- 172.21.15.111:0/3069072548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be81955b0 con 0x7f1be8106800 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1be659c640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8100800 0x7f1be819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdffff640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 0x7f1be819b930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0031460 tx=0x7f1bd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bd003f070 con 0x7f1be8106800 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1bd0004cf0 con 0x7f1be8106800 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be8195840 con 0x7f1be8106800 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1bd0035030 con 0x7f1be8106800 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.782+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be8195d70 con 0x7f1be8106800 2024-09-16T09:52:08.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.783+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be8101f40 con 0x7f1be8106800 2024-09-16T09:52:08.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.784+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1bd0042070 con 0x7f1be8106800 2024-09-16T09:52:08.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.784+0000 7f1bdf7fe640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1bd407ce60 0x7f1bd407f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:08.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.784+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7f1bd00be6f0 con 0x7f1be8106800 2024-09-16T09:52:08.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.784+0000 7f1be659c640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1bd407ce60 0x7f1bd407f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:08.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.785+0000 7f1be659c640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1bd407ce60 0x7f1bd407f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80058c0 tx=0x7f1bd8005d30 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:08.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:08.789+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1bd0089e40 con 0x7f1be8106800 2024-09-16T09:52:09.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.002+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1be8196020 con 0x7f1bd407ce60 2024-09-16T09:52:09.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.003+0000 7f1bdf7fe640 1 -- 172.21.15.111:0/3069072548 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f1be8196020 con 0x7f1bd407ce60 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1bd407ce60 msgr2=0x7f1bd407f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1bd407ce60 0x7f1bd407f320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80058c0 tx=0x7f1bd8005d30 comp rx=0 tx=0).stop 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 msgr2=0x7f1be819b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 0x7f1be819b930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0031460 tx=0x7f1bd00048f0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 shutdown_connections 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1bd407ce60 0x7f1bd407f320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1be8106800 0x7f1be819b930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 --2- 172.21.15.111:0/3069072548 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1be8100800 0x7f1be819b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 >> 172.21.15.111:0/3069072548 conn(0x7f1be80fc4e0 msgr2=0x7f1be80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 shutdown_connections 2024-09-16T09:52:09.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.005+0000 7f1becc2b640 1 -- 172.21.15.111:0/3069072548 wait complete. 2024-09-16T09:52:09.016 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:52:09.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.090+0000 7ff618d01640 1 -- 172.21.15.111:0/3936861382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6141033c0 msgr2=0x7ff61410b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.090+0000 7ff618d01640 1 --2- 172.21.15.111:0/3936861382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6141033c0 0x7ff61410b8b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009880 tx=0x7ff5fc02a530 comp rx=0 tx=0).stop 2024-09-16T09:52:09.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.090+0000 7ff618d01640 1 -- 172.21.15.111:0/3936861382 shutdown_connections 2024-09-16T09:52:09.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.090+0000 7ff618d01640 1 --2- 172.21.15.111:0/3936861382 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff6141033c0 0x7ff61410b8b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.090+0000 7ff618d01640 1 --2- 172.21.15.111:0/3936861382 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff614102aa0 0x7ff614102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.090+0000 7ff618d01640 1 -- 172.21.15.111:0/3936861382 >> 172.21.15.111:0/3936861382 conn(0x7ff6140fc4c0 msgr2=0x7ff6140fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.091+0000 7ff618d01640 1 -- 172.21.15.111:0/3936861382 shutdown_connections 2024-09-16T09:52:09.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.091+0000 7ff618d01640 1 -- 172.21.15.111:0/3936861382 wait complete. 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.091+0000 7ff618d01640 1 Processor -- start 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.091+0000 7ff618d01640 1 -- start start 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff618d01640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff614102aa0 0x7ff61419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff618d01640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 0x7ff61419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff618d01640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff61410edd0 con 0x7ff614102aa0 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff618d01640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff61410ec50 con 0x7ff6141033c0 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff611d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 0x7ff61419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff611d9b640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 0x7ff61419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:53980/0 (socket says 172.21.15.111:53980) 2024-09-16T09:52:09.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff61259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff614102aa0 0x7ff61419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff611d9b640 1 -- 172.21.15.111:0/4066493576 learned_addr learned my addr 172.21.15.111:0/4066493576 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:09.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff611d9b640 1 -- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff614102aa0 msgr2=0x7ff61419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff611d9b640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff614102aa0 0x7ff61419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.092+0000 7ff611d9b640 1 -- 172.21.15.111:0/4066493576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff614197860 con 0x7ff6141033c0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.093+0000 7ff611d9b640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 0x7ff61419dbe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc031460 tx=0x7ff5fc004530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.093+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5fc03f070 con 0x7ff6141033c0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.093+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5fc0035f0 con 0x7ff6141033c0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.093+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff614197af0 con 0x7ff6141033c0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.093+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5fc035030 con 0x7ff6141033c0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.093+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff614198020 con 0x7ff6141033c0 2024-09-16T09:52:09.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.094+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61406a410 con 0x7ff6141033c0 2024-09-16T09:52:09.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.096+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ff5fc042070 con 0x7ff6141033c0 2024-09-16T09:52:09.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.096+0000 7ff60b7fe640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff60007abf0 0x7ff60007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.096+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7ff5fc0be5d0 con 0x7ff6141033c0 2024-09-16T09:52:09.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.097+0000 7ff61259c640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff60007abf0 0x7ff60007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.097+0000 7ff61259c640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff60007abf0 0x7ff60007d0b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6141989a0 tx=0x7ff60400b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:09.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.101+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ff5fc089ca0 con 0x7ff6141033c0 2024-09-16T09:52:09.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.307+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff614198d90 con 0x7ff60007abf0 2024-09-16T09:52:09.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.308+0000 7ff60b7fe640 1 -- 172.21.15.111:0/4066493576 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff614198d90 con 0x7ff60007abf0 2024-09-16T09:52:09.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff60007abf0 msgr2=0x7ff60007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff60007abf0 0x7ff60007d0b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff6141989a0 tx=0x7ff60400b390 comp rx=0 tx=0).stop 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 msgr2=0x7ff61419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 0x7ff61419dbe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc031460 tx=0x7ff5fc004530 comp rx=0 tx=0).stop 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 shutdown_connections 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff60007abf0 0x7ff60007d0b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff6141033c0 0x7ff61419dbe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 --2- 172.21.15.111:0/4066493576 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff614102aa0 0x7ff61419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.310+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 >> 172.21.15.111:0/4066493576 conn(0x7ff6140fc4c0 msgr2=0x7ff614107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.311+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 shutdown_connections 2024-09-16T09:52:09.313 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.311+0000 7ff618d01640 1 -- 172.21.15.111:0/4066493576 wait complete. 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 -- 172.21.15.111:0/3367458300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1007e0 msgr2=0x7f77cc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 --2- 172.21.15.111:0/3367458300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1007e0 0x7f77cc100c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009880 tx=0x7f77c002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 -- 172.21.15.111:0/3367458300 shutdown_connections 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 --2- 172.21.15.111:0/3367458300 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1007e0 0x7f77cc100c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 --2- 172.21.15.111:0/3367458300 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77cc1067e0 0x7f77cc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 -- 172.21.15.111:0/3367458300 >> 172.21.15.111:0/3367458300 conn(0x7f77cc0fc4c0 msgr2=0x7f77cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 -- 172.21.15.111:0/3367458300 shutdown_connections 2024-09-16T09:52:09.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 -- 172.21.15.111:0/3367458300 wait complete. 2024-09-16T09:52:09.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 Processor -- start 2024-09-16T09:52:09.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.397+0000 7f77d2282640 1 -- start start 2024-09-16T09:52:09.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77d2282640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77cc1007e0 0x7f77cc19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77d2282640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 0x7f77cc19caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77d2282640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc10dc90 con 0x7f77cc1067e0 2024-09-16T09:52:09.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77d2282640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc10db10 con 0x7f77cc1007e0 2024-09-16T09:52:09.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 0x7f77cc19caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 0x7f77cc19caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54712/0 (socket says 172.21.15.111:54712) 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 -- 172.21.15.111:0/940985075 learned_addr learned my addr 172.21.15.111:0/940985075 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cbfff640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77cc1007e0 0x7f77cc19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 -- 172.21.15.111:0/940985075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77cc1007e0 msgr2=0x7f77cc19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77cc1007e0 0x7f77cc19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 -- 172.21.15.111:0/940985075 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc196680 con 0x7f77cc1067e0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.398+0000 7f77cb7fe640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 0x7f77cc19caf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77c0031460 tx=0x7f77c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.399+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77c003f070 con 0x7f77cc1067e0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.399+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f77c0004cf0 con 0x7f77cc1067e0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.399+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77cc196910 con 0x7f77cc1067e0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.399+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f77c0035030 con 0x7f77cc1067e0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.399+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77cc196d60 con 0x7f77cc1067e0 2024-09-16T09:52:09.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.400+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77cc101f20 con 0x7f77cc1067e0 2024-09-16T09:52:09.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.400+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f77c0042070 con 0x7f77cc1067e0 2024-09-16T09:52:09.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.401+0000 7f77c97fa640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f77b407abf0 0x7f77b407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.401+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7f77c00be720 con 0x7f77cc1067e0 2024-09-16T09:52:09.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.401+0000 7f77cbfff640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f77b407abf0 0x7f77b407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.401+0000 7f77cbfff640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f77b407abf0 0x7f77b407d0b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0058c0 tx=0x7f77bc00a4c0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:09.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.409+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f77c0089df0 con 0x7f77cc1067e0 2024-09-16T09:52:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.603+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f77cc1970d0 con 0x7f77b407abf0 2024-09-16T09:52:09.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.619+0000 7f77c97fa640 1 -- 172.21.15.111:0/940985075 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f77cc1970d0 con 0x7f77b407abf0 2024-09-16T09:52:09.621 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:52:09.621 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (3m) 33s ago 14m 21.2M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:52:09.621 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (5m) 33s ago 14m 8883k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:52:09.621 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (5m) 88s ago 13m 8326k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:52:09.621 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (96s) 33s ago 14m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (91s) 88s ago 13m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (2m) 33s ago 13m 76.2M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (8m) 33s ago 8m 148M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (8m) 33s ago 8m 18.7M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (8m) 88s ago 8m 19.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (8m) 88s ago 8m 19.4M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:52:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (4m) 33s ago 15m 522M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (4m) 88s ago 13m 455M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (2m) 33s ago 15m 43.4M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (109s) 88s ago 13m 25.7M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 33s ago 14m 11.4M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (4m) 88s ago 13m 10.6M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (72s) 33s ago 12m 91.2M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (38s) 33s ago 11m 11.2M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 starting - - - 1216M 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (10m) 88s ago 10m 305M 2240M 19.1.1-328-gad35db06 b5388489f99e 1016329a896e 2024-09-16T09:52:09.623 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (10m) 88s ago 10m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:52:09.624 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (9m) 88s ago 9m 236M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:52:09.624 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (3m) 33s ago 13m 52.5M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:52:09.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.621+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f77b407abf0 msgr2=0x7f77b407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.621+0000 7f77d2282640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f77b407abf0 0x7f77b407d0b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0058c0 tx=0x7f77bc00a4c0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.621+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 msgr2=0x7f77cc19caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.621+0000 7f77d2282640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 0x7f77cc19caf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f77c0031460 tx=0x7f77c00048f0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 shutdown_connections 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f77b407abf0 0x7f77b407d0b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f77cc1067e0 0x7f77cc19caf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 --2- 172.21.15.111:0/940985075 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f77cc1007e0 0x7f77cc19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 >> 172.21.15.111:0/940985075 conn(0x7f77cc0fc4c0 msgr2=0x7f77cc0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 shutdown_connections 2024-09-16T09:52:09.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.622+0000 7f77d2282640 1 -- 172.21.15.111:0/940985075 wait complete. 2024-09-16T09:52:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.709+0000 7fb7a04c2640 1 -- 172.21.15.111:0/1868473338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 msgr2=0x7fb79810b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.709+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/1868473338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79810b8b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb788009880 tx=0x7fb78802a530 comp rx=0 tx=0).stop 2024-09-16T09:52:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- 172.21.15.111:0/1868473338 shutdown_connections 2024-09-16T09:52:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/1868473338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79810b8b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/1868473338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb798102aa0 0x7fb798102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- 172.21.15.111:0/1868473338 >> 172.21.15.111:0/1868473338 conn(0x7fb7980fc4c0 msgr2=0x7fb7980fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- 172.21.15.111:0/1868473338 shutdown_connections 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- 172.21.15.111:0/1868473338 wait complete. 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 Processor -- start 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- start start 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb798102aa0 0x7fb79819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810ee30 con 0x7fb7981033c0 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.710+0000 7fb7a04c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810ecb0 con 0x7fb798102aa0 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79819dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54724/0 (socket says 172.21.15.111:54724) 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 -- 172.21.15.111:0/2803546904 learned_addr learned my addr 172.21.15.111:0/2803546904 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:09.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 -- 172.21.15.111:0/2803546904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb798102aa0 msgr2=0x7fb79819d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb798102aa0 0x7fb79819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 -- 172.21.15.111:0/2803546904 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7981978e0 con 0x7fb7981033c0 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb79da5d640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79819dc60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb788031460 tx=0x7fb7880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb78803f070 con 0x7fb7981033c0 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb788004ac0 con 0x7fb7981033c0 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb798197b70 con 0x7fb7981033c0 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb788035030 con 0x7fb7981033c0 2024-09-16T09:52:09.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.711+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7981980a0 con 0x7fb7981033c0 2024-09-16T09:52:09.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.712+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79806a410 con 0x7fb7981033c0 2024-09-16T09:52:09.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.713+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fb788042070 con 0x7fb7981033c0 2024-09-16T09:52:09.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.713+0000 7fb78f7fe640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb78407ac00 0x7fb78407d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:09.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.713+0000 7fb79e25e640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb78407ac00 0x7fb78407d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:09.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.713+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7fb7880be810 con 0x7fb7981033c0 2024-09-16T09:52:09.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.714+0000 7fb79e25e640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb78407ac00 0x7fb78407d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb798198a20 tx=0x7fb794006c90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:09.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.718+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fb788089ee0 con 0x7fb7981033c0 2024-09-16T09:52:09.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.983+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb798104f10 con 0x7fb7981033c0 2024-09-16T09:52:09.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.983+0000 7fb78f7fe640 1 -- 172.21.15.111:0/2803546904 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fb78808ed90 con 0x7fb7981033c0 2024-09-16T09:52:09.985 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:52:09.985 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:52:09.985 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 3, 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 7, 2024-09-16T09:52:09.986 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 6 2024-09-16T09:52:09.987 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:52:09.987 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb78407ac00 msgr2=0x7fb78407d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb78407ac00 0x7fb78407d0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb798198a20 tx=0x7fb794006c90 comp rx=0 tx=0).stop 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 msgr2=0x7fb79819dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79819dc60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb788031460 tx=0x7fb7880046c0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 shutdown_connections 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb78407ac00 0x7fb78407d0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7981033c0 0x7fb79819dc60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 --2- 172.21.15.111:0/2803546904 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb798102aa0 0x7fb79819d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 >> 172.21.15.111:0/2803546904 conn(0x7fb7980fc4c0 msgr2=0x7fb798107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:09.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 shutdown_connections 2024-09-16T09:52:09.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:09.987+0000 7fb7a04c2640 1 -- 172.21.15.111:0/2803546904 wait complete. 2024-09-16T09:52:10.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 -- 172.21.15.111:0/4254247125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300107910 msgr2=0x7f4300107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 --2- 172.21.15.111:0/4254247125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300107910 0x7f4300107cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009880 tx=0x7f42f002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 -- 172.21.15.111:0/4254247125 shutdown_connections 2024-09-16T09:52:10.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 --2- 172.21.15.111:0/4254247125 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300101910 0x7f4300101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 --2- 172.21.15.111:0/4254247125 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300107910 0x7f4300107cf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 -- 172.21.15.111:0/4254247125 >> 172.21.15.111:0/4254247125 conn(0x7f43000fd5f0 msgr2=0x7f43000ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:10.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 -- 172.21.15.111:0/4254247125 shutdown_connections 2024-09-16T09:52:10.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.075+0000 7f43048b7640 1 -- 172.21.15.111:0/4254247125 wait complete. 2024-09-16T09:52:10.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.076+0000 7f43048b7640 1 Processor -- start 2024-09-16T09:52:10.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.076+0000 7f43048b7640 1 -- start start 2024-09-16T09:52:10.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.076+0000 7f43048b7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 0x7f43000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.076+0000 7f43048b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300107910 0x7f4300074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.076+0000 7f43048b7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f430010ee40 con 0x7f4300101910 2024-09-16T09:52:10.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.076+0000 7f43048b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f430010ecc0 con 0x7f4300107910 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 0x7f43000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 0x7f43000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54740/0 (socket says 172.21.15.111:54740) 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 -- 172.21.15.111:0/630676312 learned_addr learned my addr 172.21.15.111:0/630676312 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42f5d9b640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300107910 0x7f4300074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 -- 172.21.15.111:0/630676312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300107910 msgr2=0x7f4300074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300107910 0x7f4300074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 -- 172.21.15.111:0/630676312 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4300074f70 con 0x7f4300101910 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42f5d9b640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300107910 0x7f4300074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42fe59c640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 0x7f43000744f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42f0031460 tx=0x7f42f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42f003f070 con 0x7f4300101910 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4300075200 con 0x7f4300101910 2024-09-16T09:52:10.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42f00044d0 con 0x7f4300101910 2024-09-16T09:52:10.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.077+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42f0035030 con 0x7f4300101910 2024-09-16T09:52:10.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.078+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43001a3df0 con 0x7f4300101910 2024-09-16T09:52:10.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.079+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4300103050 con 0x7f4300101910 2024-09-16T09:52:10.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.080+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f42f0042070 con 0x7f4300101910 2024-09-16T09:52:10.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.080+0000 7f42f7fff640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f42ec07ac50 0x7f42ec07d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.080+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7f42f00be7a0 con 0x7f4300101910 2024-09-16T09:52:10.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.080+0000 7f42f5d9b640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f42ec07ac50 0x7f42ec07d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.082 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.081+0000 7f42f5d9b640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f42ec07ac50 0x7f42ec07d110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:10.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.085+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f42f0004cf0 con 0x7f4300101910 2024-09-16T09:52:10.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.311+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4300109e80 con 0x7f4300101910 2024-09-16T09:52:10.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.312+0000 7f42f7fff640 1 -- 172.21.15.111:0/630676312 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7f42f0089ef0 con 0x7f4300101910 2024-09-16T09:52:10.315 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:52:10.315 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:52:10.315 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:52:10.316 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:52:10.317 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:10.318 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:10.319 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:52:10.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f42ec07ac50 msgr2=0x7f42ec07d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f42ec07ac50 0x7f42ec07d110 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e8006fd0 tx=0x7f42e8008040 comp rx=0 tx=0).stop 2024-09-16T09:52:10.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 msgr2=0x7f43000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 0x7f43000744f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42f0031460 tx=0x7f42f00048f0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 shutdown_connections 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f42ec07ac50 0x7f42ec07d110 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4300107910 0x7f4300074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 --2- 172.21.15.111:0/630676312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4300101910 0x7f43000744f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 >> 172.21.15.111:0/630676312 conn(0x7f43000fd5f0 msgr2=0x7f43000fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 shutdown_connections 2024-09-16T09:52:10.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.314+0000 7f43048b7640 1 -- 172.21.15.111:0/630676312 wait complete. 2024-09-16T09:52:10.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 -- 172.21.15.111:0/4147222069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 msgr2=0x7f666c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 --2- 172.21.15.111:0/4147222069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c102ec0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f665c0098b0 tx=0x7f665c02a560 comp rx=0 tx=0).stop 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 -- 172.21.15.111:0/4147222069 shutdown_connections 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 --2- 172.21.15.111:0/4147222069 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f666c103400 0x7f666c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 --2- 172.21.15.111:0/4147222069 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c102ec0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 -- 172.21.15.111:0/4147222069 >> 172.21.15.111:0/4147222069 conn(0x7f666c0fc4c0 msgr2=0x7f666c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 -- 172.21.15.111:0/4147222069 shutdown_connections 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.402+0000 7f6673890640 1 -- 172.21.15.111:0/4147222069 wait complete. 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6673890640 1 Processor -- start 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6673890640 1 -- start start 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6673890640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6673890640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6673890640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10edd0 con 0x7f666c102ae0 2024-09-16T09:52:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6673890640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f666c10ec50 con 0x7f666c103400 2024-09-16T09:52:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f667162c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f667162c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54750/0 (socket says 172.21.15.111:54750) 2024-09-16T09:52:10.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f667162c640 1 -- 172.21.15.111:0/702264713 learned_addr learned my addr 172.21.15.111:0/702264713 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f6670e2b640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f667162c640 1 -- 172.21.15.111:0/702264713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f666c103400 msgr2=0x7f666c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f667162c640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.403+0000 7f667162c640 1 -- 172.21.15.111:0/702264713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666c1011c0 con 0x7f666c102ae0 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.404+0000 7f667162c640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c100740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f665c031460 tx=0x7f665c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.404+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f665c03f070 con 0x7f666c102ae0 2024-09-16T09:52:10.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.404+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f665c0035f0 con 0x7f666c102ae0 2024-09-16T09:52:10.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.404+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f665c035030 con 0x7f666c102ae0 2024-09-16T09:52:10.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.404+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666c101450 con 0x7f666c102ae0 2024-09-16T09:52:10.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.404+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666c1a3dc0 con 0x7f666c102ae0 2024-09-16T09:52:10.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.405+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f666c06a3d0 con 0x7f666c102ae0 2024-09-16T09:52:10.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.406+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f665c042070 con 0x7f666c102ae0 2024-09-16T09:52:10.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.406+0000 7f66627fc640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f665807ac40 0x7f665807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.407+0000 7f6670e2b640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f665807ac40 0x7f665807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.407+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7f665c0be620 con 0x7f666c102ae0 2024-09-16T09:52:10.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.407+0000 7f6670e2b640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f665807ac40 0x7f665807d100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f666c1021d0 tx=0x7f6668005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:10.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.411+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f665c089cd0 con 0x7f666c102ae0 2024-09-16T09:52:10.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.630+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f666c062630 con 0x7f665807ac40 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.631+0000 7f66627fc640 1 -- 172.21.15.111:0/702264713 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f666c062630 con 0x7f665807ac40 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:52:10.633 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "9/23 daemons upgraded", 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:52:10.634 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.633+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f665807ac40 msgr2=0x7f665807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.633+0000 7f6673890640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f665807ac40 0x7f665807d100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f666c1021d0 tx=0x7f6668005f90 comp rx=0 tx=0).stop 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.633+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 msgr2=0x7f666c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.633+0000 7f6673890640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c100740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f665c031460 tx=0x7f665c0045e0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 shutdown_connections 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f665807ac40 0x7f665807d100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f666c103400 0x7f666c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 --2- 172.21.15.111:0/702264713 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f666c102ae0 0x7f666c100740 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 >> 172.21.15.111:0/702264713 conn(0x7f666c0fc4c0 msgr2=0x7f666c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:10.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 shutdown_connections 2024-09-16T09:52:10.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.634+0000 7f6673890640 1 -- 172.21.15.111:0/702264713 wait complete. 2024-09-16T09:52:10.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 -- 172.21.15.111:0/2481588060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 msgr2=0x7f66c4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/2481588060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4106bc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009880 tx=0x7f66b402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 -- 172.21.15.111:0/2481588060 shutdown_connections 2024-09-16T09:52:10.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/2481588060 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 0x7f66c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/2481588060 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4106bc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 -- 172.21.15.111:0/2481588060 >> 172.21.15.111:0/2481588060 conn(0x7f66c40fc4c0 msgr2=0x7f66c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:10.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 -- 172.21.15.111:0/2481588060 shutdown_connections 2024-09-16T09:52:10.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.718+0000 7f66cc1bb640 1 -- 172.21.15.111:0/2481588060 wait complete. 2024-09-16T09:52:10.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66cc1bb640 1 Processor -- start 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66cc1bb640 1 -- start start 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66cc1bb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 0x7f66c4198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66cc1bb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66cc1bb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410dd10 con 0x7f66c41067e0 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66cc1bb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f66c410db90 con 0x7f66c41007e0 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54774/0 (socket says 172.21.15.111:54774) 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 -- 172.21.15.111:0/1985608518 learned_addr learned my addr 172.21.15.111:0/1985608518 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9f57640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 0x7f66c4198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 -- 172.21.15.111:0/1985608518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 msgr2=0x7f66c4198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 0x7f66c4198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 -- 172.21.15.111:0/1985608518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c41993d0 con 0x7f66c41067e0 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9f57640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 0x7f66c4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.719+0000 7f66c9756640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4198d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b420 tx=0x7f66c000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.720+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66c0011630 con 0x7f66c41067e0 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.720+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66c0016070 con 0x7f66c41067e0 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.720+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c41a18b0 con 0x7f66c41067e0 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.720+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66c0010d40 con 0x7f66c41067e0 2024-09-16T09:52:10.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.720+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c4196630 con 0x7f66c41067e0 2024-09-16T09:52:10.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.721+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c4101f20 con 0x7f66c41067e0 2024-09-16T09:52:10.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.721+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f66c001b460 con 0x7f66c41067e0 2024-09-16T09:52:10.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.722+0000 7f66baffd640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f66b007f050 0x7f66b0081510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:10.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.722+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6360+0+0 (secure 0 0 0) 0x7f66c009d370 con 0x7f66c41067e0 2024-09-16T09:52:10.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.722+0000 7f66c9f57640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f66b007f050 0x7f66b0081510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:10.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.722+0000 7f66c9f57640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f66b007f050 0x7f66b0081510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66b4006010 tx=0x7f66b40095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:10.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:10.726+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f66c0021250 con 0x7f66c41067e0 2024-09-16T09:52:11.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.043+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f66c4108d50 con 0x7f66c41067e0 2024-09-16T09:52:11.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: pgmap v167: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:11.045 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2803546904' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:11.046 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/630676312' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:52:11.046 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:11.046 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:10 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:11.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.043+0000 7f66baffd640 1 -- 172.21.15.111:0/1985608518 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1186 (secure 0 0 0) 0x7f66c0068ac0 con 0x7f66c41067e0 2024-09-16T09:52:11.046 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 37/234 objects degraded (15.812%), 13 pgs degraded 2024-09-16T09:52:11.046 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:52:11.046 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: osd.2 (root=default,host=smithi111) is down 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/234 objects degraded (15.812%), 13 pgs degraded 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.e is active+undersized+degraded, acting [1,3] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-16T09:52:11.047 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-16T09:52:11.048 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-16T09:52:11.048 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-16T09:52:11.048 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-16T09:52:11.048 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-16T09:52:11.048 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f66b007f050 msgr2=0x7f66b0081510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f66b007f050 0x7f66b0081510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66b4006010 tx=0x7f66b40095f0 comp rx=0 tx=0).stop 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 msgr2=0x7f66c4198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4198d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f66c000b420 tx=0x7f66c000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 shutdown_connections 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f66b007f050 0x7f66b0081510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66c41067e0 0x7f66c4198d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 --2- 172.21.15.111:0/1985608518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f66c41007e0 0x7f66c4198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 >> 172.21.15.111:0/1985608518 conn(0x7f66c40fc4c0 msgr2=0x7f66c40fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 shutdown_connections 2024-09-16T09:52:11.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:11.046+0000 7f66cc1bb640 1 -- 172.21.15.111:0/1985608518 wait complete. 2024-09-16T09:52:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='client.44181 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: pgmap v167: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:11.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2803546904' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:11.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/630676312' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:52:11.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:11.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:10 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:11.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:11 smithi111 ceph-mon[109885]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:11.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:11 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1985608518' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:52:11.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:11 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:11.926 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:11 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:11 smithi114 ceph-mon[79732]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:11 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1985608518' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:52:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:11 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:11 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:12.382 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:12 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[128349]: 2024-09-16T09:52:12.139+0000 7f20fb6e4640 -1 osd.2 67 log_to_monitors true 2024-09-16T09:52:12.907 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:52:12 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[128349]: 2024-09-16T09:52:12.798+0000 7f20f348e640 -1 osd.2 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:52:12.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:12 smithi111 ceph-mon[109885]: pgmap v168: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:12.908 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:12 smithi111 ceph-mon[109885]: from='osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-16T09:52:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:12 smithi114 ceph-mon[79732]: pgmap v168: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:12 smithi114 ceph-mon[79732]: from='osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-16T09:52:13.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:13 smithi111 ceph-mon[109885]: from='osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T09:52:13.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:13 smithi111 ceph-mon[109885]: osdmap e70: 6 total, 5 up, 6 in 2024-09-16T09:52:13.972 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:13 smithi111 ceph-mon[109885]: from='osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-16T09:52:14.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:13 smithi114 ceph-mon[79732]: from='osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-16T09:52:14.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:13 smithi114 ceph-mon[79732]: osdmap e70: 6 total, 5 up, 6 in 2024-09-16T09:52:14.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:13 smithi114 ceph-mon[79732]: from='osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi111", "root=default"]} : dispatch 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: pgmap v170: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781] boot 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: osdmap e71: 6 total, 6 up, 6 in 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:15.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-16T09:52:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: pgmap v170: 65 pgs: 16 active+undersized, 13 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/234 objects degraded (15.812%) 2024-09-16T09:52:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:52:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: osd.2 [v2:172.21.15.111:6818/720117781,v1:172.21.15.111:6819/720117781] boot 2024-09-16T09:52:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: osdmap e71: 6 total, 6 up, 6 in 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:15.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:15.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:15.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-16T09:52:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:15 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T09:52:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:15 smithi111 ceph-mon[109885]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-16T09:52:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:15 smithi111 ceph-mon[109885]: osdmap e72: 6 total, 6 up, 6 in 2024-09-16T09:52:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:16.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:15 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T09:52:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:15 smithi114 ceph-mon[79732]: Upgrade: unsafe to stop osd(s) at this time (9 PGs are or would become offline) 2024-09-16T09:52:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:15 smithi114 ceph-mon[79732]: osdmap e72: 6 total, 6 up, 6 in 2024-09-16T09:52:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:15 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:15 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:17.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:16 smithi111 ceph-mon[109885]: pgmap v173: 65 pgs: 5 peering, 5 active+undersized, 5 active+undersized+degraded, 50 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/234 objects degraded (6.838%) 2024-09-16T09:52:17.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:16 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 16/234 objects degraded (6.838%), 5 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:17.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:16 smithi114 ceph-mon[79732]: pgmap v173: 65 pgs: 5 peering, 5 active+undersized, 5 active+undersized+degraded, 50 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/234 objects degraded (6.838%) 2024-09-16T09:52:17.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:16 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 16/234 objects degraded (6.838%), 5 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:19.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:18 smithi111 ceph-mon[109885]: pgmap v174: 65 pgs: 5 peering, 5 active+undersized, 5 active+undersized+degraded, 50 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/234 objects degraded (6.838%) 2024-09-16T09:52:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:18 smithi114 ceph-mon[79732]: pgmap v174: 65 pgs: 5 peering, 5 active+undersized, 5 active+undersized+degraded, 50 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16/234 objects degraded (6.838%) 2024-09-16T09:52:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:19 smithi111 ceph-mon[109885]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/234 objects degraded (6.838%), 5 pgs degraded) 2024-09-16T09:52:20.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:19 smithi114 ceph-mon[79732]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 16/234 objects degraded (6.838%), 5 pgs degraded) 2024-09-16T09:52:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:20 smithi111 ceph-mon[109885]: pgmap v175: 65 pgs: 5 peering, 60 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 2 objects/s recovering 2024-09-16T09:52:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:20 smithi114 ceph-mon[79732]: pgmap v175: 65 pgs: 5 peering, 60 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 2 objects/s recovering 2024-09-16T09:52:23.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:22 smithi111 ceph-mon[109885]: pgmap v176: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 2 objects/s recovering 2024-09-16T09:52:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:22 smithi114 ceph-mon[79732]: pgmap v176: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 2 objects/s recovering 2024-09-16T09:52:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:23 smithi114 ceph-mon[79732]: pgmap v177: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:24.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:23 smithi111 ceph-mon[109885]: pgmap v177: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:27.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:26 smithi111 ceph-mon[109885]: pgmap v178: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:26 smithi114 ceph-mon[79732]: pgmap v178: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:29.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:28 smithi111 ceph-mon[109885]: pgmap v179: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:28 smithi114 ceph-mon[79732]: pgmap v179: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:30.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:29 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-16T09:52:30.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:29 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-16T09:52:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:30 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T09:52:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:30 smithi111 ceph-mon[109885]: Upgrade: osd.3 is safe to restart 2024-09-16T09:52:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:30 smithi111 ceph-mon[109885]: pgmap v180: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:31.164 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:30 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-16T09:52:31.164 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:30 smithi114 ceph-mon[79732]: Upgrade: osd.3 is safe to restart 2024-09-16T09:52:31.164 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:30 smithi114 ceph-mon[79732]: pgmap v180: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s, 1 objects/s recovering 2024-09-16T09:52:31.164 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:31.164 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:31.164 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:31 smithi111 ceph-mon[109885]: Upgrade: Updating osd.3 2024-09-16T09:52:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-16T09:52:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:31 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:52:32.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:31 smithi111 ceph-mon[109885]: Deploying daemon osd.3 on smithi114 2024-09-16T09:52:32.139 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:31 smithi114 ceph-mon[79732]: Upgrade: Updating osd.3 2024-09-16T09:52:32.139 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:32.139 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-16T09:52:32.139 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:31 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:52:32.139 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:31 smithi114 ceph-mon[79732]: Deploying daemon osd.3 on smithi114 2024-09-16T09:52:33.049 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:32 smithi114 ceph-mon[79732]: pgmap v181: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:33.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:32 smithi111 ceph-mon[109885]: pgmap v181: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:33.973 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:33 smithi114 systemd[1]: Stopping Ceph osd.3 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:52:34.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[41573]: 2024-09-16T09:52:33.994+0000 7f9e95873640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:52:34.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[41573]: 2024-09-16T09:52:33.994+0000 7f9e95873640 -1 osd.3 72 *** Got signal Terminated *** 2024-09-16T09:52:34.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[41573]: 2024-09-16T09:52:33.994+0000 7f9e95873640 -1 osd.3 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:52:35.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:34 smithi111 ceph-mon[109885]: pgmap v182: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:34 smithi111 ceph-mon[109885]: osd.3 marked itself down and dead 2024-09-16T09:52:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:34 smithi114 ceph-mon[79732]: pgmap v182: 65 pgs: 65 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:34 smithi114 ceph-mon[79732]: osd.3 marked itself down and dead 2024-09-16T09:52:35.647 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:35 smithi114 podman[87229]: 2024-09-16 09:52:35.348165254 +0000 UTC m=+1.467130874 container died 1016329a896eb5f67544ef65802679774fd3a1895fa66c0c4d0ec7d8eb55bf22 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-ad35db0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-16T09:52:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:35 smithi114 ceph-mon[79732]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:52:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:35 smithi114 ceph-mon[79732]: osdmap e73: 6 total, 5 up, 6 in 2024-09-16T09:52:35.937 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:35 smithi114 podman[87229]: 2024-09-16 09:52:35.744163696 +0000 UTC m=+1.863129317 container cleanup 1016329a896eb5f67544ef65802679774fd3a1895fa66c0c4d0ec7d8eb55bf22 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-ad35db0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-16T09:52:35.938 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:35 smithi114 bash[87229]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3 2024-09-16T09:52:36.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:35 smithi111 ceph-mon[109885]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:52:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:35 smithi111 ceph-mon[109885]: osdmap e73: 6 total, 5 up, 6 in 2024-09-16T09:52:36.352 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:35 smithi114 podman[87255]: 2024-09-16 09:52:35.953876972 +0000 UTC m=+0.600833165 container remove 1016329a896eb5f67544ef65802679774fd3a1895fa66c0c4d0ec7d8eb55bf22 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, RELEASE=squid-ad35db0, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-16T09:52:36.666 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:36 smithi114 podman[87343]: 2024-09-16 09:52:36.253995764 +0000 UTC m=+0.015808814 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:52:36.666 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:36 smithi114 podman[87343]: 2024-09-16 09:52:36.363101195 +0000 UTC m=+0.124914273 container create 6d9ad59a6a98024de94505a11c191b2941b970cf68edf39617be489a7212022d (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-16T09:52:36.666 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:36 smithi114 podman[87343]: 2024-09-16 09:52:36.590510314 +0000 UTC m=+0.352323356 container init 6d9ad59a6a98024de94505a11c191b2941b970cf68edf39617be489a7212022d (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-16T09:52:36.666 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:36 smithi114 podman[87343]: 2024-09-16 09:52:36.594428152 +0000 UTC m=+0.356241188 container start 6d9ad59a6a98024de94505a11c191b2941b970cf68edf39617be489a7212022d (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T09:52:36.667 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:36 smithi114 podman[87343]: 2024-09-16 09:52:36.665409269 +0000 UTC m=+0.427222322 container attach 6d9ad59a6a98024de94505a11c191b2941b970cf68edf39617be489a7212022d (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:52:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:36 smithi114 ceph-mon[79732]: pgmap v184: 65 pgs: 22 peering, 4 stale+active+clean, 39 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:36 smithi114 ceph-mon[79732]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-16T09:52:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:36 smithi114 ceph-mon[79732]: osdmap e74: 6 total, 5 up, 6 in 2024-09-16T09:52:36.937 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:36 smithi114 podman[87343]: 2024-09-16 09:52:36.77533531 +0000 UTC m=+0.537148358 container died 6d9ad59a6a98024de94505a11c191b2941b970cf68edf39617be489a7212022d (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-16T09:52:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:36 smithi111 ceph-mon[109885]: pgmap v184: 65 pgs: 22 peering, 4 stale+active+clean, 39 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:36 smithi111 ceph-mon[109885]: Health check failed: Reduced data availability: 10 pgs peering (PG_AVAILABILITY) 2024-09-16T09:52:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:36 smithi111 ceph-mon[109885]: osdmap e74: 6 total, 5 up, 6 in 2024-09-16T09:52:37.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 podman[87366]: 2024-09-16 09:52:37.377761058 +0000 UTC m=+0.596454952 container remove 6d9ad59a6a98024de94505a11c191b2941b970cf68edf39617be489a7212022d (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T09:52:37.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-16T09:52:37.688 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 systemd[1]: Stopped Ceph osd.3 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:52:37.688 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 15.241s CPU time. 2024-09-16T09:52:37.688 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 systemd[1]: Starting Ceph osd.3 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:52:38.124 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 podman[87465]: 2024-09-16 09:52:37.722369677 +0000 UTC m=+0.016147334 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:52:38.124 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:37 smithi114 podman[87465]: 2024-09-16 09:52:37.820619032 +0000 UTC m=+0.114396688 container create c370c32aecde5661b33be2aac38334177011a98d75bb0eecba90422148f72d55 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:52:38.124 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 podman[87465]: 2024-09-16 09:52:38.040033583 +0000 UTC m=+0.333811236 container init c370c32aecde5661b33be2aac38334177011a98d75bb0eecba90422148f72d55 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:52:38.124 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 podman[87465]: 2024-09-16 09:52:38.043340729 +0000 UTC m=+0.337118375 container start c370c32aecde5661b33be2aac38334177011a98d75bb0eecba90422148f72d55 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:52:38.124 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 podman[87465]: 2024-09-16 09:52:38.123116155 +0000 UTC m=+0.416893819 container attach c370c32aecde5661b33be2aac38334177011a98d75bb0eecba90422148f72d55 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:52:38.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:38.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 bash[87465]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:38.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:38.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 bash[87465]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:52:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:38 smithi111 ceph-mon[109885]: pgmap v186: 65 pgs: 22 peering, 4 stale+active+clean, 39 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:38 smithi114 ceph-mon[79732]: pgmap v186: 65 pgs: 22 peering, 4 stale+active+clean, 39 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:39.187 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T09:52:39.187 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 bash[87465]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T09:52:39.188 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T09:52:39.188 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:38 smithi114 bash[87465]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-16T09:52:39.536 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T09:52:39.536 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 bash[87465]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-16T09:52:39.536 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 bash[87465]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 bash[87465]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 bash[87465]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate[87480]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 bash[87465]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-16T09:52:39.537 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 podman[87465]: 2024-09-16 09:52:39.240474813 +0000 UTC m=+1.534252466 container died c370c32aecde5661b33be2aac38334177011a98d75bb0eecba90422148f72d55 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-16T09:52:40.104 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-mon[79732]: pgmap v187: 65 pgs: 2 active+undersized, 22 peering, 3 stale+active+clean, 2 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4/234 objects degraded (1.709%) 2024-09-16T09:52:40.104 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:39 smithi114 ceph-mon[79732]: Health check failed: Degraded data redundancy: 4/234 objects degraded (1.709%), 2 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:40.104 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:39 smithi114 podman[87611]: 2024-09-16 09:52:39.82689078 +0000 UTC m=+0.580279939 container remove c370c32aecde5661b33be2aac38334177011a98d75bb0eecba90422148f72d55 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T09:52:40.105 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 podman[87670]: 2024-09-16 09:52:39.934324828 +0000 UTC m=+0.015687958 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:52:40.105 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 podman[87670]: 2024-09-16 09:52:40.102926865 +0000 UTC m=+0.184289995 container create e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:52:40.336 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:39 smithi111 ceph-mon[109885]: pgmap v187: 65 pgs: 2 active+undersized, 22 peering, 3 stale+active+clean, 2 active+undersized+degraded, 36 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4/234 objects degraded (1.709%) 2024-09-16T09:52:40.337 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:39 smithi111 ceph-mon[109885]: Health check failed: Degraded data redundancy: 4/234 objects degraded (1.709%), 2 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:40.423 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 podman[87670]: 2024-09-16 09:52:40.313795095 +0000 UTC m=+0.395158229 container init e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, org.label-schema.license=GPLv2) 2024-09-16T09:52:40.423 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 podman[87670]: 2024-09-16 09:52:40.317161061 +0000 UTC m=+0.398524194 container start e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-16T09:52:40.423 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 ceph-osd[87689]: -- 172.21.15.114:0/3546110980 <== mon.1 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5556b3c781e0 con 0x5556b2e17c00 2024-09-16T09:52:40.423 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 bash[87670]: e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 2024-09-16T09:52:40.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:40 smithi114 systemd[1]: Started Ceph osd.3 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:52:41.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 -- 172.21.15.111:0/2734459422 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 msgr2=0x7fc434107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 --2- 172.21.15.111:0/2734459422 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc434107d10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc424009880 tx=0x7fc42402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 -- 172.21.15.111:0/2734459422 shutdown_connections 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 --2- 172.21.15.111:0/2734459422 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434101930 0x7fc434101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 --2- 172.21.15.111:0/2734459422 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc434107d10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 -- 172.21.15.111:0/2734459422 >> 172.21.15.111:0/2734459422 conn(0x7fc4340fd630 msgr2=0x7fc4340ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 -- 172.21.15.111:0/2734459422 shutdown_connections 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 -- 172.21.15.111:0/2734459422 wait complete. 2024-09-16T09:52:41.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 Processor -- start 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.142+0000 7fc43a989640 1 -- start start 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc43a989640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434101930 0x7fc43419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc43a989640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc43419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc43a989640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc43410ee00 con 0x7fc434107930 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc43a989640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc43410ec80 con 0x7fc434101930 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc43419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc43419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45412/0 (socket says 172.21.15.111:45412) 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 -- 172.21.15.111:0/1073460884 learned_addr learned my addr 172.21.15.111:0/1073460884 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc433fff640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434101930 0x7fc43419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 -- 172.21.15.111:0/1073460884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434101930 msgr2=0x7fc43419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434101930 0x7fc43419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 -- 172.21.15.111:0/1073460884 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4341977f0 con 0x7fc434107930 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.143+0000 7fc4337fe640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc43419dbb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc42800e970 tx=0x7fc42800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.144+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc42800cac0 con 0x7fc434107930 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.144+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc4280054e0 con 0x7fc434107930 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.144+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc434197ae0 con 0x7fc434107930 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.144+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc428010430 con 0x7fc434107930 2024-09-16T09:52:41.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.144+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc434198070 con 0x7fc434107930 2024-09-16T09:52:41.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.145+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc434103070 con 0x7fc434107930 2024-09-16T09:52:41.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.146+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fc428004f00 con 0x7fc434107930 2024-09-16T09:52:41.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.146+0000 7fc4317fa640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc41c07ac40 0x7fc41c07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.146+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7fc42809e240 con 0x7fc434107930 2024-09-16T09:52:41.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.146+0000 7fc433fff640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc41c07ac40 0x7fc41c07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.147+0000 7fc433fff640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc41c07ac40 0x7fc41c07d100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4240096c0 tx=0x7fc424031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:41.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.151+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fc428069990 con 0x7fc434107930 2024-09-16T09:52:41.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.343+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc434198380 con 0x7fc41c07ac40 2024-09-16T09:52:41.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.344+0000 7fc4317fa640 1 -- 172.21.15.111:0/1073460884 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc434198380 con 0x7fc41c07ac40 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.346+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc41c07ac40 msgr2=0x7fc41c07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.346+0000 7fc43a989640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc41c07ac40 0x7fc41c07d100 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc4240096c0 tx=0x7fc424031400 comp rx=0 tx=0).stop 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.346+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 msgr2=0x7fc43419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.346+0000 7fc43a989640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc43419dbb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc42800e970 tx=0x7fc42800ed70 comp rx=0 tx=0).stop 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 shutdown_connections 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc41c07ac40 0x7fc41c07d100 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc434107930 0x7fc43419dbb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 --2- 172.21.15.111:0/1073460884 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc434101930 0x7fc43419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 >> 172.21.15.111:0/1073460884 conn(0x7fc4340fd630 msgr2=0x7fc4340fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 shutdown_connections 2024-09-16T09:52:41.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.347+0000 7fc43a989640 1 -- 172.21.15.111:0/1073460884 wait complete. 2024-09-16T09:52:41.357 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:52:41.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.429+0000 7f7507908640 1 -- 172.21.15.111:0/2995590301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 msgr2=0x7f7500100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.429+0000 7f7507908640 1 --2- 172.21.15.111:0/2995590301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f7500100ca0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74fc009880 tx=0x7f74fc02a530 comp rx=0 tx=0).stop 2024-09-16T09:52:41.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.429+0000 7f7507908640 1 -- 172.21.15.111:0/2995590301 shutdown_connections 2024-09-16T09:52:41.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.429+0000 7f7507908640 1 --2- 172.21.15.111:0/2995590301 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75001011e0 0x7f75001056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.430+0000 7f7507908640 1 --2- 172.21.15.111:0/2995590301 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f7500100ca0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.430+0000 7f7507908640 1 -- 172.21.15.111:0/2995590301 >> 172.21.15.111:0/2995590301 conn(0x7f75000fc510 msgr2=0x7f75000fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.430+0000 7f7507908640 1 -- 172.21.15.111:0/2995590301 shutdown_connections 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.430+0000 7f7507908640 1 -- 172.21.15.111:0/2995590301 wait complete. 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.430+0000 7f7507908640 1 Processor -- start 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.430+0000 7f7507908640 1 -- start start 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f7507908640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f750019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f7507908640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75001011e0 0x7f750019e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f7507908640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7500115400 con 0x7f75001008c0 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f7507908640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7500115280 con 0x7f75001011e0 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f750019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f750019dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45420/0 (socket says 172.21.15.111:45420) 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 -- 172.21.15.111:0/2089387893 learned_addr learned my addr 172.21.15.111:0/2089387893 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f7504ea3640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75001011e0 0x7f750019e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 -- 172.21.15.111:0/2089387893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75001011e0 msgr2=0x7f750019e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75001011e0 0x7f750019e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 -- 172.21.15.111:0/2089387893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75001a28b0 con 0x7f75001008c0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.431+0000 7f75056a4640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f750019dfe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74fc031460 tx=0x7f74fc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.432+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74fc03f070 con 0x7f75001008c0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.432+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f74fc0035f0 con 0x7f75001008c0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.432+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75001a2b40 con 0x7f75001008c0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.432+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f74fc035030 con 0x7f75001008c0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.432+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75001a3070 con 0x7f75001008c0 2024-09-16T09:52:41.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.433+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e4005290 con 0x7f75001008c0 2024-09-16T09:52:41.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.433+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f74fc042070 con 0x7f75001008c0 2024-09-16T09:52:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.434+0000 7f74f67fc640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f74ec07ac40 0x7f74ec07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.434+0000 7f7504ea3640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f74ec07ac40 0x7f74ec07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.434+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7f74fc0be4b0 con 0x7f75001008c0 2024-09-16T09:52:41.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.434+0000 7f7504ea3640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f74ec07ac40 0x7f74ec07d100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75000ff010 tx=0x7f74f000b2e0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:41.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.440+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f74fc089c00 con 0x7f75001008c0 2024-09-16T09:52:41.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.631+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f74e4000bc0 con 0x7f74ec07ac40 2024-09-16T09:52:41.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.632+0000 7f74f67fc640 1 -- 172.21.15.111:0/2089387893 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f74e4000bc0 con 0x7f74ec07ac40 2024-09-16T09:52:41.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f74ec07ac40 msgr2=0x7f74ec07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f74ec07ac40 0x7f74ec07d100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f75000ff010 tx=0x7f74f000b2e0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 msgr2=0x7f750019dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f750019dfe0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f74fc031460 tx=0x7f74fc0045e0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 shutdown_connections 2024-09-16T09:52:41.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f74ec07ac40 0x7f74ec07d100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f75001011e0 0x7f750019e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 --2- 172.21.15.111:0/2089387893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f75001008c0 0x7f750019dfe0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.634+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 >> 172.21.15.111:0/2089387893 conn(0x7f75000fc510 msgr2=0x7f75000fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:41.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.635+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 shutdown_connections 2024-09-16T09:52:41.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.635+0000 7f7507908640 1 -- 172.21.15.111:0/2089387893 wait complete. 2024-09-16T09:52:41.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 -- 172.21.15.111:0/1765752430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124101930 msgr2=0x7f3124101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 --2- 172.21.15.111:0/1765752430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124101930 0x7f3124101d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3120009880 tx=0x7f312002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:41 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:41.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:41 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:41.718 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:41 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 -- 172.21.15.111:0/1765752430 shutdown_connections 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 --2- 172.21.15.111:0/1765752430 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124101930 0x7f3124101d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 --2- 172.21.15.111:0/1765752430 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3124107930 0x7f3124107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 -- 172.21.15.111:0/1765752430 >> 172.21.15.111:0/1765752430 conn(0x7f31240fd630 msgr2=0x7f31240ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 -- 172.21.15.111:0/1765752430 shutdown_connections 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 -- 172.21.15.111:0/1765752430 wait complete. 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.716+0000 7f312c719640 1 Processor -- start 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f312c719640 1 -- start start 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f312c719640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3124101930 0x7f312419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f312c719640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 0x7f312419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f312c719640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f312410ee00 con 0x7f3124107930 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f312c719640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f312410ec80 con 0x7f3124101930 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 0x7f312419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 0x7f312419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45424/0 (socket says 172.21.15.111:45424) 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 -- 172.21.15.111:0/4141851962 learned_addr learned my addr 172.21.15.111:0/4141851962 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f312a4b5640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3124101930 0x7f312419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 -- 172.21.15.111:0/4141851962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3124101930 msgr2=0x7f312419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3124101930 0x7f312419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 -- 172.21.15.111:0/4141851962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3124197810 con 0x7f3124107930 2024-09-16T09:52:41.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f3129cb4640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 0x7f312419dbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3120031460 tx=0x7f3120004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:41.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.717+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f312003f070 con 0x7f3124107930 2024-09-16T09:52:41.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.718+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3124197aa0 con 0x7f3124107930 2024-09-16T09:52:41.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.718+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f31200035f0 con 0x7f3124107930 2024-09-16T09:52:41.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.718+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3120035030 con 0x7f3124107930 2024-09-16T09:52:41.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.718+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3124197fd0 con 0x7f3124107930 2024-09-16T09:52:41.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.719+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3124103070 con 0x7f3124107930 2024-09-16T09:52:41.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.719+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f3120042070 con 0x7f3124107930 2024-09-16T09:52:41.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.720+0000 7f31177fe640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f311007abf0 0x7f311007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:41.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.720+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7f31200be680 con 0x7f3124107930 2024-09-16T09:52:41.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.720+0000 7f312a4b5640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f311007abf0 0x7f311007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:41.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.720+0000 7f312a4b5640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f311007abf0 0x7f311007d0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3118009b60 tx=0x7f3118005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:41.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.724+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f3120089d50 con 0x7f3124107930 2024-09-16T09:52:41.804 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:41 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:41.804 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:41 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:41.804 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:41 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:41.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.914+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f31241982e0 con 0x7f311007abf0 2024-09-16T09:52:41.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.923+0000 7f31177fe640 1 -- 172.21.15.111:0/4141851962 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f31241982e0 con 0x7f311007abf0 2024-09-16T09:52:41.925 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:52:41.925 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (3m) 31s ago 14m 20.6M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (5m) 31s ago 14m 8946k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (5m) 2m ago 13m 8326k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (2m) 31s ago 14m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (2m) 2m ago 13m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (3m) 31s ago 14m 76.4M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (9m) 31s ago 9m 148M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (9m) 31s ago 9m 18.9M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (9m) 2m ago 9m 19.6M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (9m) 2m ago 9m 19.4M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (5m) 31s ago 15m 524M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (4m) 2m ago 13m 455M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:52:41.926 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (2m) 31s ago 16m 45.3M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (2m) 2m ago 13m 25.7M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (4m) 31s ago 14m 11.1M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (4m) 2m ago 13m 10.6M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (105s) 31s ago 12m 104M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (71s) 31s ago 12m 150M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (37s) 31s ago 11m 12.1M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 starting - - - 2240M 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (10m) 2m ago 10m 245M 2240M 19.1.1-328-gad35db06 b5388489f99e 768332b8fc0c 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (10m) 2m ago 10m 236M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:52:41.927 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (4m) 31s ago 14m 52.5M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f311007abf0 msgr2=0x7f311007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f311007abf0 0x7f311007d0b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3118009b60 tx=0x7f3118005f90 comp rx=0 tx=0).stop 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 msgr2=0x7f312419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 0x7f312419dbd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3120031460 tx=0x7f3120004530 comp rx=0 tx=0).stop 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 shutdown_connections 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f311007abf0 0x7f311007d0b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3124107930 0x7f312419dbd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 --2- 172.21.15.111:0/4141851962 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3124101930 0x7f312419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:41.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.925+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 >> 172.21.15.111:0/4141851962 conn(0x7f31240fd630 msgr2=0x7f31240fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:41.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.926+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 shutdown_connections 2024-09-16T09:52:41.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:41.926+0000 7f312c719640 1 -- 172.21.15.111:0/4141851962 wait complete. 2024-09-16T09:52:42.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 -- 172.21.15.111:0/2075623206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 msgr2=0x7f95b0100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 --2- 172.21.15.111:0/2075623206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b0100c40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009c20 tx=0x7f95a002a970 comp rx=0 tx=0).stop 2024-09-16T09:52:42.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 -- 172.21.15.111:0/2075623206 shutdown_connections 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 --2- 172.21.15.111:0/2075623206 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b0100c40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 --2- 172.21.15.111:0/2075623206 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 0x7f95b0106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 -- 172.21.15.111:0/2075623206 >> 172.21.15.111:0/2075623206 conn(0x7f95b00fc4c0 msgr2=0x7f95b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 -- 172.21.15.111:0/2075623206 shutdown_connections 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 -- 172.21.15.111:0/2075623206 wait complete. 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 Processor -- start 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.006+0000 7f95b6daf640 1 -- start start 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b6daf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b6daf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 0x7f95b019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b6daf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f95b010dcb0 con 0x7f95b01007e0 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b6daf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f95b010db30 con 0x7f95b01067e0 2024-09-16T09:52:42.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45444/0 (socket says 172.21.15.111:45444) 2024-09-16T09:52:42.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 -- 172.21.15.111:0/1651553672 learned_addr learned my addr 172.21.15.111:0/1651553672 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:42.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95affff640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 0x7f95b019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 -- 172.21.15.111:0/1651553672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 msgr2=0x7f95b019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 0x7f95b019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 -- 172.21.15.111:0/1651553672 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b0197830 con 0x7f95b01007e0 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95affff640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 0x7f95b019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95b4b4b640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b019d6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95a800e970 tx=0x7f95a800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.007+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95a800cac0 con 0x7f95b01007e0 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.008+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b0197b20 con 0x7f95b01007e0 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.008+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f95a80054e0 con 0x7f95b01007e0 2024-09-16T09:52:42.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.008+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f95a8010430 con 0x7f95b01007e0 2024-09-16T09:52:42.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.008+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b01980b0 con 0x7f95b01007e0 2024-09-16T09:52:42.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.009+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b0101f20 con 0x7f95b01007e0 2024-09-16T09:52:42.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.009+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f95a8004e80 con 0x7f95b01007e0 2024-09-16T09:52:42.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.010+0000 7f95adffb640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f959c07abf0 0x7f959c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.010+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7f95a809e310 con 0x7f95b01007e0 2024-09-16T09:52:42.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.010+0000 7f95affff640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f959c07abf0 0x7f959c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.010+0000 7f95affff640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f959c07abf0 0x7f959c07d0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f95b0104fa0 tx=0x7f95a003c040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.015+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f95a80699e0 con 0x7f95b01007e0 2024-09-16T09:52:42.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.260+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f95b0109d60 con 0x7f95b01007e0 2024-09-16T09:52:42.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.260+0000 7f95adffb640 1 -- 172.21.15.111:0/1651553672 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f95a806e890 con 0x7f95b01007e0 2024-09-16T09:52:42.262 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:52:42.262 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:52:42.262 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:52:42.262 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 2, 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 3 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 6, 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 7 2024-09-16T09:52:42.263 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:52:42.264 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:52:42.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f959c07abf0 msgr2=0x7f959c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f959c07abf0 0x7f959c07d0b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f95b0104fa0 tx=0x7f95a003c040 comp rx=0 tx=0).stop 2024-09-16T09:52:42.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 msgr2=0x7f95b019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b019d6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f95a800e970 tx=0x7f95a800ed70 comp rx=0 tx=0).stop 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 shutdown_connections 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f959c07abf0 0x7f959c07d0b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f95b01067e0 0x7f95b019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 --2- 172.21.15.111:0/1651553672 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f95b01007e0 0x7f95b019d6b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 >> 172.21.15.111:0/1651553672 conn(0x7f95b00fc4c0 msgr2=0x7f95b0069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 shutdown_connections 2024-09-16T09:52:42.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.263+0000 7f95b6daf640 1 -- 172.21.15.111:0/1651553672 wait complete. 2024-09-16T09:52:42.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/1837811927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 msgr2=0x7f1b38104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/1837811927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b38104be0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1b28009880 tx=0x7f1b2802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/1837811927 shutdown_connections 2024-09-16T09:52:42.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/1837811927 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b38104be0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/1837811927 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b381001e0 0x7f1b381005c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/1837811927 >> 172.21.15.111:0/1837811927 conn(0x7f1b380fbc40 msgr2=0x7f1b380fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/1837811927 shutdown_connections 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.343+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/1837811927 wait complete. 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3fe2c640 1 Processor -- start 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3fe2c640 1 -- start start 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3fe2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b381001e0 0x7f1b3819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3fe2c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b3819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3fe2c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3810cbb0 con 0x7f1b38100b90 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3fe2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3810ca30 con 0x7f1b381001e0 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3d3c7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b3819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3d3c7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b3819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45454/0 (socket says 172.21.15.111:45454) 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3d3c7640 1 -- 172.21.15.111:0/3701186439 learned_addr learned my addr 172.21.15.111:0/3701186439 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.344+0000 7f1b3dbc8640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b381001e0 0x7f1b3819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b3d3c7640 1 -- 172.21.15.111:0/3701186439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b381001e0 msgr2=0x7f1b3819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b3d3c7640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b381001e0 0x7f1b3819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b3d3c7640 1 -- 172.21.15.111:0/3701186439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b381977b0 con 0x7f1b38100b90 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b3d3c7640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b3819db70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b28031460 tx=0x7f1b280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b2803f070 con 0x7f1b38100b90 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b280035f0 con 0x7f1b38100b90 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b38197a40 con 0x7f1b38100b90 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b28035030 con 0x7f1b38100b90 2024-09-16T09:52:42.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.345+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b38197f70 con 0x7f1b38100b90 2024-09-16T09:52:42.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.346+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b381016c0 con 0x7f1b38100b90 2024-09-16T09:52:42.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.347+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1b28042070 con 0x7f1b38100b90 2024-09-16T09:52:42.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.347+0000 7f1b2effd640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b2407ac40 0x7f1b2407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.347+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7f1b280be500 con 0x7f1b38100b90 2024-09-16T09:52:42.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.347+0000 7f1b3dbc8640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b2407ac40 0x7f1b2407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.348+0000 7f1b3dbc8640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b2407ac40 0x7f1b2407d100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400bce0 tx=0x7f1b3400b490 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.352+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1b28089c50 con 0x7f1b38100b90 2024-09-16T09:52:42.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:42 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:52:42.195+0000 7f8c8e9be640 -1 Falling back to public interface 2024-09-16T09:52:42.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.566+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1b38198ce0 con 0x7f1b38100b90 2024-09-16T09:52:42.568 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:42 smithi111 ceph-mon[109885]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:42.568 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:42 smithi111 ceph-mon[109885]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:42.568 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:42 smithi111 ceph-mon[109885]: pgmap v188: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:42.568 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:42 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1651553672' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:42.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.566+0000 7f1b2effd640 1 -- 172.21.15.111:0/3701186439 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7f1b2808eb00 con 0x7f1b38100b90 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:52:42.569 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:52:42.570 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:52:42.571 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:42.572 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b2407ac40 msgr2=0x7f1b2407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b2407ac40 0x7f1b2407d100 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b3400bce0 tx=0x7f1b3400b490 comp rx=0 tx=0).stop 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 msgr2=0x7f1b3819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b3819db70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1b28031460 tx=0x7f1b280045e0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 shutdown_connections 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b2407ac40 0x7f1b2407d100 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b38100b90 0x7f1b3819db70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 --2- 172.21.15.111:0/3701186439 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b381001e0 0x7f1b3819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.569+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 >> 172.21.15.111:0/3701186439 conn(0x7f1b380fbc40 msgr2=0x7f1b380fd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.570+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 shutdown_connections 2024-09-16T09:52:42.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.570+0000 7f1b3fe2c640 1 -- 172.21.15.111:0/3701186439 wait complete. 2024-09-16T09:52:42.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 -- 172.21.15.111:0/3991227388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 msgr2=0x7fada0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 --2- 172.21.15.111:0/3991227388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada0106c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fad9c009880 tx=0x7fad9c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 -- 172.21.15.111:0/3991227388 shutdown_connections 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 --2- 172.21.15.111:0/3991227388 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada0100820 0x7fada0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 --2- 172.21.15.111:0/3991227388 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada0106c00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 -- 172.21.15.111:0/3991227388 >> 172.21.15.111:0/3991227388 conn(0x7fada00fc520 msgr2=0x7fada00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 -- 172.21.15.111:0/3991227388 shutdown_connections 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.653+0000 7fada80b8640 1 -- 172.21.15.111:0/3991227388 wait complete. 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada80b8640 1 Processor -- start 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada80b8640 1 -- start start 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada80b8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada0100820 0x7fada019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada80b8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada80b8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fada010dcf0 con 0x7fada0106820 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada80b8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fada010db70 con 0x7fada0100820 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5653640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5653640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45476/0 (socket says 172.21.15.111:45476) 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5653640 1 -- 172.21.15.111:0/2949989146 learned_addr learned my addr 172.21.15.111:0/2949989146 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5e54640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada0100820 0x7fada019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5653640 1 -- 172.21.15.111:0/2949989146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada0100820 msgr2=0x7fada019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5653640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada0100820 0x7fada019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.654+0000 7fada5653640 1 -- 172.21.15.111:0/2949989146 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada01977e0 con 0x7fada0106820 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.655+0000 7fada5653640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada019dba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad9000d6f0 tx=0x7fad9000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.655+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad90017070 con 0x7fada0106820 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.655+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad9000de00 con 0x7fada0106820 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.655+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada0197a70 con 0x7fada0106820 2024-09-16T09:52:42.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.655+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad90004bb0 con 0x7fada0106820 2024-09-16T09:52:42.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.655+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada0198000 con 0x7fada0106820 2024-09-16T09:52:42.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.656+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fada0101f60 con 0x7fada0106820 2024-09-16T09:52:42.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.657+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fad90009a30 con 0x7fada0106820 2024-09-16T09:52:42.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.657+0000 7fad96ffd640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad8c07ac40 0x7fad8c07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.657+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7fad9009d7b0 con 0x7fada0106820 2024-09-16T09:52:42.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.657+0000 7fada5e54640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad8c07ac40 0x7fad8c07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.660 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.658+0000 7fada5e54640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad8c07ac40 0x7fad8c07d100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0096c0 tx=0x7fad9c031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.662+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fad90068f00 con 0x7fada0106820 2024-09-16T09:52:42.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.854+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fada01982b0 con 0x7fad8c07ac40 2024-09-16T09:52:42.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.855+0000 7fad96ffd640 1 -- 172.21.15.111:0/2949989146 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fada01982b0 con 0x7fad8c07ac40 2024-09-16T09:52:42.856 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:52:42.856 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "9/23 daemons upgraded", 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:52:42.857 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad8c07ac40 msgr2=0x7fad8c07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad8c07ac40 0x7fad8c07d100 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0096c0 tx=0x7fad9c031400 comp rx=0 tx=0).stop 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 msgr2=0x7fada019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada019dba0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad9000d6f0 tx=0x7fad9000dbb0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 shutdown_connections 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad8c07ac40 0x7fad8c07d100 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fada0106820 0x7fada019dba0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 --2- 172.21.15.111:0/2949989146 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fada0100820 0x7fada019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 >> 172.21.15.111:0/2949989146 conn(0x7fada00fc520 msgr2=0x7fada006a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 shutdown_connections 2024-09-16T09:52:42.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.857+0000 7fada80b8640 1 -- 172.21.15.111:0/2949989146 wait complete. 2024-09-16T09:52:42.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:42 smithi114 ceph-mon[79732]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:42.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:42 smithi114 ceph-mon[79732]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:42.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:42 smithi114 ceph-mon[79732]: pgmap v188: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:42.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:42 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1651553672' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:42.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 -- 172.21.15.111:0/3791494406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c103400 msgr2=0x7fc40c10b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 --2- 172.21.15.111:0/3791494406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c103400 0x7fc40c10b8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc408009880 tx=0x7fc40802a530 comp rx=0 tx=0).stop 2024-09-16T09:52:42.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 -- 172.21.15.111:0/3791494406 shutdown_connections 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 --2- 172.21.15.111:0/3791494406 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c103400 0x7fc40c10b8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 --2- 172.21.15.111:0/3791494406 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40c102ae0 0x7fc40c102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 -- 172.21.15.111:0/3791494406 >> 172.21.15.111:0/3791494406 conn(0x7fc40c0fc520 msgr2=0x7fc40c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 -- 172.21.15.111:0/3791494406 shutdown_connections 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 -- 172.21.15.111:0/3791494406 wait complete. 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 Processor -- start 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.938+0000 7fc41378d640 1 -- start start 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc41378d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 0x7fc40c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc41378d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40c103400 0x7fc40c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc41378d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c10edf0 con 0x7fc40c102ae0 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc41378d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c10ec70 con 0x7fc40c103400 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 0x7fc40c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 0x7fc40c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45496/0 (socket says 172.21.15.111:45496) 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 -- 172.21.15.111:0/1530434701 learned_addr learned my addr 172.21.15.111:0/1530434701 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc410d28640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40c103400 0x7fc40c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 -- 172.21.15.111:0/1530434701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40c103400 msgr2=0x7fc40c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40c103400 0x7fc40c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 -- 172.21.15.111:0/1530434701 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c1011c0 con 0x7fc40c102ae0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc411529640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 0x7fc40c100740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e970 tx=0x7fc40000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc40000cac0 con 0x7fc40c102ae0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc40000cc60 con 0x7fc40c102ae0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c1014b0 con 0x7fc40c102ae0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.939+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc400018720 con 0x7fc40c102ae0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.940+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c1a3e80 con 0x7fc40c102ae0 2024-09-16T09:52:42.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.940+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c06abe0 con 0x7fc40c102ae0 2024-09-16T09:52:42.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.941+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fc400010430 con 0x7fc40c102ae0 2024-09-16T09:52:42.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.942+0000 7fc3fe7fc640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc3f807ac00 0x7fc3f807d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:52:42.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.942+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6360+0+0 (secure 0 0 0) 0x7fc40009e290 con 0x7fc40c102ae0 2024-09-16T09:52:42.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.942+0000 7fc410d28640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc3f807ac00 0x7fc3f807d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:52:42.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.942+0000 7fc410d28640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc3f807ac00 0x7fc3f807d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc40c1021d0 tx=0x7fc408031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:52:42.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:42.946+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fc400069960 con 0x7fc40c102ae0 2024-09-16T09:52:43.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.192+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fc40c102ec0 con 0x7fc40c102ae0 2024-09-16T09:52:43.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.193+0000 7fc3fe7fc640 1 -- 172.21.15.111:0/1530434701 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1294 (secure 0 0 0) 0x7fc40006e810 con 0x7fc40c102ae0 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 45/234 objects degraded (19.231%), 15 pgs degraded 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: osd.3 (root=default,host=smithi114) is down 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 45/234 objects degraded (19.231%), 15 pgs degraded 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.0 is active+undersized+degraded, acting [1,5] 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-16T09:52:43.195 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.e is active+undersized+degraded, acting [2,1] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-16T09:52:43.196 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-16T09:52:43.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc3f807ac00 msgr2=0x7fc3f807d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:43.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc3f807ac00 0x7fc3f807d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc40c1021d0 tx=0x7fc408031400 comp rx=0 tx=0).stop 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 msgr2=0x7fc40c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 0x7fc40c100740 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc40000e970 tx=0x7fc40000ee30 comp rx=0 tx=0).stop 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 shutdown_connections 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fc3f807ac00 0x7fc3f807d0c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fc40c103400 0x7fc40c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 --2- 172.21.15.111:0/1530434701 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc40c102ae0 0x7fc40c100740 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 >> 172.21.15.111:0/1530434701 conn(0x7fc40c0fc520 msgr2=0x7fc40c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 shutdown_connections 2024-09-16T09:52:43.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:52:43.196+0000 7fc41378d640 1 -- 172.21.15.111:0/1530434701 wait complete. 2024-09-16T09:52:43.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-16T09:52:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3701186439' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:52:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1530434701' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:52:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:43.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:43 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:43.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:43.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 10 pgs peering) 2024-09-16T09:52:43.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3701186439' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:52:43.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:52:43.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1530434701' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:52:43.929 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:43.930 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:43 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:45.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:44 smithi114 ceph-mon[79732]: pgmap v189: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:45.107 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:44 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:45.108 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:44 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:45.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:44 smithi111 ceph-mon[109885]: pgmap v189: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:45.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:44 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:45.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:44 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:46 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 45/234 objects degraded (19.231%), 15 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:46.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:46 smithi114 ceph-mon[79732]: pgmap v190: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:52:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:46 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 45/234 objects degraded (19.231%), 15 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:46 smithi111 ceph-mon[109885]: pgmap v190: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:47.905 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:52:47.861+0000 7f8c8e9be640 -1 osd.3 72 log_to_monitors true 2024-09-16T09:52:47.905 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:47.905 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:47.905 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: pgmap v191: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='osd.3 [v2:172.21.15.114:6800/2100997526,v1:172.21.15.114:6801/2100997526]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-16T09:52:47.906 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-mon[79732]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-16T09:52:48.187 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:52:47 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:52:47.950+0000 7f8c82760640 -1 osd.3 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:48.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:52:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-16T09:52:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T09:52:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-09-16T09:52:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: pgmap v191: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='osd.3 [v2:172.21.15.114:6800/2100997526,v1:172.21.15.114:6801/2100997526]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-16T09:52:48.383 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:47 smithi111 ceph-mon[109885]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-16T09:52:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:48 smithi111 ceph-mon[109885]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T09:52:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:48 smithi111 ceph-mon[109885]: from='osd.3 [v2:172.21.15.114:6800/2100997526,v1:172.21.15.114:6801/2100997526]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:52:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:48 smithi111 ceph-mon[109885]: osdmap e75: 6 total, 5 up, 6 in 2024-09-16T09:52:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:48 smithi111 ceph-mon[109885]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:52:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:48 smithi114 ceph-mon[79732]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-16T09:52:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:48 smithi114 ceph-mon[79732]: from='osd.3 [v2:172.21.15.114:6800/2100997526,v1:172.21.15.114:6801/2100997526]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:52:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:48 smithi114 ceph-mon[79732]: osdmap e75: 6 total, 5 up, 6 in 2024-09-16T09:52:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:48 smithi114 ceph-mon[79732]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:52:50.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:49 smithi114 ceph-mon[79732]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:52:50.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:49 smithi114 ceph-mon[79732]: osd.3 [v2:172.21.15.114:6800/2100997526,v1:172.21.15.114:6801/2100997526] boot 2024-09-16T09:52:50.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:49 smithi114 ceph-mon[79732]: osdmap e76: 6 total, 6 up, 6 in 2024-09-16T09:52:50.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:49 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-16T09:52:50.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:49 smithi114 ceph-mon[79732]: pgmap v194: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1017 MiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:50.344 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:49 smithi114 ceph-mon[79732]: osdmap e77: 6 total, 6 up, 6 in 2024-09-16T09:52:50.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:49 smithi111 ceph-mon[109885]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:52:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:49 smithi111 ceph-mon[109885]: osd.3 [v2:172.21.15.114:6800/2100997526,v1:172.21.15.114:6801/2100997526] boot 2024-09-16T09:52:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:49 smithi111 ceph-mon[109885]: osdmap e76: 6 total, 6 up, 6 in 2024-09-16T09:52:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:49 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-16T09:52:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:49 smithi111 ceph-mon[109885]: pgmap v194: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 219 MiB data, 1017 MiB used, 535 GiB / 536 GiB avail; 45/234 objects degraded (19.231%) 2024-09-16T09:52:50.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:49 smithi111 ceph-mon[109885]: osdmap e77: 6 total, 6 up, 6 in 2024-09-16T09:52:52.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:51 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 31/234 objects degraded (13.248%), 10 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:51 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 31/234 objects degraded (13.248%), 10 pgs degraded (PG_DEGRADED) 2024-09-16T09:52:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:52 smithi111 ceph-mon[109885]: pgmap v196: 65 pgs: 10 peering, 7 active+undersized, 10 active+undersized+degraded, 38 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 31/234 objects degraded (13.248%) 2024-09-16T09:52:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:52 smithi114 ceph-mon[79732]: pgmap v196: 65 pgs: 10 peering, 7 active+undersized, 10 active+undersized+degraded, 38 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail; 31/234 objects degraded (13.248%) 2024-09-16T09:52:54.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:53 smithi114 ceph-mon[79732]: pgmap v197: 65 pgs: 10 peering, 55 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:54.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:53 smithi114 ceph-mon[79732]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/234 objects degraded (13.248%), 10 pgs degraded) 2024-09-16T09:52:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:53 smithi111 ceph-mon[109885]: pgmap v197: 65 pgs: 10 peering, 55 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:54.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:53 smithi111 ceph-mon[109885]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 31/234 objects degraded (13.248%), 10 pgs degraded) 2024-09-16T09:52:57.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:56 smithi111 ceph-mon[109885]: pgmap v198: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:56 smithi114 ceph-mon[79732]: pgmap v198: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:59.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:52:58 smithi111 ceph-mon[109885]: pgmap v199: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:52:59.172 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:52:58 smithi114 ceph-mon[79732]: pgmap v199: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:01.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:00 smithi111 ceph-mon[109885]: pgmap v200: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:01.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:01.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:00 smithi114 ceph-mon[79732]: pgmap v200: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:01.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:02.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:02 smithi114 ceph-mon[79732]: pgmap v201: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:02.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:02 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-16T09:53:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:02 smithi111 ceph-mon[109885]: pgmap v201: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:03.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:02 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-16T09:53:04.019 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:03 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T09:53:04.019 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:03 smithi114 ceph-mon[79732]: Upgrade: osd.4 is safe to restart 2024-09-16T09:53:04.019 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:03 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:04.019 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:03 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-16T09:53:04.019 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:03 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:04.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:03 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-16T09:53:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:03 smithi111 ceph-mon[109885]: Upgrade: osd.4 is safe to restart 2024-09-16T09:53:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:03 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:03 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-16T09:53:04.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:03 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:05.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:04 smithi114 ceph-mon[79732]: Upgrade: Updating osd.4 2024-09-16T09:53:05.066 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:04 smithi114 ceph-mon[79732]: Deploying daemon osd.4 on smithi114 2024-09-16T09:53:05.067 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:04 smithi114 ceph-mon[79732]: pgmap v202: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:04 smithi111 ceph-mon[109885]: Upgrade: Updating osd.4 2024-09-16T09:53:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:04 smithi111 ceph-mon[109885]: Deploying daemon osd.4 on smithi114 2024-09-16T09:53:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:04 smithi111 ceph-mon[109885]: pgmap v202: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:06.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:06 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:06.689 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:06 smithi114 ceph-mon[79732]: pgmap v203: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:06.689 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:06 smithi114 systemd[1]: Stopping Ceph osd.4 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:53:06.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:06 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:06.779 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:06 smithi111 ceph-mon[109885]: pgmap v203: 65 pgs: 65 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:07.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:06 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[48021]: 2024-09-16T09:53:06.776+0000 7f563d38a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:53:07.188 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:06 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[48021]: 2024-09-16T09:53:06.776+0000 7f563d38a640 -1 osd.4 77 *** Got signal Terminated *** 2024-09-16T09:53:07.188 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:06 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[48021]: 2024-09-16T09:53:06.776+0000 7f563d38a640 -1 osd.4 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:53:07.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:07 smithi114 ceph-mon[79732]: osd.4 marked itself down and dead 2024-09-16T09:53:07.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:07 smithi111 ceph-mon[109885]: osd.4 marked itself down and dead 2024-09-16T09:53:08.178 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:07 smithi114 podman[91883]: 2024-09-16 09:53:07.874864885 +0000 UTC m=+1.221113027 container died 768332b8fc0ca33bcf02068073e7826f6c59224cbfadeb723ab332697b4ad196 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ad35db0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-16T09:53:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:08 smithi114 ceph-mon[79732]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:53:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:08 smithi114 ceph-mon[79732]: osdmap e78: 6 total, 5 up, 6 in 2024-09-16T09:53:08.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:08 smithi114 ceph-mon[79732]: pgmap v205: 65 pgs: 5 stale+active+clean, 60 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:08.437 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:08 smithi114 podman[91883]: 2024-09-16 09:53:08.275988829 +0000 UTC m=+1.622236969 container cleanup 768332b8fc0ca33bcf02068073e7826f6c59224cbfadeb723ab332697b4ad196 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-ad35db0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:53:08.437 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:08 smithi114 bash[91883]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4 2024-09-16T09:53:08.853 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:08 smithi114 podman[91911]: 2024-09-16 09:53:08.544242935 +0000 UTC m=+0.666372624 container remove 768332b8fc0ca33bcf02068073e7826f6c59224cbfadeb723ab332697b4ad196 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-ad35db0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True) 2024-09-16T09:53:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:08 smithi111 ceph-mon[109885]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:53:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:08 smithi111 ceph-mon[109885]: osdmap e78: 6 total, 5 up, 6 in 2024-09-16T09:53:08.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:08 smithi111 ceph-mon[109885]: pgmap v205: 65 pgs: 5 stale+active+clean, 60 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:09.110 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:08 smithi114 podman[92001]: 2024-09-16 09:53:08.755262929 +0000 UTC m=+0.015649093 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:53:09.110 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:08 smithi114 podman[92001]: 2024-09-16 09:53:08.862697241 +0000 UTC m=+0.123083396 container create 933d1b3ee347e7cfce0904a47427db916b74136e674e92287a4d75a73ce0a519 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True) 2024-09-16T09:53:09.436 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 podman[92001]: 2024-09-16 09:53:09.109350423 +0000 UTC m=+0.369736577 container init 933d1b3ee347e7cfce0904a47427db916b74136e674e92287a4d75a73ce0a519 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T09:53:09.436 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 podman[92001]: 2024-09-16 09:53:09.112872121 +0000 UTC m=+0.373258285 container start 933d1b3ee347e7cfce0904a47427db916b74136e674e92287a4d75a73ce0a519 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:53:09.436 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 podman[92001]: 2024-09-16 09:53:09.184774127 +0000 UTC m=+0.445160288 container attach 933d1b3ee347e7cfce0904a47427db916b74136e674e92287a4d75a73ce0a519 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-16T09:53:09.436 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 podman[92001]: 2024-09-16 09:53:09.301946114 +0000 UTC m=+0.562332279 container died 933d1b3ee347e7cfce0904a47427db916b74136e674e92287a4d75a73ce0a519 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, ceph=True) 2024-09-16T09:53:09.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:09 smithi114 ceph-mon[79732]: osdmap e79: 6 total, 5 up, 6 in 2024-09-16T09:53:09.767 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:09 smithi111 ceph-mon[109885]: osdmap e79: 6 total, 5 up, 6 in 2024-09-16T09:53:10.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 podman[92024]: 2024-09-16 09:53:09.924820723 +0000 UTC m=+0.617182665 container remove 933d1b3ee347e7cfce0904a47427db916b74136e674e92287a4d75a73ce0a519 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-16T09:53:10.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-16T09:53:10.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 systemd[1]: Stopped Ceph osd.4 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:53:10.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:09 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.4.service: Consumed 1min 1.342s CPU time. 2024-09-16T09:53:10.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 systemd[1]: Starting Ceph osd.4 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:53:10.640 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:10 smithi114 ceph-mon[79732]: pgmap v207: 65 pgs: 11 peering, 4 stale+active+clean, 50 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:10.641 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 podman[92122]: 2024-09-16 09:53:10.270930687 +0000 UTC m=+0.015839498 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:53:10.641 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 podman[92122]: 2024-09-16 09:53:10.378703391 +0000 UTC m=+0.123612185 container create 9bed0e51b60bed3ebaf900121a8f4361b5d03863b289d4dfed56bdb9995a0469 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-09-16T09:53:10.641 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 podman[92122]: 2024-09-16 09:53:10.639707805 +0000 UTC m=+0.384616599 container init 9bed0e51b60bed3ebaf900121a8f4361b5d03863b289d4dfed56bdb9995a0469 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-16T09:53:10.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:10 smithi111 ceph-mon[109885]: pgmap v207: 65 pgs: 11 peering, 4 stale+active+clean, 50 active+clean; 219 MiB data, 1018 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:10.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 podman[92122]: 2024-09-16 09:53:10.643036775 +0000 UTC m=+0.387945577 container start 9bed0e51b60bed3ebaf900121a8f4361b5d03863b289d4dfed56bdb9995a0469 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-16T09:53:10.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 podman[92122]: 2024-09-16 09:53:10.715169637 +0000 UTC m=+0.460078456 container attach 9bed0e51b60bed3ebaf900121a8f4361b5d03863b289d4dfed56bdb9995a0469 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:53:10.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:10.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 bash[92122]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:10.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:10.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:10 smithi114 bash[92122]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:11.795 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-mon[79732]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-16T09:53:11.795 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T09:53:11.795 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T09:53:11.795 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T09:53:11.795 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-16T09:53:11.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:11 smithi111 ceph-mon[109885]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-16T09:53:12.102 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate[92137]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 bash[92122]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-16T09:53:12.103 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:11 smithi114 podman[92122]: 2024-09-16 09:53:11.823019873 +0000 UTC m=+1.567928667 container died 9bed0e51b60bed3ebaf900121a8f4361b5d03863b289d4dfed56bdb9995a0469 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T09:53:12.678 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:12 smithi114 ceph-mon[79732]: pgmap v208: 65 pgs: 11 active+undersized, 11 peering, 10 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 21/234 objects degraded (8.974%) 2024-09-16T09:53:12.679 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 podman[92273]: 2024-09-16 09:53:12.360600375 +0000 UTC m=+0.531887874 container remove 9bed0e51b60bed3ebaf900121a8f4361b5d03863b289d4dfed56bdb9995a0469 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:53:12.679 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 podman[92331]: 2024-09-16 09:53:12.569858282 +0000 UTC m=+0.113127545 container create 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-16T09:53:12.679 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 podman[92331]: 2024-09-16 09:53:12.472504614 +0000 UTC m=+0.015773881 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:53:12.775 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:12 smithi111 ceph-mon[109885]: pgmap v208: 65 pgs: 11 active+undersized, 11 peering, 10 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 21/234 objects degraded (8.974%) 2024-09-16T09:53:13.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 podman[92331]: 2024-09-16 09:53:12.790628286 +0000 UTC m=+0.333897553 container init 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-16T09:53:13.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 podman[92331]: 2024-09-16 09:53:12.794035954 +0000 UTC m=+0.337305218 container start 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-16T09:53:13.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 ceph-osd[92349]: -- 172.21.15.114:0/3512331055 <== mon.1 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56147ec381e0 con 0x56147ebc8000 2024-09-16T09:53:13.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 bash[92331]: 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f 2024-09-16T09:53:13.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:12 smithi114 systemd[1]: Started Ceph osd.4 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 -- 172.21.15.111:0/3497389090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 msgr2=0x7f6434100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 --2- 172.21.15.111:0/3497389090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f6434100c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6428009880 tx=0x7f642802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 -- 172.21.15.111:0/3497389090 shutdown_connections 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 --2- 172.21.15.111:0/3497389090 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f6434100c40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 --2- 172.21.15.111:0/3497389090 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64341067e0 0x7f6434106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 -- 172.21.15.111:0/3497389090 >> 172.21.15.111:0/3497389090 conn(0x7f64340fc4c0 msgr2=0x7f64340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 -- 172.21.15.111:0/3497389090 shutdown_connections 2024-09-16T09:53:13.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.284+0000 7f643a225640 1 -- 172.21.15.111:0/3497389090 wait complete. 2024-09-16T09:53:13.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.285+0000 7f643a225640 1 Processor -- start 2024-09-16T09:53:13.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f643a225640 1 -- start start 2024-09-16T09:53:13.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f643a225640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f643419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f643a225640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64341067e0 0x7f643419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f643a225640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f643410dcb0 con 0x7f64341007e0 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f643a225640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f643410db30 con 0x7f64341067e0 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f64337fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f643419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f64337fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f643419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35766/0 (socket says 172.21.15.111:35766) 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f64337fe640 1 -- 172.21.15.111:0/4083669534 learned_addr learned my addr 172.21.15.111:0/4083669534 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.286+0000 7f6432ffd640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64341067e0 0x7f643419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f64337fe640 1 -- 172.21.15.111:0/4083669534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64341067e0 msgr2=0x7f643419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f64337fe640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64341067e0 0x7f643419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f64337fe640 1 -- 172.21.15.111:0/4083669534 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64341977e0 con 0x7f64341007e0 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f64337fe640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f643419d660 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f642400e970 tx=0x7f642400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:13.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f642400cac0 con 0x7f64341007e0 2024-09-16T09:53:13.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64240054e0 con 0x7f64341007e0 2024-09-16T09:53:13.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6434197ad0 con 0x7f64341007e0 2024-09-16T09:53:13.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6424010430 con 0x7f64341007e0 2024-09-16T09:53:13.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.287+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6434198030 con 0x7f64341007e0 2024-09-16T09:53:13.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.288+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6434101f20 con 0x7f64341007e0 2024-09-16T09:53:13.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.289+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f64240105d0 con 0x7f64341007e0 2024-09-16T09:53:13.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.290+0000 7f6430ff9640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f641c07ac50 0x7f641c07d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.290+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7f642409e300 con 0x7f64341007e0 2024-09-16T09:53:13.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.290+0000 7f6432ffd640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f641c07ac50 0x7f641c07d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.290+0000 7f6432ffd640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f641c07ac50 0x7f641c07d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6434198b30 tx=0x7f6428031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.295+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f64240699b0 con 0x7f64341007e0 2024-09-16T09:53:13.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.490+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6434198340 con 0x7f641c07ac50 2024-09-16T09:53:13.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.491+0000 7f6430ff9640 1 -- 172.21.15.111:0/4083669534 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f6434198340 con 0x7f641c07ac50 2024-09-16T09:53:13.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f641c07ac50 msgr2=0x7f641c07d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f641c07ac50 0x7f641c07d110 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6434198b30 tx=0x7f6428031400 comp rx=0 tx=0).stop 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 msgr2=0x7f643419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f643419d660 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f642400e970 tx=0x7f642400ed70 comp rx=0 tx=0).stop 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 shutdown_connections 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f641c07ac50 0x7f641c07d110 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f64341067e0 0x7f643419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 --2- 172.21.15.111:0/4083669534 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64341007e0 0x7f643419d660 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.493+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 >> 172.21.15.111:0/4083669534 conn(0x7f64340fc4c0 msgr2=0x7f6434104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.494+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 shutdown_connections 2024-09-16T09:53:13.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.494+0000 7f643a225640 1 -- 172.21.15.111:0/4083669534 wait complete. 2024-09-16T09:53:13.504 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:53:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/2843625421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100bb0 msgr2=0x7f9c24104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/2843625421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100bb0 0x7f9c24104c00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009880 tx=0x7f9c2002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/2843625421 shutdown_connections 2024-09-16T09:53:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/2843625421 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100bb0 0x7f9c24104c00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/2843625421 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100200 0x7f9c241005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/2843625421 >> 172.21.15.111:0/2843625421 conn(0x7f9c240fbc60 msgr2=0x7f9c240fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:13.578 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:13 smithi111 ceph-mon[109885]: Health check failed: Degraded data redundancy: 21/234 objects degraded (8.974%), 10 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:13.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:13 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:13.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:13 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:13.579 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:13 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:13.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/2843625421 shutdown_connections 2024-09-16T09:53:13.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.576+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/2843625421 wait complete. 2024-09-16T09:53:13.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c2b2a4640 1 Processor -- start 2024-09-16T09:53:13.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c2b2a4640 1 -- start start 2024-09-16T09:53:13.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c2b2a4640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 0x7f9c2419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c2b2a4640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100bb0 0x7f9c2419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c2b2a4640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2410cbf0 con 0x7f9c24100200 2024-09-16T09:53:13.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c2b2a4640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2410ca70 con 0x7f9c24100bb0 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c29040640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 0x7f9c2419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c29040640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 0x7f9c2419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57822/0 (socket says 172.21.15.111:57822) 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.577+0000 7f9c29040640 1 -- 172.21.15.111:0/4134939744 learned_addr learned my addr 172.21.15.111:0/4134939744 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c2883f640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100bb0 0x7f9c2419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c29040640 1 -- 172.21.15.111:0/4134939744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100bb0 msgr2=0x7f9c2419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c29040640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100bb0 0x7f9c2419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c29040640 1 -- 172.21.15.111:0/4134939744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c241977e0 con 0x7f9c24100200 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c2883f640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100bb0 0x7f9c2419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c29040640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 0x7f9c2419d660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400db40 tx=0x7f9c1400a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c1400ac90 con 0x7f9c24100200 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c24197ad0 con 0x7f9c24100200 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9c1400ae30 con 0x7f9c24100200 2024-09-16T09:53:13.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c24198030 con 0x7f9c24100200 2024-09-16T09:53:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.578+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9c1400e680 con 0x7f9c24100200 2024-09-16T09:53:13.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.580+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c08005290 con 0x7f9c24100200 2024-09-16T09:53:13.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.580+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f9c140046c0 con 0x7f9c24100200 2024-09-16T09:53:13.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.580+0000 7f9c1a7fc640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9c1007ac40 0x7f9c1007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.580+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7f9c1409dc20 con 0x7f9c24100200 2024-09-16T09:53:13.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.580+0000 7f9c2883f640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9c1007ac40 0x7f9c1007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.581+0000 7f9c2883f640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9c1007ac40 0x7f9c1007d100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9c24198b30 tx=0x7f9c20031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:13.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.585+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f9c14069370 con 0x7f9c24100200 2024-09-16T09:53:13.745 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:13 smithi114 ceph-mon[79732]: Health check failed: Degraded data redundancy: 21/234 objects degraded (8.974%), 10 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:13.745 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:13 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:13.745 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:13 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:13.745 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:13 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.774+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9c08000bc0 con 0x7f9c1007ac40 2024-09-16T09:53:13.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.775+0000 7f9c1a7fc640 1 -- 172.21.15.111:0/4134939744 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f9c08000bc0 con 0x7f9c1007ac40 2024-09-16T09:53:13.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9c1007ac40 msgr2=0x7f9c1007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9c1007ac40 0x7f9c1007d100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9c24198b30 tx=0x7f9c20031400 comp rx=0 tx=0).stop 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 msgr2=0x7f9c2419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 0x7f9c2419d660 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9c1400db40 tx=0x7f9c1400a250 comp rx=0 tx=0).stop 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 shutdown_connections 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f9c1007ac40 0x7f9c1007d100 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9c24100bb0 0x7f9c2419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 --2- 172.21.15.111:0/4134939744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c24100200 0x7f9c2419d660 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 >> 172.21.15.111:0/4134939744 conn(0x7f9c240fbc60 msgr2=0x7f9c240fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 shutdown_connections 2024-09-16T09:53:13.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.777+0000 7f9c2b2a4640 1 -- 172.21.15.111:0/4134939744 wait complete. 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.858+0000 7fb79394d640 1 -- 172.21.15.111:0/810503852 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 msgr2=0x7fb78c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.858+0000 7fb79394d640 1 --2- 172.21.15.111:0/810503852 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c101d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb77c009880 tx=0x7fb77c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 -- 172.21.15.111:0/810503852 shutdown_connections 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 --2- 172.21.15.111:0/810503852 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c101d90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 --2- 172.21.15.111:0/810503852 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 0x7fb78c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 -- 172.21.15.111:0/810503852 >> 172.21.15.111:0/810503852 conn(0x7fb78c0fd630 msgr2=0x7fb78c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 -- 172.21.15.111:0/810503852 shutdown_connections 2024-09-16T09:53:13.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 -- 172.21.15.111:0/810503852 wait complete. 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 Processor -- start 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.859+0000 7fb79394d640 1 -- start start 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb79394d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb79394d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 0x7fb78c19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb79394d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c10ee60 con 0x7fb78c101930 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb79394d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb78c10ece0 con 0x7fb78c107930 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57840/0 (socket says 172.21.15.111:57840) 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 -- 172.21.15.111:0/3119754546 learned_addr learned my addr 172.21.15.111:0/3119754546 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb790ee8640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 0x7fb78c19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 -- 172.21.15.111:0/3119754546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 msgr2=0x7fb78c19dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:13.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 0x7fb78c19dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 -- 172.21.15.111:0/3119754546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb78c197870 con 0x7fb78c101930 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb790ee8640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 0x7fb78c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7916e9640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c19d6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b420 tx=0x7fb78800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.860+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb788011630 con 0x7fb78c101930 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.861+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb788016070 con 0x7fb78c101930 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.861+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb78c197b60 con 0x7fb78c101930 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.861+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb788010d40 con 0x7fb78c101930 2024-09-16T09:53:13.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.861+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb78c1980c0 con 0x7fb78c101930 2024-09-16T09:53:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.862+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb78c103070 con 0x7fb78c101930 2024-09-16T09:53:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.862+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fb78801b480 con 0x7fb78c101930 2024-09-16T09:53:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.863+0000 7fb7827fc640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb77807abf0 0x7fb77807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.863+0000 7fb790ee8640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb77807abf0 0x7fb77807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.863+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7fb78809d430 con 0x7fb78c101930 2024-09-16T09:53:13.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.863+0000 7fb790ee8640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb77807abf0 0x7fb77807d0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb78c199060 tx=0x7fb77c031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:13.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:13.867+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fb788068b00 con 0x7fb78c101930 2024-09-16T09:53:14.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.052+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb78c198da0 con 0x7fb77807abf0 2024-09-16T09:53:14.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.062+0000 7fb7827fc640 1 -- 172.21.15.111:0/3119754546 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fb78c198da0 con 0x7fb77807abf0 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (4m) 63s ago 15m 20.6M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (6m) 63s ago 15m 8946k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (6m) 30s ago 14m 8497k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (2m) 63s ago 15m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (2m) 30s ago 14m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (3m) 63s ago 14m 76.4M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (9m) 63s ago 9m 148M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:53:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (9m) 63s ago 9m 18.9M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (9m) 30s ago 9m 20.5M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (9m) 30s ago 9m 20.2M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (6m) 63s ago 16m 524M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (5m) 30s ago 14m 456M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (3m) 63s ago 16m 45.3M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (2m) 30s ago 14m 36.9M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 63s ago 15m 11.1M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (5m) 30s ago 14m 11.2M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (2m) 63s ago 13m 104M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (103s) 63s ago 12m 150M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (69s) 63s ago 12m 12.1M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (34s) 30s ago 11m 12.0M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:53:14.066 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 starting - - - 2240M 2024-09-16T09:53:14.067 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (10m) 30s ago 10m 291M 2240M 19.1.1-328-gad35db06 b5388489f99e bd556263e300 2024-09-16T09:53:14.067 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (4m) 63s ago 14m 52.5M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:53:14.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb77807abf0 msgr2=0x7fb77807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb77807abf0 0x7fb77807d0b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb78c199060 tx=0x7fb77c031400 comp rx=0 tx=0).stop 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 msgr2=0x7fb78c19d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c19d6b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb78800b420 tx=0x7fb78800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 shutdown_connections 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb77807abf0 0x7fb77807d0b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb78c107930 0x7fb78c19dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 --2- 172.21.15.111:0/3119754546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb78c101930 0x7fb78c19d6b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 >> 172.21.15.111:0/3119754546 conn(0x7fb78c0fd630 msgr2=0x7fb78c0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 shutdown_connections 2024-09-16T09:53:14.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.064+0000 7fb79394d640 1 -- 172.21.15.111:0/3119754546 wait complete. 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 -- 172.21.15.111:0/62105708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 msgr2=0x7f9090100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 --2- 172.21.15.111:0/62105708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f9090100430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9084009880 tx=0x7f908402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 -- 172.21.15.111:0/62105708 shutdown_connections 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 --2- 172.21.15.111:0/62105708 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 0x7f9090106540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 --2- 172.21.15.111:0/62105708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f9090100430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 -- 172.21.15.111:0/62105708 >> 172.21.15.111:0/62105708 conn(0x7f90900fbc40 msgr2=0x7f90900fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 -- 172.21.15.111:0/62105708 shutdown_connections 2024-09-16T09:53:14.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 -- 172.21.15.111:0/62105708 wait complete. 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.145+0000 7f90954fb640 1 Processor -- start 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f90954fb640 1 -- start start 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f90954fb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f909019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f90954fb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 0x7f909019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f90954fb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f909010edc0 con 0x7f9090100050 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f90954fb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f909010ec40 con 0x7f9090100a00 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f909019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f909019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57860/0 (socket says 172.21.15.111:57860) 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908effd640 1 -- 172.21.15.111:0/930663749 learned_addr learned my addr 172.21.15.111:0/930663749 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908e7fc640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 0x7f909019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908effd640 1 -- 172.21.15.111:0/930663749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 msgr2=0x7f909019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908effd640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 0x7f909019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908effd640 1 -- 172.21.15.111:0/930663749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90901977b0 con 0x7f9090100050 2024-09-16T09:53:14.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.146+0000 7f908e7fc640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 0x7f909019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.147+0000 7f908effd640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f909019d630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9084031460 tx=0x7f90840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.147+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f908403f070 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.147+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90840035f0 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.147+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9090197a40 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.147+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9084035030 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.147+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9090197f70 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.148+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9090100430 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.149+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f9084042070 con 0x7f9090100050 2024-09-16T09:53:14.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.149+0000 7f9077fff640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907807ac40 0x7f907807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.149+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7f90840be500 con 0x7f9090100050 2024-09-16T09:53:14.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.150+0000 7f908e7fc640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907807ac40 0x7f907807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.150+0000 7f908e7fc640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907807ac40 0x7f907807d100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9080009fd0 tx=0x7f9080009680 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:14.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.154+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f9084089c50 con 0x7f9090100050 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.399+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f909002d7c0 con 0x7f9090100050 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.399+0000 7f9077fff640 1 -- 172.21.15.111:0/930663749 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f908408eb00 con 0x7f9090100050 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:53:14.401 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 1, 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 4 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 5, 2024-09-16T09:53:14.402 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 8 2024-09-16T09:53:14.403 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:53:14.403 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:53:14.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907807ac40 msgr2=0x7f907807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907807ac40 0x7f907807d100 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9080009fd0 tx=0x7f9080009680 comp rx=0 tx=0).stop 2024-09-16T09:53:14.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 msgr2=0x7f909019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f909019d630 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9084031460 tx=0x7f90840045e0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 shutdown_connections 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907807ac40 0x7f907807d100 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f9090100a00 0x7f909019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 --2- 172.21.15.111:0/930663749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9090100050 0x7f909019d630 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 >> 172.21.15.111:0/930663749 conn(0x7f90900fbc40 msgr2=0x7f90900fd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 shutdown_connections 2024-09-16T09:53:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.402+0000 7f90954fb640 1 -- 172.21.15.111:0/930663749 wait complete. 2024-09-16T09:53:14.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 -- 172.21.15.111:0/335807415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 msgr2=0x7f16c8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 --2- 172.21.15.111:0/335807415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c8106bc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009880 tx=0x7f16b802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 -- 172.21.15.111:0/335807415 shutdown_connections 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 --2- 172.21.15.111:0/335807415 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c81007e0 0x7f16c8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 --2- 172.21.15.111:0/335807415 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c8106bc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 -- 172.21.15.111:0/335807415 >> 172.21.15.111:0/335807415 conn(0x7f16c80fc4c0 msgr2=0x7f16c80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 -- 172.21.15.111:0/335807415 shutdown_connections 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.487+0000 7f16ce057640 1 -- 172.21.15.111:0/335807415 wait complete. 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16ce057640 1 Processor -- start 2024-09-16T09:53:14.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16ce057640 1 -- start start 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16ce057640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c81007e0 0x7f16c810b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16ce057640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c810bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16ce057640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f16c810edd0 con 0x7f16c81067e0 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16ce057640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f16c810ec50 con 0x7f16c81007e0 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16bffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c810bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16bffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c810bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57872/0 (socket says 172.21.15.111:57872) 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16bffff640 1 -- 172.21.15.111:0/1444132079 learned_addr learned my addr 172.21.15.111:0/1444132079 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16c77fe640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c81007e0 0x7f16c810b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16bffff640 1 -- 172.21.15.111:0/1444132079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c81007e0 msgr2=0x7f16c810b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16bffff640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c81007e0 0x7f16c810b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.488+0000 7f16bffff640 1 -- 172.21.15.111:0/1444132079 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c810c1f0 con 0x7f16c81067e0 2024-09-16T09:53:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.489+0000 7f16bffff640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c810bcb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e970 tx=0x7f16b000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.489+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16b000cac0 con 0x7f16c81067e0 2024-09-16T09:53:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.489+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16b00054e0 con 0x7f16c81067e0 2024-09-16T09:53:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.489+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c810c4e0 con 0x7f16c81067e0 2024-09-16T09:53:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.489+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16b0010430 con 0x7f16c81067e0 2024-09-16T09:53:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.489+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81a3e80 con 0x7f16c81067e0 2024-09-16T09:53:14.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.490+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16c8101f20 con 0x7f16c81067e0 2024-09-16T09:53:14.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.490+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f16b0004f00 con 0x7f16c81067e0 2024-09-16T09:53:14.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.491+0000 7f16c57fa640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f16b407ac40 0x7f16b407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.491+0000 7f16c77fe640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f16b407ac40 0x7f16b407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.491+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7f16b009e360 con 0x7f16c81067e0 2024-09-16T09:53:14.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.492+0000 7f16c77fe640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f16b407ac40 0x7f16b407d100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16b80096c0 tx=0x7f16b8031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:14.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.495+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f16b0069ab0 con 0x7f16c81067e0 2024-09-16T09:53:14.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:14 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:53:14.442+0000 7f0bca263640 -1 Falling back to public interface 2024-09-16T09:53:14.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:14 smithi114 ceph-mon[79732]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:14 smithi114 ceph-mon[79732]: pgmap v209: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:14.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:14 smithi114 ceph-mon[79732]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:14 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/930663749' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.703+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f16c8108d50 con 0x7f16c81067e0 2024-09-16T09:53:14.705 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:14 smithi111 ceph-mon[109885]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.705 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:14 smithi111 ceph-mon[109885]: pgmap v209: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:14.705 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:14 smithi111 ceph-mon[109885]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:14.705 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:14 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/930663749' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.703+0000 7f16c57fa640 1 -- 172.21.15.111:0/1444132079 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7f16b006e960 con 0x7f16c81067e0 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:53:14.706 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:53:14.707 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:53:14.708 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:14.709 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:14.710 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:14.710 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:53:14.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f16b407ac40 msgr2=0x7f16b407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f16b407ac40 0x7f16b407d100 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f16b80096c0 tx=0x7f16b8031400 comp rx=0 tx=0).stop 2024-09-16T09:53:14.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 msgr2=0x7f16c810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c810bcb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f16b000e970 tx=0x7f16b000ed70 comp rx=0 tx=0).stop 2024-09-16T09:53:14.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 shutdown_connections 2024-09-16T09:53:14.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f16b407ac40 0x7f16b407d100 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f16c81067e0 0x7f16c810bcb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 --2- 172.21.15.111:0/1444132079 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f16c81007e0 0x7f16c810b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 >> 172.21.15.111:0/1444132079 conn(0x7f16c80fc4c0 msgr2=0x7f16c80fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.705+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 shutdown_connections 2024-09-16T09:53:14.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.706+0000 7f16ce057640 1 -- 172.21.15.111:0/1444132079 wait complete. 2024-09-16T09:53:14.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 -- 172.21.15.111:0/3807352715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 msgr2=0x7f10dc106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 --2- 172.21.15.111:0/3807352715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc106bf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009880 tx=0x7f10d802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 -- 172.21.15.111:0/3807352715 shutdown_connections 2024-09-16T09:53:14.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 --2- 172.21.15.111:0/3807352715 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 --2- 172.21.15.111:0/3807352715 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc106bf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 -- 172.21.15.111:0/3807352715 >> 172.21.15.111:0/3807352715 conn(0x7f10dc0fc4f0 msgr2=0x7f10dc0fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.787+0000 7f10e30b8640 1 -- 172.21.15.111:0/3807352715 shutdown_connections 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 -- 172.21.15.111:0/3807352715 wait complete. 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 Processor -- start 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 -- start start 2024-09-16T09:53:14.791 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc19d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc19dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc10dd40 con 0x7f10dc106810 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10e30b8640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f10dc10dbc0 con 0x7f10dc100810 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10e0e54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc19d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.788+0000 7f10d3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc19dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10e0e54640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc19d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.114:3300/0 says I am v2:172.21.15.111:57598/0 (socket says 172.21.15.111:57598) 2024-09-16T09:53:14.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10e0e54640 1 -- 172.21.15.111:0/1274810040 learned_addr learned my addr 172.21.15.111:0/1274810040 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:14.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d3fff640 1 -- 172.21.15.111:0/1274810040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 msgr2=0x7f10dc19d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d3fff640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc19d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d3fff640 1 -- 172.21.15.111:0/1274810040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10dc197830 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10e0e54640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d3fff640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc19dbf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b370 tx=0x7f10cc00b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10cc015020 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10dc197b20 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10cc011af0 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10cc010d60 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.789+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10dc1980b0 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.790+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10dc101f50 con 0x7f10dc106810 2024-09-16T09:53:14.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.791+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f10cc018020 con 0x7f10dc106810 2024-09-16T09:53:14.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.791+0000 7f10d1ffb640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f10c407abf0 0x7f10c407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:14.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.792+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7f10cc09d570 con 0x7f10dc106810 2024-09-16T09:53:14.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.792+0000 7f10e0e54640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f10c407abf0 0x7f10c407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:14.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.792+0000 7f10e0e54640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f10c407abf0 0x7f10c407d0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10d80096c0 tx=0x7f10d80058d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:14.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.796+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f10cc01f020 con 0x7f10dc106810 2024-09-16T09:53:14.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.989+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f10dc1983c0 con 0x7f10c407abf0 2024-09-16T09:53:14.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.991+0000 7f10d1ffb640 1 -- 172.21.15.111:0/1274810040 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f10dc1983c0 con 0x7f10c407abf0 2024-09-16T09:53:14.992 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "10/23 daemons upgraded", 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:53:14.993 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:53:14.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.993+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f10c407abf0 msgr2=0x7f10c407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.993+0000 7f10e30b8640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f10c407abf0 0x7f10c407d0b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f10d80096c0 tx=0x7f10d80058d0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.993+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 msgr2=0x7f10dc19dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:14.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.993+0000 7f10e30b8640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc19dbf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b370 tx=0x7f10cc00b830 comp rx=0 tx=0).stop 2024-09-16T09:53:14.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 shutdown_connections 2024-09-16T09:53:14.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f10c407abf0 0x7f10c407d0b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f10dc106810 0x7f10dc19dbf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 --2- 172.21.15.111:0/1274810040 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f10dc100810 0x7f10dc19d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:14.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 >> 172.21.15.111:0/1274810040 conn(0x7f10dc0fc4f0 msgr2=0x7f10dc06a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:14.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 shutdown_connections 2024-09-16T09:53:14.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:14.994+0000 7f10e30b8640 1 -- 172.21.15.111:0/1274810040 wait complete. 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 -- 172.21.15.111:0/3079202307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8107930 msgr2=0x7f30d8107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 --2- 172.21.15.111:0/3079202307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8107930 0x7f30d8107d10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f30d4009880 tx=0x7f30d402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 -- 172.21.15.111:0/3079202307 shutdown_connections 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 --2- 172.21.15.111:0/3079202307 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30d8101930 0x7f30d8101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 --2- 172.21.15.111:0/3079202307 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8107930 0x7f30d8107d10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 -- 172.21.15.111:0/3079202307 >> 172.21.15.111:0/3079202307 conn(0x7f30d80fd630 msgr2=0x7f30d80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 -- 172.21.15.111:0/3079202307 shutdown_connections 2024-09-16T09:53:15.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.075+0000 7f30dff2c640 1 -- 172.21.15.111:0/3079202307 wait complete. 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dff2c640 1 Processor -- start 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dff2c640 1 -- start start 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dff2c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 0x7f30d819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dff2c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30d8107930 0x7f30d819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dff2c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810ede0 con 0x7f30d8101930 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dff2c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f30d810ec60 con 0x7f30d8107930 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 0x7f30d819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 0x7f30d819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57914/0 (socket says 172.21.15.111:57914) 2024-09-16T09:53:15.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 -- 172.21.15.111:0/1660464372 learned_addr learned my addr 172.21.15.111:0/1660464372 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30dd4c7640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30d8107930 0x7f30d819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 -- 172.21.15.111:0/1660464372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30d8107930 msgr2=0x7f30d819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30d8107930 0x7f30d819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 -- 172.21.15.111:0/1660464372 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d81977d0 con 0x7f30d8101930 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.076+0000 7f30ddcc8640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 0x7f30d819d650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30d4031460 tx=0x7f30d40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.077+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30d403f070 con 0x7f30d8101930 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.077+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d8197a60 con 0x7f30d8101930 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.077+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30d4004cf0 con 0x7f30d8101930 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.077+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30d4035030 con 0x7f30d8101930 2024-09-16T09:53:15.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.077+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d8197f90 con 0x7f30d8101930 2024-09-16T09:53:15.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.078+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d8103070 con 0x7f30d8101930 2024-09-16T09:53:15.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.078+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f30d4042070 con 0x7f30d8101930 2024-09-16T09:53:15.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.079+0000 7f30caffd640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f30c407abf0 0x7f30c407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:15.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.079+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6360+0+0 (secure 0 0 0) 0x7f30d40be670 con 0x7f30d8101930 2024-09-16T09:53:15.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.079+0000 7f30dd4c7640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f30c407abf0 0x7f30c407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:15.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.079+0000 7f30dd4c7640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f30c407abf0 0x7f30c407d0b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30d8100d60 tx=0x7f30cc00a2d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:15.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.083+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f30d4089d40 con 0x7f30d8101930 2024-09-16T09:53:15.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.326+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f30d8104b40 con 0x7f30d8101930 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.327+0000 7f30caffd640 1 -- 172.21.15.111:0/1660464372 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1296 (secure 0 0 0) 0x7f30d408ebf0 con 0x7f30d8101930 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 42/234 objects degraded (17.949%), 15 pgs degraded 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout: osd.4 (root=default,host=smithi114) is down 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 42/234 objects degraded (17.949%), 15 pgs degraded 2024-09-16T09:53:15.329 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.f is active+undersized+degraded, acting [1,5] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.18 is active+undersized+degraded, acting [5,1] 2024-09-16T09:53:15.330 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-16T09:53:15.331 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-16T09:53:15.331 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-16T09:53:15.331 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-16T09:53:15.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f30c407abf0 msgr2=0x7f30c407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f30c407abf0 0x7f30c407d0b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30d8100d60 tx=0x7f30cc00a2d0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 msgr2=0x7f30d819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 0x7f30d819d650 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30d4031460 tx=0x7f30d40048f0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 shutdown_connections 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f30c407abf0 0x7f30c407d0b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f30d8107930 0x7f30d819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 --2- 172.21.15.111:0/1660464372 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f30d8101930 0x7f30d819d650 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:15.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 >> 172.21.15.111:0/1660464372 conn(0x7f30d80fd630 msgr2=0x7f30d80fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:15.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 shutdown_connections 2024-09-16T09:53:15.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:15.329+0000 7f30dff2c640 1 -- 172.21.15.111:0/1660464372 wait complete. 2024-09-16T09:53:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:15 smithi111 ceph-mon[109885]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:15 smithi111 ceph-mon[109885]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-16T09:53:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:15 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1444132079' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:53:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:15 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1660464372' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:53:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:15.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:15 smithi114 ceph-mon[79732]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:15 smithi114 ceph-mon[79732]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-16T09:53:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:15 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1444132079' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:53:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:15 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1660464372' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:53:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:15 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:15.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:15 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:16.827 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:16 smithi114 ceph-mon[79732]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:16.827 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.827 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.827 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:16 smithi114 ceph-mon[79732]: pgmap v210: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:16.827 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:16 smithi111 ceph-mon[109885]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:16.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:16 smithi111 ceph-mon[109885]: pgmap v210: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:16.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:16.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:18 smithi111 ceph-mon[109885]: pgmap v211: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:18 smithi114 ceph-mon[79732]: pgmap v211: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:20.838 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:53:20.539+0000 7f0bca263640 -1 osd.4 77 log_to_monitors true 2024-09-16T09:53:20.839 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:53:20.622+0000 7f0bc200d640 -1 osd.4 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:20.839 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:20.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:20.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-16T09:53:20.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T09:53:20.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-16T09:53:20.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: pgmap v212: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:20.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='osd.4 [v2:172.21.15.114:6808/2961832675,v1:172.21.15.114:6809/2961832675]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-16T09:53:20.841 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:20 smithi114 ceph-mon[79732]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-16T09:53:20.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:20.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:20.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:20.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:53:20.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:20.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:20.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:20.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:20.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:20.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-16T09:53:20.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T09:53:20.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-09-16T09:53:20.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: pgmap v212: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 1022 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:20.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='osd.4 [v2:172.21.15.114:6808/2961832675,v1:172.21.15.114:6809/2961832675]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-16T09:53:20.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:20 smithi111 ceph-mon[109885]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-16T09:53:21.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:21 smithi111 ceph-mon[109885]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T09:53:21.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:21 smithi111 ceph-mon[109885]: from='osd.4 [v2:172.21.15.114:6808/2961832675,v1:172.21.15.114:6809/2961832675]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:21.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:21 smithi111 ceph-mon[109885]: osdmap e80: 6 total, 5 up, 6 in 2024-09-16T09:53:21.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:21 smithi111 ceph-mon[109885]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:21.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:21 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 42/234 objects degraded (17.949%), 15 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:21 smithi114 ceph-mon[79732]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-16T09:53:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:21 smithi114 ceph-mon[79732]: from='osd.4 [v2:172.21.15.114:6808/2961832675,v1:172.21.15.114:6809/2961832675]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:21 smithi114 ceph-mon[79732]: osdmap e80: 6 total, 5 up, 6 in 2024-09-16T09:53:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:21 smithi114 ceph-mon[79732]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:21.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:21 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 42/234 objects degraded (17.949%), 15 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:22 smithi111 ceph-mon[109885]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:53:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:22 smithi111 ceph-mon[109885]: osd.4 [v2:172.21.15.114:6808/2961832675,v1:172.21.15.114:6809/2961832675] boot 2024-09-16T09:53:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:22 smithi111 ceph-mon[109885]: osdmap e81: 6 total, 6 up, 6 in 2024-09-16T09:53:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-16T09:53:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:22 smithi111 ceph-mon[109885]: pgmap v215: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 956 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:22 smithi111 ceph-mon[109885]: osdmap e82: 6 total, 6 up, 6 in 2024-09-16T09:53:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:22 smithi114 ceph-mon[79732]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:53:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:22 smithi114 ceph-mon[79732]: osd.4 [v2:172.21.15.114:6808/2961832675,v1:172.21.15.114:6809/2961832675] boot 2024-09-16T09:53:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:22 smithi114 ceph-mon[79732]: osdmap e81: 6 total, 6 up, 6 in 2024-09-16T09:53:22.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-16T09:53:22.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:22 smithi114 ceph-mon[79732]: pgmap v215: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 219 MiB data, 956 MiB used, 535 GiB / 536 GiB avail; 42/234 objects degraded (17.949%) 2024-09-16T09:53:22.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:22 smithi114 ceph-mon[79732]: osdmap e82: 6 total, 6 up, 6 in 2024-09-16T09:53:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:24 smithi111 ceph-mon[109885]: pgmap v217: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 43 active+clean; 219 MiB data, 956 MiB used, 535 GiB / 536 GiB avail; 21/234 objects degraded (8.974%) 2024-09-16T09:53:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:24 smithi114 ceph-mon[79732]: pgmap v217: 65 pgs: 12 active+undersized, 10 active+undersized+degraded, 43 active+clean; 219 MiB data, 956 MiB used, 535 GiB / 536 GiB avail; 21/234 objects degraded (8.974%) 2024-09-16T09:53:26.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:25 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 21/234 objects degraded (8.974%), 10 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:26.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:25 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 21/234 objects degraded (8.974%), 10 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:27.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:26 smithi111 ceph-mon[109885]: pgmap v218: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:27.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:26 smithi111 ceph-mon[109885]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/234 objects degraded (8.974%), 10 pgs degraded) 2024-09-16T09:53:27.194 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:26 smithi114 ceph-mon[79732]: pgmap v218: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:27.194 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:26 smithi114 ceph-mon[79732]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 21/234 objects degraded (8.974%), 10 pgs degraded) 2024-09-16T09:53:29.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:28 smithi111 ceph-mon[109885]: pgmap v219: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:28 smithi114 ceph-mon[79732]: pgmap v219: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:30 smithi111 ceph-mon[109885]: pgmap v220: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:30 smithi114 ceph-mon[79732]: pgmap v220: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:32 smithi111 ceph-mon[109885]: pgmap v221: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:32 smithi114 ceph-mon[79732]: pgmap v221: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:34.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:34 smithi114 ceph-mon[79732]: pgmap v222: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:34.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:34 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-16T09:53:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:34 smithi111 ceph-mon[109885]: pgmap v222: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:34 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-16T09:53:36.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:35 smithi114 ceph-mon[79732]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T09:53:36.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:35 smithi114 ceph-mon[79732]: Upgrade: osd.5 is safe to restart 2024-09-16T09:53:36.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:35 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:36.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:35 smithi111 ceph-mon[109885]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-16T09:53:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:35 smithi111 ceph-mon[109885]: Upgrade: osd.5 is safe to restart 2024-09-16T09:53:36.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:35 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:37.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:36 smithi114 ceph-mon[79732]: pgmap v223: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:37.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:37.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-16T09:53:37.069 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:37.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:36 smithi111 ceph-mon[109885]: pgmap v223: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-16T09:53:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:37 smithi114 ceph-mon[79732]: Upgrade: Updating osd.5 2024-09-16T09:53:37.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:37 smithi114 ceph-mon[79732]: Deploying daemon osd.5 on smithi114 2024-09-16T09:53:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:37 smithi111 ceph-mon[109885]: Upgrade: Updating osd.5 2024-09-16T09:53:38.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:37 smithi111 ceph-mon[109885]: Deploying daemon osd.5 on smithi114 2024-09-16T09:53:39.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:38 smithi114 ceph-mon[79732]: pgmap v224: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:39.063 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:38 smithi114 systemd[1]: Stopping Ceph osd.5 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:53:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:38 smithi111 ceph-mon[109885]: pgmap v224: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:39.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[54756]: 2024-09-16T09:53:39.086+0000 7f581d005640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:53:39.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[54756]: 2024-09-16T09:53:39.086+0000 7f581d005640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-16T09:53:39.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[54756]: 2024-09-16T09:53:39.086+0000 7f581d005640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:53:40.033 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:39 smithi114 ceph-mon[79732]: osd.5 marked itself down and dead 2024-09-16T09:53:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:39 smithi111 ceph-mon[109885]: osd.5 marked itself down and dead 2024-09-16T09:53:40.569 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:40 smithi114 podman[96995]: 2024-09-16 09:53:40.297484116 +0000 UTC m=+1.334789521 container died bd556263e300b779c3eb48072ec978f152f940c632ccab74407474603d84e236 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-ad35db0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:53:40.827 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:40 smithi114 podman[96995]: 2024-09-16 09:53:40.674729295 +0000 UTC m=+1.712034690 container cleanup bd556263e300b779c3eb48072ec978f152f940c632ccab74407474603d84e236 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-ad35db0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-16T09:53:40.827 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:40 smithi114 bash[96995]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5 2024-09-16T09:53:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:40 smithi111 ceph-mon[109885]: pgmap v225: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:40 smithi111 ceph-mon[109885]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:53:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:40 smithi111 ceph-mon[109885]: osdmap e83: 6 total, 5 up, 6 in 2024-09-16T09:53:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:40 smithi114 ceph-mon[79732]: pgmap v225: 65 pgs: 65 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:40 smithi114 ceph-mon[79732]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-16T09:53:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:40 smithi114 ceph-mon[79732]: osdmap e83: 6 total, 5 up, 6 in 2024-09-16T09:53:41.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:40 smithi114 podman[97022]: 2024-09-16 09:53:40.959524331 +0000 UTC m=+0.663032078 container remove bd556263e300b779c3eb48072ec978f152f940c632ccab74407474603d84e236 (image=quay.ceph.io/ceph-ci/ceph@sha256:492037805376aaa75d18e0094fd59778d9efe585eee2e5c893fdf6a5d0e45d60, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-ad35db0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-16T09:53:41.572 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:41 smithi114 podman[97110]: 2024-09-16 09:53:41.193645941 +0000 UTC m=+0.015865885 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:53:41.572 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:41 smithi114 podman[97110]: 2024-09-16 09:53:41.302023331 +0000 UTC m=+0.124243311 container create c88fca17d8843cb4b5e148bef4c0e092c13548b6835a2fbc9062cf44d6e9fe95 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:53:41.572 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:41 smithi114 podman[97110]: 2024-09-16 09:53:41.495855385 +0000 UTC m=+0.318075329 container init c88fca17d8843cb4b5e148bef4c0e092c13548b6835a2fbc9062cf44d6e9fe95 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-16T09:53:41.572 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:41 smithi114 podman[97110]: 2024-09-16 09:53:41.499244682 +0000 UTC m=+0.321464619 container start c88fca17d8843cb4b5e148bef4c0e092c13548b6835a2fbc9062cf44d6e9fe95 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-16T09:53:41.573 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:41 smithi114 podman[97110]: 2024-09-16 09:53:41.570958749 +0000 UTC m=+0.393178693 container attach c88fca17d8843cb4b5e148bef4c0e092c13548b6835a2fbc9062cf44d6e9fe95 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-16T09:53:41.840 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:41 smithi114 podman[97110]: 2024-09-16 09:53:41.683423966 +0000 UTC m=+0.505643904 container died c88fca17d8843cb4b5e148bef4c0e092c13548b6835a2fbc9062cf44d6e9fe95 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-16T09:53:41.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:41 smithi111 ceph-mon[109885]: osdmap e84: 6 total, 5 up, 6 in 2024-09-16T09:53:42.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:41 smithi114 ceph-mon[79732]: osdmap e84: 6 total, 5 up, 6 in 2024-09-16T09:53:42.687 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 podman[97133]: 2024-09-16 09:53:42.274999389 +0000 UTC m=+0.579887654 container remove c88fca17d8843cb4b5e148bef4c0e092c13548b6835a2fbc9062cf44d6e9fe95 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-16T09:53:42.687 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-16T09:53:42.687 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 systemd[1]: Stopped Ceph osd.5 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:53:42.687 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.5.service: Consumed 1min 4.188s CPU time. 2024-09-16T09:53:42.688 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 systemd[1]: Starting Ceph osd.5 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:53:43.030 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:42 smithi114 ceph-mon[79732]: pgmap v228: 65 pgs: 11 peering, 8 stale+active+clean, 46 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:43.030 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:42 smithi114 ceph-mon[79732]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-16T09:53:43.030 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 podman[97234]: 2024-09-16 09:53:42.61308185 +0000 UTC m=+0.015864202 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:53:43.030 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 podman[97234]: 2024-09-16 09:53:42.734686725 +0000 UTC m=+0.137469061 container create b95421174212141f5f490b12395f653ff505bc68aefdc7a2f30e2e9be67d210a (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True) 2024-09-16T09:53:43.030 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 podman[97234]: 2024-09-16 09:53:42.953633715 +0000 UTC m=+0.356416052 container init b95421174212141f5f490b12395f653ff505bc68aefdc7a2f30e2e9be67d210a (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-16T09:53:43.030 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:42 smithi114 podman[97234]: 2024-09-16 09:53:42.957643618 +0000 UTC m=+0.360425956 container start b95421174212141f5f490b12395f653ff505bc68aefdc7a2f30e2e9be67d210a (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731) 2024-09-16T09:53:43.030 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 podman[97234]: 2024-09-16 09:53:43.028629273 +0000 UTC m=+0.431411630 container attach b95421174212141f5f490b12395f653ff505bc68aefdc7a2f30e2e9be67d210a (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-16T09:53:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:42 smithi111 ceph-mon[109885]: pgmap v228: 65 pgs: 11 peering, 8 stale+active+clean, 46 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail 2024-09-16T09:53:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:42 smithi111 ceph-mon[109885]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-09-16T09:53:43.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:43.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 bash[97234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:43.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:43.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 bash[97234]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-16T09:53:44.123 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:43 smithi114 ceph-mon[79732]: pgmap v229: 65 pgs: 7 active+undersized, 11 peering, 2 stale+active+clean, 8 active+undersized+degraded, 37 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 27/234 objects degraded (11.538%) 2024-09-16T09:53:44.124 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:43 smithi114 ceph-mon[79732]: Health check failed: Degraded data redundancy: 27/234 objects degraded (11.538%), 8 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:44.124 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T09:53:44.124 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 bash[97234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T09:53:44.124 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T09:53:44.124 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:43 smithi114 bash[97234]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-16T09:53:44.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:43 smithi111 ceph-mon[109885]: pgmap v229: 65 pgs: 7 active+undersized, 11 peering, 2 stale+active+clean, 8 active+undersized+degraded, 37 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 27/234 objects degraded (11.538%) 2024-09-16T09:53:44.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:43 smithi111 ceph-mon[109885]: Health check failed: Degraded data redundancy: 27/234 objects degraded (11.538%), 8 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:44.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 bash[97234]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 bash[97234]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 bash[97234]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 bash[97234]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate[97248]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-16T09:53:44.438 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 bash[97234]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-16T09:53:44.439 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 podman[97234]: 2024-09-16 09:53:44.155267757 +0000 UTC m=+1.558050105 container died b95421174212141f5f490b12395f653ff505bc68aefdc7a2f30e2e9be67d210a (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-16T09:53:44.943 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 podman[97389]: 2024-09-16 09:53:44.691462534 +0000 UTC m=+0.529747733 container remove b95421174212141f5f490b12395f653ff505bc68aefdc7a2f30e2e9be67d210a (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, io.buildah.version=1.37.2) 2024-09-16T09:53:44.944 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 podman[97447]: 2024-09-16 09:53:44.8104035 +0000 UTC m=+0.016392402 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:53:44.944 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:44 smithi114 podman[97447]: 2024-09-16 09:53:44.942555641 +0000 UTC m=+0.148544576 container create 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-16T09:53:45.238 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:45 smithi114 podman[97447]: 2024-09-16 09:53:45.145054604 +0000 UTC m=+0.351043497 container init 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2) 2024-09-16T09:53:45.238 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:45 smithi114 podman[97447]: 2024-09-16 09:53:45.14838829 +0000 UTC m=+0.354377190 container start 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T09:53:45.238 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:45 smithi114 ceph-osd[97466]: -- 172.21.15.114:0/2675116090 <== mon.1 v2:172.21.15.114:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c7e42e1e0 con 0x558c7d5cdc00 2024-09-16T09:53:45.238 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:45 smithi114 bash[97447]: 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.423+0000 7f2934d79640 1 -- 172.21.15.111:0/53672707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930101930 msgr2=0x7f2930101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.423+0000 7f2934d79640 1 --2- 172.21.15.111:0/53672707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930101930 0x7f2930101d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2918009880 tx=0x7f291802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 -- 172.21.15.111:0/53672707 shutdown_connections 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 --2- 172.21.15.111:0/53672707 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930101930 0x7f2930101d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 --2- 172.21.15.111:0/53672707 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930107930 0x7f2930107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 -- 172.21.15.111:0/53672707 >> 172.21.15.111:0/53672707 conn(0x7f29300fd630 msgr2=0x7f29300ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 -- 172.21.15.111:0/53672707 shutdown_connections 2024-09-16T09:53:45.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 -- 172.21.15.111:0/53672707 wait complete. 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 Processor -- start 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.424+0000 7f2934d79640 1 -- start start 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2934d79640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930101930 0x7f293019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2934d79640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930107930 0x7f293019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2934d79640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f293010ee00 con 0x7f2930107930 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2934d79640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f293010ec80 con 0x7f2930101930 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2927fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930107930 0x7f293019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f292e59c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930101930 0x7f293019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2927fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930107930 0x7f293019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36050/0 (socket says 172.21.15.111:36050) 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f2927fff640 1 -- 172.21.15.111:0/3290337257 learned_addr learned my addr 172.21.15.111:0/3290337257 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f292e59c640 1 -- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930107930 msgr2=0x7f293019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f292e59c640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930107930 0x7f293019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f292e59c640 1 -- 172.21.15.111:0/3290337257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2930197810 con 0x7f2930101930 2024-09-16T09:53:45.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f292e59c640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930101930 0x7f293019d690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f292000e970 tx=0x7f292000ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:45.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.425+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f292000cac0 con 0x7f2930101930 2024-09-16T09:53:45.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.426+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f292000cc60 con 0x7f2930101930 2024-09-16T09:53:45.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.426+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2930197b00 con 0x7f2930101930 2024-09-16T09:53:45.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.426+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29200047a0 con 0x7f2930101930 2024-09-16T09:53:45.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.426+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2930198060 con 0x7f2930101930 2024-09-16T09:53:45.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.427+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2930103070 con 0x7f2930101930 2024-09-16T09:53:45.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.427+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f2920004a50 con 0x7f2930101930 2024-09-16T09:53:45.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.428+0000 7f29277fe640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f291c07abf0 0x7f291c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:45.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.428+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7f292009e140 con 0x7f2930101930 2024-09-16T09:53:45.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.428+0000 7f2927fff640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f291c07abf0 0x7f291c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:45.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.428+0000 7f2927fff640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f291c07abf0 0x7f291c07d0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2930198b60 tx=0x7f29180058d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:45.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.432+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f2920069810 con 0x7f2930101930 2024-09-16T09:53:45.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.625+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2930198370 con 0x7f291c07abf0 2024-09-16T09:53:45.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.626+0000 7f29277fe640 1 -- 172.21.15.111:0/3290337257 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f2930198370 con 0x7f291c07abf0 2024-09-16T09:53:45.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.628+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f291c07abf0 msgr2=0x7f291c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.628+0000 7f2934d79640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f291c07abf0 0x7f291c07d0b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2930198b60 tx=0x7f29180058d0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.628+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930101930 msgr2=0x7f293019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.628+0000 7f2934d79640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930101930 0x7f293019d690 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f292000e970 tx=0x7f292000ee30 comp rx=0 tx=0).stop 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.628+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 shutdown_connections 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.629+0000 7f2934d79640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f291c07abf0 0x7f291c07d0b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.629+0000 7f2934d79640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2930107930 0x7f293019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.629+0000 7f2934d79640 1 --2- 172.21.15.111:0/3290337257 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2930101930 0x7f293019d690 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.629+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 >> 172.21.15.111:0/3290337257 conn(0x7f29300fd630 msgr2=0x7f29300fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.629+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 shutdown_connections 2024-09-16T09:53:45.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.629+0000 7f2934d79640 1 -- 172.21.15.111:0/3290337257 wait complete. 2024-09-16T09:53:45.639 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:53:45.687 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:45 smithi114 systemd[1]: Started Ceph osd.5 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 -- 172.21.15.111:0/2977771338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100bb0 msgr2=0x7f2b0c104c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 --2- 172.21.15.111:0/2977771338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100bb0 0x7f2b0c104c00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2afc009880 tx=0x7f2afc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 -- 172.21.15.111:0/2977771338 shutdown_connections 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 --2- 172.21.15.111:0/2977771338 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100bb0 0x7f2b0c104c00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 --2- 172.21.15.111:0/2977771338 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b0c100200 0x7f2b0c1005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 -- 172.21.15.111:0/2977771338 >> 172.21.15.111:0/2977771338 conn(0x7f2b0c0fbc60 msgr2=0x7f2b0c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 -- 172.21.15.111:0/2977771338 shutdown_connections 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.711+0000 7f2b144bc640 1 -- 172.21.15.111:0/2977771338 wait complete. 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b144bc640 1 Processor -- start 2024-09-16T09:53:45.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b144bc640 1 -- start start 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b144bc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 0x7f2b0c196670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b144bc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b0c100bb0 0x7f2b0c196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b144bc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c10d460 con 0x7f2b0c100200 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b144bc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c10d2e0 con 0x7f2b0c100bb0 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b12258640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 0x7f2b0c196670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b12258640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 0x7f2b0c196670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36072/0 (socket says 172.21.15.111:36072) 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.712+0000 7f2b12258640 1 -- 172.21.15.111:0/489159437 learned_addr learned my addr 172.21.15.111:0/489159437 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b11a57640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b0c100bb0 0x7f2b0c196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b12258640 1 -- 172.21.15.111:0/489159437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b0c100bb0 msgr2=0x7f2b0c196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b12258640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b0c100bb0 0x7f2b0c196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b12258640 1 -- 172.21.15.111:0/489159437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c1970f0 con 0x7f2b0c100200 2024-09-16T09:53:45.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b12258640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 0x7f2b0c196670 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c8a0 tx=0x7f2b0800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:45.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b080079b0 con 0x7f2b0c100200 2024-09-16T09:53:45.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b08007b50 con 0x7f2b0c100200 2024-09-16T09:53:45.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c1973e0 con 0x7f2b0c100200 2024-09-16T09:53:45.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b08018700 con 0x7f2b0c100200 2024-09-16T09:53:45.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.713+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c1a3eb0 con 0x7f2b0c100200 2024-09-16T09:53:45.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.714+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c1016e0 con 0x7f2b0c100200 2024-09-16T09:53:45.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.715+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f2b08007d00 con 0x7f2b0c100200 2024-09-16T09:53:45.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.715+0000 7f2b037fe640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2af807abf0 0x7f2af807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:45.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.716+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7f2b0809df00 con 0x7f2b0c100200 2024-09-16T09:53:45.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.716+0000 7f2b11a57640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2af807abf0 0x7f2af807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:45.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.716+0000 7f2b11a57640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2af807abf0 0x7f2af807d0b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c1987d0 tx=0x7f2afc031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:45.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.720+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f2b08014030 con 0x7f2b0c100200 2024-09-16T09:53:45.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.912+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2b0c1042f0 con 0x7f2af807abf0 2024-09-16T09:53:45.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.913+0000 7f2b037fe640 1 -- 172.21.15.111:0/489159437 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f2b0c1042f0 con 0x7f2af807abf0 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2af807abf0 msgr2=0x7f2af807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2af807abf0 0x7f2af807d0b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c1987d0 tx=0x7f2afc031400 comp rx=0 tx=0).stop 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 msgr2=0x7f2b0c196670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 0x7f2b0c196670 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800c8a0 tx=0x7f2b0800cd60 comp rx=0 tx=0).stop 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 shutdown_connections 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2af807abf0 0x7f2af807d0b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2b0c100bb0 0x7f2b0c196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 --2- 172.21.15.111:0/489159437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b0c100200 0x7f2b0c196670 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:45.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 >> 172.21.15.111:0/489159437 conn(0x7f2b0c0fbc60 msgr2=0x7f2b0c103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:45.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 shutdown_connections 2024-09-16T09:53:45.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.916+0000 7f2b144bc640 1 -- 172.21.15.111:0/489159437 wait complete. 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 -- 172.21.15.111:0/2682381730 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 msgr2=0x7f7abc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 --2- 172.21.15.111:0/2682381730 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc106c00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009880 tx=0x7f7aac02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 -- 172.21.15.111:0/2682381730 shutdown_connections 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 --2- 172.21.15.111:0/2682381730 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 0x7f7abc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 --2- 172.21.15.111:0/2682381730 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc106c00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 -- 172.21.15.111:0/2682381730 >> 172.21.15.111:0/2682381730 conn(0x7f7abc0fc520 msgr2=0x7f7abc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 -- 172.21.15.111:0/2682381730 shutdown_connections 2024-09-16T09:53:46.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.998+0000 7f7ac1582640 1 -- 172.21.15.111:0/2682381730 wait complete. 2024-09-16T09:53:46.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7ac1582640 1 Processor -- start 2024-09-16T09:53:46.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7ac1582640 1 -- start start 2024-09-16T09:53:46.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7ac1582640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 0x7f7abc198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7ac1582640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7ac1582640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc10dcf0 con 0x7f7abc106820 2024-09-16T09:53:46.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7ac1582640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc10db70 con 0x7f7abc100820 2024-09-16T09:53:46.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7aba7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7aba7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36082/0 (socket says 172.21.15.111:36082) 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7aba7fc640 1 -- 172.21.15.111:0/1746094684 learned_addr learned my addr 172.21.15.111:0/1746094684 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7abaffd640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 0x7f7abc198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:45.999+0000 7f7aba7fc640 1 -- 172.21.15.111:0/1746094684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 msgr2=0x7f7abc198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7aba7fc640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 0x7f7abc198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7aba7fc640 1 -- 172.21.15.111:0/1746094684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc199380 con 0x7f7abc106820 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7abaffd640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 0x7f7abc198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7aba7fc640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc198d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e970 tx=0x7f7aa400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7aa400cac0 con 0x7f7abc106820 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc199670 con 0x7f7abc106820 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7aa40054e0 con 0x7f7abc106820 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7aa4010430 con 0x7f7abc106820 2024-09-16T09:53:46.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.000+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc1a1c70 con 0x7f7abc106820 2024-09-16T09:53:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.001+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7abc101f60 con 0x7f7abc106820 2024-09-16T09:53:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.002+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f7aa4004ee0 con 0x7f7abc106820 2024-09-16T09:53:46.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.002+0000 7f7ab3fff640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7aa807abf0 0x7f7aa807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.003+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7f7aa409e390 con 0x7f7abc106820 2024-09-16T09:53:46.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.003+0000 7f7abaffd640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7aa807abf0 0x7f7aa807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.003+0000 7f7abaffd640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7aa807abf0 0x7f7aa807d0b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0096c0 tx=0x7f7aac031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.007+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f7abc199670 con 0x7f7abc106820 2024-09-16T09:53:46.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.193+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7abc062630 con 0x7f7aa807abf0 2024-09-16T09:53:46.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.202+0000 7f7ab3fff640 1 -- 172.21.15.111:0/1746094684 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f7abc062630 con 0x7f7aa807abf0 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (4m) 95s ago 15m 20.6M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (7m) 95s ago 15m 8946k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (6m) 30s ago 15m 8535k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (3m) 95s ago 15m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (3m) 30s ago 14m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (4m) 95s ago 15m 76.4M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (10m) 95s ago 10m 148M - 19.1.1-328-gad35db06 b5388489f99e f951c6449095 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (10m) 95s ago 10m 18.9M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (10m) 30s ago 10m 20.7M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (10m) 30s ago 10m 20.4M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:53:46.204 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (6m) 95s ago 16m 524M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (5m) 30s ago 14m 456M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (3m) 95s ago 17m 45.3M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (3m) 30s ago 14m 37.5M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (5m) 95s ago 15m 11.1M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (5m) 30s ago 14m 10.5M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (2m) 95s ago 13m 104M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (2m) 95s ago 13m 150M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (101s) 95s ago 12m 12.1M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (66s) 30s ago 12m 100M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (33s) 30s ago 11m 14.5M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 52420a54759b 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 starting - - - 2240M 2024-09-16T09:53:46.205 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (5m) 95s ago 15m 52.5M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:53:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7aa807abf0 msgr2=0x7f7aa807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7aa807abf0 0x7f7aa807d0b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0096c0 tx=0x7f7aac031400 comp rx=0 tx=0).stop 2024-09-16T09:53:46.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 msgr2=0x7f7abc198d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc198d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e970 tx=0x7f7aa400ed70 comp rx=0 tx=0).stop 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 shutdown_connections 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7aa807abf0 0x7f7aa807d0b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7abc106820 0x7f7abc198d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 --2- 172.21.15.111:0/1746094684 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7abc100820 0x7f7abc198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 >> 172.21.15.111:0/1746094684 conn(0x7f7abc0fc520 msgr2=0x7f7abc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 shutdown_connections 2024-09-16T09:53:46.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.205+0000 7f7ac1582640 1 -- 172.21.15.111:0/1746094684 wait complete. 2024-09-16T09:53:46.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 -- 172.21.15.111:0/2582703308 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4107930 msgr2=0x7f5bf4107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 --2- 172.21.15.111:0/2582703308 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4107930 0x7f5bf4107d10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009880 tx=0x7f5be402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 -- 172.21.15.111:0/2582703308 shutdown_connections 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 --2- 172.21.15.111:0/2582703308 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4101930 0x7f5bf4101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 --2- 172.21.15.111:0/2582703308 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4107930 0x7f5bf4107d10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 -- 172.21.15.111:0/2582703308 >> 172.21.15.111:0/2582703308 conn(0x7f5bf40fd630 msgr2=0x7f5bf40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 -- 172.21.15.111:0/2582703308 shutdown_connections 2024-09-16T09:53:46.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.284+0000 7f5bfa310640 1 -- 172.21.15.111:0/2582703308 wait complete. 2024-09-16T09:53:46.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.285+0000 7f5bfa310640 1 Processor -- start 2024-09-16T09:53:46.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.285+0000 7f5bfa310640 1 -- start start 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.285+0000 7f5bfa310640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4101930 0x7f5bf40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.285+0000 7f5bfa310640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4107930 0x7f5bf4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.285+0000 7f5bfa310640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf410ee00 con 0x7f5bf4101930 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.285+0000 7f5bfa310640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5bf410ec80 con 0x7f5bf4107930 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4101930 0x7f5bf40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4101930 0x7f5bf40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36104/0 (socket says 172.21.15.111:36104) 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf3fff640 1 -- 172.21.15.111:0/1951423061 learned_addr learned my addr 172.21.15.111:0/1951423061 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf37fe640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4107930 0x7f5bf4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf37fe640 1 -- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4101930 msgr2=0x7f5bf40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf37fe640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4101930 0x7f5bf40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf37fe640 1 -- 172.21.15.111:0/1951423061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bf4074f70 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf37fe640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4107930 0x7f5bf4074a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5be800e970 tx=0x7f5be800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5be800cac0 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bf4075260 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5be800cc60 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5be80047a0 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.286+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bf41a3e70 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.288+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bf4103070 con 0x7f5bf4107930 2024-09-16T09:53:46.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.288+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f5be80049a0 con 0x7f5bf4107930 2024-09-16T09:53:46.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.289+0000 7f5bf17fa640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5bdc07ac40 0x7f5bdc07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.289+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7f5be809e070 con 0x7f5bf4107930 2024-09-16T09:53:46.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.289+0000 7f5bf3fff640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5bdc07ac40 0x7f5bdc07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.289+0000 7f5bf3fff640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5bdc07ac40 0x7f5bdc07d100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009230 tx=0x7f5be40058d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.297+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f5be80697c0 con 0x7f5bf4107930 2024-09-16T09:53:46.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.540+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5bf4109ea0 con 0x7f5bf4107930 2024-09-16T09:53:46.542 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:46.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:46.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:46.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:46.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:46.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:46.543 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:46 smithi111 ceph-mon[109885]: pgmap v230: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.541+0000 7f5bf17fa640 1 -- 172.21.15.111:0/1951423061 <== mon.1 v2:172.21.15.114:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+730 (secure 0 0 0) 0x7f5be806e670 con 0x7f5bf4107930 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:53:46.544 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 5 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 4, 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 9 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:53:46.545 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5bdc07ac40 msgr2=0x7f5bdc07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5bdc07ac40 0x7f5bdc07d100 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009230 tx=0x7f5be40058d0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4107930 msgr2=0x7f5bf4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4107930 0x7f5bf4074a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5be800e970 tx=0x7f5be800ee30 comp rx=0 tx=0).stop 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 shutdown_connections 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5bdc07ac40 0x7f5bdc07d100 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5bf4107930 0x7f5bf4074a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 --2- 172.21.15.111:0/1951423061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bf4101930 0x7f5bf40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 >> 172.21.15.111:0/1951423061 conn(0x7f5bf40fd630 msgr2=0x7f5bf40fdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 shutdown_connections 2024-09-16T09:53:46.547 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.543+0000 7f5bfa310640 1 -- 172.21.15.111:0/1951423061 wait complete. 2024-09-16T09:53:46.569 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:46.569 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:46.569 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:46.569 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:46.570 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:53:46.570 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:46.570 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-mon[79732]: pgmap v230: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:46.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 -- 172.21.15.111:0/556601363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 msgr2=0x7fac58106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/556601363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac58106bc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fac48009880 tx=0x7fac4802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 -- 172.21.15.111:0/556601363 shutdown_connections 2024-09-16T09:53:46.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/556601363 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac581007e0 0x7fac58100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/556601363 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac58106bc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 -- 172.21.15.111:0/556601363 >> 172.21.15.111:0/556601363 conn(0x7fac580fc4c0 msgr2=0x7fac580fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 -- 172.21.15.111:0/556601363 shutdown_connections 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.625+0000 7fac5e4aa640 1 -- 172.21.15.111:0/556601363 wait complete. 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac5e4aa640 1 Processor -- start 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac5e4aa640 1 -- start start 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac5e4aa640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac581007e0 0x7fac5819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac5e4aa640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac5819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac5e4aa640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fac5810dc90 con 0x7fac581067e0 2024-09-16T09:53:46.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac5e4aa640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fac5810db10 con 0x7fac581007e0 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac577fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac5819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac577fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac5819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36112/0 (socket says 172.21.15.111:36112) 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac577fe640 1 -- 172.21.15.111:0/3581479660 learned_addr learned my addr 172.21.15.111:0/3581479660 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.626+0000 7fac57fff640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac581007e0 0x7fac5819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac577fe640 1 -- 172.21.15.111:0/3581479660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac581007e0 msgr2=0x7fac5819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac577fe640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac581007e0 0x7fac5819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac577fe640 1 -- 172.21.15.111:0/3581479660 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac58197750 con 0x7fac581067e0 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac577fe640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac5819dbc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac4000d8d0 tx=0x7fac4000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac40017030 con 0x7fac581067e0 2024-09-16T09:53:46.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac58197a40 con 0x7fac581067e0 2024-09-16T09:53:46.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac40004020 con 0x7fac581067e0 2024-09-16T09:53:46.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac400047a0 con 0x7fac581067e0 2024-09-16T09:53:46.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.627+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac58197fa0 con 0x7fac581067e0 2024-09-16T09:53:46.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.628+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac58101f20 con 0x7fac581067e0 2024-09-16T09:53:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.629+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fac400041d0 con 0x7fac581067e0 2024-09-16T09:53:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.629+0000 7fac557fa640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fac4407abf0 0x7fac4407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.629+0000 7fac57fff640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fac4407abf0 0x7fac4407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.630+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7fac40018070 con 0x7fac581067e0 2024-09-16T09:53:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.630+0000 7fac57fff640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fac4407abf0 0x7fac4407d0b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac480096c0 tx=0x7fac48031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.634+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fac40069100 con 0x7fac581067e0 2024-09-16T09:53:46.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.848+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fac58198310 con 0x7fac581067e0 2024-09-16T09:53:46.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.848+0000 7fac557fa640 1 -- 172.21.15.111:0/3581479660 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2023 (secure 0 0 0) 0x7fac4006dfb0 con 0x7fac581067e0 2024-09-16T09:53:46.850 INFO:teuthology.orchestra.run.smithi111.stdout:e14 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:43:27:090244+0000 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 11 2024-09-16T09:53:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:43:23.011624+0000 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:53:46.852 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 0 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14550} 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:53:46.853 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14550 members: 14550 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:14550} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.111:6826/4028227545,v1:172.21.15.111:6827/4028227545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:46.854 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:46.855 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:53:46.855 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:53:46.855 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:14566} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:46.855 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:46.855 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:53:46.856 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:53:46.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.851+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fac4407abf0 msgr2=0x7fac4407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.851+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fac4407abf0 0x7fac4407d0b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fac480096c0 tx=0x7fac48031400 comp rx=0 tx=0).stop 2024-09-16T09:53:46.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.851+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 msgr2=0x7fac5819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.851+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac5819dbc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fac4000d8d0 tx=0x7fac4000dd90 comp rx=0 tx=0).stop 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 shutdown_connections 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fac4407abf0 0x7fac4407d0b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fac581067e0 0x7fac5819dbc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 --2- 172.21.15.111:0/3581479660 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fac581007e0 0x7fac5819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 >> 172.21.15.111:0/3581479660 conn(0x7fac580fc4c0 msgr2=0x7fac58069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 shutdown_connections 2024-09-16T09:53:46.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.852+0000 7fac5e4aa640 1 -- 172.21.15.111:0/3581479660 wait complete. 2024-09-16T09:53:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 -- 172.21.15.111:0/3946935461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 msgr2=0x7f1e90100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 --2- 172.21.15.111:0/3946935461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e90100c40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1e78009880 tx=0x7f1e7802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 -- 172.21.15.111:0/3946935461 shutdown_connections 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 --2- 172.21.15.111:0/3946935461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e90100c40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 --2- 172.21.15.111:0/3946935461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e901067e0 0x7f1e90106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 -- 172.21.15.111:0/3946935461 >> 172.21.15.111:0/3946935461 conn(0x7f1e900fc4c0 msgr2=0x7f1e900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 -- 172.21.15.111:0/3946935461 shutdown_connections 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 -- 172.21.15.111:0/3946935461 wait complete. 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.934+0000 7f1e96134640 1 Processor -- start 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e96134640 1 -- start start 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e96134640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e900fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e96134640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e901067e0 0x7f1e900fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e96134640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9010dcb0 con 0x7f1e901007e0 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e96134640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9010db30 con 0x7f1e901067e0 2024-09-16T09:53:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e900fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e900fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36138/0 (socket says 172.21.15.111:36138) 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 -- 172.21.15.111:0/912876050 learned_addr learned my addr 172.21.15.111:0/912876050 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e87fff640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e901067e0 0x7f1e900fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 -- 172.21.15.111:0/912876050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e901067e0 msgr2=0x7f1e900fd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e901067e0 0x7f1e900fd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 -- 172.21.15.111:0/912876050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e900fd6f0 con 0x7f1e901007e0 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8f7fe640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e900fcc70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000c8f0 tx=0x7f1e8000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.935+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e800079b0 con 0x7f1e901007e0 2024-09-16T09:53:46.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.936+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e800054e0 con 0x7f1e901007e0 2024-09-16T09:53:46.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.936+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e80004dd0 con 0x7f1e901007e0 2024-09-16T09:53:46.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.936+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e900fd9e0 con 0x7f1e901007e0 2024-09-16T09:53:46.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.936+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e901a3eb0 con 0x7f1e901007e0 2024-09-16T09:53:46.940 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:46 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:53:46.782+0000 7f82092c5640 -1 Falling back to public interface 2024-09-16T09:53:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.937+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e90101f20 con 0x7f1e901007e0 2024-09-16T09:53:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.937+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1e80005020 con 0x7f1e901007e0 2024-09-16T09:53:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.938+0000 7f1e8d7fa640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1e7c07ab90 0x7f1e7c07d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.938+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7f1e8009dca0 con 0x7f1e901007e0 2024-09-16T09:53:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.938+0000 7f1e87fff640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1e7c07ab90 0x7f1e7c07d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.939+0000 7f1e87fff640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1e7c07ab90 0x7f1e7c07d050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e900fe700 tx=0x7f1e78031420 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:46.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:46.942+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1e800a2070 con 0x7f1e901007e0 2024-09-16T09:53:47.137 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.136+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1e90062630 con 0x7f1e7c07ab90 2024-09-16T09:53:47.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.137+0000 7f1e8d7fa640 1 -- 172.21.15.111:0/912876050 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f1e90062630 con 0x7f1e7c07ab90 2024-09-16T09:53:47.138 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "11/23 daemons upgraded", 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading osd daemons", 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:53:47.139 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:53:47.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1e7c07ab90 msgr2=0x7f1e7c07d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:47.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1e7c07ab90 0x7f1e7c07d050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e900fe700 tx=0x7f1e78031420 comp rx=0 tx=0).stop 2024-09-16T09:53:47.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 msgr2=0x7f1e900fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:47.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e900fcc70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e8000c8f0 tx=0x7f1e8000cdb0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 shutdown_connections 2024-09-16T09:53:47.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1e7c07ab90 0x7f1e7c07d050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e901067e0 0x7f1e900fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 --2- 172.21.15.111:0/912876050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e901007e0 0x7f1e900fcc70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 >> 172.21.15.111:0/912876050 conn(0x7f1e900fc4c0 msgr2=0x7f1e90069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:47.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 shutdown_connections 2024-09-16T09:53:47.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.139+0000 7f1e96134640 1 -- 172.21.15.111:0/912876050 wait complete. 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 -- 172.21.15.111:0/4131357518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1007e0 msgr2=0x7f58cc100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/4131357518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1007e0 0x7f58cc100c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009880 tx=0x7f58b402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 -- 172.21.15.111:0/4131357518 shutdown_connections 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/4131357518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1007e0 0x7f58cc100c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/4131357518 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58cc1067e0 0x7f58cc106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 -- 172.21.15.111:0/4131357518 >> 172.21.15.111:0/4131357518 conn(0x7f58cc0fc4c0 msgr2=0x7f58cc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 -- 172.21.15.111:0/4131357518 shutdown_connections 2024-09-16T09:53:47.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.220+0000 7f58d0f9a640 1 -- 172.21.15.111:0/4131357518 wait complete. 2024-09-16T09:53:47.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58d0f9a640 1 Processor -- start 2024-09-16T09:53:47.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58d0f9a640 1 -- start start 2024-09-16T09:53:47.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58d0f9a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58cc1007e0 0x7f58cc1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:47.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58d0f9a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 0x7f58cc198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:47.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58d0f9a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc10dcb0 con 0x7f58cc1067e0 2024-09-16T09:53:47.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58d0f9a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f58cc10db30 con 0x7f58cc1007e0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 0x7f58cc198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 0x7f58cc198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:36144/0 (socket says 172.21.15.111:36144) 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 -- 172.21.15.111:0/30109242 learned_addr learned my addr 172.21.15.111:0/30109242 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58ca59c640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58cc1007e0 0x7f58cc1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 -- 172.21.15.111:0/30109242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58cc1007e0 msgr2=0x7f58cc1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58cc1007e0 0x7f58cc1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 -- 172.21.15.111:0/30109242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58cc199320 con 0x7f58cc1067e0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.221+0000 7f58c3fff640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 0x7f58cc198d20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58b4031460 tx=0x7f58b4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.222+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58b403f070 con 0x7f58cc1067e0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.222+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58b40035f0 con 0x7f58cc1067e0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.222+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58cc1995b0 con 0x7f58cc1067e0 2024-09-16T09:53:47.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.222+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58b4035030 con 0x7f58cc1067e0 2024-09-16T09:53:47.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.222+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58cc1a1b60 con 0x7f58cc1067e0 2024-09-16T09:53:47.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.223+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58cc101f20 con 0x7f58cc1067e0 2024-09-16T09:53:47.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.223+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f58b4042070 con 0x7f58cc1067e0 2024-09-16T09:53:47.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.224+0000 7f58c37fe640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f58b807ac40 0x7f58b807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:53:47.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.224+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 6360+0+0 (secure 0 0 0) 0x7f58b40be510 con 0x7f58cc1067e0 2024-09-16T09:53:47.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.224+0000 7f58ca59c640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f58b807ac40 0x7f58b807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:53:47.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.224+0000 7f58ca59c640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f58b807ac40 0x7f58b807d100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009bd0 tx=0x7f58bc005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:53:47.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.228+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f58b4089c60 con 0x7f58cc1067e0 2024-09-16T09:53:47.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.473+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f58cc108d50 con 0x7f58cc1067e0 2024-09-16T09:53:47.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:47 smithi111 ceph-mon[109885]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:47.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:47 smithi111 ceph-mon[109885]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:47.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:47 smithi111 ceph-mon[109885]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-16T09:53:47.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:47 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1951423061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:47.475 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:47 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3581479660' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:53:47.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.473+0000 7f58c37fe640 1 -- 172.21.15.111:0/30109242 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1076 (secure 0 0 0) 0x7f58b408eb10 con 0x7f58cc1067e0 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 35/234 objects degraded (14.957%), 11 pgs degraded 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: osd.5 (root=default,host=smithi114) is down 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/234 objects degraded (14.957%), 11 pgs degraded 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.f is active+undersized+degraded, acting [4,1] 2024-09-16T09:53:47.476 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-16T09:53:47.477 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-16T09:53:47.477 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.18 is active+undersized+degraded, acting [4,1] 2024-09-16T09:53:47.477 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-16T09:53:47.477 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-16T09:53:47.477 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-16T09:53:47.477 INFO:teuthology.orchestra.run.smithi111.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f58b807ac40 msgr2=0x7f58b807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f58b807ac40 0x7f58b807d100 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009bd0 tx=0x7f58bc005f90 comp rx=0 tx=0).stop 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 msgr2=0x7f58cc198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 0x7f58cc198d20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f58b4031460 tx=0x7f58b4004530 comp rx=0 tx=0).stop 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 shutdown_connections 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f58b807ac40 0x7f58b807d100 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f58cc1067e0 0x7f58cc198d20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 --2- 172.21.15.111:0/30109242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f58cc1007e0 0x7f58cc1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:53:47.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 >> 172.21.15.111:0/30109242 conn(0x7f58cc0fc4c0 msgr2=0x7f58cc0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:53:47.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 shutdown_connections 2024-09-16T09:53:47.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:53:47.476+0000 7f58d0f9a640 1 -- 172.21.15.111:0/30109242 wait complete. 2024-09-16T09:53:47.522 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:47 smithi114 ceph-mon[79732]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:47.523 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:47 smithi114 ceph-mon[79732]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:47.523 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:47 smithi114 ceph-mon[79732]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-09-16T09:53:47.523 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:47 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1951423061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:47.523 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:47 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3581479660' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:53:48.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:48 smithi111 ceph-mon[109885]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:48.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:48 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/30109242' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:53:48.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:48 smithi111 ceph-mon[109885]: pgmap v231: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:48.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:48.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:48 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:48.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:48 smithi114 ceph-mon[79732]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:53:48.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:48 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/30109242' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:53:48.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:48 smithi114 ceph-mon[79732]: pgmap v231: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:48.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:48.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:48 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:49.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:49 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:49.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:49 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:49.882 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:49 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:49.882 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:49 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:50.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:50 smithi111 ceph-mon[109885]: pgmap v232: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:50.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:50 smithi114 ceph-mon[79732]: pgmap v232: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:51.848 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:51 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 35/234 objects degraded (14.957%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:51.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:51 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 35/234 objects degraded (14.957%), 11 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: pgmap v233: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:52.828 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-16T09:53:52.829 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-16T09:53:52.830 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-16T09:53:52.830 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-16T09:53:52.830 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-16T09:53:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: pgmap v233: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 960 MiB used, 535 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:52.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-16T09:53:52.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-16T09:53:52.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-16T09:53:52.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-16T09:53:52.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-16T09:53:52.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-16T09:53:52.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-16T09:53:52.884 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:52 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-16T09:53:53.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:52 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:53:52.825+0000 7f82092c5640 -1 osd.5 82 log_to_monitors true 2024-09-16T09:53:53.869 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:53 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all osd 2024-09-16T09:53:53.869 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:53 smithi111 ceph-mon[109885]: from='osd.5 [v2:172.21.15.114:6816/2300268992,v1:172.21.15.114:6817/2300268992]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-16T09:53:53.869 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:53 smithi111 ceph-mon[109885]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-16T09:53:53.869 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:53 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:53.869 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:53 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.jnzoej", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:53:53.870 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:53 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:53.937 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:53:53.638+0000 7f820106f640 -1 osd.5 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-16T09:53:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all osd 2024-09-16T09:53:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-mon[79732]: from='osd.5 [v2:172.21.15.114:6816/2300268992,v1:172.21.15.114:6817/2300268992]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-16T09:53:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-mon[79732]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-16T09:53:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:53:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.jnzoej", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:53:53.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:53 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: Upgrade: Updating mds.cephfs.smithi111.jnzoej 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: Deploying daemon mds.cephfs.smithi111.jnzoej on smithi111 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: osdmap e85: 6 total, 5 up, 6 in 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: from='osd.5 [v2:172.21.15.114:6816/2300268992,v1:172.21.15.114:6817/2300268992]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:54.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:54 smithi111 ceph-mon[109885]: pgmap v235: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: Upgrade: Updating mds.cephfs.smithi111.jnzoej 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: Deploying daemon mds.cephfs.smithi111.jnzoej on smithi111 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: osdmap e85: 6 total, 5 up, 6 in 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: from='osd.5 [v2:172.21.15.114:6816/2300268992,v1:172.21.15.114:6817/2300268992]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi114", "root=default"]} : dispatch 2024-09-16T09:53:54.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:54 smithi114 ceph-mon[79732]: pgmap v235: 65 pgs: 18 active+undersized, 11 active+undersized+degraded, 36 active+clean; 219 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 35/234 objects degraded (14.957%) 2024-09-16T09:53:55.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[109881]: 2024-09-16T09:53:55.127+0000 7fdf8a73c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:53:55.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:53:55.186+0000 7f8c6ef1f640 -1 bdev(0x5556b3c66c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-16T09:53:55.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: osd.5 [v2:172.21.15.114:6816/2300268992,v1:172.21.15.114:6817/2300268992] boot 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: osdmap e86: 6 total, 6 up, 6 in 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: osdmap e87: 6 total, 6 up, 6 in 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: Standby daemon mds.cephfs.smithi111.yvusja assigned to filesystem cephfs as rank 0 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:53:55.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:55 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi111.yvusja=up:replay} 2 up:standby 2024-09-16T09:53:55.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-16T09:53:55.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: osd.5 [v2:172.21.15.114:6816/2300268992,v1:172.21.15.114:6817/2300268992] boot 2024-09-16T09:53:55.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: osdmap e86: 6 total, 6 up, 6 in 2024-09-16T09:53:55.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-16T09:53:55.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:53:55.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:53:55.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: osdmap e87: 6 total, 6 up, 6 in 2024-09-16T09:53:55.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: Standby daemon mds.cephfs.smithi111.yvusja assigned to filesystem cephfs as rank 0 2024-09-16T09:53:55.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:53:55.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:53:55.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:55 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi111.yvusja=up:replay} 2 up:standby 2024-09-16T09:53:56.647 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:56 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"} : dispatch 2024-09-16T09:53:56.647 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:56 smithi111 ceph-mon[109885]: pgmap v238: 65 pgs: 5 peering, 13 active+undersized, 9 active+undersized+degraded, 38 active+clean; 219 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 0 op/s; 30/234 objects degraded (12.821%) 2024-09-16T09:53:56.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:56 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"} : dispatch 2024-09-16T09:53:56.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:56 smithi114 ceph-mon[79732]: pgmap v238: 65 pgs: 5 peering, 13 active+undersized, 9 active+undersized+degraded, 38 active+clean; 219 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 0 op/s; 30/234 objects degraded (12.821%) 2024-09-16T09:53:57.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:57 smithi114 ceph-mon[79732]: Health check update: Degraded data redundancy: 30/234 objects degraded (12.821%), 9 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:57 smithi111 ceph-mon[109885]: Health check update: Degraded data redundancy: 30/234 objects degraded (12.821%), 9 pgs degraded (PG_DEGRADED) 2024-09-16T09:53:58.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:58 smithi114 ceph-mon[79732]: pgmap v239: 65 pgs: 5 peering, 13 active+undersized, 9 active+undersized+degraded, 38 active+clean; 219 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 0 op/s; 30/234 objects degraded (12.821%) 2024-09-16T09:53:59.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:58 smithi111 ceph-mon[109885]: pgmap v239: 65 pgs: 5 peering, 13 active+undersized, 9 active+undersized+degraded, 38 active+clean; 219 MiB data, 893 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 0 op/s; 30/234 objects degraded (12.821%) 2024-09-16T09:54:00.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:53:59 smithi111 ceph-mon[109885]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/234 objects degraded (12.821%), 9 pgs degraded) 2024-09-16T09:54:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:53:59 smithi114 ceph-mon[79732]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 30/234 objects degraded (12.821%), 9 pgs degraded) 2024-09-16T09:54:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:00 smithi111 ceph-mon[109885]: pgmap v240: 65 pgs: 5 peering, 60 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T09:54:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:00 smithi114 ceph-mon[79732]: pgmap v240: 65 pgs: 5 peering, 60 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T09:54:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:03.059 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:02 smithi111 ceph-mon[109885]: pgmap v241: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-09-16T09:54:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:02 smithi114 ceph-mon[79732]: pgmap v241: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: pgmap v242: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0.000999981 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0.000999981 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:boot 2024-09-16T09:54:04.516 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:reconnect 2024-09-16T09:54:04.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi111.yvusja=up:reconnect} 3 up:standby 2024-09-16T09:54:04.517 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:04 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"} : dispatch 2024-09-16T09:54:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: pgmap v242: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-16T09:54:04.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0.000999981 2024-09-16T09:54:04.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0.000999981 2024-09-16T09:54:04.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:boot 2024-09-16T09:54:04.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:reconnect 2024-09-16T09:54:04.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi111.yvusja=up:reconnect} 3 up:standby 2024-09-16T09:54:04.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:04 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.jnzoej"} : dispatch 2024-09-16T09:54:05.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:05 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:rejoin 2024-09-16T09:54:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:05 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi111.yvusja=up:rejoin} 3 up:standby 2024-09-16T09:54:05.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:05 smithi111 ceph-mon[109885]: daemon mds.cephfs.smithi111.yvusja is now active in filesystem cephfs as rank 0 2024-09-16T09:54:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:05 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:rejoin 2024-09-16T09:54:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:05 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi111.yvusja=up:rejoin} 3 up:standby 2024-09-16T09:54:06.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:05 smithi114 ceph-mon[79732]: daemon mds.cephfs.smithi111.yvusja is now active in filesystem cephfs as rank 0 2024-09-16T09:54:07.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:06 smithi111 ceph-mon[109885]: pgmap v243: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:54:07.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:06 smithi111 ceph-mon[109885]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:54:07.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:06 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:active 2024-09-16T09:54:07.042 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:06 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.yvusja=up:active} 3 up:standby 2024-09-16T09:54:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:06 smithi114 ceph-mon[79732]: pgmap v243: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:54:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:06 smithi114 ceph-mon[79732]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:54:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:06 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] up:active 2024-09-16T09:54:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:06 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi111.yvusja=up:active} 3 up:standby 2024-09-16T09:54:09.110 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:08 smithi111 ceph-mon[109885]: pgmap v244: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T09:54:09.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:08 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:08 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:08 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.111 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:08 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:08 smithi114 ceph-mon[79732]: pgmap v244: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T09:54:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:08 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:08 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:08 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:08 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:10 smithi111 ceph-mon[109885]: pgmap v245: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:10 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:10 smithi114 ceph-mon[79732]: pgmap v245: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-16T09:54:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:10 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:13.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:12 smithi111 ceph-mon[109885]: pgmap v246: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-16T09:54:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:12 smithi114 ceph-mon[79732]: pgmap v246: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-16T09:54:15.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:14 smithi111 ceph-mon[109885]: pgmap v247: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 5.3 KiB/s wr, 7 op/s 2024-09-16T09:54:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:14 smithi114 ceph-mon[79732]: pgmap v247: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 5.7 MiB/s rd, 5.3 KiB/s wr, 7 op/s 2024-09-16T09:54:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:16 smithi111 ceph-mon[109885]: pgmap v248: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-16T09:54:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:16 smithi114 ceph-mon[79732]: pgmap v248: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-16T09:54:17.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.563+0000 7f1b59a09640 1 -- 172.21.15.111:0/1932054898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 msgr2=0x7f1b54106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.563+0000 7f1b59a09640 1 --2- 172.21.15.111:0/1932054898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b54106bc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009880 tx=0x7f1b4402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 -- 172.21.15.111:0/1932054898 shutdown_connections 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 --2- 172.21.15.111:0/1932054898 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b541007e0 0x7f1b54100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 --2- 172.21.15.111:0/1932054898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b54106bc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 -- 172.21.15.111:0/1932054898 >> 172.21.15.111:0/1932054898 conn(0x7f1b540fc4c0 msgr2=0x7f1b540fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 -- 172.21.15.111:0/1932054898 shutdown_connections 2024-09-16T09:54:17.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 -- 172.21.15.111:0/1932054898 wait complete. 2024-09-16T09:54:17.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.564+0000 7f1b59a09640 1 Processor -- start 2024-09-16T09:54:17.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b59a09640 1 -- start start 2024-09-16T09:54:17.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b59a09640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b541007e0 0x7f1b540fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:17.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b59a09640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b540fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:17.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b59a09640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5410dd10 con 0x7f1b541067e0 2024-09-16T09:54:17.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b59a09640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5410db90 con 0x7f1b541007e0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b540fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b540fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44228/0 (socket says 172.21.15.111:44228) 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 -- 172.21.15.111:0/3033416866 learned_addr learned my addr 172.21.15.111:0/3033416866 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b52ffd640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b541007e0 0x7f1b540fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 -- 172.21.15.111:0/3033416866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b541007e0 msgr2=0x7f1b540fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b541007e0 0x7f1b540fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 -- 172.21.15.111:0/3033416866 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b540fd6c0 con 0x7f1b541067e0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b527fc640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b540fd180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b420 tx=0x7f1b4800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b48011630 con 0x7f1b541067e0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.565+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b48016070 con 0x7f1b541067e0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.566+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b540fd9b0 con 0x7f1b541067e0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.566+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b48010d40 con 0x7f1b541067e0 2024-09-16T09:54:17.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.566+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b541a3e80 con 0x7f1b541067e0 2024-09-16T09:54:17.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.566+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b54101f20 con 0x7f1b541067e0 2024-09-16T09:54:17.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.567+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1b4801b460 con 0x7f1b541067e0 2024-09-16T09:54:17.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.568+0000 7f1b58a07640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b3c07abf0 0x7f1b3c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:17.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.568+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7f1b4809d510 con 0x7f1b541067e0 2024-09-16T09:54:17.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.568+0000 7f1b52ffd640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b3c07abf0 0x7f1b3c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:17.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.568+0000 7f1b52ffd640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b3c07abf0 0x7f1b3c07d0b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b440096c0 tx=0x7f1b44031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:17.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.572+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1b48021250 con 0x7f1b541067e0 2024-09-16T09:54:17.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.767+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b54062630 con 0x7f1b3c07abf0 2024-09-16T09:54:17.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.768+0000 7f1b58a07640 1 -- 172.21.15.111:0/3033416866 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f1b54062630 con 0x7f1b3c07abf0 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b3c07abf0 msgr2=0x7f1b3c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b3c07abf0 0x7f1b3c07d0b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b440096c0 tx=0x7f1b44031400 comp rx=0 tx=0).stop 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 msgr2=0x7f1b540fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b540fd180 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b4800b420 tx=0x7f1b4800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 shutdown_connections 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1b3c07abf0 0x7f1b3c07d0b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1b541067e0 0x7f1b540fd180 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 --2- 172.21.15.111:0/3033416866 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1b541007e0 0x7f1b540fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 >> 172.21.15.111:0/3033416866 conn(0x7f1b540fc4c0 msgr2=0x7f1b54069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:17.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 shutdown_connections 2024-09-16T09:54:17.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.770+0000 7f1b59a09640 1 -- 172.21.15.111:0/3033416866 wait complete. 2024-09-16T09:54:17.782 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:17.783 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.784 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:17 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 -- 172.21.15.111:0/988947215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 msgr2=0x7fbca0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 --2- 172.21.15.111:0/988947215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0106c00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009880 tx=0x7fbc9002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 -- 172.21.15.111:0/988947215 shutdown_connections 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 --2- 172.21.15.111:0/988947215 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0100820 0x7fbca0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 --2- 172.21.15.111:0/988947215 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0106c00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 -- 172.21.15.111:0/988947215 >> 172.21.15.111:0/988947215 conn(0x7fbca00fc520 msgr2=0x7fbca00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.857+0000 7fbca6981640 1 -- 172.21.15.111:0/988947215 shutdown_connections 2024-09-16T09:54:17.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.858+0000 7fbca6981640 1 -- 172.21.15.111:0/988947215 wait complete. 2024-09-16T09:54:17.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.858+0000 7fbca6981640 1 Processor -- start 2024-09-16T09:54:17.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.858+0000 7fbca6981640 1 -- start start 2024-09-16T09:54:17.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.858+0000 7fbca6981640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0100820 0x7fbca0107750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:17.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.858+0000 7fbca6981640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0107c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:17.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.858+0000 7fbca6981640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010dcd0 con 0x7fbca0106820 2024-09-16T09:54:17.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbca6981640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbca010db50 con 0x7fbca0100820 2024-09-16T09:54:17.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0107c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0107c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44240/0 (socket says 172.21.15.111:44240) 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 -- 172.21.15.111:0/3771055315 learned_addr learned my addr 172.21.15.111:0/3771055315 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9ffff640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0100820 0x7fbca0107750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 -- 172.21.15.111:0/3771055315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0100820 msgr2=0x7fbca0107750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0100820 0x7fbca0107750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 -- 172.21.15.111:0/3771055315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca01081d0 con 0x7fbca0106820 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9f7fe640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0107c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400c8a0 tx=0x7fbc9400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc940079b0 con 0x7fbca0106820 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca01084c0 con 0x7fbca0106820 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc94007b50 con 0x7fbca0106820 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.859+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc94018700 con 0x7fbca0106820 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.860+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca01a3e40 con 0x7fbca0106820 2024-09-16T09:54:17.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.860+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca0101f60 con 0x7fbca0106820 2024-09-16T09:54:17.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.861+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fbc94007d00 con 0x7fbca0106820 2024-09-16T09:54:17.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.862+0000 7fbc9d7fa640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc8807abf0 0x7fbc8807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:17.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.862+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7fbc9409dfb0 con 0x7fbca0106820 2024-09-16T09:54:17.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.862+0000 7fbc9ffff640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc8807abf0 0x7fbc8807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:17.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.863+0000 7fbc9ffff640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc8807abf0 0x7fbc8807d0b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc90000c00 tx=0x7fbc90031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:17.866+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fbc94014030 con 0x7fbca0106820 2024-09-16T09:54:17.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:17.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:17.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:17.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:54:17.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:17.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:17.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:17.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:17 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:18.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.067+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbca006aad0 con 0x7fbc8807abf0 2024-09-16T09:54:18.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.069+0000 7fbc9d7fa640 1 -- 172.21.15.111:0/3771055315 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbca006aad0 con 0x7fbc8807abf0 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc8807abf0 msgr2=0x7fbc8807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc8807abf0 0x7fbc8807d0b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbc90000c00 tx=0x7fbc90031400 comp rx=0 tx=0).stop 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 msgr2=0x7fbca0107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0107c90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400c8a0 tx=0x7fbc9400cd60 comp rx=0 tx=0).stop 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 shutdown_connections 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc8807abf0 0x7fbc8807d0b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbca0106820 0x7fbca0107c90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 --2- 172.21.15.111:0/3771055315 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbca0100820 0x7fbca0107750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 >> 172.21.15.111:0/3771055315 conn(0x7fbca00fc520 msgr2=0x7fbca006a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:18.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 shutdown_connections 2024-09-16T09:54:18.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.072+0000 7fbca6981640 1 -- 172.21.15.111:0/3771055315 wait complete. 2024-09-16T09:54:18.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.159+0000 7effe99f2640 1 -- 172.21.15.111:0/3317324386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41007e0 msgr2=0x7effe4100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.159+0000 7effe99f2640 1 --2- 172.21.15.111:0/3317324386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41007e0 0x7effe4100c40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7effcc009880 tx=0x7effcc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.159+0000 7effe99f2640 1 -- 172.21.15.111:0/3317324386 shutdown_connections 2024-09-16T09:54:18.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.159+0000 7effe99f2640 1 --2- 172.21.15.111:0/3317324386 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41007e0 0x7effe4100c40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.159+0000 7effe99f2640 1 --2- 172.21.15.111:0/3317324386 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41067e0 0x7effe4106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.159+0000 7effe99f2640 1 -- 172.21.15.111:0/3317324386 >> 172.21.15.111:0/3317324386 conn(0x7effe40fc4c0 msgr2=0x7effe40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 -- 172.21.15.111:0/3317324386 shutdown_connections 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 -- 172.21.15.111:0/3317324386 wait complete. 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 Processor -- start 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 -- start start 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41007e0 0x7effe419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 0x7effe419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7effe410dcb0 con 0x7effe41067e0 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.160+0000 7effe99f2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7effe410db30 con 0x7effe41007e0 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 0x7effe419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 0x7effe419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44244/0 (socket says 172.21.15.111:44244) 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 -- 172.21.15.111:0/2667507147 learned_addr learned my addr 172.21.15.111:0/2667507147 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe2ffd640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41007e0 0x7effe419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 -- 172.21.15.111:0/2667507147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41007e0 msgr2=0x7effe419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41007e0 0x7effe419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 -- 172.21.15.111:0/2667507147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe41977e0 con 0x7effe41067e0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe2ffd640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41007e0 0x7effe419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe27fc640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 0x7effe419dba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7effcc031460 tx=0x7effcc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effcc03f070 con 0x7effe41067e0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe4197a70 con 0x7effe41067e0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7effcc0035f0 con 0x7effe41067e0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7effcc035030 con 0x7effe41067e0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.161+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe4197fa0 con 0x7effe41067e0 2024-09-16T09:54:18.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.162+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe4101f20 con 0x7effe41067e0 2024-09-16T09:54:18.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.163+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7effcc042070 con 0x7effe41067e0 2024-09-16T09:54:18.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.163+0000 7effe89f0640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7effd007abf0 0x7effd007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.163+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7effcc0be6d0 con 0x7effe41067e0 2024-09-16T09:54:18.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.163+0000 7effe2ffd640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7effd007abf0 0x7effd007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.164+0000 7effe2ffd640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7effd007abf0 0x7effd007d0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7effd4009c20 tx=0x7effd4005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:18.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.168+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7effcc089d50 con 0x7effe41067e0 2024-09-16T09:54:18.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.356+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7effe4198250 con 0x7effd007abf0 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.365+0000 7effe89f0640 1 -- 172.21.15.111:0/2667507147 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7effe4198250 con 0x7effd007abf0 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (5m) 10s ago 16m 20.6M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (7m) 10s ago 16m 9114k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (7m) 30s ago 15m 8590k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (3m) 10s ago 16m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (3m) 30s ago 15m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:54:18.368 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (5m) 10s ago 16m 75.2M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (15s) 10s ago 11m 11.9M - 19.3.0-4882-g66e33d6a 261f2dc7b20f cf8efae733d5 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (10m) 10s ago 10m 149M - 19.1.1-328-gad35db06 b5388489f99e 043420659d6b 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (11m) 30s ago 11m 20.9M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (10m) 30s ago 10m 20.7M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (7m) 10s ago 17m 527M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (6m) 30s ago 15m 457M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (4m) 10s ago 17m 51.5M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (3m) 30s ago 15m 38.9M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (6m) 10s ago 16m 12.1M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (6m) 30s ago 15m 10.2M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (3m) 10s ago 14m 110M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (2m) 10s ago 13m 140M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:54:18.369 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (2m) 10s ago 13m 95.6M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:54:18.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (98s) 30s ago 12m 102M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:54:18.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (65s) 30s ago 12m 98.2M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 52420a54759b 2024-09-16T09:54:18.370 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (33s) 30s ago 12m 14.4M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 94a0d154c08f 2024-09-16T09:54:18.370 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (5m) 10s ago 15m 56.8M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7effd007abf0 msgr2=0x7effd007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7effd007abf0 0x7effd007d0b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7effd4009c20 tx=0x7effd4005f90 comp rx=0 tx=0).stop 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 msgr2=0x7effe419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 0x7effe419dba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7effcc031460 tx=0x7effcc004530 comp rx=0 tx=0).stop 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 shutdown_connections 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7effd007abf0 0x7effd007d0b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effe41067e0 0x7effe419dba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 --2- 172.21.15.111:0/2667507147 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7effe41007e0 0x7effe419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 >> 172.21.15.111:0/2667507147 conn(0x7effe40fc4c0 msgr2=0x7effe4104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:18.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 shutdown_connections 2024-09-16T09:54:18.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.368+0000 7effe99f2640 1 -- 172.21.15.111:0/2667507147 wait complete. 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/1694844275 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081067e0 msgr2=0x7f1e08106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/1694844275 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081067e0 0x7f1e08106bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1df8009880 tx=0x7f1df802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/1694844275 shutdown_connections 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/1694844275 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e081007e0 0x7f1e08100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/1694844275 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081067e0 0x7f1e08106bc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/1694844275 >> 172.21.15.111:0/1694844275 conn(0x7f1e080fc4c0 msgr2=0x7f1e080fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/1694844275 shutdown_connections 2024-09-16T09:54:18.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.449+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/1694844275 wait complete. 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.450+0000 7f1e0d5b5640 1 Processor -- start 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.450+0000 7f1e0d5b5640 1 -- start start 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.450+0000 7f1e0d5b5640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 0x7f1e08196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.450+0000 7f1e0d5b5640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e081067e0 0x7f1e08196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.450+0000 7f1e0d5b5640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0810dcb0 con 0x7f1e081007e0 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.450+0000 7f1e0d5b5640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0810db30 con 0x7f1e081067e0 2024-09-16T09:54:18.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 0x7f1e08196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 0x7f1e08196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44274/0 (socket says 172.21.15.111:44274) 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 -- 172.21.15.111:0/4183621484 learned_addr learned my addr 172.21.15.111:0/4183621484 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e067fc640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e081067e0 0x7f1e08196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 -- 172.21.15.111:0/4183621484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e081067e0 msgr2=0x7f1e08196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e081067e0 0x7f1e08196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 -- 172.21.15.111:0/4183621484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08197090 con 0x7f1e081007e0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e06ffd640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 0x7f1e08196610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1df8031460 tx=0x7f1df80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1df803f070 con 0x7f1e081007e0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e08197320 con 0x7f1e081007e0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1df80035f0 con 0x7f1e081007e0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e081a3e50 con 0x7f1e081007e0 2024-09-16T09:54:18.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.451+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1df8035030 con 0x7f1e081007e0 2024-09-16T09:54:18.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.452+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e08101f20 con 0x7f1e081007e0 2024-09-16T09:54:18.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.453+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1df8042070 con 0x7f1e081007e0 2024-09-16T09:54:18.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.454+0000 7f1deffff640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1df007abf0 0x7f1df007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.454+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7f1df80be750 con 0x7f1e081007e0 2024-09-16T09:54:18.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.454+0000 7f1e067fc640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1df007abf0 0x7f1df007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.455+0000 7f1e067fc640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1df007abf0 0x7f1df007d0b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005fd0 tx=0x7f1dfc005850 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:18.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.459+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1df8089d70 con 0x7f1e081007e0 2024-09-16T09:54:18.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.711+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1e08108d50 con 0x7f1e081007e0 2024-09-16T09:54:18.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.711+0000 7f1deffff640 1 -- 172.21.15.111:0/4183621484 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f1df808ec20 con 0x7f1e081007e0 2024-09-16T09:54:18.714 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:54:18.714 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:54:18.714 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:54:18.714 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:18.714 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 6 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 3, 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 1 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 3, 2024-09-16T09:54:18.715 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 11 2024-09-16T09:54:18.716 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:54:18.716 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1df007abf0 msgr2=0x7f1df007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1df007abf0 0x7f1df007d0b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005fd0 tx=0x7f1dfc005850 comp rx=0 tx=0).stop 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 msgr2=0x7f1e08196610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 0x7f1e08196610 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1df8031460 tx=0x7f1df80045e0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 shutdown_connections 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1df007abf0 0x7f1df007d0b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1e081067e0 0x7f1e08196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 --2- 172.21.15.111:0/4183621484 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e081007e0 0x7f1e08196610 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.713+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 >> 172.21.15.111:0/4183621484 conn(0x7f1e080fc4c0 msgr2=0x7f1e080fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.714+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 shutdown_connections 2024-09-16T09:54:18.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.714+0000 7f1e0d5b5640 1 -- 172.21.15.111:0/4183621484 wait complete. 2024-09-16T09:54:18.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 -- 172.21.15.111:0/3459104205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc101910 msgr2=0x7f41fc101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.801 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 --2- 172.21.15.111:0/3459104205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc101910 0x7f41fc101d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009880 tx=0x7f41e402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 -- 172.21.15.111:0/3459104205 shutdown_connections 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 --2- 172.21.15.111:0/3459104205 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc101910 0x7f41fc101d70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 --2- 172.21.15.111:0/3459104205 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41fc107910 0x7f41fc107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 -- 172.21.15.111:0/3459104205 >> 172.21.15.111:0/3459104205 conn(0x7f41fc0fd5f0 msgr2=0x7f41fc0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 -- 172.21.15.111:0/3459104205 shutdown_connections 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.798+0000 7f42020b6640 1 -- 172.21.15.111:0/3459104205 wait complete. 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f42020b6640 1 Processor -- start 2024-09-16T09:54:18.802 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f42020b6640 1 -- start start 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f42020b6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41fc101910 0x7f41fc19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f42020b6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 0x7f41fc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f42020b6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10ede0 con 0x7f41fc107910 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f42020b6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f41fc10ec60 con 0x7f41fc101910 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f41f2ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 0x7f41fc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f41f2ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 0x7f41fc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44292/0 (socket says 172.21.15.111:44292) 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f41f2ffd640 1 -- 172.21.15.111:0/2224754434 learned_addr learned my addr 172.21.15.111:0/2224754434 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.799+0000 7f41fb7fe640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41fc101910 0x7f41fc19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f2ffd640 1 -- 172.21.15.111:0/2224754434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41fc101910 msgr2=0x7f41fc19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:18.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f2ffd640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41fc101910 0x7f41fc19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f2ffd640 1 -- 172.21.15.111:0/2224754434 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41fc1999c0 con 0x7f41fc107910 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f2ffd640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 0x7f41fc19fd40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41e4031460 tx=0x7f41e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41e403f070 con 0x7f41fc107910 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41e40035f0 con 0x7f41fc107910 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41e4035030 con 0x7f41fc107910 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41fc199c50 con 0x7f41fc107910 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.800+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41fc19a180 con 0x7f41fc107910 2024-09-16T09:54:18.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.801+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41fc103050 con 0x7f41fc107910 2024-09-16T09:54:18.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.802+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f41e4042070 con 0x7f41fc107910 2024-09-16T09:54:18.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.802+0000 7f41f97fa640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f41e807ac40 0x7f41e807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:18.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.802+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7f41e40be5f0 con 0x7f41fc107910 2024-09-16T09:54:18.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.802+0000 7f41fb7fe640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f41e807ac40 0x7f41e807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:18.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.803+0000 7f41fb7fe640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f41e807ac40 0x7f41e807d100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41fc19ab00 tx=0x7f41ec00b390 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:18.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:18.807+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f41e4089c50 con 0x7f41fc107910 2024-09-16T09:54:19.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.022+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f41fc19af20 con 0x7f41fc107910 2024-09-16T09:54:19.025 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: pgmap v249: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-16T09:54:19.025 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:19.025 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: Upgrade: Updating mds.cephfs.smithi111.yvusja 2024-09-16T09:54:19.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:19.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.yvusja", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:54:19.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:19.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: Deploying daemon mds.cephfs.smithi111.yvusja on smithi111 2024-09-16T09:54:19.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:18 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/4183621484' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:19.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.023+0000 7f41f97fa640 1 -- 172.21.15.111:0/2224754434 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) ==== 76+0+2024 (secure 0 0 0) 0x7f41e408eb00 con 0x7f41fc107910 2024-09-16T09:54:19.026 INFO:teuthology.orchestra.run.smithi111.stdout:e19 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:54:05:851739+0000 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 19 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:54:19.027 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:54:05.851733+0000 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 87 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:54:19.028 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=14566} 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 14566 members: 14566 2024-09-16T09:54:19.029 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{0:14566} state up:active seq 164 join_fscid=1 addr [v2:172.21.15.111:6828/4079898764,v1:172.21.15.111:6829/4079898764] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:24307} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:19.030 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:19.031 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-09-16T09:54:19.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f41e807ac40 msgr2=0x7f41e807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f41e807ac40 0x7f41e807d100 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f41fc19ab00 tx=0x7f41ec00b390 comp rx=0 tx=0).stop 2024-09-16T09:54:19.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 msgr2=0x7f41fc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 0x7f41fc19fd40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f41e4031460 tx=0x7f41e40045e0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 shutdown_connections 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f41e807ac40 0x7f41e807d100 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f41fc107910 0x7f41fc19fd40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 --2- 172.21.15.111:0/2224754434 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f41fc101910 0x7f41fc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 >> 172.21.15.111:0/2224754434 conn(0x7f41fc0fd5f0 msgr2=0x7f41fc074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 shutdown_connections 2024-09-16T09:54:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.025+0000 7f42020b6640 1 -- 172.21.15.111:0/2224754434 wait complete. 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 -- 172.21.15.111:0/2112395912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 msgr2=0x7fcff4106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 --2- 172.21.15.111:0/2112395912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4106bf0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4009880 tx=0x7fcfe402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 -- 172.21.15.111:0/2112395912 shutdown_connections 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 --2- 172.21.15.111:0/2112395912 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 0x7fcff4100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 --2- 172.21.15.111:0/2112395912 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4106bf0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 -- 172.21.15.111:0/2112395912 >> 172.21.15.111:0/2112395912 conn(0x7fcff40fc510 msgr2=0x7fcff40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 -- 172.21.15.111:0/2112395912 shutdown_connections 2024-09-16T09:54:19.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.110+0000 7fcff9f06640 1 -- 172.21.15.111:0/2112395912 wait complete. 2024-09-16T09:54:19.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff9f06640 1 Processor -- start 2024-09-16T09:54:19.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff9f06640 1 -- start start 2024-09-16T09:54:19.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff9f06640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 0x7fcff41987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff9f06640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff9f06640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcff410dcc0 con 0x7fcff4106810 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff9f06640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcff410db40 con 0x7fcff4100810 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcfebfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcfebfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44308/0 (socket says 172.21.15.111:44308) 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcfebfff640 1 -- 172.21.15.111:0/288144709 learned_addr learned my addr 172.21.15.111:0/288144709 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff37fe640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 0x7fcff41987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcfebfff640 1 -- 172.21.15.111:0/288144709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 msgr2=0x7fcff41987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcfebfff640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 0x7fcff41987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcfebfff640 1 -- 172.21.15.111:0/288144709 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff4199330 con 0x7fcff4106810 2024-09-16T09:54:19.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.111+0000 7fcff37fe640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 0x7fcff41987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.112+0000 7fcfebfff640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4198d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c810 tx=0x7fcfdc00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.112+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfdc004020 con 0x7fcff4106810 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.112+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff4199620 con 0x7fcff4106810 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.112+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcfdc0041c0 con 0x7fcff4106810 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.112+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcfdc0047a0 con 0x7fcff4106810 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.112+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff41a1c20 con 0x7fcff4106810 2024-09-16T09:54:19.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.113+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff4101f50 con 0x7fcff4106810 2024-09-16T09:54:19.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.114+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fcfdc0079b0 con 0x7fcff4106810 2024-09-16T09:54:19.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.114+0000 7fcff17fa640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcfe007abf0 0x7fcfe007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:19.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.114+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7fcfdc09dc40 con 0x7fcff4106810 2024-09-16T09:54:19.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.114+0000 7fcff37fe640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcfe007abf0 0x7fcfe007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:19.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.115+0000 7fcff37fe640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcfe007abf0 0x7fcfe007d0b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006010 tx=0x7fcfe40095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:19.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.119+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fcff4199620 con 0x7fcff4106810 2024-09-16T09:54:19.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: pgmap v249: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 3.5 KiB/s rd, 5.3 KiB/s wr, 6 op/s 2024-09-16T09:54:19.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:19.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: Upgrade: Updating mds.cephfs.smithi111.yvusja 2024-09-16T09:54:19.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:19.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi111.yvusja", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:54:19.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:19.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: Deploying daemon mds.cephfs.smithi111.yvusja on smithi111 2024-09-16T09:54:19.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:18 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/4183621484' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.331+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcff4062630 con 0x7fcfe007abf0 2024-09-16T09:54:19.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.333+0000 7fcff17fa640 1 -- 172.21.15.111:0/288144709 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fcff4062630 con 0x7fcfe007abf0 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "osd", 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:54:19.336 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:54:19.337 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "13/23 daemons upgraded", 2024-09-16T09:54:19.337 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mds daemons", 2024-09-16T09:54:19.337 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:54:19.337 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcfe007abf0 msgr2=0x7fcfe007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcfe007abf0 0x7fcfe007d0b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfe4006010 tx=0x7fcfe40095f0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 msgr2=0x7fcff4198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4198d30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00c810 tx=0x7fcfdc00ccd0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 shutdown_connections 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcfe007abf0 0x7fcfe007d0b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcff4106810 0x7fcff4198d30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 --2- 172.21.15.111:0/288144709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcff4100810 0x7fcff41987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 >> 172.21.15.111:0/288144709 conn(0x7fcff40fc510 msgr2=0x7fcff40fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 shutdown_connections 2024-09-16T09:54:19.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.336+0000 7fcff9f06640 1 -- 172.21.15.111:0/288144709 wait complete. 2024-09-16T09:54:19.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 -- 172.21.15.111:0/1245658886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 msgr2=0x7fb910101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1245658886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb910101d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb904009880 tx=0x7fb90402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 -- 172.21.15.111:0/1245658886 shutdown_connections 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1245658886 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb910101d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1245658886 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 0x7fb910107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 -- 172.21.15.111:0/1245658886 >> 172.21.15.111:0/1245658886 conn(0x7fb9100fd630 msgr2=0x7fb9100ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 -- 172.21.15.111:0/1245658886 shutdown_connections 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 -- 172.21.15.111:0/1245658886 wait complete. 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.426+0000 7fb9155e2640 1 Processor -- start 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb9155e2640 1 -- start start 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb9155e2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb91019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:19.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb9155e2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 0x7fb91019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:19.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb9155e2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb91010ee60 con 0x7fb910101930 2024-09-16T09:54:19.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb9155e2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fb91010ece0 con 0x7fb910107930 2024-09-16T09:54:19.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb90effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb91019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:19.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb90effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb91019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44314/0 (socket says 172.21.15.111:44314) 2024-09-16T09:54:19.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.427+0000 7fb90effd640 1 -- 172.21.15.111:0/1552135844 learned_addr learned my addr 172.21.15.111:0/1552135844 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:19.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.428+0000 7fb90e7fc640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 0x7fb91019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:19.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.428+0000 7fb90effd640 1 -- 172.21.15.111:0/1552135844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 msgr2=0x7fb91019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.428+0000 7fb90effd640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 0x7fb91019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.428+0000 7fb90effd640 1 -- 172.21.15.111:0/1552135844 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb910197870 con 0x7fb910101930 2024-09-16T09:54:19.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.428+0000 7fb90e7fc640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 0x7fb91019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.428+0000 7fb90effd640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb91019d6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb90000b420 tx=0x7fb90000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.429+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb900011630 con 0x7fb910101930 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.429+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb910197b60 con 0x7fb910101930 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.429+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb900016070 con 0x7fb910101930 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.429+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9101980c0 con 0x7fb910101930 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.429+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb900011630 con 0x7fb910101930 2024-09-16T09:54:19.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.430+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb910103070 con 0x7fb910101930 2024-09-16T09:54:19.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.430+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fb900010c20 con 0x7fb910101930 2024-09-16T09:54:19.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.431+0000 7fb8f7fff640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb8f807b010 0x7fb8f807d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:19.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.431+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 6446+0+0 (secure 0 0 0) 0x7fb90009cf30 con 0x7fb910101930 2024-09-16T09:54:19.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.431+0000 7fb90e7fc640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb8f807b010 0x7fb8f807d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:19.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.432+0000 7fb90e7fc640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb8f807b010 0x7fb8f807d4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb910199060 tx=0x7fb904031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:19.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.439+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fb9000685b0 con 0x7fb910101930 2024-09-16T09:54:19.741 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.739+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb9100008d0 con 0x7fb910101930 2024-09-16T09:54:19.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.739+0000 7fb8f7fff640 1 -- 172.21.15.111:0/1552135844 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7fb90006d460 con 0x7fb910101930 2024-09-16T09:54:19.742 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-16T09:54:19.742 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-16T09:54:19.742 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs is degraded 2024-09-16T09:54:19.742 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:54:19.742 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb8f807b010 msgr2=0x7fb8f807d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb8f807b010 0x7fb8f807d4d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb910199060 tx=0x7fb904031400 comp rx=0 tx=0).stop 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 msgr2=0x7fb91019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb91019d6b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb90000b420 tx=0x7fb90000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 shutdown_connections 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fb8f807b010 0x7fb8f807d4d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fb910107930 0x7fb91019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.744 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 --2- 172.21.15.111:0/1552135844 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb910101930 0x7fb91019d6b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:19.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 >> 172.21.15.111:0/1552135844 conn(0x7fb9100fd630 msgr2=0x7fb9100fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:19.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 shutdown_connections 2024-09-16T09:54:19.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:19.741+0000 7fb9155e2640 1 -- 172.21.15.111:0/1552135844 wait complete. 2024-09-16T09:54:20.089 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:54:19.700+0000 7f8c6a716640 -1 bdev(0x5556b3c66c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 6 2024-09-16T09:54:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2224754434' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: osdmap e88: 6 total, 6 up, 6 in 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: Standby daemon mds.cephfs.smithi114.bdhdtm assigned to filesystem cephfs as rank 0 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi114.bdhdtm=up:replay} 2 up:standby 2024-09-16T09:54:20.090 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:19 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1552135844' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[109881]: 2024-09-16T09:54:19.667+0000 7fdf8a73c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2224754434' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:54:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: osdmap e88: 6 total, 6 up, 6 in 2024-09-16T09:54:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: Standby daemon mds.cephfs.smithi114.bdhdtm assigned to filesystem cephfs as rank 0 2024-09-16T09:54:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:54:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:54:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi114.bdhdtm=up:replay} 2 up:standby 2024-09-16T09:54:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:19 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1552135844' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:54:21.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:20 smithi111 ceph-mon[109885]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:20 smithi111 ceph-mon[109885]: pgmap v251: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 5.9 KiB/s wr, 4 op/s 2024-09-16T09:54:21.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:20 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"} : dispatch 2024-09-16T09:54:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:20 smithi114 ceph-mon[79732]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:20 smithi114 ceph-mon[79732]: pgmap v251: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 5.9 KiB/s wr, 4 op/s 2024-09-16T09:54:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:20 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"} : dispatch 2024-09-16T09:54:23.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:22 smithi111 ceph-mon[109885]: pgmap v252: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-09-16T09:54:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:22 smithi114 ceph-mon[79732]: pgmap v252: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 5.1 KiB/s wr, 3 op/s 2024-09-16T09:54:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:24 smithi111 ceph-mon[109885]: pgmap v253: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-16T09:54:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:24 smithi114 ceph-mon[79732]: pgmap v253: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-09-16T09:54:27.110 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:26 smithi111 ceph-mon[109885]: pgmap v254: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T09:54:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:26 smithi114 ceph-mon[79732]: pgmap v254: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T09:54:28.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:28.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: pgmap v255: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:reconnect 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6828/2183853210,v1:172.21.15.111:6829/2183853210] up:boot 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi114.bdhdtm=up:reconnect} 3 up:standby 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"} : dispatch 2024-09-16T09:54:28.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:28 smithi114 ceph-mon[79732]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0.00399991 2024-09-16T09:54:28.976 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:28.976 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: pgmap v255: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 5 op/s 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:reconnect 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6828/2183853210,v1:172.21.15.111:6829/2183853210] up:boot 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi114.bdhdtm=up:reconnect} 3 up:standby 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi111.yvusja"} : dispatch 2024-09-16T09:54:28.977 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:28 smithi111 ceph-mon[109885]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0.00399991 2024-09-16T09:54:30.126 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:29 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:rejoin 2024-09-16T09:54:30.126 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:29 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi114.bdhdtm=up:rejoin} 3 up:standby 2024-09-16T09:54:30.126 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:29 smithi111 ceph-mon[109885]: daemon mds.cephfs.smithi114.bdhdtm is now active in filesystem cephfs as rank 0 2024-09-16T09:54:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:29 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:rejoin 2024-09-16T09:54:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:29 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi114.bdhdtm=up:rejoin} 3 up:standby 2024-09-16T09:54:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:29 smithi114 ceph-mon[79732]: daemon mds.cephfs.smithi114.bdhdtm is now active in filesystem cephfs as rank 0 2024-09-16T09:54:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:30 smithi111 ceph-mon[109885]: pgmap v256: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:54:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:30 smithi111 ceph-mon[109885]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:54:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:30 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:active 2024-09-16T09:54:31.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:30 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi114.bdhdtm=up:active} 3 up:standby 2024-09-16T09:54:31.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:30 smithi114 ceph-mon[79732]: pgmap v256: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:54:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:30 smithi114 ceph-mon[79732]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:54:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:30 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6824/3743279326,v1:172.21.15.114:6825/3743279326] up:active 2024-09-16T09:54:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:30 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi114.bdhdtm=up:active} 3 up:standby 2024-09-16T09:54:31.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:33.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:32 smithi111 ceph-mon[109885]: pgmap v257: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T09:54:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:32 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:32 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:32 smithi114 ceph-mon[79732]: pgmap v257: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T09:54:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:32 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:32 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:34 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:34 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:34.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:34 smithi111 ceph-mon[109885]: pgmap v258: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-16T09:54:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:34 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:34 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:34.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:34 smithi114 ceph-mon[79732]: pgmap v258: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 9 op/s 2024-09-16T09:54:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: pgmap v259: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 8.3 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-16T09:54:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:36.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: pgmap v259: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 8.3 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-16T09:54:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:37.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:38.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:38 smithi111 ceph-mon[109885]: Upgrade: Updating mds.cephfs.smithi114.bdhdtm 2024-09-16T09:54:38.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:38.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.bdhdtm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:54:38.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:38.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:38 smithi111 ceph-mon[109885]: Deploying daemon mds.cephfs.smithi114.bdhdtm on smithi114 2024-09-16T09:54:38.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:38 smithi111 ceph-mon[109885]: pgmap v260: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:54:38.660 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:38 smithi114 ceph-mon[79732]: Upgrade: Updating mds.cephfs.smithi114.bdhdtm 2024-09-16T09:54:38.660 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:38.660 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.bdhdtm", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:54:38.660 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:38.660 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:38 smithi114 ceph-mon[79732]: Deploying daemon mds.cephfs.smithi114.bdhdtm on smithi114 2024-09-16T09:54:38.661 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:38 smithi114 ceph-mon[79732]: pgmap v260: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.7 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:54:39.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[109881]: 2024-09-16T09:54:39.205+0000 7fdf8a73c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: osdmap e89: 6 total, 6 up, 6 in 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: Standby daemon mds.cephfs.smithi114.sreoiu assigned to filesystem cephfs as rank 0 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:54:39.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:39 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi114.sreoiu=up:replay} 2 up:standby 2024-09-16T09:54:39.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:54:39.233+0000 7f8c6a716640 -1 bdev(0x5556b3c66c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-16T09:54:39.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:54:39.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:54:39.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: osdmap e89: 6 total, 6 up, 6 in 2024-09-16T09:54:39.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: Standby daemon mds.cephfs.smithi114.sreoiu assigned to filesystem cephfs as rank 0 2024-09-16T09:54:39.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:54:39.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:54:39.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:39 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi114.sreoiu=up:replay} 2 up:standby 2024-09-16T09:54:40.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:40 smithi111 ceph-mon[109885]: pgmap v262: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 823 KiB/s rd, 5.9 KiB/s wr, 8 op/s 2024-09-16T09:54:40.688 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:40 smithi114 ceph-mon[79732]: pgmap v262: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 823 KiB/s rd, 5.9 KiB/s wr, 8 op/s 2024-09-16T09:54:41.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:41 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"} : dispatch 2024-09-16T09:54:41.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:41 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"} : dispatch 2024-09-16T09:54:42.625 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:42 smithi111 ceph-mon[109885]: pgmap v263: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.9 KiB/s wr, 8 op/s 2024-09-16T09:54:42.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:42 smithi114 ceph-mon[79732]: pgmap v263: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 5.9 KiB/s wr, 8 op/s 2024-09-16T09:54:45.124 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:44 smithi114 ceph-mon[79732]: pgmap v264: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 614 B/s wr, 5 op/s 2024-09-16T09:54:45.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:44 smithi111 ceph-mon[109885]: pgmap v264: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 614 B/s wr, 5 op/s 2024-09-16T09:54:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:46 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:46.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:46 smithi111 ceph-mon[109885]: pgmap v265: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T09:54:46.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:46.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:46 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:54:46.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:46 smithi114 ceph-mon[79732]: pgmap v265: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T09:54:48.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:48 smithi114 ceph-mon[79732]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0.000999978 2024-09-16T09:54:48.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:48 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:reconnect 2024-09-16T09:54:48.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:48 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi114.sreoiu=up:reconnect} 2 up:standby 2024-09-16T09:54:48.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:48 smithi114 ceph-mon[79732]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0.00399991 2024-09-16T09:54:48.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:48 smithi114 ceph-mon[79732]: pgmap v266: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T09:54:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:48 smithi111 ceph-mon[109885]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0.000999978 2024-09-16T09:54:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:48 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:reconnect 2024-09-16T09:54:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:48 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi114.sreoiu=up:reconnect} 2 up:standby 2024-09-16T09:54:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:48 smithi111 ceph-mon[109885]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0.00399991 2024-09-16T09:54:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:48 smithi111 ceph-mon[109885]: pgmap v266: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-09-16T09:54:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 -- 172.21.15.111:0/2714593270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0103420 msgr2=0x7f34a010b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 --2- 172.21.15.111:0/2714593270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0103420 0x7f34a010b910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f34940098b0 tx=0x7f349402a560 comp rx=0 tx=0).stop 2024-09-16T09:54:49.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 -- 172.21.15.111:0/2714593270 shutdown_connections 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 --2- 172.21.15.111:0/2714593270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0103420 0x7f34a010b910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 --2- 172.21.15.111:0/2714593270 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a0102b00 0x7f34a0102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 -- 172.21.15.111:0/2714593270 >> 172.21.15.111:0/2714593270 conn(0x7f34a00fc4c0 msgr2=0x7f34a00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 -- 172.21.15.111:0/2714593270 shutdown_connections 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.838+0000 7f34a855d640 1 -- 172.21.15.111:0/2714593270 wait complete. 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a855d640 1 Processor -- start 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a855d640 1 -- start start 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a855d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 0x7f34a019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:49.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a855d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a0103420 0x7f34a019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a855d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f34a010ee30 con 0x7f34a0102b00 2024-09-16T09:54:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a855d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f34a010ecb0 con 0x7f34a0103420 2024-09-16T09:54:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a62f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 0x7f34a019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a62f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 0x7f34a019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60822/0 (socket says 172.21.15.111:60822) 2024-09-16T09:54:49.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a62f9640 1 -- 172.21.15.111:0/3926339522 learned_addr learned my addr 172.21.15.111:0/3926339522 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.839+0000 7f34a5af8640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a0103420 0x7f34a019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f34a62f9640 1 -- 172.21.15.111:0/3926339522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a0103420 msgr2=0x7f34a019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f34a62f9640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a0103420 0x7f34a019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f34a62f9640 1 -- 172.21.15.111:0/3926339522 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a01978e0 con 0x7f34a0102b00 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f34a62f9640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 0x7f34a019d720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f349000ba50 tx=0x7f349000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3490019070 con 0x7f34a0102b00 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f349000ce20 con 0x7f34a0102b00 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a0197bd0 con 0x7f34a0102b00 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34900075a0 con 0x7f34a0102b00 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.840+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a0198130 con 0x7f34a0102b00 2024-09-16T09:54:49.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.841+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a006a3b0 con 0x7f34a0102b00 2024-09-16T09:54:49.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.842+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f349001c070 con 0x7f34a0102b00 2024-09-16T09:54:49.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.842+0000 7f349f7fe640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f348807ac40 0x7f348807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:49.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.842+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7f349009d660 con 0x7f34a0102b00 2024-09-16T09:54:49.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.842+0000 7f34a5af8640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f348807ac40 0x7f348807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:49.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.843+0000 7f34a5af8640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f348807ac40 0x7f348807d100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3494000c00 tx=0x7f3494031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:49.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:49.847+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f3490068cb0 con 0x7f34a0102b00 2024-09-16T09:54:50.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.041+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f34a0106000 con 0x7f348807ac40 2024-09-16T09:54:50.043 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:49 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:rejoin 2024-09-16T09:54:50.043 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:49 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi114.sreoiu=up:rejoin} 2 up:standby 2024-09-16T09:54:50.044 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:49 smithi111 ceph-mon[109885]: daemon mds.cephfs.smithi114.sreoiu is now active in filesystem cephfs as rank 0 2024-09-16T09:54:50.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.043+0000 7f349f7fe640 1 -- 172.21.15.111:0/3926339522 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3494004340 con 0x7f348807ac40 2024-09-16T09:54:50.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f348807ac40 msgr2=0x7f348807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f348807ac40 0x7f348807d100 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3494000c00 tx=0x7f3494031400 comp rx=0 tx=0).stop 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 msgr2=0x7f34a019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 0x7f34a019d720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f349000ba50 tx=0x7f349000bf10 comp rx=0 tx=0).stop 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 shutdown_connections 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f348807ac40 0x7f348807d100 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f34a0103420 0x7f34a019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 --2- 172.21.15.111:0/3926339522 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f34a0102b00 0x7f34a019d720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 >> 172.21.15.111:0/3926339522 conn(0x7f34a00fc4c0 msgr2=0x7f34a0103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 shutdown_connections 2024-09-16T09:54:50.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.045+0000 7f34a855d640 1 -- 172.21.15.111:0/3926339522 wait complete. 2024-09-16T09:54:50.056 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 -- 172.21.15.111:0/2697064709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb8102b80 msgr2=0x7facb8102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 --2- 172.21.15.111:0/2697064709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb8102b80 0x7facb8102f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7faca8009880 tx=0x7faca802a530 comp rx=0 tx=0).stop 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 -- 172.21.15.111:0/2697064709 shutdown_connections 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 --2- 172.21.15.111:0/2697064709 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facb81034a0 0x7facb810b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 --2- 172.21.15.111:0/2697064709 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb8102b80 0x7facb8102f60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 -- 172.21.15.111:0/2697064709 >> 172.21.15.111:0/2697064709 conn(0x7facb80fc520 msgr2=0x7facb80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 -- 172.21.15.111:0/2697064709 shutdown_connections 2024-09-16T09:54:50.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.128+0000 7facbde70640 1 -- 172.21.15.111:0/2697064709 wait complete. 2024-09-16T09:54:50.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facbde70640 1 Processor -- start 2024-09-16T09:54:50.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facbde70640 1 -- start start 2024-09-16T09:54:50.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facbde70640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facb8102b80 0x7facb819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facbde70640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 0x7facb819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facbde70640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7facb810ee70 con 0x7facb81034a0 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facbde70640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7facb810ecf0 con 0x7facb8102b80 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 0x7facb819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb6ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 0x7facb819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60842/0 (socket says 172.21.15.111:60842) 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb6ffd640 1 -- 172.21.15.111:0/309833648 learned_addr learned my addr 172.21.15.111:0/309833648 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb77fe640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facb8102b80 0x7facb819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb6ffd640 1 -- 172.21.15.111:0/309833648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facb8102b80 msgr2=0x7facb819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb6ffd640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facb8102b80 0x7facb819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.129+0000 7facb6ffd640 1 -- 172.21.15.111:0/309833648 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb8197840 con 0x7facb81034a0 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.130+0000 7facb6ffd640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 0x7facb819dc00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7facac00b420 tx=0x7facac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.130+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facac011630 con 0x7facb81034a0 2024-09-16T09:54:50.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.130+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb8197b30 con 0x7facb81034a0 2024-09-16T09:54:50.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.130+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7facac016070 con 0x7facb81034a0 2024-09-16T09:54:50.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.130+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7facac010d40 con 0x7facb81034a0 2024-09-16T09:54:50.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.130+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb81980c0 con 0x7facb81034a0 2024-09-16T09:54:50.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.131+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb806ab40 con 0x7facb81034a0 2024-09-16T09:54:50.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.132+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7facac01b460 con 0x7facb81034a0 2024-09-16T09:54:50.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.132+0000 7facb4ff9640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7faca007abf0 0x7faca007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.132+0000 7facb77fe640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7faca007abf0 0x7faca007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.132+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7facac09d580 con 0x7facb81034a0 2024-09-16T09:54:50.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.133+0000 7facb77fe640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7faca007abf0 0x7faca007d0b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faca80096c0 tx=0x7faca8004f30 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:50.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.136+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7facac021250 con 0x7facb81034a0 2024-09-16T09:54:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:49 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:rejoin 2024-09-16T09:54:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:49 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi114.sreoiu=up:rejoin} 2 up:standby 2024-09-16T09:54:50.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:49 smithi114 ceph-mon[79732]: daemon mds.cephfs.smithi114.sreoiu is now active in filesystem cephfs as rank 0 2024-09-16T09:54:50.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.341+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7facb8198430 con 0x7faca007abf0 2024-09-16T09:54:50.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.342+0000 7facb4ff9640 1 -- 172.21.15.111:0/309833648 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7facb8198430 con 0x7faca007abf0 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7faca007abf0 msgr2=0x7faca007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7faca007abf0 0x7faca007d0b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faca80096c0 tx=0x7faca8004f30 comp rx=0 tx=0).stop 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 msgr2=0x7facb819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 0x7facb819dc00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7facac00b420 tx=0x7facac00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 shutdown_connections 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7faca007abf0 0x7faca007d0b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7facb81034a0 0x7facb819dc00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 --2- 172.21.15.111:0/309833648 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7facb8102b80 0x7facb819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 >> 172.21.15.111:0/309833648 conn(0x7facb80fc520 msgr2=0x7facb8108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 shutdown_connections 2024-09-16T09:54:50.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.344+0000 7facbde70640 1 -- 172.21.15.111:0/309833648 wait complete. 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 -- 172.21.15.111:0/2197464056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24106820 msgr2=0x7fef24106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 --2- 172.21.15.111:0/2197464056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24106820 0x7fef24106c00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fef14009880 tx=0x7fef1402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 -- 172.21.15.111:0/2197464056 shutdown_connections 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 --2- 172.21.15.111:0/2197464056 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef24100820 0x7fef24100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 --2- 172.21.15.111:0/2197464056 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24106820 0x7fef24106c00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 -- 172.21.15.111:0/2197464056 >> 172.21.15.111:0/2197464056 conn(0x7fef240fc520 msgr2=0x7fef240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 -- 172.21.15.111:0/2197464056 shutdown_connections 2024-09-16T09:54:50.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.426+0000 7fef29f96640 1 -- 172.21.15.111:0/2197464056 wait complete. 2024-09-16T09:54:50.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef29f96640 1 Processor -- start 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef29f96640 1 -- start start 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef29f96640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 0x7fef2419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef29f96640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef24106820 0x7fef2419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef29f96640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fef2410dd50 con 0x7fef24100820 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef29f96640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fef2410dbd0 con 0x7fef24106820 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef237fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 0x7fef2419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef237fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 0x7fef2419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60850/0 (socket says 172.21.15.111:60850) 2024-09-16T09:54:50.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef237fe640 1 -- 172.21.15.111:0/936628773 learned_addr learned my addr 172.21.15.111:0/936628773 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef237fe640 1 -- 172.21.15.111:0/936628773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef24106820 msgr2=0x7fef2419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef22ffd640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef24106820 0x7fef2419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef237fe640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef24106820 0x7fef2419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.427+0000 7fef237fe640 1 -- 172.21.15.111:0/936628773 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef24197820 con 0x7fef24100820 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.428+0000 7fef237fe640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 0x7fef2419d6a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef14031460 tx=0x7fef140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.428+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef1403f070 con 0x7fef24100820 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.428+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef24197ab0 con 0x7fef24100820 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.428+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef14004cf0 con 0x7fef24100820 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.428+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef14035030 con 0x7fef24100820 2024-09-16T09:54:50.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.428+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef24197fe0 con 0x7fef24100820 2024-09-16T09:54:50.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.429+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef24101f60 con 0x7fef24100820 2024-09-16T09:54:50.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.429+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fef14042070 con 0x7fef24100820 2024-09-16T09:54:50.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.430+0000 7fef20ff9640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fef1007abf0 0x7fef1007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.430+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7fef140be960 con 0x7fef24100820 2024-09-16T09:54:50.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.430+0000 7fef22ffd640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fef1007abf0 0x7fef1007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.430+0000 7fef22ffd640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fef1007abf0 0x7fef1007d0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fef2406b3e0 tx=0x7fef0c008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:50.435 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.434+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fef14089f30 con 0x7fef24100820 2024-09-16T09:54:50.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.617+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fef24198350 con 0x7fef1007abf0 2024-09-16T09:54:50.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.627+0000 7fef20ff9640 1 -- 172.21.15.111:0/936628773 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fef24198350 con 0x7fef1007abf0 2024-09-16T09:54:50.629 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:54:50.629 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (5m) 18s ago 16m 20.6M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:54:50.629 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (8m) 18s ago 16m 9143k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:54:50.629 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (7m) 62s ago 16m 8590k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (4m) 18s ago 16m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (4m) 62s ago 16m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (5m) 18s ago 16m 75.9M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (47s) 18s ago 11m 14.0M - 19.3.0-4882-g66e33d6a 261f2dc7b20f cf8efae733d5 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (23s) 18s ago 11m 14.7M - 19.3.0-4882-g66e33d6a 261f2dc7b20f b538ac16c766 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (11m) 62s ago 11m 20.9M - 19.1.1-328-gad35db06 b5388489f99e 6ca8315d758e 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (11m) 62s ago 11m 20.7M - 19.1.1-328-gad35db06 b5388489f99e 4ac9c10377e0 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (7m) 18s ago 17m 528M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (7m) 62s ago 15m 457M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (4m) 18s ago 18m 52.6M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (4m) 62s ago 15m 38.9M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (6m) 18s ago 16m 11.3M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (6m) 62s ago 15m 10.2M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:54:50.630 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (3m) 18s ago 14m 111M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:54:50.631 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (3m) 18s ago 14m 134M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:54:50.631 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (2m) 18s ago 13m 98.5M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:54:50.631 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (2m) 62s ago 13m 102M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:54:50.631 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (98s) 62s ago 12m 98.2M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 52420a54759b 2024-09-16T09:54:50.631 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (65s) 62s ago 12m 14.4M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 94a0d154c08f 2024-09-16T09:54:50.631 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 18s ago 16m 56.8M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fef1007abf0 msgr2=0x7fef1007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fef1007abf0 0x7fef1007d0b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fef2406b3e0 tx=0x7fef0c008040 comp rx=0 tx=0).stop 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 msgr2=0x7fef2419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 0x7fef2419d6a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fef14031460 tx=0x7fef140048f0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 shutdown_connections 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fef1007abf0 0x7fef1007d0b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fef24106820 0x7fef2419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 --2- 172.21.15.111:0/936628773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fef24100820 0x7fef2419d6a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.629+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 >> 172.21.15.111:0/936628773 conn(0x7fef240fc520 msgr2=0x7fef241045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.630+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 shutdown_connections 2024-09-16T09:54:50.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.630+0000 7fef29f96640 1 -- 172.21.15.111:0/936628773 wait complete. 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 -- 172.21.15.111:0/1635761115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 msgr2=0x7fd1ec100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1635761115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec100c40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc009880 tx=0x7fd1dc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 -- 172.21.15.111:0/1635761115 shutdown_connections 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1635761115 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec100c40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1635761115 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ec1067e0 0x7fd1ec106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 -- 172.21.15.111:0/1635761115 >> 172.21.15.111:0/1635761115 conn(0x7fd1ec0fc4c0 msgr2=0x7fd1ec0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 -- 172.21.15.111:0/1635761115 shutdown_connections 2024-09-16T09:54:50.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.712+0000 7fd1f1108640 1 -- 172.21.15.111:0/1635761115 wait complete. 2024-09-16T09:54:50.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1f1108640 1 Processor -- start 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1f1108640 1 -- start start 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1f1108640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1f1108640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ec1067e0 0x7fd1ec198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1f1108640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec10dc90 con 0x7fd1ec1007e0 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1f1108640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd1ec10db10 con 0x7fd1ec1067e0 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1ead9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1ead9d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60860/0 (socket says 172.21.15.111:60860) 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1ead9d640 1 -- 172.21.15.111:0/1816896407 learned_addr learned my addr 172.21.15.111:0/1816896407 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.713+0000 7fd1ea59c640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ec1067e0 0x7fd1ec198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1ead9d640 1 -- 172.21.15.111:0/1816896407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ec1067e0 msgr2=0x7fd1ec198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1ead9d640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ec1067e0 0x7fd1ec198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1ead9d640 1 -- 172.21.15.111:0/1816896407 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1ec199300 con 0x7fd1ec1007e0 2024-09-16T09:54:50.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1ead9d640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec1987c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000d8d0 tx=0x7fd1e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:50.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1e0017070 con 0x7fd1ec1007e0 2024-09-16T09:54:50.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1e0010460 con 0x7fd1ec1007e0 2024-09-16T09:54:50.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1ec1995f0 con 0x7fd1ec1007e0 2024-09-16T09:54:50.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1e000f5f0 con 0x7fd1ec1007e0 2024-09-16T09:54:50.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.714+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1ec1a1bf0 con 0x7fd1ec1007e0 2024-09-16T09:54:50.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.715+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1ec101f20 con 0x7fd1ec1007e0 2024-09-16T09:54:50.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.716+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fd1e0009a30 con 0x7fd1ec1007e0 2024-09-16T09:54:50.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.716+0000 7fd1d3fff640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd1d407ac40 0x7fd1d407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:50.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.716+0000 7fd1ea59c640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd1d407ac40 0x7fd1d407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:50.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.716+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7fd1e009db20 con 0x7fd1ec1007e0 2024-09-16T09:54:50.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.717+0000 7fd1ea59c640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd1d407ac40 0x7fd1d407d100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec06a680 tx=0x7fd1dc031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:50.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.720+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fd1ec1995f0 con 0x7fd1ec1007e0 2024-09-16T09:54:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:54:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: pgmap v267: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:54:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:active 2024-09-16T09:54:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6824/2412191913,v1:172.21.15.114:6825/2412191913] up:boot 2024-09-16T09:54:50.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi114.sreoiu=up:active} 3 up:standby 2024-09-16T09:54:50.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"} : dispatch 2024-09-16T09:54:50.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:50.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:50.883 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:50 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:50.922 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:54:50.922 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: pgmap v267: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:54:50.922 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] up:active 2024-09-16T09:54:50.924 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6824/2412191913,v1:172.21.15.114:6825/2412191913] up:boot 2024-09-16T09:54:50.924 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi114.sreoiu=up:active} 3 up:standby 2024-09-16T09:54:50.924 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.bdhdtm"} : dispatch 2024-09-16T09:54:50.924 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:50.924 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:50.925 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:50 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:50.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.967+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd1ec108d70 con 0x7fd1ec1007e0 2024-09-16T09:54:50.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.967+0000 7fd1d3fff640 1 -- 172.21.15.111:0/1816896407 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7fd1e006b690 con 0x7fd1ec1007e0 2024-09-16T09:54:50.969 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:54:50.969 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:54:50.969 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 6 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 1, 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 3 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:54:50.970 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.1.1-328-gad35db06 (ad35db06e8924912f01e32b35576297c0f1352b4) squid (stable)": 1, 2024-09-16T09:54:50.971 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 13 2024-09-16T09:54:50.971 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:54:50.971 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:54:50.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd1d407ac40 msgr2=0x7fd1d407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd1d407ac40 0x7fd1d407d100 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd1ec06a680 tx=0x7fd1dc031400 comp rx=0 tx=0).stop 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 msgr2=0x7fd1ec1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec1987c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000d8d0 tx=0x7fd1e000dd90 comp rx=0 tx=0).stop 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 shutdown_connections 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd1d407ac40 0x7fd1d407d100 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd1ec1067e0 0x7fd1ec198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 --2- 172.21.15.111:0/1816896407 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd1ec1007e0 0x7fd1ec1987c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.969+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 >> 172.21.15.111:0/1816896407 conn(0x7fd1ec0fc4c0 msgr2=0x7fd1ec0fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.970+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 shutdown_connections 2024-09-16T09:54:50.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:50.970+0000 7fd1f1108640 1 -- 172.21.15.111:0/1816896407 wait complete. 2024-09-16T09:54:51.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 -- 172.21.15.111:0/3459668491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980107930 msgr2=0x7f3980107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 --2- 172.21.15.111:0/3459668491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980107930 0x7f3980107d10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3970009880 tx=0x7f397002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 -- 172.21.15.111:0/3459668491 shutdown_connections 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 --2- 172.21.15.111:0/3459668491 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3980101930 0x7f3980101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 --2- 172.21.15.111:0/3459668491 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980107930 0x7f3980107d10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 -- 172.21.15.111:0/3459668491 >> 172.21.15.111:0/3459668491 conn(0x7f39800fd630 msgr2=0x7f39800ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 -- 172.21.15.111:0/3459668491 shutdown_connections 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.051+0000 7f39866a1640 1 -- 172.21.15.111:0/3459668491 wait complete. 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.052+0000 7f39866a1640 1 Processor -- start 2024-09-16T09:54:51.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.052+0000 7f39866a1640 1 -- start start 2024-09-16T09:54:51.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.052+0000 7f39866a1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 0x7f398019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.052+0000 7f39866a1640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3980107930 0x7f398019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.052+0000 7f39866a1640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f398010ede0 con 0x7f3980101930 2024-09-16T09:54:51.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.052+0000 7f39866a1640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f398010ec60 con 0x7f3980107930 2024-09-16T09:54:51.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 0x7f398019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 0x7f398019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60882/0 (socket says 172.21.15.111:60882) 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 -- 172.21.15.111:0/684722526 learned_addr learned my addr 172.21.15.111:0/684722526 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397f7fe640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3980107930 0x7f398019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 -- 172.21.15.111:0/684722526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3980107930 msgr2=0x7f398019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3980107930 0x7f398019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 -- 172.21.15.111:0/684722526 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39801977d0 con 0x7f3980101930 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397ffff640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 0x7f398019d650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3970031460 tx=0x7f39700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:51.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f397003f070 con 0x7f3980101930 2024-09-16T09:54:51.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39700035f0 con 0x7f3980101930 2024-09-16T09:54:51.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3980197a60 con 0x7f3980101930 2024-09-16T09:54:51.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3970035030 con 0x7f3980101930 2024-09-16T09:54:51.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.053+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3980197f90 con 0x7f3980101930 2024-09-16T09:54:51.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.054+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3980103070 con 0x7f3980101930 2024-09-16T09:54:51.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.055+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f3970042070 con 0x7f3980101930 2024-09-16T09:54:51.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.056+0000 7f397d7fa640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f396807abf0 0x7f396807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.056+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7f39700be740 con 0x7f3980101930 2024-09-16T09:54:51.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.056+0000 7f397f7fe640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f396807abf0 0x7f396807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.056+0000 7f397f7fe640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f396807abf0 0x7f396807d0b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3980100d60 tx=0x7f397400b410 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:51.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.060+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f3970089d10 con 0x7f3980101930 2024-09-16T09:54:51.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.273+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3980104b40 con 0x7f3980101930 2024-09-16T09:54:51.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.274+0000 7f397d7fa640 1 -- 172.21.15.111:0/684722526 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+2024 (secure 0 0 0) 0x7f397008ebc0 con 0x7f3980101930 2024-09-16T09:54:51.276 INFO:teuthology.orchestra.run.smithi111.stdout:e29 2024-09-16T09:54:51.277 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:54:49:752004+0000 2024-09-16T09:54:51.277 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:54:51.277 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:54:51.277 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:54:51.277 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:51.277 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:54:51.278 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:54:51.278 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 29 2024-09-16T09:54:51.278 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:54:51.278 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:54:51.278 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:54:49.751999+0000 2024-09-16T09:54:51.279 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:54:51.279 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:54:51.279 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:54:51.279 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:54:51.279 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:54:51.280 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:54:51.280 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:54:51.280 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:54:51.280 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 89 2024-09-16T09:54:51.280 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:54:51.281 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:54:51.281 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:54:51.281 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=24319} 2024-09-16T09:54:51.281 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:54:51.281 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:54:51.281 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:54:51.282 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:54:51.282 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:54:51.282 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:54:51.282 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:54:51.282 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:54:51.283 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:54:51.283 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 24319 members: 24319 2024-09-16T09:54:51.283 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{0:24319} state up:active seq 175 join_fscid=1 addr [v2:172.21.15.114:6826/2254901057,v1:172.21.15.114:6827/2254901057] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:51.283 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:51.283 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:51.283 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:54:51.284 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:54:51.284 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:51.284 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/2183853210,v1:172.21.15.111:6829/2183853210] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:51.284 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.114:6824/2412191913,v1:172.21.15.114:6825/2412191913] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:54:51.285 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 29 2024-09-16T09:54:51.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f396807abf0 msgr2=0x7f396807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f396807abf0 0x7f396807d0b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3980100d60 tx=0x7f397400b410 comp rx=0 tx=0).stop 2024-09-16T09:54:51.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 msgr2=0x7f398019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 0x7f398019d650 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3970031460 tx=0x7f39700045e0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 shutdown_connections 2024-09-16T09:54:51.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f396807abf0 0x7f396807d0b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3980107930 0x7f398019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 --2- 172.21.15.111:0/684722526 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3980101930 0x7f398019d650 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 >> 172.21.15.111:0/684722526 conn(0x7f39800fd630 msgr2=0x7f39800fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:51.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 shutdown_connections 2024-09-16T09:54:51.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.276+0000 7f39866a1640 1 -- 172.21.15.111:0/684722526 wait complete. 2024-09-16T09:54:51.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 -- 172.21.15.111:0/3741028219 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 msgr2=0x7f489c107d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 --2- 172.21.15.111:0/3741028219 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c107d10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f488c009880 tx=0x7f488c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 -- 172.21.15.111:0/3741028219 shutdown_connections 2024-09-16T09:54:51.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 --2- 172.21.15.111:0/3741028219 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f489c101930 0x7f489c101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 --2- 172.21.15.111:0/3741028219 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c107d10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 -- 172.21.15.111:0/3741028219 >> 172.21.15.111:0/3741028219 conn(0x7f489c0fd630 msgr2=0x7f489c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 -- 172.21.15.111:0/3741028219 shutdown_connections 2024-09-16T09:54:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.358+0000 7f48a1466640 1 -- 172.21.15.111:0/3741028219 wait complete. 2024-09-16T09:54:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f48a1466640 1 Processor -- start 2024-09-16T09:54:51.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f48a1466640 1 -- start start 2024-09-16T09:54:51.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f48a1466640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f489c101930 0x7f489c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f48a1466640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f48a1466640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f489c10ee60 con 0x7f489c107930 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f48a1466640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f489c10ece0 con 0x7f489c101930 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f489a7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f489a7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60902/0 (socket says 172.21.15.111:60902) 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f489a7fc640 1 -- 172.21.15.111:0/2629753486 learned_addr learned my addr 172.21.15.111:0/2629753486 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f489affd640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f489c101930 0x7f489c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f489a7fc640 1 -- 172.21.15.111:0/2629753486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f489c101930 msgr2=0x7f489c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.359+0000 7f489a7fc640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f489c101930 0x7f489c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f489a7fc640 1 -- 172.21.15.111:0/2629753486 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c074f70 con 0x7f489c107930 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f489a7fc640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f489000b420 tx=0x7f489000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4890011630 con 0x7f489c107930 2024-09-16T09:54:51.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4890016070 con 0x7f489c107930 2024-09-16T09:54:51.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489c075260 con 0x7f489c107930 2024-09-16T09:54:51.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4890010d40 con 0x7f489c107930 2024-09-16T09:54:51.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.360+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489c1a3f10 con 0x7f489c107930 2024-09-16T09:54:51.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.361+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f489c103070 con 0x7f489c107930 2024-09-16T09:54:51.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.362+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f489001b460 con 0x7f489c107930 2024-09-16T09:54:51.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.362+0000 7f4883fff640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f488407abf0 0x7f488407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.362+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7f489009d480 con 0x7f489c107930 2024-09-16T09:54:51.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.362+0000 7f489affd640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f488407abf0 0x7f488407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.363+0000 7f489affd640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f488407abf0 0x7f488407d0b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f488c0096c0 tx=0x7f488c031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:51.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.367+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f4890068a50 con 0x7f489c107930 2024-09-16T09:54:51.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.556+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f489c062630 con 0x7f488407abf0 2024-09-16T09:54:51.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.558+0000 7f4883fff640 1 -- 172.21.15.111:0/2629753486 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f489c062630 con 0x7f488407abf0 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "osd", 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:54:51.560 INFO:teuthology.orchestra.run.smithi111.stdout: "crash" 2024-09-16T09:54:51.561 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:54:51.561 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "14/23 daemons upgraded", 2024-09-16T09:54:51.561 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading mds daemons", 2024-09-16T09:54:51.561 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:54:51.561 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:54:51.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f488407abf0 msgr2=0x7f488407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f488407abf0 0x7f488407d0b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f488c0096c0 tx=0x7f488c031400 comp rx=0 tx=0).stop 2024-09-16T09:54:51.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 msgr2=0x7f489c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f489000b420 tx=0x7f489000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 shutdown_connections 2024-09-16T09:54:51.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f488407abf0 0x7f488407d0b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f489c107930 0x7f489c074a30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 --2- 172.21.15.111:0/2629753486 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f489c101930 0x7f489c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 >> 172.21.15.111:0/2629753486 conn(0x7f489c0fd630 msgr2=0x7f489c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:51.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 shutdown_connections 2024-09-16T09:54:51.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.560+0000 7f48a1466640 1 -- 172.21.15.111:0/2629753486 wait complete. 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 -- 172.21.15.111:0/3004348805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 msgr2=0x7f47f4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/3004348805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4106bc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009880 tx=0x7f47e402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 -- 172.21.15.111:0/3004348805 shutdown_connections 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/3004348805 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f41007e0 0x7f47f4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/3004348805 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4106bc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 -- 172.21.15.111:0/3004348805 >> 172.21.15.111:0/3004348805 conn(0x7f47f40fc4c0 msgr2=0x7f47f40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 -- 172.21.15.111:0/3004348805 shutdown_connections 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 -- 172.21.15.111:0/3004348805 wait complete. 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 Processor -- start 2024-09-16T09:54:51.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.642+0000 7f47f9b4e640 1 -- start start 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47f9b4e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f41007e0 0x7f47f4198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47f9b4e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47f9b4e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f47f410dcb0 con 0x7f47f41067e0 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47f9b4e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f47f410db30 con 0x7f47f41007e0 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4198d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60922/0 (socket says 172.21.15.111:60922) 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 -- 172.21.15.111:0/1119852780 learned_addr learned my addr 172.21.15.111:0/1119852780 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47f37fe640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f41007e0 0x7f47f4198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 -- 172.21.15.111:0/1119852780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f41007e0 msgr2=0x7f47f4198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f41007e0 0x7f47f4198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 -- 172.21.15.111:0/1119852780 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f4199360 con 0x7f47f41067e0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47eaffd640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4198d60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00d6f0 tx=0x7f47dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.643+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47dc017070 con 0x7f47f41067e0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.644+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47dc00de00 con 0x7f47f41067e0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.644+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47f4199650 con 0x7f47f41067e0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.644+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47dc004bb0 con 0x7f47f41067e0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.644+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47f41a1c50 con 0x7f47f41067e0 2024-09-16T09:54:51.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.644+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47f4101f20 con 0x7f47f41067e0 2024-09-16T09:54:51.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.645+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f47dc004e60 con 0x7f47f41067e0 2024-09-16T09:54:51.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.646+0000 7f47f17fa640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f47e007abf0 0x7f47e007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:54:51.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.646+0000 7f47f37fe640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f47e007abf0 0x7f47e007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:54:51.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.646+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 6618+0+0 (secure 0 0 0) 0x7f47dc09d950 con 0x7f47f41067e0 2024-09-16T09:54:51.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.646+0000 7f47f37fe640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f47e007abf0 0x7f47e007d0b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e40096c0 tx=0x7f47e4031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:54:51.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.650+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f47f4199650 con 0x7f47f41067e0 2024-09-16T09:54:51.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:51 smithi111 ceph-mon[109885]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:51.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:51 smithi111 ceph-mon[109885]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:51.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:51 smithi111 ceph-mon[109885]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:51.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:51 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1816896407' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:51.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:51 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/684722526' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:54:51.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.905+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f47f4108d50 con 0x7f47f41067e0 2024-09-16T09:54:51.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.906+0000 7f47f17fa640 1 -- 172.21.15.111:0/1119852780 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f47dc068f20 con 0x7f47f41067e0 2024-09-16T09:54:51.908 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:54:51.908 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:54:51.908 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:54:51.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f47e007abf0 msgr2=0x7f47e007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f47e007abf0 0x7f47e007d0b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f47e40096c0 tx=0x7f47e4031400 comp rx=0 tx=0).stop 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 msgr2=0x7f47f4198d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4198d60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00d6f0 tx=0x7f47dc00dbb0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 shutdown_connections 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f47e007abf0 0x7f47e007d0b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47f41067e0 0x7f47f4198d60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 --2- 172.21.15.111:0/1119852780 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f47f41007e0 0x7f47f4198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 >> 172.21.15.111:0/1119852780 conn(0x7f47f40fc4c0 msgr2=0x7f47f40fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 shutdown_connections 2024-09-16T09:54:51.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:54:51.908+0000 7f47f9b4e640 1 -- 172.21.15.111:0/1119852780 wait complete. 2024-09-16T09:54:51.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:51 smithi114 ceph-mon[79732]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:51.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:51 smithi114 ceph-mon[79732]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:51.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:51 smithi114 ceph-mon[79732]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:51.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:51 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1816896407' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:51.938 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:51 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/684722526' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:54:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:52 smithi111 ceph-mon[109885]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:52 smithi111 ceph-mon[109885]: pgmap v268: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-09-16T09:54:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:52 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1119852780' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:54:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:52 smithi114 ceph-mon[79732]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:54:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:52 smithi114 ceph-mon[79732]: pgmap v268: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 6 op/s 2024-09-16T09:54:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:52 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1119852780' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:54:54.669 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:54 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.669 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:54 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.669 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:54 smithi114 ceph-mon[79732]: pgmap v269: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 10 op/s 2024-09-16T09:54:54.670 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:54 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.670 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:54 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:54 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:54 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:54 smithi111 ceph-mon[109885]: pgmap v269: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 4.4 KiB/s wr, 10 op/s 2024-09-16T09:54:54.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:54 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:54.777 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:54 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:56.916 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:56 smithi114 ceph-mon[79732]: pgmap v270: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-16T09:54:57.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:56 smithi111 ceph-mon[109885]: pgmap v270: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 7.7 MiB/s rd, 4.9 KiB/s wr, 8 op/s 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:57 smithi111 ceph-mon[109885]: pgmap v271: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:54:58.272 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.273 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.274 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:54:58.274 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:57 smithi114 ceph-mon[79732]: pgmap v271: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:54:59.595 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:59 smithi114 ceph-mon[79732]: Upgrade: Updating mds.cephfs.smithi114.sreoiu 2024-09-16T09:54:59.596 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:59 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:59.596 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:59 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.sreoiu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:54:59.596 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:59 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:59.596 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:54:59 smithi114 ceph-mon[79732]: Deploying daemon mds.cephfs.smithi114.sreoiu on smithi114 2024-09-16T09:54:59.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:59 smithi111 ceph-mon[109885]: Upgrade: Updating mds.cephfs.smithi114.sreoiu 2024-09-16T09:54:59.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:59 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:54:59.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:59 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi114.sreoiu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-16T09:54:59.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:59 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:54:59.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:54:59 smithi111 ceph-mon[109885]: Deploying daemon mds.cephfs.smithi114.sreoiu on smithi114 2024-09-16T09:55:00.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:55:00.166+0000 7f8c6e71e640 -1 bdev(0x5556b3c66c00 /var/lib/ceph/osd/ceph-3/block) aio_submit retries 5 2024-09-16T09:55:00.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: pgmap v272: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: osdmap e90: 6 total, 6 up, 6 in 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: Standby daemon mds.cephfs.smithi111.jnzoej assigned to filesystem cephfs as rank 0 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:55:00.438 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:00 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi111.jnzoej=up:replay} 2 up:standby 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[109881]: 2024-09-16T09:55:00.141+0000 7fdf8a73c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: pgmap v272: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.0 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: osdmap e90: 6 total, 6 up, 6 in 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: Standby daemon mds.cephfs.smithi111.jnzoej assigned to filesystem cephfs as rank 0 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-16T09:55:00.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:00 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi111.jnzoej=up:replay} 2 up:standby 2024-09-16T09:55:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:01 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:01.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:01 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"} : dispatch 2024-09-16T09:55:01.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:01 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:01.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:01 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"} : dispatch 2024-09-16T09:55:02.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:02 smithi111 ceph-mon[109885]: pgmap v274: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 821 KiB/s rd, 5.9 KiB/s wr, 6 op/s 2024-09-16T09:55:02.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:02 smithi114 ceph-mon[79732]: pgmap v274: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 821 KiB/s rd, 5.9 KiB/s wr, 6 op/s 2024-09-16T09:55:05.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:04 smithi111 ceph-mon[109885]: pgmap v275: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 614 B/s wr, 3 op/s 2024-09-16T09:55:05.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:04 smithi114 ceph-mon[79732]: pgmap v275: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 10 MiB/s rd, 614 B/s wr, 3 op/s 2024-09-16T09:55:07.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:06 smithi111 ceph-mon[109885]: pgmap v276: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-16T09:55:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:06 smithi114 ceph-mon[79732]: pgmap v276: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-16T09:55:09.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:08 smithi111 ceph-mon[109885]: pgmap v277: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-16T09:55:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:08 smithi114 ceph-mon[79732]: pgmap v277: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 5 op/s 2024-09-16T09:55:10.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:09 smithi114 ceph-mon[79732]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0 2024-09-16T09:55:10.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:09 smithi114 ceph-mon[79732]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0.000999981 2024-09-16T09:55:10.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:09 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:reconnect 2024-09-16T09:55:10.084 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:09 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi111.jnzoej=up:reconnect} 2 up:standby 2024-09-16T09:55:10.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:09 smithi111 ceph-mon[109885]: reconnect by client.14596 v1:192.168.0.1:0/364902094 after 0 2024-09-16T09:55:10.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:09 smithi111 ceph-mon[109885]: reconnect by client.14602 v1:172.21.15.114:0/1127282170 after 0.000999981 2024-09-16T09:55:10.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:09 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:reconnect 2024-09-16T09:55:10.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:09 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi111.jnzoej=up:reconnect} 2 up:standby 2024-09-16T09:55:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:10 smithi114 ceph-mon[79732]: pgmap v278: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:55:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:10 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:rejoin 2024-09-16T09:55:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:10 smithi114 ceph-mon[79732]: fsmap cephfs:1/1 {0=cephfs.smithi111.jnzoej=up:rejoin} 2 up:standby 2024-09-16T09:55:10.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:10 smithi114 ceph-mon[79732]: daemon mds.cephfs.smithi111.jnzoej is now active in filesystem cephfs as rank 0 2024-09-16T09:55:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:10 smithi111 ceph-mon[109885]: pgmap v278: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-16T09:55:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:10 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:rejoin 2024-09-16T09:55:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:10 smithi111 ceph-mon[109885]: fsmap cephfs:1/1 {0=cephfs.smithi111.jnzoej=up:rejoin} 2 up:standby 2024-09-16T09:55:11.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:10 smithi111 ceph-mon[109885]: daemon mds.cephfs.smithi111.jnzoej is now active in filesystem cephfs as rank 0 2024-09-16T09:55:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:11 smithi111 ceph-mon[109885]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:55:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:11 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:active 2024-09-16T09:55:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:11 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2 up:standby 2024-09-16T09:55:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:11 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:11 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:12.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:11 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:11 smithi114 ceph-mon[79732]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-16T09:55:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:11 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] up:active 2024-09-16T09:55:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:11 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 2 up:standby 2024-09-16T09:55:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:11 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:11 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:12.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:11 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:13.090 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:12 smithi111 ceph-mon[109885]: pgmap v279: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T09:55:13.090 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:12 smithi111 ceph-mon[109885]: mds.? [v2:172.21.15.114:6826/2165184879,v1:172.21.15.114:6827/2165184879] up:boot 2024-09-16T09:55:13.091 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:12 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:55:13.091 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:12 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"} : dispatch 2024-09-16T09:55:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:12 smithi114 ceph-mon[79732]: pgmap v279: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-09-16T09:55:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:12 smithi114 ceph-mon[79732]: mds.? [v2:172.21.15.114:6826/2165184879,v1:172.21.15.114:6827/2165184879] up:boot 2024-09-16T09:55:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:12 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:55:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:12 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "mds metadata", "who": "cephfs.smithi114.sreoiu"} : dispatch 2024-09-16T09:55:15.111 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:14 smithi114 ceph-mon[79732]: pgmap v280: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-16T09:55:15.111 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.111 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.111 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.111 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:14 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:14 smithi111 ceph-mon[109885]: pgmap v280: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-16T09:55:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:15.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:14 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:16.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:16 smithi111 ceph-mon[109885]: pgmap v281: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 682 B/s wr, 7 op/s 2024-09-16T09:55:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:16 smithi114 ceph-mon[79732]: pgmap v281: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 9.3 MiB/s rd, 682 B/s wr, 7 op/s 2024-09-16T09:55:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: pgmap v282: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 682 B/s wr, 5 op/s 2024-09-16T09:55:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.jnzoej"} : dispatch 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.jnzoej"}]': finished 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.yvusja"} : dispatch 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.yvusja"}]': finished 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.bdhdtm"} : dispatch 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.bdhdtm"}]': finished 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.sreoiu"} : dispatch 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.sreoiu"}]': finished 2024-09-16T09:55:19.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:18 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-16T09:55:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: pgmap v282: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 682 B/s wr, 5 op/s 2024-09-16T09:55:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.jnzoej"} : dispatch 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.jnzoej"}]': finished 2024-09-16T09:55:19.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.yvusja"} : dispatch 2024-09-16T09:55:19.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi111.yvusja"}]': finished 2024-09-16T09:55:19.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.bdhdtm"} : dispatch 2024-09-16T09:55:19.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.bdhdtm"}]': finished 2024-09-16T09:55:19.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.sreoiu"} : dispatch 2024-09-16T09:55:19.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi114.sreoiu"}]': finished 2024-09-16T09:55:19.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:18 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-16T09:55:20.088 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all mds 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: Upgrade: Setting filesystem cephfs Joinable 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:20.089 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:19 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all mds 2024-09-16T09:55:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: Upgrade: Setting filesystem cephfs Joinable 2024-09-16T09:55:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-16T09:55:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:55:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:20.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:20.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:19 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:21.093 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:20 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all rgw 2024-09-16T09:55:21.093 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:20 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T09:55:21.093 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:20 smithi111 ceph-mon[109885]: pgmap v283: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:55:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:20 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all rgw 2024-09-16T09:55:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:20 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all rbd-mirror 2024-09-16T09:55:21.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:20 smithi114 ceph-mon[79732]: pgmap v283: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 4.9 KiB/s wr, 7 op/s 2024-09-16T09:55:21.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 -- 172.21.15.111:0/3821639656 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 msgr2=0x7fa0c4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:21.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 --2- 172.21.15.111:0/3821639656 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4102e80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009880 tx=0x7fa0b802a530 comp rx=0 tx=0).stop 2024-09-16T09:55:21.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 -- 172.21.15.111:0/3821639656 shutdown_connections 2024-09-16T09:55:21.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 --2- 172.21.15.111:0/3821639656 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0c41033c0 0x7fa0c410b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:21.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 --2- 172.21.15.111:0/3821639656 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4102e80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:21.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 -- 172.21.15.111:0/3821639656 >> 172.21.15.111:0/3821639656 conn(0x7fa0c40fc4c0 msgr2=0x7fa0c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:21.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 -- 172.21.15.111:0/3821639656 shutdown_connections 2024-09-16T09:55:21.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.996+0000 7fa0caeca640 1 -- 172.21.15.111:0/3821639656 wait complete. 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0caeca640 1 Processor -- start 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0caeca640 1 -- start start 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0caeca640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4100700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0caeca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0c41033c0 0x7fa0c4100c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0caeca640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c410edd0 con 0x7fa0c4102aa0 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0caeca640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c410ec50 con 0x7fa0c41033c0 2024-09-16T09:55:22.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0c8c66640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4100700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0c8c66640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4100700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:51696/0 (socket says 172.21.15.111:51696) 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0c8c66640 1 -- 172.21.15.111:0/2734900754 learned_addr learned my addr 172.21.15.111:0/2734900754 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.997+0000 7fa0c3fff640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0c41033c0 0x7fa0c4100c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c8c66640 1 -- 172.21.15.111:0/2734900754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0c41033c0 msgr2=0x7fa0c4100c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c8c66640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0c41033c0 0x7fa0c4100c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c8c66640 1 -- 172.21.15.111:0/2734900754 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c4101180 con 0x7fa0c4102aa0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c8c66640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4100700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8031460 tx=0x7fa0b80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0b803f070 con 0x7fa0c4102aa0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c4101410 con 0x7fa0c4102aa0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0b80035f0 con 0x7fa0c4102aa0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0b8035030 con 0x7fa0c4102aa0 2024-09-16T09:55:22.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.998+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c41a3dc0 con 0x7fa0c4102aa0 2024-09-16T09:55:22.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:21.999+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c406a410 con 0x7fa0c4102aa0 2024-09-16T09:55:22.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.000+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fa0b8042070 con 0x7fa0c4102aa0 2024-09-16T09:55:22.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.000+0000 7fa0c1ffb640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa0b407abf0 0x7fa0b407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.001+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fa0b80be710 con 0x7fa0c4102aa0 2024-09-16T09:55:22.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.001+0000 7fa0c3fff640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa0b407abf0 0x7fa0b407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.001+0000 7fa0c3fff640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa0b407abf0 0x7fa0b407d0b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4102190 tx=0x7fa0b000b2e0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.008+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fa0b808eb40 con 0x7fa0c4102aa0 2024-09-16T09:55:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.208+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa0c4062630 con 0x7fa0b407abf0 2024-09-16T09:55:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.210+0000 7fa0c1ffb640 1 -- 172.21.15.111:0/2734900754 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7fa0c4062630 con 0x7fa0b407abf0 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa0b407abf0 msgr2=0x7fa0b407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa0b407abf0 0x7fa0b407d0b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4102190 tx=0x7fa0b000b2e0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 msgr2=0x7fa0c4100700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4100700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8031460 tx=0x7fa0b80045e0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 shutdown_connections 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fa0b407abf0 0x7fa0b407d0b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fa0c41033c0 0x7fa0c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 --2- 172.21.15.111:0/2734900754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa0c4102aa0 0x7fa0c4100700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 >> 172.21.15.111:0/2734900754 conn(0x7fa0c40fc4c0 msgr2=0x7fa0c4108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 shutdown_connections 2024-09-16T09:55:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.212+0000 7fa0caeca640 1 -- 172.21.15.111:0/2734900754 wait complete. 2024-09-16T09:55:22.222 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:55:22.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 -- 172.21.15.111:0/2391068454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 msgr2=0x7fadb0100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 --2- 172.21.15.111:0/2391068454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb0100160 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fada0009880 tx=0x7fada002a530 comp rx=0 tx=0).stop 2024-09-16T09:55:22.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 -- 172.21.15.111:0/2391068454 shutdown_connections 2024-09-16T09:55:22.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 --2- 172.21.15.111:0/2391068454 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb0100160 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 --2- 172.21.15.111:0/2391068454 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb0106850 0x7fadb0106c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 -- 172.21.15.111:0/2391068454 >> 172.21.15.111:0/2391068454 conn(0x7fadb00fbc10 msgr2=0x7fadb00fe030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:22.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.296+0000 7fadb7c81640 1 -- 172.21.15.111:0/2391068454 shutdown_connections 2024-09-16T09:55:22.299 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 -- 172.21.15.111:0/2391068454 wait complete. 2024-09-16T09:55:22.300 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 Processor -- start 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 -- start start 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb019def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb0106850 0x7fadb019e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fadb0115390 con 0x7fadb00ffd20 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb7c81640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fadb0115210 con 0x7fadb0106850 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.297+0000 7fadb5a1d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb019def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb5a1d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb019def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:51710/0 (socket says 172.21.15.111:51710) 2024-09-16T09:55:22.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb5a1d640 1 -- 172.21.15.111:0/661927523 learned_addr learned my addr 172.21.15.111:0/661927523 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb521c640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb0106850 0x7fadb019e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb5a1d640 1 -- 172.21.15.111:0/661927523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb0106850 msgr2=0x7fadb019e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb5a1d640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb0106850 0x7fadb019e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb5a1d640 1 -- 172.21.15.111:0/661927523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadb01a27c0 con 0x7fadb00ffd20 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb5a1d640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb019def0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c810 tx=0x7fadac00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadac004020 con 0x7fadb00ffd20 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fadac0041c0 con 0x7fadb00ffd20 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadb01a2ab0 con 0x7fadb00ffd20 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fadac0047a0 con 0x7fadb00ffd20 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.298+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadb01a3040 con 0x7fadb00ffd20 2024-09-16T09:55:22.302 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.299+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb0100f40 con 0x7fadb00ffd20 2024-09-16T09:55:22.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.300+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fadac0079b0 con 0x7fadb00ffd20 2024-09-16T09:55:22.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.301+0000 7fada6ffd640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad9c07ac00 0x7fad9c07d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.301+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fadac09dcd0 con 0x7fadb00ffd20 2024-09-16T09:55:22.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.301+0000 7fadb521c640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad9c07ac00 0x7fad9c07d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.301+0000 7fadb521c640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad9c07ac00 0x7fad9c07d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadb0113710 tx=0x7fada0031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.305+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fadac014030 con 0x7fadb00ffd20 2024-09-16T09:55:22.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.506+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fadb01a3350 con 0x7fad9c07ac00 2024-09-16T09:55:22.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.507+0000 7fada6ffd640 1 -- 172.21.15.111:0/661927523 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7fadb01a3350 con 0x7fad9c07ac00 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad9c07ac00 msgr2=0x7fad9c07d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad9c07ac00 0x7fad9c07d0c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadb0113710 tx=0x7fada0031400 comp rx=0 tx=0).stop 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 msgr2=0x7fadb019def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb019def0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fadac00c810 tx=0x7fadac00ccd0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 shutdown_connections 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fad9c07ac00 0x7fad9c07d0c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fadb0106850 0x7fadb019e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 --2- 172.21.15.111:0/661927523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fadb00ffd20 0x7fadb019def0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 >> 172.21.15.111:0/661927523 conn(0x7fadb00fbc10 msgr2=0x7fadb00fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:22.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.509+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 shutdown_connections 2024-09-16T09:55:22.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.510+0000 7fadb7c81640 1 -- 172.21.15.111:0/661927523 wait complete. 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 -- 172.21.15.111:0/947260650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 msgr2=0x7f0710106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 --2- 172.21.15.111:0/947260650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f0710106c00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f070c009880 tx=0x7f070c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 -- 172.21.15.111:0/947260650 shutdown_connections 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 --2- 172.21.15.111:0/947260650 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0710100820 0x7f0710100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 --2- 172.21.15.111:0/947260650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f0710106c00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 -- 172.21.15.111:0/947260650 >> 172.21.15.111:0/947260650 conn(0x7f07100fc520 msgr2=0x7f07100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 -- 172.21.15.111:0/947260650 shutdown_connections 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.590+0000 7f0717a89640 1 -- 172.21.15.111:0/947260650 wait complete. 2024-09-16T09:55:22.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0717a89640 1 Processor -- start 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0717a89640 1 -- start start 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0717a89640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0710100820 0x7f071019f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0717a89640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f071019fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0717a89640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f071010dcf0 con 0x7f0710106820 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0717a89640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f071010db70 con 0x7f0710100820 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0715024640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f071019fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0715024640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f071019fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:51728/0 (socket says 172.21.15.111:51728) 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.591+0000 7f0715024640 1 -- 172.21.15.111:0/193001627 learned_addr learned my addr 172.21.15.111:0/193001627 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0715825640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0710100820 0x7f071019f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0715024640 1 -- 172.21.15.111:0/193001627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0710100820 msgr2=0x7f071019f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0715024640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0710100820 0x7f071019f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0715024640 1 -- 172.21.15.111:0/193001627 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0710199a40 con 0x7f0710106820 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0715024640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f071019fdc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f070000e970 tx=0x7f070000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f070000cac0 con 0x7f0710106820 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07000054e0 con 0x7f0710106820 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0710199d30 con 0x7f0710106820 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071019a2c0 con 0x7f0710106820 2024-09-16T09:55:22.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.592+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0700010430 con 0x7f0710106820 2024-09-16T09:55:22.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.593+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f4005290 con 0x7f0710106820 2024-09-16T09:55:22.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.594+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f07000046c0 con 0x7f0710106820 2024-09-16T09:55:22.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.594+0000 7f0706ffd640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f06fc07ac40 0x7f06fc07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.594+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f070009e370 con 0x7f0710106820 2024-09-16T09:55:22.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.594+0000 7f0715825640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f06fc07ac40 0x7f06fc07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.595+0000 7f0715825640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f06fc07ac40 0x7f06fc07d100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f070c000c00 tx=0x7f070c031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.599+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f0700069970 con 0x7f0710106820 2024-09-16T09:55:22.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.792+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f06f4000bc0 con 0x7f06fc07ac40 2024-09-16T09:55:22.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.802+0000 7f0706ffd640 1 -- 172.21.15.111:0/193001627 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f06f4000bc0 con 0x7f06fc07ac40 2024-09-16T09:55:22.804 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:55:22.804 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (6m) 50s ago 17m 20.6M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:55:22.804 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (8m) 50s ago 17m 9143k - 19.1.1-328-gad35db06 b5388489f99e 7f32d4588dbb 2024-09-16T09:55:22.804 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (8m) 8s ago 16m 8967k - 19.1.1-328-gad35db06 b5388489f99e a0c7508211f0 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (4m) 50s ago 17m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (4m) 8s ago 16m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 50s ago 17m 75.9M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (80s) 50s ago 12m 14.0M - 19.3.0-4882-g66e33d6a 261f2dc7b20f cf8efae733d5 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (55s) 50s ago 12m 14.7M - 19.3.0-4882-g66e33d6a 261f2dc7b20f b538ac16c766 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (36s) 8s ago 12m 15.4M - 19.3.0-4882-g66e33d6a 261f2dc7b20f c17003510f66 2024-09-16T09:55:22.805 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (11s) 8s ago 12m 11.7M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 2722c6788018 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (8m) 50s ago 18m 528M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (7m) 8s ago 16m 457M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (5m) 50s ago 18m 52.6M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (5m) 8s ago 16m 43.7M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (7m) 50s ago 17m 11.3M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (7m) 8s ago 16m 10.9M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:55:22.806 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (4m) 50s ago 15m 111M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:55:22.807 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (3m) 50s ago 14m 134M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:55:22.807 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (3m) 50s ago 14m 98.5M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:55:22.807 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (2m) 8s ago 13m 118M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:55:22.807 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (2m) 8s ago 13m 103M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 52420a54759b 2024-09-16T09:55:22.807 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (97s) 8s ago 13m 102M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 94a0d154c08f 2024-09-16T09:55:22.807 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (6m) 50s ago 16m 56.8M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:55:22.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f06fc07ac40 msgr2=0x7f06fc07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f06fc07ac40 0x7f06fc07d100 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f070c000c00 tx=0x7f070c031400 comp rx=0 tx=0).stop 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 msgr2=0x7f071019fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f071019fdc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f070000e970 tx=0x7f070000ed70 comp rx=0 tx=0).stop 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 shutdown_connections 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f06fc07ac40 0x7f06fc07d100 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0710106820 0x7f071019fdc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 --2- 172.21.15.111:0/193001627 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0710100820 0x7f071019f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 >> 172.21.15.111:0/193001627 conn(0x7f07100fc520 msgr2=0x7f07100fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:22.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 shutdown_connections 2024-09-16T09:55:22.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.805+0000 7f0717a89640 1 -- 172.21.15.111:0/193001627 wait complete. 2024-09-16T09:55:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:22 smithi111 ceph-mon[109885]: pgmap v284: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-09-16T09:55:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:22 smithi111 ceph-mon[109885]: Upgrade: Updating ceph-exporter.smithi111 (1/2) 2024-09-16T09:55:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-16T09:55:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:22 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:22.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:22 smithi111 ceph-mon[109885]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 -- 172.21.15.111:0/3864141635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 msgr2=0x7f83b8106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 --2- 172.21.15.111:0/3864141635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b8106bc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f83b4009880 tx=0x7f83b402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 -- 172.21.15.111:0/3864141635 shutdown_connections 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 --2- 172.21.15.111:0/3864141635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 0x7f83b8100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 --2- 172.21.15.111:0/3864141635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b8106bc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 -- 172.21.15.111:0/3864141635 >> 172.21.15.111:0/3864141635 conn(0x7f83b80fc4c0 msgr2=0x7f83b80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 -- 172.21.15.111:0/3864141635 shutdown_connections 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 -- 172.21.15.111:0/3864141635 wait complete. 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 Processor -- start 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.886+0000 7f83bf786640 1 -- start start 2024-09-16T09:55:22.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bf786640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 0x7f83b819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bf786640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bf786640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f83b810dd10 con 0x7f83b81067e0 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bf786640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f83b810db90 con 0x7f83b81007e0 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:51742/0 (socket says 172.21.15.111:51742) 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 -- 172.21.15.111:0/116294008 learned_addr learned my addr 172.21.15.111:0/116294008 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bd522640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 0x7f83b819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 -- 172.21.15.111:0/116294008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 msgr2=0x7f83b819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:22.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 0x7f83b819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 -- 172.21.15.111:0/116294008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b8197830 con 0x7f83b81067e0 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bd522640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 0x7f83b819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bcd21640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b819dbf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b420 tx=0x7f83a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83a8011630 con 0x7f83b81067e0 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83a8016070 con 0x7f83b81067e0 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83bf786640 1 -- 172.21.15.111:0/116294008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b8197b20 con 0x7f83b81067e0 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.887+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83a8010d40 con 0x7f83b81067e0 2024-09-16T09:55:22.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.888+0000 7f83bf786640 1 -- 172.21.15.111:0/116294008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b81980b0 con 0x7f83b81067e0 2024-09-16T09:55:22.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.889+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b8101f20 con 0x7f83b81067e0 2024-09-16T09:55:22.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.889+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f83a801b460 con 0x7f83b81067e0 2024-09-16T09:55:22.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.890+0000 7f83ae7fc640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f83a407abf0 0x7f83a407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:22.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.890+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f83a809d5c0 con 0x7f83b81067e0 2024-09-16T09:55:22.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.890+0000 7f83bd522640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f83a407abf0 0x7f83a407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:22.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.890+0000 7f83bd522640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f83a407abf0 0x7f83a407d0b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006010 tx=0x7f83b40095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:22.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:22.894+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f83a8021250 con 0x7f83b81067e0 2024-09-16T09:55:23.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.142+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f83b8198d60 con 0x7f83b81067e0 2024-09-16T09:55:23.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.143+0000 7f83ae7fc640 1 -- 172.21.15.111:0/116294008 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f83a8068ac0 con 0x7f83b81067e0 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:55:23.146 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 6 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 4 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 14 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:55:23.147 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f83a407abf0 msgr2=0x7f83a407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f83a407abf0 0x7f83a407d0b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f83b4006010 tx=0x7f83b40095f0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 msgr2=0x7f83b819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b819dbf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b420 tx=0x7f83a800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 shutdown_connections 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f83a407abf0 0x7f83a407d0b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f83b81067e0 0x7f83b819dbf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 --2- 172.21.15.111:0/116294008 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f83b81007e0 0x7f83b819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 >> 172.21.15.111:0/116294008 conn(0x7f83b80fc4c0 msgr2=0x7f83b8069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:23.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 shutdown_connections 2024-09-16T09:55:23.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.145+0000 7f83a3fff640 1 -- 172.21.15.111:0/116294008 wait complete. 2024-09-16T09:55:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:22 smithi114 ceph-mon[79732]: pgmap v284: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-09-16T09:55:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:22 smithi114 ceph-mon[79732]: Upgrade: Updating ceph-exporter.smithi111 (1/2) 2024-09-16T09:55:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi111", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-16T09:55:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:22 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:23.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:22 smithi114 ceph-mon[79732]: Deploying daemon ceph-exporter.smithi111 on smithi111 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 -- 172.21.15.111:0/3221978418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341067e0 msgr2=0x7f5234106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 --2- 172.21.15.111:0/3221978418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341067e0 0x7f5234106bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5224009880 tx=0x7f522402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 -- 172.21.15.111:0/3221978418 shutdown_connections 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 --2- 172.21.15.111:0/3221978418 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341007e0 0x7f5234100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 --2- 172.21.15.111:0/3221978418 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341067e0 0x7f5234106bc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 -- 172.21.15.111:0/3221978418 >> 172.21.15.111:0/3221978418 conn(0x7f52340fc4c0 msgr2=0x7f52340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.238+0000 7f5238911640 1 -- 172.21.15.111:0/3221978418 shutdown_connections 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.239+0000 7f5238911640 1 -- 172.21.15.111:0/3221978418 wait complete. 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.239+0000 7f5238911640 1 Processor -- start 2024-09-16T09:55:23.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.239+0000 7f5238911640 1 -- start start 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.239+0000 7f5238911640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 0x7f52341965b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.239+0000 7f5238911640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341067e0 0x7f5234196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.239+0000 7f5238911640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f523410dc90 con 0x7f52341007e0 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f5238911640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f523410db10 con 0x7f52341067e0 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 0x7f52341965b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 0x7f52341965b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:51754/0 (socket says 172.21.15.111:51754) 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 -- 172.21.15.111:0/224844797 learned_addr learned my addr 172.21.15.111:0/224844797 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f5231d9b640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341067e0 0x7f5234196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 -- 172.21.15.111:0/224844797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341067e0 msgr2=0x7f5234196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341067e0 0x7f5234196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 -- 172.21.15.111:0/224844797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5234197030 con 0x7f52341007e0 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f5231d9b640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341067e0 0x7f5234196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:55:23.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f523259c640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 0x7f52341965b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5224031460 tx=0x7f52240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f522403f070 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52240044d0 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52341972c0 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.240+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5224035030 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.241+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52341a3df0 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.241+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5234101f20 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.242+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f5224042070 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.242+0000 7f52237fe640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f521c07ac00 0x7f521c07d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.243+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f52240be940 con 0x7f52341007e0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.243+0000 7f5231d9b640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f521c07ac00 0x7f521c07d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.243+0000 7f5231d9b640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f521c07ac00 0x7f521c07d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5234198710 tx=0x7f5228005d90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:23.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.247+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f5224004cf0 con 0x7f52341007e0 2024-09-16T09:55:23.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.480+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5234103a50 con 0x7f52341007e0 2024-09-16T09:55:23.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.481+0000 7f52237fe640 1 -- 172.21.15.111:0/224844797 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 36 v36) ==== 76+0+2023 (secure 0 0 0) 0x7f522408e020 con 0x7f52341007e0 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:e36 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:55:18:941345+0000 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:55:23.483 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 36 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:55:17.944327+0000 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 90 2024-09-16T09:55:23.484 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=34314} 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:55:23.485 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 34314 members: 34314 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:34314} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/2183853210,v1:172.21.15.111:6829/2183853210] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.114:6824/2412191913,v1:172.21.15.114:6825/2412191913] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:55:23.486 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.114:6826/2165184879,v1:172.21.15.114:6827/2165184879] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 36 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f521c07ac00 msgr2=0x7f521c07d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f521c07ac00 0x7f521c07d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5234198710 tx=0x7f5228005d90 comp rx=0 tx=0).stop 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 msgr2=0x7f52341965b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 0x7f52341965b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5224031460 tx=0x7f52240048f0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 shutdown_connections 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f521c07ac00 0x7f521c07d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f52341067e0 0x7f5234196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 --2- 172.21.15.111:0/224844797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52341007e0 0x7f52341965b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 >> 172.21.15.111:0/224844797 conn(0x7f52340fc4c0 msgr2=0x7f52340fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 shutdown_connections 2024-09-16T09:55:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.484+0000 7f5238911640 1 -- 172.21.15.111:0/224844797 wait complete. 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.576+0000 7fab6a315640 1 -- 172.21.15.111:0/396802549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 msgr2=0x7fab64107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.576+0000 7fab6a315640 1 --2- 172.21.15.111:0/396802549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64107cf0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fab54009880 tx=0x7fab5402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.576+0000 7fab6a315640 1 -- 172.21.15.111:0/396802549 shutdown_connections 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.576+0000 7fab6a315640 1 --2- 172.21.15.111:0/396802549 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 0x7fab64101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.576+0000 7fab6a315640 1 --2- 172.21.15.111:0/396802549 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64107cf0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.576+0000 7fab6a315640 1 -- 172.21.15.111:0/396802549 >> 172.21.15.111:0/396802549 conn(0x7fab640fd5f0 msgr2=0x7fab640ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.577+0000 7fab6a315640 1 -- 172.21.15.111:0/396802549 shutdown_connections 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.577+0000 7fab6a315640 1 -- 172.21.15.111:0/396802549 wait complete. 2024-09-16T09:55:23.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.577+0000 7fab6a315640 1 Processor -- start 2024-09-16T09:55:23.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.577+0000 7fab6a315640 1 -- start start 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab6a315640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 0x7fab640744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab6a315640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab6a315640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fab6410ede0 con 0x7fab64107910 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab6a315640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fab6410ec60 con 0x7fab64101910 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab63fff640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 0x7fab640744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33200/0 (socket says 172.21.15.111:33200) 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 -- 172.21.15.111:0/2280812905 learned_addr learned my addr 172.21.15.111:0/2280812905 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 -- 172.21.15.111:0/2280812905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 msgr2=0x7fab640744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 0x7fab640744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 -- 172.21.15.111:0/2280812905 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab64074f70 con 0x7fab64107910 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab63fff640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 0x7fab640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab637fe640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64074a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c8f0 tx=0x7fab5800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.578+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab580079b0 con 0x7fab64107910 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.579+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab580054e0 con 0x7fab64107910 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.579+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab64075260 con 0x7fab64107910 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.579+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab58004dd0 con 0x7fab64107910 2024-09-16T09:55:23.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.579+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab641a3e50 con 0x7fab64107910 2024-09-16T09:55:23.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.580+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab64103050 con 0x7fab64107910 2024-09-16T09:55:23.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.580+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fab5800f450 con 0x7fab64107910 2024-09-16T09:55:23.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.581+0000 7fab617fa640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fab4c07abf0 0x7fab4c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.581+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fab5809dc80 con 0x7fab64107910 2024-09-16T09:55:23.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.581+0000 7fab63fff640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fab4c07abf0 0x7fab4c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.581+0000 7fab63fff640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fab4c07abf0 0x7fab4c07d0b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab54000c00 tx=0x7fab54031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:23.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.585+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fab58014030 con 0x7fab64107910 2024-09-16T09:55:23.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.782+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fab64062630 con 0x7fab4c07abf0 2024-09-16T09:55:23.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.783+0000 7fab617fa640 1 -- 172.21.15.111:0/2280812905 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7fab64062630 con 0x7fab4c07abf0 2024-09-16T09:55:23.784 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": true, 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [ 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "mon", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "osd", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "crash", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "mds" 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": "16/23 daemons upgraded", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-16T09:55:23.785 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:55:23.786 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:55:23.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fab4c07abf0 msgr2=0x7fab4c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fab4c07abf0 0x7fab4c07d0b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fab54000c00 tx=0x7fab54031400 comp rx=0 tx=0).stop 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 msgr2=0x7fab64074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64074a30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c8f0 tx=0x7fab5800cdb0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 shutdown_connections 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fab4c07abf0 0x7fab4c07d0b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fab64107910 0x7fab64074a30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 --2- 172.21.15.111:0/2280812905 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fab64101910 0x7fab640744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 >> 172.21.15.111:0/2280812905 conn(0x7fab640fd5f0 msgr2=0x7fab640fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 shutdown_connections 2024-09-16T09:55:23.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.785+0000 7fab6a315640 1 -- 172.21.15.111:0/2280812905 wait complete. 2024-09-16T09:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 -- 172.21.15.111:0/968458788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c101930 msgr2=0x7ff67c101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 --2- 172.21.15.111:0/968458788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c101930 0x7ff67c101d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff670009880 tx=0x7ff67002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 -- 172.21.15.111:0/968458788 shutdown_connections 2024-09-16T09:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 --2- 172.21.15.111:0/968458788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c101930 0x7ff67c101d90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 --2- 172.21.15.111:0/968458788 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c107930 0x7ff67c107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 -- 172.21.15.111:0/968458788 >> 172.21.15.111:0/968458788 conn(0x7ff67c0fd630 msgr2=0x7ff67c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 -- 172.21.15.111:0/968458788 shutdown_connections 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 -- 172.21.15.111:0/968458788 wait complete. 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.867+0000 7ff681c25640 1 Processor -- start 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff681c25640 1 -- start start 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff681c25640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c101930 0x7ff67c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff681c25640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 0x7ff67c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff681c25640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10ede0 con 0x7ff67c107930 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff681c25640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff67c10ec60 con 0x7ff67c101930 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 0x7ff67c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 0x7ff67c19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33216/0 (socket says 172.21.15.111:33216) 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 -- 172.21.15.111:0/2371516826 learned_addr learned my addr 172.21.15.111:0/2371516826 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67b7fe640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c101930 0x7ff67c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 -- 172.21.15.111:0/2371516826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c101930 msgr2=0x7ff67c19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:23.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c101930 0x7ff67c19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 -- 172.21.15.111:0/2371516826 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff67c197850 con 0x7ff67c107930 2024-09-16T09:55:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67b7fe640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c101930 0x7ff67c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:55:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.868+0000 7ff67affd640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 0x7ff67c19dc10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff670031460 tx=0x7ff6700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.869+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff67003f070 con 0x7ff67c107930 2024-09-16T09:55:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.869+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff67c197ae0 con 0x7ff67c107930 2024-09-16T09:55:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.869+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff670004b10 con 0x7ff67c107930 2024-09-16T09:55:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.869+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff670035030 con 0x7ff67c107930 2024-09-16T09:55:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.869+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff67c198010 con 0x7ff67c107930 2024-09-16T09:55:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.870+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff67c103070 con 0x7ff67c107930 2024-09-16T09:55:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.870+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ff670042070 con 0x7ff67c107930 2024-09-16T09:55:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.871+0000 7ff678ff9640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff66407ac00 0x7ff66407d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.871+0000 7ff67b7fe640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff66407ac00 0x7ff66407d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.871+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7ff6700be990 con 0x7ff67c107930 2024-09-16T09:55:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.871+0000 7ff67b7fe640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff66407ac00 0x7ff66407d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009b40 tx=0x7ff66c005e50 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:23.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:23.875+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ff670089f10 con 0x7ff67c107930 2024-09-16T09:55:24.067 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:23 smithi111 ceph-mon[109885]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:24.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:23 smithi111 ceph-mon[109885]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:24.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:23 smithi111 ceph-mon[109885]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:24.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:23 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/116294008' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:24.068 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:23 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/224844797' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:55:24.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.124+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff67c198db0 con 0x7ff67c107930 2024-09-16T09:55:24.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.125+0000 7ff678ff9640 1 -- 172.21.15.111:0/2371516826 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7ff67c198db0 con 0x7ff67c107930 2024-09-16T09:55:24.127 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:55:24.127 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:55:24.127 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:55:24.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff66407ac00 msgr2=0x7ff66407d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:24.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff66407ac00 0x7ff66407d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff66c009b40 tx=0x7ff66c005e50 comp rx=0 tx=0).stop 2024-09-16T09:55:24.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 msgr2=0x7ff67c19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 0x7ff67c19dc10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff670031460 tx=0x7ff6700045e0 comp rx=0 tx=0).stop 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 shutdown_connections 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff66407ac00 0x7ff66407d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff67c107930 0x7ff67c19dc10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 --2- 172.21.15.111:0/2371516826 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff67c101930 0x7ff67c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 >> 172.21.15.111:0/2371516826 conn(0x7ff67c0fd630 msgr2=0x7ff67c0fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 shutdown_connections 2024-09-16T09:55:24.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:24.127+0000 7ff681c25640 1 -- 172.21.15.111:0/2371516826 wait complete. 2024-09-16T09:55:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:23 smithi114 ceph-mon[79732]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:23 smithi114 ceph-mon[79732]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:23 smithi114 ceph-mon[79732]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:23 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/116294008' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:24.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:23 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/224844797' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:55:25.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:24 smithi111 ceph-mon[109885]: pgmap v285: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-09-16T09:55:25.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:24 smithi111 ceph-mon[109885]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:25.041 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:24 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2371516826' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:55:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:24 smithi114 ceph-mon[79732]: pgmap v285: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.9 KiB/s wr, 6 op/s 2024-09-16T09:55:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:24 smithi114 ceph-mon[79732]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:24 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2371516826' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:55:26.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:26 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:26.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:26 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:26.681 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:26 smithi111 ceph-mon[109885]: pgmap v286: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-16T09:55:26.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:26 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:26.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:26 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:26.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:26 smithi114 ceph-mon[79732]: pgmap v286: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-16T09:55:28.109 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:27 smithi114 ceph-mon[79732]: Upgrade: Updating ceph-exporter.smithi114 (2/2) 2024-09-16T09:55:28.109 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:27 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:28.109 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:27 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-16T09:55:28.109 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:27 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:28.109 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:27 smithi114 ceph-mon[79732]: Deploying daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:55:28.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:27 smithi111 ceph-mon[109885]: Upgrade: Updating ceph-exporter.smithi114 (2/2) 2024-09-16T09:55:28.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:27 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:28.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:27 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi114", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-16T09:55:28.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:27 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:28.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:27 smithi111 ceph-mon[109885]: Deploying daemon ceph-exporter.smithi114 on smithi114 2024-09-16T09:55:28.855 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:28 smithi114 ceph-mon[79732]: pgmap v287: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-16T09:55:29.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:28 smithi111 ceph-mon[109885]: pgmap v287: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-16T09:55:31.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:30 smithi111 ceph-mon[109885]: pgmap v288: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-16T09:55:31.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:31.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:31.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:31.040 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:31.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:30 smithi114 ceph-mon[79732]: pgmap v288: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-09-16T09:55:31.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:31.062 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:31.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:31.063 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:32 smithi111 ceph-mon[109885]: pgmap v289: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:32 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:32 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:32 smithi114 ceph-mon[79732]: pgmap v289: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:32 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:32 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:34.074 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:33 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:34.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:33 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:34.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:33 smithi111 ceph-mon[109885]: pgmap v290: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:33 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:33 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:34.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:33 smithi114 ceph-mon[79732]: pgmap v290: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:35.746 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:35 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.746 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:35 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.746 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:35 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.746 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:35 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:35 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:35 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:35 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:35.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:35 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:36.743 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:36 smithi111 ceph-mon[109885]: pgmap v291: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:36.743 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:36.743 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:36 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:36 smithi114 ceph-mon[79732]: pgmap v291: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:36.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:36 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: pgmap v292: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:38 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-16T09:55:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: pgmap v292: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:39.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:38 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-16T09:55:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: Upgrade: Setting filesystem cephfs Joinable 2024-09-16T09:55:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-16T09:55:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:55:40.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"}]': finished 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi114"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi114"}]': finished 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.133 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T09:55:40.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-16T09:55:40.135 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T09:55:40.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-16T09:55:40.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T09:55:40.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-16T09:55:40.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T09:55:40.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-16T09:55:40.136 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:40.137 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:40.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:40.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:40.138 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: Upgrade: Setting filesystem cephfs Joinable 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: fsmap cephfs:1 {0=cephfs.smithi111.jnzoej=up:active} 3 up:standby 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi111"}]': finished 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi114"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi114"}]': finished 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-16T09:55:40.190 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-16T09:55:40.191 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-16T09:55:40.192 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:55:40.193 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all iscsi 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all nfs 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: Upgrade: Setting container_image for all nvmeof 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: Upgrade: Finalizing container_image settings 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: Upgrade: Complete! 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: pgmap v293: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:40.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all ceph-exporter 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all iscsi 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all nfs 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: Upgrade: Setting container_image for all nvmeof 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: Upgrade: Finalizing container_image settings 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: Upgrade: Complete! 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: pgmap v293: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:55:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:42 smithi111 ceph-mon[109885]: pgmap v294: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:42 smithi114 ceph-mon[79732]: pgmap v294: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:45.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:44 smithi111 ceph-mon[109885]: pgmap v295: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:45.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:44 smithi114 ceph-mon[79732]: pgmap v295: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:46.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:55:47.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:46 smithi111 ceph-mon[109885]: pgmap v296: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:46 smithi114 ceph-mon[79732]: pgmap v296: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:48 smithi111 ceph-mon[109885]: pgmap v297: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:48 smithi114 ceph-mon[79732]: pgmap v297: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:50.947 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:50 smithi114 ceph-mon[79732]: pgmap v298: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:51.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:50 smithi111 ceph-mon[109885]: pgmap v298: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:52 smithi111 ceph-mon[109885]: pgmap v299: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:52 smithi114 ceph-mon[79732]: pgmap v299: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.221+0000 7f1caf6cb640 1 -- 172.21.15.111:0/1603845273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 msgr2=0x7f1ca81001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.221+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/1603845273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca81001d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009880 tx=0x7f1c9802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.221+0000 7f1caf6cb640 1 -- 172.21.15.111:0/1603845273 shutdown_connections 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.221+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/1603845273 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca81001d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.221+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/1603845273 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 0x7f1ca8106d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.222+0000 7f1caf6cb640 1 -- 172.21.15.111:0/1603845273 >> 172.21.15.111:0/1603845273 conn(0x7f1ca80fbc60 msgr2=0x7f1ca80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.222+0000 7f1caf6cb640 1 -- 172.21.15.111:0/1603845273 shutdown_connections 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.222+0000 7f1caf6cb640 1 -- 172.21.15.111:0/1603845273 wait complete. 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.222+0000 7f1caf6cb640 1 Processor -- start 2024-09-16T09:55:54.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.222+0000 7f1caf6cb640 1 -- start start 2024-09-16T09:55:54.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1caf6cb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:54.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1caf6cb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 0x7f1ca819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:54.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1caf6cb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca810eed0 con 0x7f1ca80ffd70 2024-09-16T09:55:54.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1caf6cb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca810ed50 con 0x7f1ca8106950 2024-09-16T09:55:54.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:54.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47776/0 (socket says 172.21.15.111:47776) 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 -- 172.21.15.111:0/2363262058 learned_addr learned my addr 172.21.15.111:0/2363262058 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cacc66640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 0x7f1ca819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 -- 172.21.15.111:0/2363262058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 msgr2=0x7f1ca819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 0x7f1ca819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 -- 172.21.15.111:0/2363262058 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca8197810 con 0x7f1ca80ffd70 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cacc66640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 0x7f1ca819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1cad467640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca819d690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400c810 tx=0x7f1ca400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ca4004020 con 0x7f1ca80ffd70 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ca40041c0 con 0x7f1ca80ffd70 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.223+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca8197b00 con 0x7f1ca80ffd70 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.224+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ca40047a0 con 0x7f1ca80ffd70 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.224+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca8198060 con 0x7f1ca80ffd70 2024-09-16T09:55:54.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.225+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca8103090 con 0x7f1ca80ffd70 2024-09-16T09:55:54.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.225+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1ca40079b0 con 0x7f1ca80ffd70 2024-09-16T09:55:54.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.226+0000 7f1c9e7fc640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1c9407abf0 0x7f1c9407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:54.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.226+0000 7f1cacc66640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1c9407abf0 0x7f1c9407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:54.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.226+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f1ca409dd40 con 0x7f1ca80ffd70 2024-09-16T09:55:54.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.226+0000 7f1cacc66640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1c9407abf0 0x7f1c9407d0b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8198b60 tx=0x7f1c98031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:54.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.230+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1ca40a1030 con 0x7f1ca80ffd70 2024-09-16T09:55:54.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.424+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1ca8198370 con 0x7f1c9407abf0 2024-09-16T09:55:54.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.425+0000 7f1c9e7fc640 1 -- 172.21.15.111:0/2363262058 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f1ca8198370 con 0x7f1c9407abf0 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1c9407abf0 msgr2=0x7f1c9407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1c9407abf0 0x7f1c9407d0b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8198b60 tx=0x7f1c98031400 comp rx=0 tx=0).stop 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 msgr2=0x7f1ca819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca819d690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400c810 tx=0x7f1ca400ccd0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 shutdown_connections 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1c9407abf0 0x7f1c9407d0b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1ca8106950 0x7f1ca819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 --2- 172.21.15.111:0/2363262058 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1ca80ffd70 0x7f1ca819d690 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 >> 172.21.15.111:0/2363262058 conn(0x7f1ca80fbc60 msgr2=0x7f1ca80fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 shutdown_connections 2024-09-16T09:55:54.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:54.427+0000 7f1caf6cb640 1 -- 172.21.15.111:0/2363262058 wait complete. 2024-09-16T09:55:55.070 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:54 smithi111 ceph-mon[109885]: pgmap v300: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:55.099 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch ps' 2024-09-16T09:55:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:54 smithi114 ceph-mon[79732]: pgmap v300: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:55.393 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:55:55.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 -- 172.21.15.111:0/3557794169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881007f0 msgr2=0x7f9088100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:55.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 --2- 172.21.15.111:0/3557794169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881007f0 0x7f9088100c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9078009c20 tx=0x7f907802a970 comp rx=0 tx=0).stop 2024-09-16T09:55:55.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 -- 172.21.15.111:0/3557794169 shutdown_connections 2024-09-16T09:55:55.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 --2- 172.21.15.111:0/3557794169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881007f0 0x7f9088100c50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:55.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 --2- 172.21.15.111:0/3557794169 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90881067f0 0x7f9088106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 -- 172.21.15.111:0/3557794169 >> 172.21.15.111:0/3557794169 conn(0x7f90880fc4f0 msgr2=0x7f90880fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 -- 172.21.15.111:0/3557794169 shutdown_connections 2024-09-16T09:55:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.805+0000 7f908eed0640 1 -- 172.21.15.111:0/3557794169 wait complete. 2024-09-16T09:55:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908eed0640 1 Processor -- start 2024-09-16T09:55:55.808 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908eed0640 1 -- start start 2024-09-16T09:55:55.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908eed0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90881007f0 0x7f9088198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:55.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908eed0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 0x7f9088198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:55.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908eed0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f908810dcc0 con 0x7f90881067f0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908eed0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f908810db40 con 0x7f90881007f0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f9087fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 0x7f9088198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f9087fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 0x7f9088198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47796/0 (socket says 172.21.15.111:47796) 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f9087fff640 1 -- 172.21.15.111:0/2226458789 learned_addr learned my addr 172.21.15.111:0/2226458789 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f908cc6c640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90881007f0 0x7f9088198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f9087fff640 1 -- 172.21.15.111:0/2226458789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90881007f0 msgr2=0x7f9088198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.806+0000 7f9087fff640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90881007f0 0x7f9088198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f9087fff640 1 -- 172.21.15.111:0/2226458789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9088199370 con 0x7f90881067f0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f9087fff640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 0x7f9088198d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9078005cc0 tx=0x7f907802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9078047070 con 0x7f90881067f0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f907802f7e0 con 0x7f90881067f0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9088199600 con 0x7f90881067f0 2024-09-16T09:55:55.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9078034070 con 0x7f90881067f0 2024-09-16T09:55:55.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.807+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90881a1bb0 con 0x7f90881067f0 2024-09-16T09:55:55.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.809+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9088101f30 con 0x7f90881067f0 2024-09-16T09:55:55.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.809+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f907804a070 con 0x7f90881067f0 2024-09-16T09:55:55.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.809+0000 7f9085ffb640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907407ac40 0x7f907407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:55.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.809+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f90780bec00 con 0x7f90881067f0 2024-09-16T09:55:55.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.809+0000 7f908cc6c640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907407ac40 0x7f907407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:55.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.810+0000 7f908cc6c640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907407ac40 0x7f907407d100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90800058c0 tx=0x7f908000a250 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:55.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:55.814+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f907803f070 con 0x7f90881067f0 2024-09-16T09:55:56.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.008+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9088062630 con 0x7f907407ac40 2024-09-16T09:55:56.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.018+0000 7f9085ffb640 1 -- 172.21.15.111:0/2226458789 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f9088062630 con 0x7f907407ac40 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (7m) 21s ago 17m 22.2M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (31s) 21s ago 18m 7982k - 19.3.0-4882-g66e33d6a 261f2dc7b20f e17f0b3ff65b 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (26s) 23s ago 17m 7281k - 19.3.0-4882-g66e33d6a 261f2dc7b20f d3f04ea754af 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (5m) 21s ago 18m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (5m) 23s ago 17m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (6m) 21s ago 17m 76.1M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (113s) 21s ago 12m 93.8M - 19.3.0-4882-g66e33d6a 261f2dc7b20f cf8efae733d5 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (88s) 21s ago 12m 15.7M - 19.3.0-4882-g66e33d6a 261f2dc7b20f b538ac16c766 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (69s) 23s ago 12m 15.5M - 19.3.0-4882-g66e33d6a 261f2dc7b20f c17003510f66 2024-09-16T09:55:56.020 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (45s) 23s ago 12m 13.8M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 2722c6788018 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (8m) 21s ago 19m 529M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (8m) 23s ago 17m 457M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (5m) 21s ago 19m 57.9M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (5m) 23s ago 16m 43.1M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (7m) 21s ago 17m 11.7M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (7m) 23s ago 17m 11.1M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (4m) 21s ago 15m 117M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (4m) 21s ago 15m 140M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (3m) 21s ago 14m 102M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (3m) 23s ago 14m 117M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (2m) 23s ago 14m 103M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 52420a54759b 2024-09-16T09:55:56.021 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (2m) 23s ago 13m 103M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 94a0d154c08f 2024-09-16T09:55:56.022 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (7m) 21s ago 17m 56.8M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:55:56.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907407ac40 msgr2=0x7f907407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:56.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907407ac40 0x7f907407d100 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90800058c0 tx=0x7f908000a250 comp rx=0 tx=0).stop 2024-09-16T09:55:56.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 msgr2=0x7f9088198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:56.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 0x7f9088198d70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9078005cc0 tx=0x7f907802f5f0 comp rx=0 tx=0).stop 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 shutdown_connections 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f907407ac40 0x7f907407d100 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f90881067f0 0x7f9088198d70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 --2- 172.21.15.111:0/2226458789 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f90881007f0 0x7f9088198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 >> 172.21.15.111:0/2226458789 conn(0x7f90880fc4f0 msgr2=0x7f90880fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 shutdown_connections 2024-09-16T09:55:56.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:56.020+0000 7f908eed0640 1 -- 172.21.15.111:0/2226458789 wait complete. 2024-09-16T09:55:56.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:55 smithi111 ceph-mon[109885]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:56.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:55 smithi114 ceph-mon[79732]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:56.799 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch upgrade status' 2024-09-16T09:55:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:55:57.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:56 smithi111 ceph-mon[109885]: pgmap v301: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:56 smithi114 ceph-mon[79732]: pgmap v301: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 -- 172.21.15.111:0/3398490020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b301001c0 msgr2=0x7f3b301005a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 --2- 172.21.15.111:0/3398490020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b301001c0 0x7f3b301005a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b20009880 tx=0x7f3b2002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 -- 172.21.15.111:0/3398490020 shutdown_connections 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 --2- 172.21.15.111:0/3398490020 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b30100b70 0x7f3b30104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 --2- 172.21.15.111:0/3398490020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b301001c0 0x7f3b301005a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 -- 172.21.15.111:0/3398490020 >> 172.21.15.111:0/3398490020 conn(0x7f3b300fbc40 msgr2=0x7f3b300fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:57.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 -- 172.21.15.111:0/3398490020 shutdown_connections 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.530+0000 7f3b3566c640 1 -- 172.21.15.111:0/3398490020 wait complete. 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b3566c640 1 Processor -- start 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b3566c640 1 -- start start 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b3566c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b301001c0 0x7f3b30198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b3566c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 0x7f3b30198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b3566c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3010dcc0 con 0x7f3b30100b70 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b3566c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3010db40 con 0x7f3b301001c0 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b27fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 0x7f3b30198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b27fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 0x7f3b30198d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47814/0 (socket says 172.21.15.111:47814) 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b27fff640 1 -- 172.21.15.111:0/487578381 learned_addr learned my addr 172.21.15.111:0/487578381 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.531+0000 7f3b2effd640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b301001c0 0x7f3b30198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:57.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b27fff640 1 -- 172.21.15.111:0/487578381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b301001c0 msgr2=0x7f3b30198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b27fff640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b301001c0 0x7f3b30198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b27fff640 1 -- 172.21.15.111:0/487578381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b301993e0 con 0x7f3b30100b70 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b27fff640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 0x7f3b30198d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800d6f0 tx=0x7f3b1800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b18017070 con 0x7f3b30100b70 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3b1800de00 con 0x7f3b30100b70 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b301a18c0 con 0x7f3b30100b70 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3b18004bb0 con 0x7f3b30100b70 2024-09-16T09:55:57.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.532+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b301a1cc0 con 0x7f3b30100b70 2024-09-16T09:55:57.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.533+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b301016a0 con 0x7f3b30100b70 2024-09-16T09:55:57.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.534+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f3b18009a30 con 0x7f3b30100b70 2024-09-16T09:55:57.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.534+0000 7f3b2cff9640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3b1c07abf0 0x7f3b1c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:57.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.534+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f3b1809d9a0 con 0x7f3b30100b70 2024-09-16T09:55:57.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.534+0000 7f3b2effd640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3b1c07abf0 0x7f3b1c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:57.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.535+0000 7f3b2effd640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3b1c07abf0 0x7f3b1c07d0b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b200096c0 tx=0x7f3b20031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:57.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.539+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f3b18068f20 con 0x7f3b30100b70 2024-09-16T09:55:57.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.728+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3b30062630 con 0x7f3b1c07abf0 2024-09-16T09:55:57.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.730+0000 7f3b2cff9640 1 -- 172.21.15.111:0/487578381 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f3b30062630 con 0x7f3b1c07abf0 2024-09-16T09:55:57.731 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:55:57.731 INFO:teuthology.orchestra.run.smithi111.stdout: "target_image": null, 2024-09-16T09:55:57.731 INFO:teuthology.orchestra.run.smithi111.stdout: "in_progress": false, 2024-09-16T09:55:57.731 INFO:teuthology.orchestra.run.smithi111.stdout: "which": "", 2024-09-16T09:55:57.732 INFO:teuthology.orchestra.run.smithi111.stdout: "services_complete": [], 2024-09-16T09:55:57.732 INFO:teuthology.orchestra.run.smithi111.stdout: "progress": null, 2024-09-16T09:55:57.732 INFO:teuthology.orchestra.run.smithi111.stdout: "message": "", 2024-09-16T09:55:57.732 INFO:teuthology.orchestra.run.smithi111.stdout: "is_paused": false 2024-09-16T09:55:57.732 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3b1c07abf0 msgr2=0x7f3b1c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3b1c07abf0 0x7f3b1c07d0b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b200096c0 tx=0x7f3b20031400 comp rx=0 tx=0).stop 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 msgr2=0x7f3b30198d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 0x7f3b30198d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3b1800d6f0 tx=0x7f3b1800dbb0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 shutdown_connections 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f3b1c07abf0 0x7f3b1c07d0b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.734 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3b30100b70 0x7f3b30198d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 --2- 172.21.15.111:0/487578381 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f3b301001c0 0x7f3b30198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 >> 172.21.15.111:0/487578381 conn(0x7f3b300fbc40 msgr2=0x7f3b300fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 shutdown_connections 2024-09-16T09:55:57.735 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:57.732+0000 7f3b3566c640 1 -- 172.21.15.111:0/487578381 wait complete. 2024-09-16T09:55:58.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:57 smithi111 ceph-mon[109885]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:58.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:57 smithi114 ceph-mon[79732]: from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:58.297 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph health detail' 2024-09-16T09:55:58.547 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:55:58.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:58 smithi111 ceph-mon[109885]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:58.966 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:58 smithi111 ceph-mon[109885]: pgmap v302: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:58.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/821277004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 msgr2=0x7f2a04106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:58.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/821277004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a04106bc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2a00009880 tx=0x7f2a0002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:55:58.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/821277004 shutdown_connections 2024-09-16T09:55:58.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/821277004 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a041007e0 0x7f2a04100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:58.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/821277004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a04106bc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:58.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/821277004 >> 172.21.15.111:0/821277004 conn(0x7f2a040fc4c0 msgr2=0x7f2a040fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:58.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/821277004 shutdown_connections 2024-09-16T09:55:58.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.969+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/821277004 wait complete. 2024-09-16T09:55:58.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0c2b3640 1 Processor -- start 2024-09-16T09:55:58.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0c2b3640 1 -- start start 2024-09-16T09:55:58.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0c2b3640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a041007e0 0x7f2a0419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0c2b3640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a0419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0c2b3640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0410dd10 con 0x7f2a041067e0 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0c2b3640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0410db90 con 0x7f2a041007e0 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0984e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a0419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0984e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a0419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47834/0 (socket says 172.21.15.111:47834) 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.970+0000 7f2a0984e640 1 -- 172.21.15.111:0/1375070463 learned_addr learned my addr 172.21.15.111:0/1375070463 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0a04f640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a041007e0 0x7f2a0419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0984e640 1 -- 172.21.15.111:0/1375070463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a041007e0 msgr2=0x7f2a0419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0984e640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a041007e0 0x7f2a0419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:58.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0984e640 1 -- 172.21.15.111:0/1375070463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a04196740 con 0x7f2a041067e0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0984e640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a0419cbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29f400b420 tx=0x7f29f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29f4011630 con 0x7f2a041067e0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29f4016070 con 0x7f2a041067e0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a04196a30 con 0x7f2a041067e0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29f4010d40 con 0x7f2a041067e0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.971+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a04196f90 con 0x7f2a041067e0 2024-09-16T09:55:58.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.972+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a04101f20 con 0x7f2a041067e0 2024-09-16T09:55:58.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.973+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f29f401b460 con 0x7f2a041067e0 2024-09-16T09:55:58.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.973+0000 7f29fb7fe640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f007abf0 0x7f29f007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:55:58.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.973+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f29f409d5c0 con 0x7f2a041067e0 2024-09-16T09:55:58.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.973+0000 7f2a0a04f640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f007abf0 0x7f29f007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:55:58.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.974+0000 7f2a0a04f640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f007abf0 0x7f29f007d0b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a000096c0 tx=0x7f2a00031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:55:58.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:58.978+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f29f4021250 con 0x7f2a041067e0 2024-09-16T09:55:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:58 smithi114 ceph-mon[79732]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:55:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:58 smithi114 ceph-mon[79732]: pgmap v302: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:55:59.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.223+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2a04108d50 con 0x7f2a041067e0 2024-09-16T09:55:59.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.224+0000 7f29fb7fe640 1 -- 172.21.15.111:0/1375070463 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f29f4068ac0 con 0x7f2a041067e0 2024-09-16T09:55:59.226 INFO:teuthology.orchestra.run.smithi111.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-16T09:55:59.226 INFO:teuthology.orchestra.run.smithi111.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-16T09:55:59.226 INFO:teuthology.orchestra.run.smithi111.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-16T09:55:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f007abf0 msgr2=0x7f29f007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f007abf0 0x7f29f007d0b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2a000096c0 tx=0x7f2a00031400 comp rx=0 tx=0).stop 2024-09-16T09:55:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 msgr2=0x7f2a0419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:55:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a0419cbb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f29f400b420 tx=0x7f29f400b8e0 comp rx=0 tx=0).stop 2024-09-16T09:55:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 shutdown_connections 2024-09-16T09:55:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f29f007abf0 0x7f29f007d0b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:59.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a041067e0 0x7f2a0419cbb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:59.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 --2- 172.21.15.111:0/1375070463 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2a041007e0 0x7f2a0419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:55:59.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 >> 172.21.15.111:0/1375070463 conn(0x7f2a040fc4c0 msgr2=0x7f2a040fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:55:59.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 shutdown_connections 2024-09-16T09:55:59.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:55:59.226+0000 7f2a0c2b3640 1 -- 172.21.15.111:0/1375070463 wait complete. 2024-09-16T09:55:59.789 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions' 2024-09-16T09:56:00.039 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:56:00.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:55:59 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1375070463' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:56:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:55:59 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1375070463' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-16T09:56:00.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 -- 172.21.15.111:0/3763225679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 msgr2=0x7f99d0101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:56:00.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 --2- 172.21.15.111:0/3763225679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d0101d70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f99c00097e0 tx=0x7f99c002a3f0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 -- 172.21.15.111:0/3763225679 shutdown_connections 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 --2- 172.21.15.111:0/3763225679 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d0101d70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 --2- 172.21.15.111:0/3763225679 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d0107910 0x7f99d0107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 -- 172.21.15.111:0/3763225679 >> 172.21.15.111:0/3763225679 conn(0x7f99d00fd5f0 msgr2=0x7f99d00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 -- 172.21.15.111:0/3763225679 shutdown_connections 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.467+0000 7f99d795d640 1 -- 172.21.15.111:0/3763225679 wait complete. 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d795d640 1 Processor -- start 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d795d640 1 -- start start 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d795d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d795d640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d0107910 0x7f99d019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d795d640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f99d010edc0 con 0x7f99d0101910 2024-09-16T09:56:00.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d795d640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f99d010ec40 con 0x7f99d0107910 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d019d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47852/0 (socket says 172.21.15.111:47852) 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 -- 172.21.15.111:0/1349854774 learned_addr learned my addr 172.21.15.111:0/1349854774 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d4ef8640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d0107910 0x7f99d019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 -- 172.21.15.111:0/1349854774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d0107910 msgr2=0x7f99d019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d0107910 0x7f99d019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 -- 172.21.15.111:0/1349854774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d01977d0 con 0x7f99d0101910 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.468+0000 7f99d56f9640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d019d650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00e940 tx=0x7f99cc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.469+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99cc00cac0 con 0x7f99d0101910 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.469+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f99cc0054e0 con 0x7f99d0101910 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.469+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d0197ac0 con 0x7f99d0101910 2024-09-16T09:56:00.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.469+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f99cc004df0 con 0x7f99d0101910 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.469+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d0198020 con 0x7f99d0101910 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.470+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99d0103050 con 0x7f99d0101910 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.470+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f99cc004f90 con 0x7f99d0101910 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.471+0000 7f99c67fc640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f99bc07abe0 0x7f99bc07d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.471+0000 7f99d4ef8640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f99bc07abe0 0x7f99bc07d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.471+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f99cc09e4a0 con 0x7f99d0101910 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.472+0000 7f99d4ef8640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f99bc07abe0 0x7f99bc07d0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99d0198b20 tx=0x7f99c00046c0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:56:00.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.475+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f99cc069a20 con 0x7f99d0101910 2024-09-16T09:56:00.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.722+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f99d0109ea0 con 0x7f99d0101910 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.723+0000 7f99c67fc640 1 -- 172.21.15.111:0/1349854774 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f99cc06e8d0 con 0x7f99d0101910 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:56:00.725 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 6 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 4 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 14 2024-09-16T09:56:00.726 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:56:00.727 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:56:00.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f99bc07abe0 msgr2=0x7f99bc07d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f99bc07abe0 0x7f99bc07d0a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99d0198b20 tx=0x7f99c00046c0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 msgr2=0x7f99d019d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d019d650 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00e940 tx=0x7f99cc00ee00 comp rx=0 tx=0).stop 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 shutdown_connections 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f99bc07abe0 0x7f99bc07d0a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f99d0107910 0x7f99d019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 --2- 172.21.15.111:0/1349854774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99d0101910 0x7f99d019d650 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.725+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 >> 172.21.15.111:0/1349854774 conn(0x7f99d00fd5f0 msgr2=0x7f99d00fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:56:00.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.726+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 shutdown_connections 2024-09-16T09:56:00.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:56:00.726+0000 7f99d795d640 1 -- 172.21.15.111:0/1349854774 wait complete. 2024-09-16T09:56:01.087 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:00 smithi111 ceph-mon[109885]: pgmap v303: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:01.087 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:01.087 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:00 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1349854774' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:56:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:00 smithi114 ceph-mon[79732]: pgmap v303: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:00 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1349854774' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:56:01.397 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-16T09:56:01.647 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:56:02.082 INFO:teuthology.orchestra.run.smithi111.stdout:wait for servicemap items w/ changing names to refresh 2024-09-16T09:56:02.615 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'sleep 60' 2024-09-16T09:56:02.863 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:56:03.124 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:02 smithi111 ceph-mon[109885]: pgmap v304: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:02 smithi114 ceph-mon[79732]: pgmap v304: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:05.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:04 smithi111 ceph-mon[109885]: pgmap v305: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:04 smithi114 ceph-mon[79732]: pgmap v305: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:07.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:06 smithi111 ceph-mon[109885]: pgmap v306: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:06 smithi114 ceph-mon[79732]: pgmap v306: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:09.134 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:08 smithi111 ceph-mon[109885]: pgmap v307: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:08 smithi114 ceph-mon[79732]: pgmap v307: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:10 smithi114 ceph-mon[79732]: pgmap v308: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:11.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:10 smithi111 ceph-mon[109885]: pgmap v308: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:13.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:12 smithi111 ceph-mon[109885]: pgmap v309: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:12 smithi114 ceph-mon[79732]: pgmap v309: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:15.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:14 smithi114 ceph-mon[79732]: pgmap v310: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:15.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:14 smithi111 ceph-mon[109885]: pgmap v310: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:16.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:15 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:16.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:15 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:17.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:16 smithi114 ceph-mon[79732]: pgmap v311: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:17.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:16 smithi111 ceph-mon[109885]: pgmap v311: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:19.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:18 smithi111 ceph-mon[109885]: pgmap v312: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:19.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:18 smithi114 ceph-mon[79732]: pgmap v312: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:20.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:19 smithi111 ceph-mon[109885]: pgmap v313: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:20.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:19 smithi114 ceph-mon[79732]: pgmap v313: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:23.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:22 smithi111 ceph-mon[109885]: pgmap v314: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:23.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:22 smithi114 ceph-mon[79732]: pgmap v314: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:25.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:24 smithi111 ceph-mon[109885]: pgmap v315: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:25.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:24 smithi114 ceph-mon[79732]: pgmap v315: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:26.892 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:26 smithi111 ceph-mon[109885]: pgmap v316: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:27.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:26 smithi114 ceph-mon[79732]: pgmap v316: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:29.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:28 smithi111 ceph-mon[109885]: pgmap v317: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:28 smithi114 ceph-mon[79732]: pgmap v317: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:30 smithi111 ceph-mon[109885]: pgmap v318: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:30 smithi114 ceph-mon[79732]: pgmap v318: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:32 smithi111 ceph-mon[109885]: pgmap v319: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:32 smithi114 ceph-mon[79732]: pgmap v319: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:35.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:34 smithi111 ceph-mon[109885]: pgmap v320: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:34 smithi114 ceph-mon[79732]: pgmap v320: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:37.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:36 smithi111 ceph-mon[109885]: pgmap v321: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:36 smithi114 ceph-mon[79732]: pgmap v321: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:39.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:38 smithi111 ceph-mon[109885]: pgmap v322: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:38 smithi114 ceph-mon[79732]: pgmap v322: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:40.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:39 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:56:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:39 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:56:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:40 smithi111 ceph-mon[109885]: pgmap v323: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:56:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:56:41.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:56:41.154 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:40 smithi114 ceph-mon[79732]: pgmap v323: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:41.154 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:56:41.154 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:56:41.154 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:56:43.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:42 smithi111 ceph-mon[109885]: pgmap v324: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:42 smithi114 ceph-mon[79732]: pgmap v324: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:45.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:44 smithi111 ceph-mon[109885]: pgmap v325: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:45.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:44 smithi114 ceph-mon[79732]: pgmap v325: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:46.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:56:47.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:46 smithi111 ceph-mon[109885]: pgmap v326: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:46 smithi114 ceph-mon[79732]: pgmap v326: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:48 smithi111 ceph-mon[109885]: pgmap v327: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:48 smithi114 ceph-mon[79732]: pgmap v327: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:51.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:50 smithi111 ceph-mon[109885]: pgmap v328: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:51.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:50 smithi114 ceph-mon[79732]: pgmap v328: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:53.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:52 smithi111 ceph-mon[109885]: pgmap v329: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:53.189 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:52 smithi114 ceph-mon[79732]: pgmap v329: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:55.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:54 smithi111 ceph-mon[109885]: pgmap v330: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:55.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:54 smithi114 ceph-mon[79732]: pgmap v330: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:57.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:56 smithi114 ceph-mon[79732]: pgmap v331: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:57.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:56 smithi111 ceph-mon[109885]: pgmap v331: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:59.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:56:58 smithi114 ceph-mon[79732]: pgmap v332: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:56:59.382 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:56:58 smithi111 ceph-mon[109885]: pgmap v332: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:00 smithi111 ceph-mon[109885]: pgmap v333: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:01.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:00 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:00 smithi114 ceph-mon[79732]: pgmap v333: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:01.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:00 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:03.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:02 smithi114 ceph-mon[79732]: pgmap v334: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:03.239 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:02 smithi111 ceph-mon[109885]: pgmap v334: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:04.107 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph orch ps' 2024-09-16T09:57:04.362 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 -- 172.21.15.111:0/4179001139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 msgr2=0x7f1efc106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/4179001139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc106c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009880 tx=0x7f1ef002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 -- 172.21.15.111:0/4179001139 shutdown_connections 2024-09-16T09:57:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/4179001139 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1efc100820 0x7f1efc100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/4179001139 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc106c00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 -- 172.21.15.111:0/4179001139 >> 172.21.15.111:0/4179001139 conn(0x7f1efc0fc520 msgr2=0x7f1efc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 -- 172.21.15.111:0/4179001139 shutdown_connections 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.773+0000 7f1f02fdf640 1 -- 172.21.15.111:0/4179001139 wait complete. 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f02fdf640 1 Processor -- start 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f02fdf640 1 -- start start 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f02fdf640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1efc100820 0x7f1efc19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f02fdf640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f02fdf640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc10dcf0 con 0x7f1efc106820 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f02fdf640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc10db70 con 0x7f1efc100820 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1efbfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1efbfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc19cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45438/0 (socket says 172.21.15.111:45438) 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1efbfff640 1 -- 172.21.15.111:0/2142803603 learned_addr learned my addr 172.21.15.111:0/2142803603 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.774+0000 7f1f00d7b640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1efc100820 0x7f1efc19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1efbfff640 1 -- 172.21.15.111:0/2142803603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1efc100820 msgr2=0x7f1efc19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1efbfff640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1efc100820 0x7f1efc19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1efbfff640 1 -- 172.21.15.111:0/2142803603 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc196700 con 0x7f1efc106820 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1efbfff640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc19cb70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800d6f0 tx=0x7f1ee800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ee8017070 con 0x7f1efc106820 2024-09-16T09:57:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ee800de00 con 0x7f1efc106820 2024-09-16T09:57:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1efc1969f0 con 0x7f1efc106820 2024-09-16T09:57:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ee8004bb0 con 0x7f1efc106820 2024-09-16T09:57:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.775+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1efc196f50 con 0x7f1efc106820 2024-09-16T09:57:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.776+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1efc101f60 con 0x7f1efc106820 2024-09-16T09:57:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.777+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1ee8004e60 con 0x7f1efc106820 2024-09-16T09:57:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.777+0000 7f1ef9ffb640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1eec07abf0 0x7f1eec07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.777+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f1ee809d9e0 con 0x7f1efc106820 2024-09-16T09:57:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.777+0000 7f1f00d7b640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1eec07abf0 0x7f1eec07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:04.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.778+0000 7f1f00d7b640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1eec07abf0 0x7f1eec07d0b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00096c0 tx=0x7f1ef0031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:04.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.782+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1ee8068f20 con 0x7f1efc106820 2024-09-16T09:57:04.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.966+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 --> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1efc197200 con 0x7f1eec07abf0 2024-09-16T09:57:04.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.976+0000 7f1ef9ffb640 1 -- 172.21.15.111:0/2142803603 <== mgr.14724 v2:172.21.15.111:6800/1537958175 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f1efc197200 con 0x7f1eec07abf0 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:alertmanager.smithi111 smithi111 *:9093,9094 running (8m) 90s ago 18m 22.2M - 0.27.0 11f11916f8cd f8782eb26610 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi111 smithi111 running (100s) 90s ago 19m 7982k - 19.3.0-4882-g66e33d6a 261f2dc7b20f e17f0b3ff65b 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-exporter.smithi114 smithi114 running (95s) 92s ago 18m 7281k - 19.3.0-4882-g66e33d6a 261f2dc7b20f d3f04ea754af 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi111 smithi111 running (6m) 90s ago 19m 6895k - 19.3.0-4882-g66e33d6a 261f2dc7b20f cef27775679f 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:crash.smithi114 smithi114 running (6m) 92s ago 18m 6891k - 19.3.0-4882-g66e33d6a 261f2dc7b20f 82426fa5976c 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:grafana.smithi111 smithi111 *:3000 running (7m) 90s ago 18m 76.1M - 10.4.0 c8b91775d855 84172f86c8c5 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.jnzoej smithi111 running (3m) 90s ago 13m 93.8M - 19.3.0-4882-g66e33d6a 261f2dc7b20f cf8efae733d5 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi111.yvusja smithi111 running (2m) 90s ago 13m 15.7M - 19.3.0-4882-g66e33d6a 261f2dc7b20f b538ac16c766 2024-09-16T09:57:04.979 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.bdhdtm smithi114 running (2m) 92s ago 13m 15.5M - 19.3.0-4882-g66e33d6a 261f2dc7b20f c17003510f66 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:mds.cephfs.smithi114.sreoiu smithi114 running (113s) 92s ago 13m 13.8M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 2722c6788018 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi111.erxodt smithi111 *:8443,9283,8765 running (9m) 90s ago 20m 529M - 19.3.0-4882-g66e33d6a 261f2dc7b20f d48bb59b0c28 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:mgr.smithi114.xvotey smithi114 *:8443,9283,8765 running (9m) 92s ago 18m 457M - 19.3.0-4882-g66e33d6a 261f2dc7b20f 860c883880ed 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi111 smithi111 running (6m) 90s ago 20m 57.9M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f b551614a9fe4 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:mon.smithi114 smithi114 running (6m) 92s ago 18m 43.1M 2048M 19.3.0-4882-g66e33d6a 261f2dc7b20f 1890a098e70d 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi111 smithi111 *:9100 running (9m) 90s ago 19m 11.7M - 1.7.0 72c9c2088986 c4b5bfed1f06 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:node-exporter.smithi114 smithi114 *:9100 running (8m) 92s ago 18m 11.1M - 1.7.0 72c9c2088986 ba234f20998c 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.0 smithi111 running (6m) 90s ago 17m 117M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 77d6529d894e 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.1 smithi111 running (5m) 90s ago 16m 140M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 14a192b194c0 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.2 smithi111 running (5m) 90s ago 16m 102M 1216M 19.3.0-4882-g66e33d6a 261f2dc7b20f 93f32c9e8a95 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.3 smithi114 running (4m) 92s ago 15m 117M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f e7f600344e6b 2024-09-16T09:57:04.980 INFO:teuthology.orchestra.run.smithi111.stdout:osd.4 smithi114 running (3m) 92s ago 15m 103M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 52420a54759b 2024-09-16T09:57:04.981 INFO:teuthology.orchestra.run.smithi111.stdout:osd.5 smithi114 running (3m) 92s ago 14m 103M 2240M 19.3.0-4882-g66e33d6a 261f2dc7b20f 94a0d154c08f 2024-09-16T09:57:04.981 INFO:teuthology.orchestra.run.smithi111.stdout:prometheus.smithi111 smithi111 *:9095 running (8m) 90s ago 18m 56.8M - 2.51.0 1d3b7f56885b 3688b3af8511 2024-09-16T09:57:04.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1eec07abf0 msgr2=0x7f1eec07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:04.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1eec07abf0 0x7f1eec07d0b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1ef00096c0 tx=0x7f1ef0031400 comp rx=0 tx=0).stop 2024-09-16T09:57:04.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 msgr2=0x7f1efc19cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc19cb70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800d6f0 tx=0x7f1ee800dbb0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 shutdown_connections 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1eec07abf0 0x7f1eec07d0b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1efc106820 0x7f1efc19cb70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 --2- 172.21.15.111:0/2142803603 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1efc100820 0x7f1efc19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 >> 172.21.15.111:0/2142803603 conn(0x7f1efc0fc520 msgr2=0x7f1efc0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 shutdown_connections 2024-09-16T09:57:04.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:04.979+0000 7f1f02fdf640 1 -- 172.21.15.111:0/2142803603 wait complete. 2024-09-16T09:57:05.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:04 smithi111 ceph-mon[109885]: pgmap v335: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:05.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:04 smithi114 ceph-mon[79732]: pgmap v335: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:05.845 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions' 2024-09-16T09:57:06.103 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/819056597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 msgr2=0x7fcbb8106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/819056597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb8106c00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009880 tx=0x7fcba802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/819056597 shutdown_connections 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/819056597 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb8100820 0x7fcbb8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/819056597 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb8106c00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/819056597 >> 172.21.15.111:0/819056597 conn(0x7fcbb80fc520 msgr2=0x7fcbb80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/819056597 shutdown_connections 2024-09-16T09:57:06.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.601+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/819056597 wait complete. 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbbd3fc640 1 Processor -- start 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbbd3fc640 1 -- start start 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbbd3fc640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb8100820 0x7fcbb819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbbd3fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbbd3fc640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb810dcf0 con 0x7fcbb8106820 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbbd3fc640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb810db70 con 0x7fcbb8100820 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbaffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbaffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45450/0 (socket says 172.21.15.111:45450) 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbaffff640 1 -- 172.21.15.111:0/202133785 learned_addr learned my addr 172.21.15.111:0/202133785 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.602+0000 7fcbb6ffd640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb8100820 0x7fcbb819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbaffff640 1 -- 172.21.15.111:0/202133785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb8100820 msgr2=0x7fcbb819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbaffff640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb8100820 0x7fcbb819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbaffff640 1 -- 172.21.15.111:0/202133785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb8197810 con 0x7fcbb8106820 2024-09-16T09:57:06.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbaffff640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb819dbd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcba000e970 tx=0x7fcba000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:06.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcba000cac0 con 0x7fcbb8106820 2024-09-16T09:57:06.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb8197b00 con 0x7fcbb8106820 2024-09-16T09:57:06.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcba00054e0 con 0x7fcbb8106820 2024-09-16T09:57:06.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcba0010430 con 0x7fcbb8106820 2024-09-16T09:57:06.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.603+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb8198090 con 0x7fcbb8106820 2024-09-16T09:57:06.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.604+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbb8101f60 con 0x7fcbb8106820 2024-09-16T09:57:06.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.605+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fcba0004e80 con 0x7fcbb8106820 2024-09-16T09:57:06.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.605+0000 7fcbb4ff9640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcba407abf0 0x7fcba407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:06.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.606+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fcba009e460 con 0x7fcbb8106820 2024-09-16T09:57:06.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.606+0000 7fcbb6ffd640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcba407abf0 0x7fcba407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:06.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.606+0000 7fcbb6ffd640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcba407abf0 0x7fcba407d0b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcba80096c0 tx=0x7fcba8031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:06.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.610+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fcba00699e0 con 0x7fcbb8106820 2024-09-16T09:57:06.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.860+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcbb8109da0 con 0x7fcbb8106820 2024-09-16T09:57:06.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.861+0000 7fcbb4ff9640 1 -- 172.21.15.111:0/202133785 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fcba006e890 con 0x7fcbb8106820 2024-09-16T09:57:06.862 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-09-16T09:57:06.862 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 2 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 6 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 4 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-09-16T09:57:06.863 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-09-16T09:57:06.864 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)": 14 2024-09-16T09:57:06.864 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-09-16T09:57:06.864 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-09-16T09:57:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcba407abf0 msgr2=0x7fcba407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcba407abf0 0x7fcba407d0b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcba80096c0 tx=0x7fcba8031400 comp rx=0 tx=0).stop 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 msgr2=0x7fcbb819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb819dbd0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcba000e970 tx=0x7fcba000ed70 comp rx=0 tx=0).stop 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 shutdown_connections 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcba407abf0 0x7fcba407d0b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb8106820 0x7fcbb819dbd0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 --2- 172.21.15.111:0/202133785 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcbb8100820 0x7fcbb819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 >> 172.21.15.111:0/202133785 conn(0x7fcbb80fc520 msgr2=0x7fcbb806a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 shutdown_connections 2024-09-16T09:57:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:06.863+0000 7fcbbd3fc640 1 -- 172.21.15.111:0/202133785 wait complete. 2024-09-16T09:57:07.060 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:06 smithi111 ceph-mon[109885]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:07.061 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:06 smithi111 ceph-mon[109885]: pgmap v336: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:07.061 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:06 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/202133785' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:57:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:06 smithi114 ceph-mon[79732]: from='client.34434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-16T09:57:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:06 smithi114 ceph-mon[79732]: pgmap v336: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:07.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:06 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/202133785' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:57:07.505 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-16T09:57:07.756 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 -- 172.21.15.111:0/590376546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 msgr2=0x7f22b0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/590376546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b0106c00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009880 tx=0x7f22a002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 -- 172.21.15.111:0/590376546 shutdown_connections 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/590376546 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b0100820 0x7f22b0100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/590376546 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b0106c00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 -- 172.21.15.111:0/590376546 >> 172.21.15.111:0/590376546 conn(0x7f22b00fc520 msgr2=0x7f22b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 -- 172.21.15.111:0/590376546 shutdown_connections 2024-09-16T09:57:08.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.239+0000 7f22b4dc6640 1 -- 172.21.15.111:0/590376546 wait complete. 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22b4dc6640 1 Processor -- start 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22b4dc6640 1 -- start start 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22b4dc6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b0100820 0x7f22b019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22b4dc6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b019dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22b4dc6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010dcd0 con 0x7f22b0106820 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22b4dc6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f22b010db50 con 0x7f22b0100820 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b019dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b019dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45466/0 (socket says 172.21.15.111:45466) 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 -- 172.21.15.111:0/252728914 learned_addr learned my addr 172.21.15.111:0/252728914 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22ae59c640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b0100820 0x7f22b019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 -- 172.21.15.111:0/252728914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b0100820 msgr2=0x7f22b019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:08.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b0100820 0x7f22b019d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 -- 172.21.15.111:0/252728914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b0197840 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.240+0000 7f22a7fff640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b019dc00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f229800c810 tx=0x7f229800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.241+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2298004020 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.241+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22b0197b30 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.241+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f22980041c0 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.241+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f22980047a0 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.241+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22b01980c0 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.242+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22b0101f60 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.242+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f22980079b0 con 0x7f22b0106820 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.243+0000 7f22a77fe640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f229c07abf0 0x7f229c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.243+0000 7f22ae59c640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f229c07abf0 0x7f229c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:08.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.243+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f229809dcf0 con 0x7f22b0106820 2024-09-16T09:57:08.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.243+0000 7f22ae59c640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f229c07abf0 0x7f229c07d0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f22a0000c00 tx=0x7f22a0031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:08.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.247+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f2298014030 con 0x7f22b0106820 2024-09-16T09:57:08.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.490+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f22b01983d0 con 0x7f22b0106820 2024-09-16T09:57:08.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.490+0000 7f22a77fe640 1 -- 172.21.15.111:0/252728914 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2298069270 con 0x7f22b0106820 2024-09-16T09:57:08.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f229c07abf0 msgr2=0x7f229c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f229c07abf0 0x7f229c07d0b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f22a0000c00 tx=0x7f22a0031400 comp rx=0 tx=0).stop 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 msgr2=0x7f22b019dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b019dc00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f229800c810 tx=0x7f229800ccd0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 shutdown_connections 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f229c07abf0 0x7f229c07d0b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22b0106820 0x7f22b019dc00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 --2- 172.21.15.111:0/252728914 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f22b0100820 0x7f22b019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 >> 172.21.15.111:0/252728914 conn(0x7f22b00fc520 msgr2=0x7f22b006a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 shutdown_connections 2024-09-16T09:57:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:08.493+0000 7f22b4dc6640 1 -- 172.21.15.111:0/252728914 wait complete. 2024-09-16T09:57:08.503 INFO:teuthology.orchestra.run.smithi111.stdout:true 2024-09-16T09:57:09.091 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:08 smithi111 ceph-mon[109885]: pgmap v337: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:09.091 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:08 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/252728914' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:57:09.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -e sha1=66e33d6af1496291b0602ee0a859e68145f17dad -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-16T09:57:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:08 smithi114 ceph-mon[79732]: pgmap v337: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:09.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:08 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/252728914' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:57:09.368 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:09.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 -- 172.21.15.111:0/812753754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c101910 msgr2=0x7efc0c101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:09.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 --2- 172.21.15.111:0/812753754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c101910 0x7efc0c101d70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efbf4009880 tx=0x7efbf402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 -- 172.21.15.111:0/812753754 shutdown_connections 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 --2- 172.21.15.111:0/812753754 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c101910 0x7efc0c101d70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 --2- 172.21.15.111:0/812753754 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c107910 0x7efc0c107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 -- 172.21.15.111:0/812753754 >> 172.21.15.111:0/812753754 conn(0x7efc0c0fd5f0 msgr2=0x7efc0c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 -- 172.21.15.111:0/812753754 shutdown_connections 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.808+0000 7efc1094a640 1 -- 172.21.15.111:0/812753754 wait complete. 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc1094a640 1 Processor -- start 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc1094a640 1 -- start start 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc1094a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c101910 0x7efc0c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:09.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc1094a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 0x7efc0c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc1094a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10ee40 con 0x7efc0c107910 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc1094a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efc0c10ecc0 con 0x7efc0c101910 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc09d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 0x7efc0c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc09d9b640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 0x7efc0c19dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45484/0 (socket says 172.21.15.111:45484) 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.809+0000 7efc09d9b640 1 -- 172.21.15.111:0/1862202309 learned_addr learned my addr 172.21.15.111:0/1862202309 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc09d9b640 1 -- 172.21.15.111:0/1862202309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c101910 msgr2=0x7efc0c19d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc0a59c640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c101910 0x7efc0c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:09.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc09d9b640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c101910 0x7efc0c19d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc09d9b640 1 -- 172.21.15.111:0/1862202309 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc0c197850 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc0a59c640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c101910 0x7efc0c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc09d9b640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 0x7efc0c19dc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efbf4031460 tx=0x7efbf40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efbf403f070 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc0c197ae0 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efbf4004cf0 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efbf4035030 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.810+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc0c198010 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.811+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc0c103050 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.812+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7efbf4042070 con 0x7efc0c107910 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.812+0000 7efc037fe640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efbf807abf0 0x7efbf807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.812+0000 7efc0a59c640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efbf807abf0 0x7efbf807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:09.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.812+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7efbf40be970 con 0x7efc0c107910 2024-09-16T09:57:09.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.813+0000 7efc0a59c640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efbf807abf0 0x7efbf807d0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006fd0 tx=0x7efbfc008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:09.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:09.817+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7efbf4089ef0 con 0x7efc0c107910 2024-09-16T09:57:10.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.064+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efc0c109ea0 con 0x7efc0c107910 2024-09-16T09:57:10.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.064+0000 7efc037fe640 1 -- 172.21.15.111:0/1862202309 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7efbf408eda0 con 0x7efc0c107910 2024-09-16T09:57:10.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efbf807abf0 msgr2=0x7efbf807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:10.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efbf807abf0 0x7efbf807d0b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efbfc006fd0 tx=0x7efbfc008040 comp rx=0 tx=0).stop 2024-09-16T09:57:10.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 msgr2=0x7efc0c19dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 0x7efc0c19dc10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efbf4031460 tx=0x7efbf40048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 shutdown_connections 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efbf807abf0 0x7efbf807d0b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc0c107910 0x7efc0c19dc10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 --2- 172.21.15.111:0/1862202309 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc0c101910 0x7efc0c19d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 >> 172.21.15.111:0/1862202309 conn(0x7efc0c0fd5f0 msgr2=0x7efc0c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 shutdown_connections 2024-09-16T09:57:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:10.067+0000 7efc1094a640 1 -- 172.21.15.111:0/1862202309 wait complete. 2024-09-16T09:57:10.077 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 19.3.0-4882-g66e33d6a (66e33d6af1496291b0602ee0a859e68145f17dad) squid (dev)" 2024-09-16T09:57:10.688 DEBUG:teuthology.parallel:result is None 2024-09-16T09:57:10.688 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-16T09:57:10.701 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:57:10.701 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-16T09:57:10.954 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:11.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:10 smithi111 ceph-mon[109885]: pgmap v338: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:11.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:10 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1862202309' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:57:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:10 smithi114 ceph-mon[79732]: pgmap v338: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:11.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:10 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1862202309' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-16T09:57:11.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 -- 172.21.15.111:0/1844765461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 msgr2=0x7f1288102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 --2- 172.21.15.111:0/1844765461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f1288102ec0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1278009880 tx=0x7f127802a530 comp rx=0 tx=0).stop 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 -- 172.21.15.111:0/1844765461 shutdown_connections 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 --2- 172.21.15.111:0/1844765461 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 0x7f128810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 --2- 172.21.15.111:0/1844765461 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f1288102ec0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 -- 172.21.15.111:0/1844765461 >> 172.21.15.111:0/1844765461 conn(0x7f12880fc520 msgr2=0x7f12880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 -- 172.21.15.111:0/1844765461 shutdown_connections 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.616+0000 7f128d7b7640 1 -- 172.21.15.111:0/1844765461 wait complete. 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f128d7b7640 1 Processor -- start 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f128d7b7640 1 -- start start 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f128d7b7640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f128819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:11.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f128d7b7640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 0x7f128819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f128d7b7640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f128810edf0 con 0x7f1288102ae0 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f128d7b7640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f128810ec70 con 0x7f1288103400 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f1286ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f128819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f1286ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f128819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45488/0 (socket says 172.21.15.111:45488) 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.617+0000 7f1286ffd640 1 -- 172.21.15.111:0/2146500261 learned_addr learned my addr 172.21.15.111:0/2146500261 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f12867fc640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 0x7f128819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f1286ffd640 1 -- 172.21.15.111:0/2146500261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 msgr2=0x7f128819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f1286ffd640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 0x7f128819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f1286ffd640 1 -- 172.21.15.111:0/2146500261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12881977e0 con 0x7f1288102ae0 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f12867fc640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 0x7f128819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f1286ffd640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f128819d660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1278031460 tx=0x7f1278004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:11.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f127803f070 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f12780035f0 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1288197a70 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1278035030 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.618+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1288197fa0 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.619+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f128806abe0 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.620+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1278042070 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.620+0000 7f126ffff640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f127007abf0 0x7f127007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.621+0000 7f12867fc640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f127007abf0 0x7f127007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.621+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f12780be7d0 con 0x7f1288102ae0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.621+0000 7f12867fc640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f127007abf0 0x7f127007d0b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f12880fe510 tx=0x7f127c005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:11.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.625+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1278089d50 con 0x7f1288102ae0 2024-09-16T09:57:11.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.836+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1288105fb0 con 0x7f1288102ae0 2024-09-16T09:57:11.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.837+0000 7f126ffff640 1 -- 172.21.15.111:0/2146500261 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 37 v37) ==== 76+0+2023 (secure 0 0 0) 0x7f127808ec00 con 0x7f1288102ae0 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:e37 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:btime 2024-09-16T09:55:39:208870+0000 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:legacy client fscid: 1 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:Filesystem 'cephfs' (1) 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:fs_name cephfs 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 37 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-09-16T09:43:11.978216+0000 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:modified 2024-09-16T09:55:38.298029+0000 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:tableserver 0 2024-09-16T09:57:11.840 INFO:teuthology.orchestra.run.smithi111.stdout:root 0 2024-09-16T09:57:11.841 INFO:teuthology.orchestra.run.smithi111.stdout:session_timeout 60 2024-09-16T09:57:11.841 INFO:teuthology.orchestra.run.smithi111.stdout:session_autoclose 300 2024-09-16T09:57:11.841 INFO:teuthology.orchestra.run.smithi111.stdout:max_file_size 1099511627776 2024-09-16T09:57:11.841 INFO:teuthology.orchestra.run.smithi111.stdout:max_xattr_size 65536 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:required_client_features {} 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure 0 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:last_failure_osd_epoch 90 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:max_mds 1 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:in 0 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:up {0=34314} 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:failed 2024-09-16T09:57:11.842 INFO:teuthology.orchestra.run.smithi111.stdout:damaged 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:stopped 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:data_pools [3] 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:metadata_pool 2 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:inline_data enabled 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:balancer 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:bal_rank_mask -1 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:standby_count_wanted 1 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:qdb_cluster leader: 34314 members: 34314 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.jnzoej{0:34314} state up:active seq 20 join_fscid=1 addr [v2:172.21.15.111:6826/125675573,v1:172.21.15.111:6827/125675573] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:11.843 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:11.844 INFO:teuthology.orchestra.run.smithi111.stdout:Standby daemons: 2024-09-16T09:57:11.844 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:11.844 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi111.yvusja{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.111:6828/2183853210,v1:172.21.15.111:6829/2183853210] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:57:11.844 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.bdhdtm{-1:44297} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.114:6824/2412191913,v1:172.21.15.114:6825/2412191913] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:57:11.844 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.cephfs.smithi114.sreoiu{-1:44319} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.114:6826/2165184879,v1:172.21.15.114:6827/2165184879] compat {c=[1],r=[1],i=[1fff]}] 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 37 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f127007abf0 msgr2=0x7f127007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f127007abf0 0x7f127007d0b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f12880fe510 tx=0x7f127c005f90 comp rx=0 tx=0).stop 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 msgr2=0x7f128819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f128819d660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1278031460 tx=0x7f1278004530 comp rx=0 tx=0).stop 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 shutdown_connections 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f127007abf0 0x7f127007d0b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1288103400 0x7f128819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 --2- 172.21.15.111:0/2146500261 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1288102ae0 0x7f128819d660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 >> 172.21.15.111:0/2146500261 conn(0x7f12880fc520 msgr2=0x7f1288108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:11.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 shutdown_connections 2024-09-16T09:57:11.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:11.839+0000 7f128d7b7640 1 -- 172.21.15.111:0/2146500261 wait complete. 2024-09-16T09:57:12.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:11 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2146500261' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:57:12.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:11 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2146500261' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-16T09:57:12.604 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-16T09:57:12.616 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-16T09:57:12.864 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:13.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:12 smithi114 ceph-mon[79732]: pgmap v339: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:13.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:12 smithi111 ceph-mon[109885]: pgmap v339: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 -- 172.21.15.111:0/2345515238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 msgr2=0x7f8af8101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 --2- 172.21.15.111:0/2345515238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af8101d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8aec009880 tx=0x7f8aec02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 -- 172.21.15.111:0/2345515238 shutdown_connections 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 --2- 172.21.15.111:0/2345515238 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af8101d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 --2- 172.21.15.111:0/2345515238 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 0x7f8af8107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 -- 172.21.15.111:0/2345515238 >> 172.21.15.111:0/2345515238 conn(0x7f8af80fd630 msgr2=0x7f8af80ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 -- 172.21.15.111:0/2345515238 shutdown_connections 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.282+0000 7f8afdad0640 1 -- 172.21.15.111:0/2345515238 wait complete. 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8afdad0640 1 Processor -- start 2024-09-16T09:57:13.296 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8afdad0640 1 -- start start 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8afdad0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af819d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8afdad0640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 0x7f8af819dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8afdad0640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8af810ede0 con 0x7f8af8101930 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8afdad0640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f8af810ec60 con 0x7f8af8107930 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8af77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af819d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8af77fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af819d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:45498/0 (socket says 172.21.15.111:45498) 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8af77fe640 1 -- 172.21.15.111:0/3984729087 learned_addr learned my addr 172.21.15.111:0/3984729087 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.283+0000 7f8af6ffd640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 0x7f8af819dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af77fe640 1 -- 172.21.15.111:0/3984729087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 msgr2=0x7f8af819dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af77fe640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 0x7f8af819dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af77fe640 1 -- 172.21.15.111:0/3984729087 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af8197850 con 0x7f8af8101930 2024-09-16T09:57:13.297 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af6ffd640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 0x7f8af819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af77fe640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af819d6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c8a0 tx=0x7f8ae800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ae80079b0 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af8197b40 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ae8007b50 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ae8018700 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.284+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af81980a0 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.285+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af8103070 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.286+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f8ae8007d00 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.286+0000 7f8af4ff9640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8ae007abf0 0x7f8ae007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.286+0000 7f8af6ffd640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8ae007abf0 0x7f8ae007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.286+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f8ae809e150 con 0x7f8af8101930 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.287+0000 7f8af6ffd640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8ae007abf0 0x7f8ae007d0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8af8198ba0 tx=0x7f8aec009560 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:13.298 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.291+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f8ae8014030 con 0x7f8af8101930 2024-09-16T09:57:13.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.499+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8af8109ec0 con 0x7f8af8101930 2024-09-16T09:57:13.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.500+0000 7f8af4ff9640 1 -- 172.21.15.111:0/3984729087 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5326 (secure 0 0 0) 0x7f8ae80696d0 con 0x7f8af8101930 2024-09-16T09:57:13.502 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:13.502 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":37,"btime":"2024-09-16T09:55:39:208870+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6827/2165184879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2165184879},{"type":"v1","addr":"172.21.15.114:6827","nonce":2165184879}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:38.298029+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:active","state_seq":20,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-16T09:57:13.502 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 37 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8ae007abf0 msgr2=0x7f8ae007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8ae007abf0 0x7f8ae007d0b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8af8198ba0 tx=0x7f8aec009560 comp rx=0 tx=0).stop 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 msgr2=0x7f8af819d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af819d6d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c8a0 tx=0x7f8ae800cd60 comp rx=0 tx=0).stop 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 shutdown_connections 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f8ae007abf0 0x7f8ae007d0b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8af8107930 0x7f8af819dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 --2- 172.21.15.111:0/3984729087 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8af8101930 0x7f8af819d6d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:13.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 >> 172.21.15.111:0/3984729087 conn(0x7f8af80fd630 msgr2=0x7f8af80fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:13.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 shutdown_connections 2024-09-16T09:57:13.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:13.502+0000 7f8afdad0640 1 -- 172.21.15.111:0/3984729087 wait complete. 2024-09-16T09:57:14.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:13 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3984729087' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-16T09:57:14.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:13 smithi114 ceph-mon[79732]: pgmap v340: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:14.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:13 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3984729087' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-16T09:57:14.217 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:13 smithi111 ceph-mon[109885]: pgmap v340: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:14.246 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 11, 'max_mds': 1, 'flags': 18} 2024-09-16T09:57:14.246 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 12 2024-09-16T09:57:14.493 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.931+0000 7f67ba291640 1 -- 172.21.15.111:0/484497017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 msgr2=0x7f67b4102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.931+0000 7f67ba291640 1 --2- 172.21.15.111:0/484497017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4102ec0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009880 tx=0x7f67a402a530 comp rx=0 tx=0).stop 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 -- 172.21.15.111:0/484497017 shutdown_connections 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 --2- 172.21.15.111:0/484497017 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 0x7f67b410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 --2- 172.21.15.111:0/484497017 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4102ec0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 -- 172.21.15.111:0/484497017 >> 172.21.15.111:0/484497017 conn(0x7f67b40fc520 msgr2=0x7f67b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 -- 172.21.15.111:0/484497017 shutdown_connections 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 -- 172.21.15.111:0/484497017 wait complete. 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 Processor -- start 2024-09-16T09:57:14.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 -- start start 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.932+0000 7f67ba291640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67ba291640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 0x7f67b4100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67ba291640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f67b410ee10 con 0x7f67b4102ae0 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67ba291640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f67b410ec90 con 0x7f67b4103400 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44156/0 (socket says 172.21.15.111:44156) 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 -- 172.21.15.111:0/2360483012 learned_addr learned my addr 172.21.15.111:0/2360483012 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b37fe640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 0x7f67b4100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 -- 172.21.15.111:0/2360483012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 msgr2=0x7f67b4100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 0x7f67b4100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 -- 172.21.15.111:0/2360483012 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b41011c0 con 0x7f67b4102ae0 2024-09-16T09:57:14.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b37fe640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 0x7f67b4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b3fff640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4100740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67a4031460 tx=0x7f67a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67a403f070 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b4101450 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67a40035f0 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67a4035030 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.933+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b41a3dc0 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.934+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b406abe0 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.935+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f67a4042070 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.935+0000 7f67b17fa640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f679c07abf0 0x7f679c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.936+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f67a40be840 con 0x7f67b4102ae0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.936+0000 7f67b37fe640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f679c07abf0 0x7f679c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:14.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.936+0000 7f67b37fe640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f679c07abf0 0x7f679c07d0b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67a8005fd0 tx=0x7f67a8005850 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:14.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:14.940+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f67a4089dc0 con 0x7f67b4102ae0 2024-09-16T09:57:15.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.147+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 12, "format": "json"} v 0) -- 0x7f67b4105fb0 con 0x7f67b4102ae0 2024-09-16T09:57:15.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.148+0000 7f67b17fa640 1 -- 172.21.15.111:0/2360483012 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 12, "format": "json"}]=0 dumped fsmap epoch 12 v37) ==== 107+0+5327 (secure 0 0 0) 0x7f67a408ec70 con 0x7f67b4102ae0 2024-09-16T09:57:15.149 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:15.150 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":12,"btime":"2024-09-16T09:43:24:552303+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:43:23.011624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14550":{"gid":14550,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6827/4028227545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4028227545},{"type":"v1","addr":"172.21.15.111:6827","nonce":4028227545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14550,"qdb_cluster":[14550]},"id":1}]} 2024-09-16T09:57:15.150 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 12 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f679c07abf0 msgr2=0x7f679c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f679c07abf0 0x7f679c07d0b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f67a8005fd0 tx=0x7f67a8005850 comp rx=0 tx=0).stop 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 msgr2=0x7f67b4100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4100740 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67a4031460 tx=0x7f67a40045e0 comp rx=0 tx=0).stop 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 shutdown_connections 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f679c07abf0 0x7f679c07d0b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f67b4103400 0x7f67b4100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 --2- 172.21.15.111:0/2360483012 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67b4102ae0 0x7f67b4100740 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 >> 172.21.15.111:0/2360483012 conn(0x7f67b40fc520 msgr2=0x7f67b4108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 shutdown_connections 2024-09-16T09:57:15.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:15.150+0000 7f67ba291640 1 -- 172.21.15.111:0/2360483012 wait complete. 2024-09-16T09:57:15.612 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:15 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2360483012' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 12, "format": "json"} : dispatch 2024-09-16T09:57:15.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:15 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2360483012' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 12, "format": "json"} : dispatch 2024-09-16T09:57:15.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 13 2024-09-16T09:57:16.038 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:16.430 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:16 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:16.430 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:16 smithi111 ceph-mon[109885]: pgmap v341: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:16.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 -- 172.21.15.111:0/1449076635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 msgr2=0x7f1520100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:16.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 --2- 172.21.15.111:0/1449076635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f1520100c40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1514009880 tx=0x7f151402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 -- 172.21.15.111:0/1449076635 shutdown_connections 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 --2- 172.21.15.111:0/1449076635 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f1520100c40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 --2- 172.21.15.111:0/1449076635 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 0x7f1520106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 -- 172.21.15.111:0/1449076635 >> 172.21.15.111:0/1449076635 conn(0x7f15200fc4c0 msgr2=0x7f15200fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 -- 172.21.15.111:0/1449076635 shutdown_connections 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 -- 172.21.15.111:0/1449076635 wait complete. 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.636+0000 7f1525428640 1 Processor -- start 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f1525428640 1 -- start start 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f1525428640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f15201023b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f1525428640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 0x7f15201028f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f1525428640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f152010dcb0 con 0x7f15201007e0 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f1525428640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f152010db30 con 0x7f15201067e0 2024-09-16T09:57:16.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f15201023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f15201023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44176/0 (socket says 172.21.15.111:44176) 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 -- 172.21.15.111:0/925283827 learned_addr learned my addr 172.21.15.111:0/925283827 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151e7fc640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 0x7f15201028f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 -- 172.21.15.111:0/925283827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 msgr2=0x7f15201028f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 0x7f15201028f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 -- 172.21.15.111:0/925283827 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520102e30 con 0x7f15201007e0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151e7fc640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 0x7f15201028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f151effd640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f15201023b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f151800ea00 tx=0x7f151800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.637+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f151800cb80 con 0x7f15201007e0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.638+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f151800cd20 con 0x7f15201007e0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.638+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1520103120 con 0x7f15201007e0 2024-09-16T09:57:16.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.638+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1518011470 con 0x7f15201007e0 2024-09-16T09:57:16.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.638+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15201a3e60 con 0x7f15201007e0 2024-09-16T09:57:16.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.639+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1520101f20 con 0x7f15201007e0 2024-09-16T09:57:16.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.639+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1518005020 con 0x7f15201007e0 2024-09-16T09:57:16.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.640+0000 7f1507fff640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f150807ac40 0x7f150807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:16.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.640+0000 7f151e7fc640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f150807ac40 0x7f150807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:16.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.640+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f151809e1b0 con 0x7f15201007e0 2024-09-16T09:57:16.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.640+0000 7f151e7fc640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f150807ac40 0x7f150807d100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1520103e40 tx=0x7f1514031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:16.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.644+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1518016030 con 0x7f15201007e0 2024-09-16T09:57:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:16 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:16.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:16 smithi114 ceph-mon[79732]: pgmap v341: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:16.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.852+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) -- 0x7f15201a41d0 con 0x7f15201007e0 2024-09-16T09:57:16.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.852+0000 7f1507fff640 1 -- 172.21.15.111:0/925283827 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v37) ==== 107+0+5327 (secure 0 0 0) 0x7f15180697b0 con 0x7f15201007e0 2024-09-16T09:57:16.854 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:16.854 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":13,"btime":"2024-09-16T09:43:26:081220+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:43:23.011624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14550":{"gid":14550,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6827/4028227545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4028227545},{"type":"v1","addr":"172.21.15.111:6827","nonce":4028227545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14550,"qdb_cluster":[14550]},"id":1}]} 2024-09-16T09:57:16.854 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 13 2024-09-16T09:57:16.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.854+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f150807ac40 msgr2=0x7f150807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.854+0000 7f1525428640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f150807ac40 0x7f150807d100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1520103e40 tx=0x7f1514031400 comp rx=0 tx=0).stop 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 msgr2=0x7f15201023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f15201023b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f151800ea00 tx=0x7f151800eec0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 shutdown_connections 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f150807ac40 0x7f150807d100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f15201067e0 0x7f15201028f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 --2- 172.21.15.111:0/925283827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f15201007e0 0x7f15201023b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 >> 172.21.15.111:0/925283827 conn(0x7f15200fc4c0 msgr2=0x7f1520104630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 shutdown_connections 2024-09-16T09:57:16.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:16.855+0000 7f1525428640 1 -- 172.21.15.111:0/925283827 wait complete. 2024-09-16T09:57:17.500 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:17 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/925283827' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 13, "format": "json"} : dispatch 2024-09-16T09:57:17.527 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 14 2024-09-16T09:57:17.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:17 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/925283827' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 13, "format": "json"} : dispatch 2024-09-16T09:57:17.774 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 -- 172.21.15.111:0/2000112942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 msgr2=0x7f1acc10b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2000112942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc10b8b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009880 tx=0x7f1ab402a530 comp rx=0 tx=0).stop 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 -- 172.21.15.111:0/2000112942 shutdown_connections 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2000112942 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc10b8b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2000112942 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 0x7f1acc102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 -- 172.21.15.111:0/2000112942 >> 172.21.15.111:0/2000112942 conn(0x7f1acc0fc4c0 msgr2=0x7f1acc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:18.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 -- 172.21.15.111:0/2000112942 shutdown_connections 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 -- 172.21.15.111:0/2000112942 wait complete. 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 Processor -- start 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.203+0000 7f1ad144e640 1 -- start start 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ad144e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 0x7f1acc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ad144e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ad144e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10edd0 con 0x7f1acc1033c0 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ad144e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f1acc10ec50 con 0x7f1acc102aa0 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44196/0 (socket says 172.21.15.111:44196) 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 -- 172.21.15.111:0/2980473864 learned_addr learned my addr 172.21.15.111:0/2980473864 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1acaffd640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 0x7f1acc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 -- 172.21.15.111:0/2980473864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 msgr2=0x7f1acc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:18.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 0x7f1acc19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 -- 172.21.15.111:0/2980473864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1acc197860 con 0x7f1acc1033c0 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1acaffd640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 0x7f1acc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1aca7fc640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc19dbe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4031460 tx=0x7f1ab4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ab403f070 con 0x7f1acc1033c0 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1acc197af0 con 0x7f1acc1033c0 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ab40035f0 con 0x7f1acc1033c0 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ab4035030 con 0x7f1acc1033c0 2024-09-16T09:57:18.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.204+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1acc198020 con 0x7f1acc1033c0 2024-09-16T09:57:18.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.205+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aac005290 con 0x7f1acc1033c0 2024-09-16T09:57:18.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.206+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1ab4042070 con 0x7f1acc1033c0 2024-09-16T09:57:18.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.207+0000 7f1ac3fff640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ab807abf0 0x7f1ab807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:18.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.207+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f1ab40be6c0 con 0x7f1acc1033c0 2024-09-16T09:57:18.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.207+0000 7f1acaffd640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ab807abf0 0x7f1ab807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:18.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.207+0000 7f1acaffd640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ab807abf0 0x7f1ab807d0b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1acc1989a0 tx=0x7f1abc009520 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:18.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.211+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1ab4089c40 con 0x7f1acc1033c0 2024-09-16T09:57:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.421+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) -- 0x7f1aac005580 con 0x7f1acc1033c0 2024-09-16T09:57:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.421+0000 7f1ac3fff640 1 -- 172.21.15.111:0/2980473864 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v37) ==== 107+0+5326 (secure 0 0 0) 0x7f1ab408eaf0 con 0x7f1acc1033c0 2024-09-16T09:57:18.423 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:18.424 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":14,"btime":"2024-09-16T09:43:27:090244+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:43:23.011624+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14550":{"gid":14550,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6827/4028227545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":4028227545},{"type":"v1","addr":"172.21.15.111:6827","nonce":4028227545}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14550,"qdb_cluster":[14550]},"id":1}]} 2024-09-16T09:57:18.424 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 14 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ab807abf0 msgr2=0x7f1ab807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ab807abf0 0x7f1ab807d0b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1acc1989a0 tx=0x7f1abc009520 comp rx=0 tx=0).stop 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 msgr2=0x7f1acc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc19dbe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4031460 tx=0x7f1ab4004530 comp rx=0 tx=0).stop 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 shutdown_connections 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ab807abf0 0x7f1ab807d0b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1acc1033c0 0x7f1acc19dbe0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 --2- 172.21.15.111:0/2980473864 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f1acc102aa0 0x7f1acc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 >> 172.21.15.111:0/2980473864 conn(0x7f1acc0fc4c0 msgr2=0x7f1acc107d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 shutdown_connections 2024-09-16T09:57:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:18.424+0000 7f1ad144e640 1 -- 172.21.15.111:0/2980473864 wait complete. 2024-09-16T09:57:18.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:18 smithi111 ceph-mon[109885]: pgmap v342: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:18.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:18 smithi114 ceph-mon[79732]: pgmap v342: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:19.003 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 15 2024-09-16T09:57:19.262 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:19.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:19 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2980473864' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 14, "format": "json"} : dispatch 2024-09-16T09:57:19.687 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:19 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2980473864' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 14, "format": "json"} : dispatch 2024-09-16T09:57:19.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 -- 172.21.15.111:0/2460849617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 msgr2=0x7f8274107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:19.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 --2- 172.21.15.111:0/2460849617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f8274107ce0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8264009880 tx=0x7f826402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 -- 172.21.15.111:0/2460849617 shutdown_connections 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 --2- 172.21.15.111:0/2460849617 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8274101900 0x7f8274101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 --2- 172.21.15.111:0/2460849617 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f8274107ce0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 -- 172.21.15.111:0/2460849617 >> 172.21.15.111:0/2460849617 conn(0x7f82740fd620 msgr2=0x7f82740ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 -- 172.21.15.111:0/2460849617 shutdown_connections 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.709+0000 7f827aa5c640 1 -- 172.21.15.111:0/2460849617 wait complete. 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f827aa5c640 1 Processor -- start 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f827aa5c640 1 -- start start 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f827aa5c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8274101900 0x7f827419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f827aa5c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f827419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f827aa5c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f827410edd0 con 0x7f8274107900 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f827aa5c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f827410ec50 con 0x7f8274101900 2024-09-16T09:57:19.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f82737fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f827419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f82737fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f827419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44212/0 (socket says 172.21.15.111:44212) 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.710+0000 7f82737fe640 1 -- 172.21.15.111:0/3883106398 learned_addr learned my addr 172.21.15.111:0/3883106398 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82737fe640 1 -- 172.21.15.111:0/3883106398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8274101900 msgr2=0x7f827419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82737fe640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8274101900 0x7f827419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82737fe640 1 -- 172.21.15.111:0/3883106398 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82741977a0 con 0x7f8274107900 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82737fe640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f827419db60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f826800d6f0 tx=0x7f826800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8268017070 con 0x7f8274107900 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f826800de00 con 0x7f8274107900 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8268004bb0 con 0x7f8274107900 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8274197a90 con 0x7f8274107900 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.711+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8274198020 con 0x7f8274107900 2024-09-16T09:57:19.732 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.712+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8274103040 con 0x7f8274107900 2024-09-16T09:57:19.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.713+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f8268004e60 con 0x7f8274107900 2024-09-16T09:57:19.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.713+0000 7f82717fa640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f825c07abf0 0x7f825c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:19.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.713+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f826809da50 con 0x7f8274107900 2024-09-16T09:57:19.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.713+0000 7f8273fff640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f825c07abf0 0x7f825c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:19.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.714+0000 7f8273fff640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f825c07abf0 0x7f825c07d0b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f82640096c0 tx=0x7f8264000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:19.733 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.718+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f8268068fd0 con 0x7f8274107900 2024-09-16T09:57:19.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.928+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) -- 0x7f8274109e70 con 0x7f8274107900 2024-09-16T09:57:19.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.929+0000 7f82717fa640 1 -- 172.21.15.111:0/3883106398 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v37) ==== 107+0+4458 (secure 0 0 0) 0x7f826806de80 con 0x7f8274107900 2024-09-16T09:57:19.930 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:19.931 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":15,"btime":"2024-09-16T09:53:55:127758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:53:55.127755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:19.931 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 15 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f825c07abf0 msgr2=0x7f825c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f825c07abf0 0x7f825c07d0b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f82640096c0 tx=0x7f8264000bc0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 msgr2=0x7f827419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f827419db60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f826800d6f0 tx=0x7f826800dbb0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 shutdown_connections 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f825c07abf0 0x7f825c07d0b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8274107900 0x7f827419db60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 --2- 172.21.15.111:0/3883106398 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8274101900 0x7f827419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 >> 172.21.15.111:0/3883106398 conn(0x7f82740fd620 msgr2=0x7f82740fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 shutdown_connections 2024-09-16T09:57:19.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:19.931+0000 7f827aa5c640 1 -- 172.21.15.111:0/3883106398 wait complete. 2024-09-16T09:57:20.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:20 smithi111 ceph-mon[109885]: pgmap v343: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:20.509 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:20 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3883106398' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-16T09:57:20.539 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 16 2024-09-16T09:57:20.588 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:20 smithi114 ceph-mon[79732]: pgmap v343: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:20.588 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:20 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3883106398' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-16T09:57:20.789 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 -- 172.21.15.111:0/2719451175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 msgr2=0x7f2f58101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2719451175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f58101d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009880 tx=0x7f2f4802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 -- 172.21.15.111:0/2719451175 shutdown_connections 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2719451175 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f58101d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2719451175 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f58107930 0x7f2f58107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 -- 172.21.15.111:0/2719451175 >> 172.21.15.111:0/2719451175 conn(0x7f2f580fd630 msgr2=0x7f2f580ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 -- 172.21.15.111:0/2719451175 shutdown_connections 2024-09-16T09:57:21.227 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.225+0000 7f2f5d451640 1 -- 172.21.15.111:0/2719451175 wait complete. 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f5d451640 1 Processor -- start 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f5d451640 1 -- start start 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f5d451640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f5d451640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f58107930 0x7f2f58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f5d451640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5810ee60 con 0x7f2f58101930 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f5d451640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5810ece0 con 0x7f2f58107930 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f56ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f56ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44230/0 (socket says 172.21.15.111:44230) 2024-09-16T09:57:21.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.226+0000 7f2f56ffd640 1 -- 172.21.15.111:0/2982469743 learned_addr learned my addr 172.21.15.111:0/2982469743 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f56ffd640 1 -- 172.21.15.111:0/2982469743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f58107930 msgr2=0x7f2f58074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f56ffd640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f58107930 0x7f2f58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f56ffd640 1 -- 172.21.15.111:0/2982469743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f58074f70 con 0x7f2f58101930 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f56ffd640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f580744f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000b420 tx=0x7f2f4000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f40011630 con 0x7f2f58101930 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f40016070 con 0x7f2f58101930 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f40010d40 con 0x7f2f58101930 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f58075260 con 0x7f2f58101930 2024-09-16T09:57:21.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.227+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f581a3ef0 con 0x7f2f58101930 2024-09-16T09:57:21.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.228+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f58103070 con 0x7f2f58101930 2024-09-16T09:57:21.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.229+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f2f4001b460 con 0x7f2f58101930 2024-09-16T09:57:21.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.229+0000 7f2f4ffff640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2f4407ac40 0x7f2f4407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:21.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.229+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f2f4009d4c0 con 0x7f2f58101930 2024-09-16T09:57:21.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.229+0000 7f2f567fc640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2f4407ac40 0x7f2f4407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:21.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.230+0000 7f2f567fc640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2f4407ac40 0x7f2f4407d100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f480096c0 tx=0x7f2f48000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:21.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.234+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f2f40021250 con 0x7f2f58101930 2024-09-16T09:57:21.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.443+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7f2f58101d90 con 0x7f2f58101930 2024-09-16T09:57:21.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.443+0000 7f2f4ffff640 1 -- 172.21.15.111:0/2982469743 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v37) ==== 107+0+4469 (secure 0 0 0) 0x7f2f40068ac0 con 0x7f2f58101930 2024-09-16T09:57:21.445 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:21.445 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":16,"btime":"2024-09-16T09:53:55:133254+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:53:55.133240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":0,"incarnation":16,"state":"up:replay","state_seq":2,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:21.446 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 16 2024-09-16T09:57:21.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2f4407ac40 msgr2=0x7f2f4407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:21.447 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2f4407ac40 0x7f2f4407d100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2f480096c0 tx=0x7f2f48000bc0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 msgr2=0x7f2f580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f580744f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000b420 tx=0x7f2f4000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 shutdown_connections 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f2f4407ac40 0x7f2f4407d100 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2f58107930 0x7f2f58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 --2- 172.21.15.111:0/2982469743 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2f58101930 0x7f2f580744f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 >> 172.21.15.111:0/2982469743 conn(0x7f2f580fd630 msgr2=0x7f2f580fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 shutdown_connections 2024-09-16T09:57:21.448 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:21.446+0000 7f2f5d451640 1 -- 172.21.15.111:0/2982469743 wait complete. 2024-09-16T09:57:21.765 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:21 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2982469743' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-16T09:57:21.774 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:21 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2982469743' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-16T09:57:22.271 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 17 2024-09-16T09:57:22.546 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:22.778 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:22 smithi111 ceph-mon[109885]: pgmap v344: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:22.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:22 smithi114 ceph-mon[79732]: pgmap v344: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 -- 172.21.15.111:0/686206436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658103460 msgr2=0x7f265810b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 --2- 172.21.15.111:0/686206436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658103460 0x7f265810b950 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26400098b0 tx=0x7f264002a560 comp rx=0 tx=0).stop 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 -- 172.21.15.111:0/686206436 shutdown_connections 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 --2- 172.21.15.111:0/686206436 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658103460 0x7f265810b950 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 --2- 172.21.15.111:0/686206436 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658102b40 0x7f2658102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 -- 172.21.15.111:0/686206436 >> 172.21.15.111:0/686206436 conn(0x7f26580fc520 msgr2=0x7f26580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 -- 172.21.15.111:0/686206436 shutdown_connections 2024-09-16T09:57:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.000+0000 7f265cec6640 1 -- 172.21.15.111:0/686206436 wait complete. 2024-09-16T09:57:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265cec6640 1 Processor -- start 2024-09-16T09:57:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265cec6640 1 -- start start 2024-09-16T09:57:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265cec6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 0x7f265819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265cec6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658103460 0x7f265819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265cec6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f265810edf0 con 0x7f2658102b40 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265cec6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f265810ec70 con 0x7f2658103460 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 0x7f265819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265659c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 0x7f265819d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44250/0 (socket says 172.21.15.111:44250) 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265659c640 1 -- 172.21.15.111:0/3457517879 learned_addr learned my addr 172.21.15.111:0/3457517879 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f264ffff640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658103460 0x7f265819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265659c640 1 -- 172.21.15.111:0/3457517879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658103460 msgr2=0x7f265819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265659c640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658103460 0x7f265819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.001+0000 7f265659c640 1 -- 172.21.15.111:0/3457517879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2658197880 con 0x7f2658102b40 2024-09-16T09:57:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.002+0000 7f265659c640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 0x7f265819d6c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f264800d8d0 tx=0x7f264800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.002+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2648017030 con 0x7f2658102b40 2024-09-16T09:57:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.002+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2658197b70 con 0x7f2658102b40 2024-09-16T09:57:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.002+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2648004020 con 0x7f2658102b40 2024-09-16T09:57:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.002+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26480047a0 con 0x7f2658102b40 2024-09-16T09:57:23.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.002+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26581980d0 con 0x7f2658102b40 2024-09-16T09:57:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.003+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f265806ab80 con 0x7f2658102b40 2024-09-16T09:57:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.004+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f26480041d0 con 0x7f2658102b40 2024-09-16T09:57:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.004+0000 7f264f7fe640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f264407abf0 0x7f264407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.004+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f2648018070 con 0x7f2658102b40 2024-09-16T09:57:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.004+0000 7f264ffff640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f264407abf0 0x7f264407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.005+0000 7f264ffff640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f264407abf0 0x7f264407d0b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2640000c00 tx=0x7f2640031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.008+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f2648069190 con 0x7f2658102b40 2024-09-16T09:57:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.220+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7f2658198db0 con 0x7f2658102b40 2024-09-16T09:57:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.220+0000 7f264f7fe640 1 -- 172.21.15.111:0/3457517879 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v37) ==== 107+0+5321 (secure 0 0 0) 0x7f264806e040 con 0x7f2658102b40 2024-09-16T09:57:23.222 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:23.222 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":17,"btime":"2024-09-16T09:54:03:848898+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:03.101596+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":0,"incarnation":16,"state":"up:reconnect","state_seq":162,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:23.223 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 17 2024-09-16T09:57:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f264407abf0 msgr2=0x7f264407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f264407abf0 0x7f264407d0b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2640000c00 tx=0x7f2640031400 comp rx=0 tx=0).stop 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 msgr2=0x7f265819d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 0x7f265819d6c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f264800d8d0 tx=0x7f264800dd90 comp rx=0 tx=0).stop 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 shutdown_connections 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f264407abf0 0x7f264407d0b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f2658103460 0x7f265819dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 --2- 172.21.15.111:0/3457517879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2658102b40 0x7f265819d6c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 >> 172.21.15.111:0/3457517879 conn(0x7f26580fc520 msgr2=0x7f2658103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 shutdown_connections 2024-09-16T09:57:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:23.223+0000 7f265cec6640 1 -- 172.21.15.111:0/3457517879 wait complete. 2024-09-16T09:57:23.767 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:23 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3457517879' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-16T09:57:23.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 18 2024-09-16T09:57:23.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:23 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3457517879' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-16T09:57:24.042 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:24.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 -- 172.21.15.111:0/2833979644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 msgr2=0x7f0a18100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 --2- 172.21.15.111:0/2833979644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a18100c40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0a14009880 tx=0x7f0a1402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 -- 172.21.15.111:0/2833979644 shutdown_connections 2024-09-16T09:57:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 --2- 172.21.15.111:0/2833979644 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a18100c40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 --2- 172.21.15.111:0/2833979644 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 0x7f0a18106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 -- 172.21.15.111:0/2833979644 >> 172.21.15.111:0/2833979644 conn(0x7f0a180fc4c0 msgr2=0x7f0a180fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 -- 172.21.15.111:0/2833979644 shutdown_connections 2024-09-16T09:57:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.533+0000 7f0a204c2640 1 -- 172.21.15.111:0/2833979644 wait complete. 2024-09-16T09:57:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a204c2640 1 Processor -- start 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a204c2640 1 -- start start 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a204c2640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a1819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a204c2640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 0x7f0a1819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a204c2640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810dd10 con 0x7f0a181007e0 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a204c2640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1810db90 con 0x7f0a181067e0 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a1819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a1819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54950/0 (socket says 172.21.15.111:54950) 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 -- 172.21.15.111:0/998909825 learned_addr learned my addr 172.21.15.111:0/998909825 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1da5d640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 0x7f0a1819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 -- 172.21.15.111:0/998909825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 msgr2=0x7f0a1819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 0x7f0a1819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 -- 172.21.15.111:0/998909825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a18199a20 con 0x7f0a181007e0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1da5d640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 0x7f0a1819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.534+0000 7f0a1e25e640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a1819f860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800b420 tx=0x7f0a0800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.535+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a08011630 con 0x7f0a181007e0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.535+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a18199d10 con 0x7f0a181007e0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.535+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a08016070 con 0x7f0a181007e0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.535+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a08010d40 con 0x7f0a181007e0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.535+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a1819a270 con 0x7f0a181007e0 2024-09-16T09:57:24.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.536+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a18101f20 con 0x7f0a181007e0 2024-09-16T09:57:24.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.536+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f0a080117d0 con 0x7f0a181007e0 2024-09-16T09:57:24.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.537+0000 7f0a0f7fe640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0a0407abf0 0x7f0a0407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.537+0000 7f0a1da5d640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0a0407abf0 0x7f0a0407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.537+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f0a0809d540 con 0x7f0a181007e0 2024-09-16T09:57:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.537+0000 7f0a1da5d640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0a0407abf0 0x7f0a0407d0b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a1819b210 tx=0x7f0a14031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:24.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.541+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f0a08068ac0 con 0x7f0a181007e0 2024-09-16T09:57:24.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.750+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7f0a18100c40 con 0x7f0a181007e0 2024-09-16T09:57:24.754 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:24 smithi111 ceph-mon[109885]: pgmap v345: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:24.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.751+0000 7f0a0f7fe640 1 -- 172.21.15.111:0/998909825 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v37) ==== 107+0+5318 (secure 0 0 0) 0x7f0a18100c40 con 0x7f0a181007e0 2024-09-16T09:57:24.754 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:24.755 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"btime":"2024-09-16T09:54:04:850250+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:03.854047+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":0,"incarnation":16,"state":"up:rejoin","state_seq":163,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 18 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0a0407abf0 msgr2=0x7f0a0407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0a0407abf0 0x7f0a0407d0b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a1819b210 tx=0x7f0a14031400 comp rx=0 tx=0).stop 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 msgr2=0x7f0a1819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a1819f860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800b420 tx=0x7f0a0800b8e0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 shutdown_connections 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f0a0407abf0 0x7f0a0407d0b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f0a181067e0 0x7f0a1819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 --2- 172.21.15.111:0/998909825 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a181007e0 0x7f0a1819f860 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 >> 172.21.15.111:0/998909825 conn(0x7f0a180fc4c0 msgr2=0x7f0a180fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:24.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 shutdown_connections 2024-09-16T09:57:24.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:24.753+0000 7f0a204c2640 1 -- 172.21.15.111:0/998909825 wait complete. 2024-09-16T09:57:24.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:24 smithi114 ceph-mon[79732]: pgmap v345: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:25.436 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 19 2024-09-16T09:57:25.685 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:25.807 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:25 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/998909825' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-16T09:57:25.937 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:25 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/998909825' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-16T09:57:26.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.149+0000 7ffa577e6640 1 -- 172.21.15.111:0/3239118366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50103400 msgr2=0x7ffa5010b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:26.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.149+0000 7ffa577e6640 1 --2- 172.21.15.111:0/3239118366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50103400 0x7ffa5010b8f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009880 tx=0x7ffa4002a530 comp rx=0 tx=0).stop 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- 172.21.15.111:0/3239118366 shutdown_connections 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 --2- 172.21.15.111:0/3239118366 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50103400 0x7ffa5010b8f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 --2- 172.21.15.111:0/3239118366 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50102ae0 0x7ffa50102ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- 172.21.15.111:0/3239118366 >> 172.21.15.111:0/3239118366 conn(0x7ffa500fc520 msgr2=0x7ffa500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- 172.21.15.111:0/3239118366 shutdown_connections 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- 172.21.15.111:0/3239118366 wait complete. 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 Processor -- start 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- start start 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 0x7ffa5019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50103400 0x7ffa5019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:26.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5010edf0 con 0x7ffa50102ae0 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.150+0000 7ffa577e6640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5010ec70 con 0x7ffa50103400 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 0x7ffa5019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 0x7ffa5019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54958/0 (socket says 172.21.15.111:54958) 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 -- 172.21.15.111:0/649535634 learned_addr learned my addr 172.21.15.111:0/649535634 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa54d81640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50103400 0x7ffa5019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 -- 172.21.15.111:0/649535634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50103400 msgr2=0x7ffa5019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50103400 0x7ffa5019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 -- 172.21.15.111:0/649535634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa50197800 con 0x7ffa50102ae0 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa54d81640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50103400 0x7ffa5019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa55582640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 0x7ffa5019d680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c810 tx=0x7ffa4c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa4c004020 con 0x7ffa50102ae0 2024-09-16T09:57:26.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa4c0041c0 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa50197af0 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa4c0047a0 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.151+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa50198050 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.152+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa5006abe0 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.153+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ffa4c0079b0 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.154+0000 7ffa467fc640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffa3c07ac40 0x7ffa3c07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.154+0000 7ffa54d81640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffa3c07ac40 0x7ffa3c07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.154+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7ffa4c09dc60 con 0x7ffa50102ae0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.154+0000 7ffa54d81640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffa3c07ac40 0x7ffa3c07d100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa50198b50 tx=0x7ffa40009560 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:26.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.158+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ffa4c014030 con 0x7ffa50102ae0 2024-09-16T09:57:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.369+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7ffa50105f80 con 0x7ffa50102ae0 2024-09-16T09:57:26.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.369+0000 7ffa467fc640 1 -- 172.21.15.111:0/649535634 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v37) ==== 107+0+5327 (secure 0 0 0) 0x7ffa4c069260 con 0x7ffa50102ae0 2024-09-16T09:57:26.371 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:26.371 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"btime":"2024-09-16T09:54:05:851739+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:05.851733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":87,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14566},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14566":{"gid":14566,"name":"cephfs.smithi111.yvusja","rank":0,"incarnation":16,"state":"up:active","state_seq":164,"addr":"172.21.15.111:6829/4079898764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":4079898764},{"type":"v1","addr":"172.21.15.111:6829","nonce":4079898764}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14566,"qdb_cluster":[14566]},"id":1}]} 2024-09-16T09:57:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-09-16T09:57:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffa3c07ac40 msgr2=0x7ffa3c07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffa3c07ac40 0x7ffa3c07d100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffa50198b50 tx=0x7ffa40009560 comp rx=0 tx=0).stop 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 msgr2=0x7ffa5019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 0x7ffa5019d680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c00c810 tx=0x7ffa4c00ccd0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 shutdown_connections 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ffa3c07ac40 0x7ffa3c07d100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ffa50103400 0x7ffa5019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 --2- 172.21.15.111:0/649535634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffa50102ae0 0x7ffa5019d680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 >> 172.21.15.111:0/649535634 conn(0x7ffa500fc520 msgr2=0x7ffa50108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 shutdown_connections 2024-09-16T09:57:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:26.372+0000 7ffa577e6640 1 -- 172.21.15.111:0/649535634 wait complete. 2024-09-16T09:57:26.631 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:26 smithi111 ceph-mon[109885]: pgmap v346: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:26.632 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:26 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/649535634' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-16T09:57:26.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:26 smithi114 ceph-mon[79732]: pgmap v346: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:26.840 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:26 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/649535634' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-16T09:57:26.998 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-16T09:57:27.257 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 -- 172.21.15.111:0/3790984573 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c106820 msgr2=0x7efc3c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 --2- 172.21.15.111:0/3790984573 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c106820 0x7efc3c106c00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7efc38009880 tx=0x7efc3802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 -- 172.21.15.111:0/3790984573 shutdown_connections 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 --2- 172.21.15.111:0/3790984573 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c100820 0x7efc3c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 --2- 172.21.15.111:0/3790984573 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c106820 0x7efc3c106c00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 -- 172.21.15.111:0/3790984573 >> 172.21.15.111:0/3790984573 conn(0x7efc3c0fc520 msgr2=0x7efc3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.852+0000 7efc44134640 1 -- 172.21.15.111:0/3790984573 shutdown_connections 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 -- 172.21.15.111:0/3790984573 wait complete. 2024-09-16T09:57:27.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 Processor -- start 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 -- start start 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 0x7efc3c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c106820 0x7efc3c198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c10dcf0 con 0x7efc3c100820 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc44134640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c10db70 con 0x7efc3c106820 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc41ed0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 0x7efc3c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc41ed0640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 0x7efc3c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:54982/0 (socket says 172.21.15.111:54982) 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.853+0000 7efc41ed0640 1 -- 172.21.15.111:0/3545069437 learned_addr learned my addr 172.21.15.111:0/3545069437 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc416cf640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c106820 0x7efc3c198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc41ed0640 1 -- 172.21.15.111:0/3545069437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c106820 msgr2=0x7efc3c198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc41ed0640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c106820 0x7efc3c198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:27.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc41ed0640 1 -- 172.21.15.111:0/3545069437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c199360 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc416cf640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c106820 0x7efc3c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc41ed0640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 0x7efc3c198820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc38031460 tx=0x7efc38004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc3803f070 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc380035f0 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c1995f0 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc38035030 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.854+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c1a1ba0 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.855+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc3c101f60 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.856+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7efc38042070 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.856+0000 7efc32ffd640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efc2807abf0 0x7efc2807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.856+0000 7efc416cf640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efc2807abf0 0x7efc2807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.856+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7efc380be7d0 con 0x7efc3c100820 2024-09-16T09:57:27.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.857+0000 7efc416cf640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efc2807abf0 0x7efc2807d0b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc3c06ae50 tx=0x7efc2c005f90 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:27.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:27.861+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7efc38089d50 con 0x7efc3c100820 2024-09-16T09:57:28.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.072+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7efc3c108d90 con 0x7efc3c100820 2024-09-16T09:57:28.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.073+0000 7efc32ffd640 1 -- 172.21.15.111:0/3545069437 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v37) ==== 107+0+4455 (secure 0 0 0) 0x7efc3808ec00 con 0x7efc3c100820 2024-09-16T09:57:28.074 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:28.075 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":20,"btime":"2024-09-16T09:54:19:669569+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:19.669565+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:28.075 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 20 2024-09-16T09:57:28.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efc2807abf0 msgr2=0x7efc2807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:28.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efc2807abf0 0x7efc2807d0b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc3c06ae50 tx=0x7efc2c005f90 comp rx=0 tx=0).stop 2024-09-16T09:57:28.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 msgr2=0x7efc3c198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:28.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 0x7efc3c198820 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc38031460 tx=0x7efc38004530 comp rx=0 tx=0).stop 2024-09-16T09:57:28.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 shutdown_connections 2024-09-16T09:57:28.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7efc2807abf0 0x7efc2807d0b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:28.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7efc3c106820 0x7efc3c198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:28.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 --2- 172.21.15.111:0/3545069437 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc3c100820 0x7efc3c198820 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:28.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.075+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 >> 172.21.15.111:0/3545069437 conn(0x7efc3c0fc520 msgr2=0x7efc3c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:28.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.076+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 shutdown_connections 2024-09-16T09:57:28.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:28.076+0000 7efc44134640 1 -- 172.21.15.111:0/3545069437 wait complete. 2024-09-16T09:57:28.652 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-16T09:57:28.881 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:28 smithi111 ceph-mon[109885]: pgmap v347: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:28.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:28 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3545069437' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-16T09:57:28.903 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:28 smithi114 ceph-mon[79732]: pgmap v347: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:29.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:28 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3545069437' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-16T09:57:29.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 -- 172.21.15.111:0/3927327051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c107910 msgr2=0x7fee8c107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 --2- 172.21.15.111:0/3927327051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c107910 0x7fee8c107cf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009880 tx=0x7fee7c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 -- 172.21.15.111:0/3927327051 shutdown_connections 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 --2- 172.21.15.111:0/3927327051 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee8c101910 0x7fee8c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 --2- 172.21.15.111:0/3927327051 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c107910 0x7fee8c107cf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 -- 172.21.15.111:0/3927327051 >> 172.21.15.111:0/3927327051 conn(0x7fee8c0fd5f0 msgr2=0x7fee8c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 -- 172.21.15.111:0/3927327051 shutdown_connections 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 -- 172.21.15.111:0/3927327051 wait complete. 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.366+0000 7fee90fbb640 1 Processor -- start 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee90fbb640 1 -- start start 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee90fbb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 0x7fee8c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee90fbb640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee8c107910 0x7fee8c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee90fbb640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c10ee40 con 0x7fee8c101910 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee90fbb640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c10ecc0 con 0x7fee8c107910 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 0x7fee8c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 0x7fee8c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55010/0 (socket says 172.21.15.111:55010) 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 -- 172.21.15.111:0/1007832818 learned_addr learned my addr 172.21.15.111:0/1007832818 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee83fff640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee8c107910 0x7fee8c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 -- 172.21.15.111:0/1007832818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee8c107910 msgr2=0x7fee8c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee8c107910 0x7fee8c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 -- 172.21.15.111:0/1007832818 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8c197810 con 0x7fee8c101910 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee8a59c640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 0x7fee8c19d690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fee7c031460 tx=0x7fee7c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.367+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee7c03f070 con 0x7fee8c101910 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.368+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8c197aa0 con 0x7fee8c101910 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.368+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee7c004cf0 con 0x7fee8c101910 2024-09-16T09:57:29.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.368+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee7c035030 con 0x7fee8c101910 2024-09-16T09:57:29.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.368+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8c197fd0 con 0x7fee8c101910 2024-09-16T09:57:29.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.369+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8c103050 con 0x7fee8c101910 2024-09-16T09:57:29.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.369+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fee7c042070 con 0x7fee8c101910 2024-09-16T09:57:29.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.370+0000 7fee837fe640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee7807abf0 0x7fee7807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:29.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.370+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fee7c0be970 con 0x7fee8c101910 2024-09-16T09:57:29.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.370+0000 7fee83fff640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee7807abf0 0x7fee7807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:29.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.370+0000 7fee83fff640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee7807abf0 0x7fee7807d0b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0ffbd0 tx=0x7fee74008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.374+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fee7c089ef0 con 0x7fee8c101910 2024-09-16T09:57:29.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.582+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7fee8c198d40 con 0x7fee8c101910 2024-09-16T09:57:29.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.583+0000 7fee837fe640 1 -- 172.21.15.111:0/1007832818 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v37) ==== 107+0+4466 (secure 0 0 0) 0x7fee7c08eda0 con 0x7fee8c101910 2024-09-16T09:57:29.585 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 21 2024-09-16T09:57:29.585 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:29.585 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":21,"btime":"2024-09-16T09:54:19:675259+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:19.675245+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":0,"incarnation":21,"state":"up:replay","state_seq":3,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:29.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee7807abf0 msgr2=0x7fee7807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee7807abf0 0x7fee7807d0b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0ffbd0 tx=0x7fee74008040 comp rx=0 tx=0).stop 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 msgr2=0x7fee8c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 0x7fee8c19d690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fee7c031460 tx=0x7fee7c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 shutdown_connections 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee7807abf0 0x7fee7807d0b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee8c107910 0x7fee8c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 --2- 172.21.15.111:0/1007832818 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee8c101910 0x7fee8c19d690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 >> 172.21.15.111:0/1007832818 conn(0x7fee8c0fd5f0 msgr2=0x7fee8c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 shutdown_connections 2024-09-16T09:57:29.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:29.586+0000 7fee90fbb640 1 -- 172.21.15.111:0/1007832818 wait complete. 2024-09-16T09:57:30.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:29 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1007832818' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-16T09:57:30.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:29 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1007832818' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-16T09:57:30.204 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-16T09:57:30.457 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.930+0000 7f7289333640 1 -- 172.21.15.111:0/3480872030 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284102b60 msgr2=0x7f7284102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.930+0000 7f7289333640 1 --2- 172.21.15.111:0/3480872030 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284102b60 0x7f7284102f40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7274009c20 tx=0x7f727402aa00 comp rx=0 tx=0).stop 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.930+0000 7f7289333640 1 -- 172.21.15.111:0/3480872030 shutdown_connections 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.930+0000 7f7289333640 1 --2- 172.21.15.111:0/3480872030 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284103480 0x7f728410b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.930+0000 7f7289333640 1 --2- 172.21.15.111:0/3480872030 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284102b60 0x7f7284102f40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.930+0000 7f7289333640 1 -- 172.21.15.111:0/3480872030 >> 172.21.15.111:0/3480872030 conn(0x7f72840fc4c0 msgr2=0x7f72840fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.931+0000 7f7289333640 1 -- 172.21.15.111:0/3480872030 shutdown_connections 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.931+0000 7f7289333640 1 -- 172.21.15.111:0/3480872030 wait complete. 2024-09-16T09:57:30.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.931+0000 7f7289333640 1 Processor -- start 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.931+0000 7f7289333640 1 -- start start 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7289333640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284102b60 0x7f728419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7289333640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 0x7f728419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7289333640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f728410edd0 con 0x7f7284103480 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7289333640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f728410ec50 con 0x7f7284102b60 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 0x7f728419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 0x7f728419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55016/0 (socket says 172.21.15.111:55016) 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 -- 172.21.15.111:0/984819063 learned_addr learned my addr 172.21.15.111:0/984819063 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7282ffd640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284102b60 0x7f728419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 -- 172.21.15.111:0/984819063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284102b60 msgr2=0x7f728419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284102b60 0x7f728419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 -- 172.21.15.111:0/984819063 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7284197800 con 0x7f7284103480 2024-09-16T09:57:30.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7282ffd640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284102b60 0x7f728419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f72827fc640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 0x7f728419dbc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f726c00d6f0 tx=0x7f726c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f726c017070 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f726c00de00 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.932+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7284197af0 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.933+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f726c004bb0 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.933+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7284198080 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.933+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f728406a350 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.934+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f726c004e60 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.935+0000 7f727bfff640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727007abf0 0x7f727007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.935+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f726c09da50 con 0x7f7284103480 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.935+0000 7f7282ffd640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727007abf0 0x7f727007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.935+0000 7f7282ffd640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727007abf0 0x7f727007d0b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7274006010 tx=0x7f727402e9a0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:30.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:30.939+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f726c068fd0 con 0x7f7284103480 2024-09-16T09:57:31.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:30 smithi111 ceph-mon[109885]: pgmap v348: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:31.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:30 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:31.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.148+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f7284105fc0 con 0x7f7284103480 2024-09-16T09:57:31.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.148+0000 7f727bfff640 1 -- 172.21.15.111:0/984819063 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v37) ==== 107+0+5321 (secure 0 0 0) 0x7f726c06de80 con 0x7f7284103480 2024-09-16T09:57:31.150 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:31.150 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":22,"btime":"2024-09-16T09:54:27:857570+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:27.494625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":0,"incarnation":21,"state":"up:reconnect","state_seq":169,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:31.150 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 22 2024-09-16T09:57:31.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727007abf0 msgr2=0x7f727007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:31.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727007abf0 0x7f727007d0b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7274006010 tx=0x7f727402e9a0 comp rx=0 tx=0).stop 2024-09-16T09:57:31.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 msgr2=0x7f728419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:31.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 0x7f728419dbc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f726c00d6f0 tx=0x7f726c00dbb0 comp rx=0 tx=0).stop 2024-09-16T09:57:31.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 shutdown_connections 2024-09-16T09:57:31.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f727007abf0 0x7f727007d0b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7284103480 0x7f728419dbc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 --2- 172.21.15.111:0/984819063 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7284102b60 0x7f728419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.150+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 >> 172.21.15.111:0/984819063 conn(0x7f72840fc4c0 msgr2=0x7f7284108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.151+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 shutdown_connections 2024-09-16T09:57:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:31.151+0000 7f7289333640 1 -- 172.21.15.111:0/984819063 wait complete. 2024-09-16T09:57:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:30 smithi114 ceph-mon[79732]: pgmap v348: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:31.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:30 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:31.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-16T09:57:32.071 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:32.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:31 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/984819063' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-16T09:57:32.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:31 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/984819063' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 -- 172.21.15.111:0/2156233416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 msgr2=0x7fbc34100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 --2- 172.21.15.111:0/2156233416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc34100c40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009880 tx=0x7fbc2402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 -- 172.21.15.111:0/2156233416 shutdown_connections 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 --2- 172.21.15.111:0/2156233416 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc34100c40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 --2- 172.21.15.111:0/2156233416 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 0x7fbc34106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 -- 172.21.15.111:0/2156233416 >> 172.21.15.111:0/2156233416 conn(0x7fbc340fc4c0 msgr2=0x7fbc340fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 -- 172.21.15.111:0/2156233416 shutdown_connections 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 -- 172.21.15.111:0/2156233416 wait complete. 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 Processor -- start 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.532+0000 7fbc3b570640 1 -- start start 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3b570640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc3419c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3b570640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 0x7fbc3419caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3b570640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3410dc90 con 0x7fbc341007e0 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3b570640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fbc3410db10 con 0x7fbc341067e0 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc3419c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc3419c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:55042/0 (socket says 172.21.15.111:55042) 2024-09-16T09:57:32.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 -- 172.21.15.111:0/1626850182 learned_addr learned my addr 172.21.15.111:0/1626850182 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc38b0b640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 0x7fbc3419caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 -- 172.21.15.111:0/1626850182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 msgr2=0x7fbc3419caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 0x7fbc3419caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 -- 172.21.15.111:0/1626850182 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc34196680 con 0x7fbc341007e0 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc38b0b640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 0x7fbc3419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc3930c640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc3419c5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c8a0 tx=0x7fbc3000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc300079b0 con 0x7fbc341007e0 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.533+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbc30007b50 con 0x7fbc341007e0 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.534+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc34196970 con 0x7fbc341007e0 2024-09-16T09:57:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.534+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbc30018700 con 0x7fbc341007e0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.534+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc34196f00 con 0x7fbc341007e0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.535+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc34101f20 con 0x7fbc341007e0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.535+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fbc30007d00 con 0x7fbc341007e0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.536+0000 7fbc2a7fc640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc2007abf0 0x7fbc2007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.536+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fbc3009e490 con 0x7fbc341007e0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.536+0000 7fbc38b0b640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc2007abf0 0x7fbc2007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.537+0000 7fbc38b0b640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc2007abf0 0x7fbc2007d0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbc24006010 tx=0x7fbc240095f0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.541+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fbc30014030 con 0x7fbc341007e0 2024-09-16T09:57:32.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.756+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7fbc34108d70 con 0x7fbc341007e0 2024-09-16T09:57:32.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.756+0000 7fbc2a7fc640 1 -- 172.21.15.111:0/1626850182 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v37) ==== 107+0+5318 (secure 0 0 0) 0x7fbc30069a90 con 0x7fbc341007e0 2024-09-16T09:57:32.758 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:32.758 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":23,"btime":"2024-09-16T09:54:28:858758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:27.867279+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":170,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:32.758 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 23 2024-09-16T09:57:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc2007abf0 msgr2=0x7fbc2007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc2007abf0 0x7fbc2007d0b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbc24006010 tx=0x7fbc240095f0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 msgr2=0x7fbc3419c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:32.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc3419c5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000c8a0 tx=0x7fbc3000cd60 comp rx=0 tx=0).stop 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 shutdown_connections 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fbc2007abf0 0x7fbc2007d0b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fbc341067e0 0x7fbc3419caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 --2- 172.21.15.111:0/1626850182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc341007e0 0x7fbc3419c5b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 >> 172.21.15.111:0/1626850182 conn(0x7fbc340fc4c0 msgr2=0x7fbc340fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 shutdown_connections 2024-09-16T09:57:32.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:32.759+0000 7fbc3b570640 1 -- 172.21.15.111:0/1626850182 wait complete. 2024-09-16T09:57:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:32 smithi111 ceph-mon[109885]: pgmap v349: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:33.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:32 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1626850182' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-16T09:57:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:32 smithi114 ceph-mon[79732]: pgmap v349: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:33.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:32 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1626850182' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-16T09:57:33.451 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-16T09:57:33.699 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:34.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.121+0000 7fcafb723640 1 -- 172.21.15.111:0/1894147242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 msgr2=0x7fcaf4106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:34.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.121+0000 7fcafb723640 1 --2- 172.21.15.111:0/1894147242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf4106bf0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0009880 tx=0x7fcaf002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.121+0000 7fcafb723640 1 -- 172.21.15.111:0/1894147242 shutdown_connections 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.121+0000 7fcafb723640 1 --2- 172.21.15.111:0/1894147242 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 0x7fcaf4100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.121+0000 7fcafb723640 1 --2- 172.21.15.111:0/1894147242 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf4106bf0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.121+0000 7fcafb723640 1 -- 172.21.15.111:0/1894147242 >> 172.21.15.111:0/1894147242 conn(0x7fcaf40fc510 msgr2=0x7fcaf40fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.122+0000 7fcafb723640 1 -- 172.21.15.111:0/1894147242 shutdown_connections 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.122+0000 7fcafb723640 1 -- 172.21.15.111:0/1894147242 wait complete. 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.122+0000 7fcafb723640 1 Processor -- start 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.122+0000 7fcafb723640 1 -- start start 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcafb723640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 0x7fcaf419c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcafb723640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcafb723640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf410dce0 con 0x7fcaf4106810 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcafb723640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf410db60 con 0x7fcaf4100810 2024-09-16T09:57:34.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42826/0 (socket says 172.21.15.111:42826) 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 -- 172.21.15.111:0/1213398984 learned_addr learned my addr 172.21.15.111:0/1213398984 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf94bf640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 0x7fcaf419c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 -- 172.21.15.111:0/1213398984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 msgr2=0x7fcaf419c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 0x7fcaf419c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 -- 172.21.15.111:0/1213398984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf41966f0 con 0x7fcaf4106810 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf94bf640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 0x7fcaf419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaf8cbe640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf419cb60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d6f0 tx=0x7fcae400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcae4017070 con 0x7fcaf4106810 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcae400de00 con 0x7fcaf4106810 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf41969e0 con 0x7fcaf4106810 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcae4004bb0 con 0x7fcaf4106810 2024-09-16T09:57:34.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.123+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf4196f40 con 0x7fcaf4106810 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.124+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf4101f50 con 0x7fcaf4106810 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.125+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fcae4004e60 con 0x7fcaf4106810 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.125+0000 7fcaea7fc640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcae007abf0 0x7fcae007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.126+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fcae409da50 con 0x7fcaf4106810 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.126+0000 7fcaf94bf640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcae007abf0 0x7fcae007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.126+0000 7fcaf94bf640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcae007abf0 0x7fcae007d0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0000c00 tx=0x7fcaf0031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:34.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.130+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fcae4068fd0 con 0x7fcaf4106810 2024-09-16T09:57:34.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.342+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7fcaf4108d80 con 0x7fcaf4106810 2024-09-16T09:57:34.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.342+0000 7fcaea7fc640 1 -- 172.21.15.111:0/1213398984 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v37) ==== 107+0+5327 (secure 0 0 0) 0x7fcae406de80 con 0x7fcaf4106810 2024-09-16T09:57:34.344 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:34.344 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":24,"btime":"2024-09-16T09:54:29:860719+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:29.860715+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":88,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24307":{"gid":24307,"name":"cephfs.smithi114.bdhdtm","rank":0,"incarnation":21,"state":"up:active","state_seq":171,"addr":"172.21.15.114:6825/3743279326","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":3743279326},{"type":"v1","addr":"172.21.15.114:6825","nonce":3743279326}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24307,"qdb_cluster":[24307]},"id":1}]} 2024-09-16T09:57:34.345 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 24 2024-09-16T09:57:34.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcae007abf0 msgr2=0x7fcae007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcae007abf0 0x7fcae007d0b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0000c00 tx=0x7fcaf0031400 comp rx=0 tx=0).stop 2024-09-16T09:57:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 msgr2=0x7fcaf419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf419cb60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d6f0 tx=0x7fcae400dbb0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 shutdown_connections 2024-09-16T09:57:34.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fcae007abf0 0x7fcae007d0b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcaf4106810 0x7fcaf419cb60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 --2- 172.21.15.111:0/1213398984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fcaf4100810 0x7fcaf419c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:34.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 >> 172.21.15.111:0/1213398984 conn(0x7fcaf40fc510 msgr2=0x7fcaf40fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:34.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 shutdown_connections 2024-09-16T09:57:34.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:34.345+0000 7fcafb723640 1 -- 172.21.15.111:0/1213398984 wait complete. 2024-09-16T09:57:34.982 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:34 smithi111 ceph-mon[109885]: pgmap v350: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:34.982 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:34 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1213398984' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-16T09:57:35.010 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-16T09:57:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:34 smithi114 ceph-mon[79732]: pgmap v350: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:35.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:34 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1213398984' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-16T09:57:35.259 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 -- 172.21.15.111:0/3269930807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c106820 msgr2=0x7f7f0c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 --2- 172.21.15.111:0/3269930807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c106820 0x7f7f0c106c00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7efc009880 tx=0x7f7efc02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 -- 172.21.15.111:0/3269930807 shutdown_connections 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 --2- 172.21.15.111:0/3269930807 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c100820 0x7f7f0c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 --2- 172.21.15.111:0/3269930807 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c106820 0x7f7f0c106c00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 -- 172.21.15.111:0/3269930807 >> 172.21.15.111:0/3269930807 conn(0x7f7f0c0fc520 msgr2=0x7f7f0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 -- 172.21.15.111:0/3269930807 shutdown_connections 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.723+0000 7f7f10d99640 1 -- 172.21.15.111:0/3269930807 wait complete. 2024-09-16T09:57:35.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f10d99640 1 Processor -- start 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f10d99640 1 -- start start 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f10d99640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 0x7f7f0c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f10d99640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c106820 0x7f7f0c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f10d99640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c10dcf0 con 0x7f7f0c100820 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f10d99640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c10db70 con 0x7f7f0c106820 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f0a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 0x7f7f0c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f0a59c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 0x7f7f0c1987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42848/0 (socket says 172.21.15.111:42848) 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.724+0000 7f7f0a59c640 1 -- 172.21.15.111:0/2005443572 learned_addr learned my addr 172.21.15.111:0/2005443572 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7f0a59c640 1 -- 172.21.15.111:0/2005443572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c106820 msgr2=0x7f7f0c198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7f0a59c640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c106820 0x7f7f0c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7f0a59c640 1 -- 172.21.15.111:0/2005443572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c199370 con 0x7f7f0c100820 2024-09-16T09:57:35.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7f0a59c640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 0x7f7f0c1987e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7efc031460 tx=0x7f7efc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7efc03f070 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7efc004cf0 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c199600 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7efc035030 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.725+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c1a1bb0 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.726+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c101f60 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.727+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f7efc042070 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.727+0000 7f7efb7fe640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ef407ac40 0x7f7ef407d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.727+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f7efc0be840 con 0x7f7f0c100820 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.727+0000 7f7f09d9b640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ef407ac40 0x7f7ef407d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.728+0000 7f7f09d9b640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ef407ac40 0x7f7ef407d100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c06ae90 tx=0x7f7f00005bf0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:35.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.731+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f7efc089e40 con 0x7f7f0c100820 2024-09-16T09:57:35.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.944+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f7f0c108d90 con 0x7f7f0c100820 2024-09-16T09:57:35.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.945+0000 7f7efb7fe640 1 -- 172.21.15.111:0/2005443572 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v37) ==== 107+0+4455 (secure 0 0 0) 0x7f7efc08ecf0 con 0x7f7f0c100820 2024-09-16T09:57:35.947 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:35.947 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":25,"btime":"2024-09-16T09:54:39:206581+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":14},{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:39.206576+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:35.948 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 25 2024-09-16T09:57:35.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ef407ac40 msgr2=0x7f7ef407d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:35.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ef407ac40 0x7f7ef407d100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c06ae90 tx=0x7f7f00005bf0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 msgr2=0x7f7f0c1987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:35.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 0x7f7f0c1987e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7efc031460 tx=0x7f7efc0048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 shutdown_connections 2024-09-16T09:57:35.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ef407ac40 0x7f7ef407d100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7f0c106820 0x7f7f0c198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 --2- 172.21.15.111:0/2005443572 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7f0c100820 0x7f7f0c1987e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:35.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 >> 172.21.15.111:0/2005443572 conn(0x7f7f0c0fc520 msgr2=0x7f7f0c0fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:35.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 shutdown_connections 2024-09-16T09:57:35.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:35.947+0000 7f7f10d99640 1 -- 172.21.15.111:0/2005443572 wait complete. 2024-09-16T09:57:36.591 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-16T09:57:36.853 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:37.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:36 smithi111 ceph-mon[109885]: pgmap v351: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:37.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:36 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2005443572' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-16T09:57:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:36 smithi114 ceph-mon[79732]: pgmap v351: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:37.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:36 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2005443572' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 -- 172.21.15.111:0/633145659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41067e0 msgr2=0x7f18e4106bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/633145659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41067e0 0x7f18e4106bc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f18e0009880 tx=0x7f18e002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 -- 172.21.15.111:0/633145659 shutdown_connections 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/633145659 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e41007e0 0x7f18e4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/633145659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41067e0 0x7f18e4106bc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 -- 172.21.15.111:0/633145659 >> 172.21.15.111:0/633145659 conn(0x7f18e40fc4c0 msgr2=0x7f18e40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:37.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 -- 172.21.15.111:0/633145659 shutdown_connections 2024-09-16T09:57:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.272+0000 7f18ebf1f640 1 -- 172.21.15.111:0/633145659 wait complete. 2024-09-16T09:57:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18ebf1f640 1 Processor -- start 2024-09-16T09:57:37.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18ebf1f640 1 -- start start 2024-09-16T09:57:37.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18ebf1f640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 0x7f18e419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:37.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18ebf1f640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e41067e0 0x7f18e419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:37.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18ebf1f640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18e410dd10 con 0x7f18e41007e0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18ebf1f640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f18e410db90 con 0x7f18e41067e0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 0x7f18e419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 0x7f18e419c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42876/0 (socket says 172.21.15.111:42876) 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 -- 172.21.15.111:0/185987397 learned_addr learned my addr 172.21.15.111:0/185987397 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e94ba640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e41067e0 0x7f18e419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 -- 172.21.15.111:0/185987397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e41067e0 msgr2=0x7f18e419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e41067e0 0x7f18e419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 -- 172.21.15.111:0/185987397 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e4196780 con 0x7f18e41007e0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.273+0000 7f18e9cbb640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 0x7f18e419c600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18e0031460 tx=0x7f18e00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.274+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18e003f070 con 0x7f18e41007e0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.274+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f18e00044d0 con 0x7f18e41007e0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.274+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f18e0035030 con 0x7f18e41007e0 2024-09-16T09:57:37.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.274+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e4196a10 con 0x7f18e41007e0 2024-09-16T09:57:37.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.274+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e4196f40 con 0x7f18e41007e0 2024-09-16T09:57:37.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.275+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e4101f20 con 0x7f18e41007e0 2024-09-16T09:57:37.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.275+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f18e0042070 con 0x7f18e41007e0 2024-09-16T09:57:37.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.276+0000 7f18daffd640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f18d007ac00 0x7f18d007d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:37.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.276+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f18e00bea50 con 0x7f18e41007e0 2024-09-16T09:57:37.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.276+0000 7f18e94ba640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f18d007ac00 0x7f18d007d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:37.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.276+0000 7f18e94ba640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f18d007ac00 0x7f18d007d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f18e4105e70 tx=0x7f18d4008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:37.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.280+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f18e0004cf0 con 0x7f18e41007e0 2024-09-16T09:57:37.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.488+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7f18e4197cb0 con 0x7f18e41007e0 2024-09-16T09:57:37.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.489+0000 7f18daffd640 1 -- 172.21.15.111:0/185987397 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v37) ==== 107+0+4466 (secure 0 0 0) 0x7f18e0089f50 con 0x7f18e41007e0 2024-09-16T09:57:37.490 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:37.491 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":26,"btime":"2024-09-16T09:54:39:214057+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:39.214044+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":0,"incarnation":26,"state":"up:replay","state_seq":2,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:37.491 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 26 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f18d007ac00 msgr2=0x7f18d007d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f18d007ac00 0x7f18d007d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f18e4105e70 tx=0x7f18d4008040 comp rx=0 tx=0).stop 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 msgr2=0x7f18e419c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 0x7f18e419c600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f18e0031460 tx=0x7f18e00048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 shutdown_connections 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f18d007ac00 0x7f18d007d0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f18e41067e0 0x7f18e419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 --2- 172.21.15.111:0/185987397 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18e41007e0 0x7f18e419c600 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 >> 172.21.15.111:0/185987397 conn(0x7f18e40fc4c0 msgr2=0x7f18e40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:37.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 shutdown_connections 2024-09-16T09:57:37.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:37.491+0000 7f18ebf1f640 1 -- 172.21.15.111:0/185987397 wait complete. 2024-09-16T09:57:38.099 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-16T09:57:38.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:37 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/185987397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-16T09:57:38.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:37 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/185987397' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-16T09:57:38.347 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/3774533328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 msgr2=0x7f7d94106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:38.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/3774533328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d94106c00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009880 tx=0x7f7d8802a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/3774533328 shutdown_connections 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/3774533328 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d94100820 0x7f7d94100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/3774533328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d94106c00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/3774533328 >> 172.21.15.111:0/3774533328 conn(0x7f7d940fc520 msgr2=0x7f7d940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/3774533328 shutdown_connections 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/3774533328 wait complete. 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.830+0000 7f7d9ac8c640 1 Processor -- start 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d9ac8c640 1 -- start start 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d9ac8c640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d94100820 0x7f7d9419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d9ac8c640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d9419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:38.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d9ac8c640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9410dd50 con 0x7f7d94106820 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d9ac8c640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f7d9410dbd0 con 0x7f7d94100820 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d9419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d9419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42902/0 (socket says 172.21.15.111:42902) 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 -- 172.21.15.111:0/4186198410 learned_addr learned my addr 172.21.15.111:0/4186198410 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d98a28640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d94100820 0x7f7d9419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 -- 172.21.15.111:0/4186198410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d94100820 msgr2=0x7f7d9419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d94100820 0x7f7d9419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 -- 172.21.15.111:0/4186198410 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d94197810 con 0x7f7d94106820 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d93fff640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d9419dbd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b420 tx=0x7f7d8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d80011630 con 0x7f7d94106820 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.831+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d94197b00 con 0x7f7d94106820 2024-09-16T09:57:38.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.832+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7d80016070 con 0x7f7d94106820 2024-09-16T09:57:38.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.832+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7d80010d40 con 0x7f7d94106820 2024-09-16T09:57:38.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.832+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d94198090 con 0x7f7d94106820 2024-09-16T09:57:38.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.834+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d94101f60 con 0x7f7d94106820 2024-09-16T09:57:38.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.834+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f7d8001b460 con 0x7f7d94106820 2024-09-16T09:57:38.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.834+0000 7f7d91ffb640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7d8407abf0 0x7f7d8407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:38.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.834+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f7d8009d4d0 con 0x7f7d94106820 2024-09-16T09:57:38.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.834+0000 7f7d98a28640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7d8407abf0 0x7f7d8407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:38.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.835+0000 7f7d98a28640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7d8407abf0 0x7f7d8407d0b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d880096c0 tx=0x7f7d88031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:38.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:38.839+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f7d80068a50 con 0x7f7d94106820 2024-09-16T09:57:39.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.047+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f7d94109da0 con 0x7f7d94106820 2024-09-16T09:57:39.049 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:38 smithi111 ceph-mon[109885]: pgmap v352: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:39.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.048+0000 7f7d91ffb640 1 -- 172.21.15.111:0/4186198410 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v37) ==== 107+0+4471 (secure 0 0 0) 0x7f7d8006d900 con 0x7f7d94106820 2024-09-16T09:57:39.050 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:39.050 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":27,"btime":"2024-09-16T09:54:47:744955+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:46.941267+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":0,"incarnation":26,"state":"up:reconnect","state_seq":173,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:39.050 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 27 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7d8407abf0 msgr2=0x7f7d8407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7d8407abf0 0x7f7d8407d0b0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d880096c0 tx=0x7f7d88031400 comp rx=0 tx=0).stop 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 msgr2=0x7f7d9419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d9419dbd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7d8000b420 tx=0x7f7d8000b8e0 comp rx=0 tx=0).stop 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 shutdown_connections 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7d8407abf0 0x7f7d8407d0b0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7d94106820 0x7f7d9419dbd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 --2- 172.21.15.111:0/4186198410 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f7d94100820 0x7f7d9419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:39.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 >> 172.21.15.111:0/4186198410 conn(0x7f7d940fc520 msgr2=0x7f7d9406a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:39.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.050+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 shutdown_connections 2024-09-16T09:57:39.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:39.051+0000 7f7d9ac8c640 1 -- 172.21.15.111:0/4186198410 wait complete. 2024-09-16T09:57:39.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:38 smithi114 ceph-mon[79732]: pgmap v352: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:39.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-16T09:57:39.977 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:40.082 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:39 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/4186198410' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-16T09:57:40.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:39 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/4186198410' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-16T09:57:40.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.418+0000 7fd8ebad9640 1 -- 172.21.15.111:0/1386776734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41067f0 msgr2=0x7fd8e4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:40.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.418+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/1386776734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41067f0 0x7fd8e4106bd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0009880 tx=0x7fd8e002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.418+0000 7fd8ebad9640 1 -- 172.21.15.111:0/1386776734 shutdown_connections 2024-09-16T09:57:40.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.418+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/1386776734 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8e41007f0 0x7fd8e4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.418+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/1386776734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41067f0 0x7fd8e4106bd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.418+0000 7fd8ebad9640 1 -- 172.21.15.111:0/1386776734 >> 172.21.15.111:0/1386776734 conn(0x7fd8e40fc4f0 msgr2=0x7fd8e40fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.419+0000 7fd8ebad9640 1 -- 172.21.15.111:0/1386776734 shutdown_connections 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.419+0000 7fd8ebad9640 1 -- 172.21.15.111:0/1386776734 wait complete. 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.419+0000 7fd8ebad9640 1 Processor -- start 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.419+0000 7fd8ebad9640 1 -- start start 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8ebad9640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 0x7fd8e419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8ebad9640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8e41067f0 0x7fd8e419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8ebad9640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e410dca0 con 0x7fd8e41007f0 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8ebad9640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e410db20 con 0x7fd8e41067f0 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 0x7fd8e419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:40.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 0x7fd8e419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42930/0 (socket says 172.21.15.111:42930) 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 -- 172.21.15.111:0/2375542096 learned_addr learned my addr 172.21.15.111:0/2375542096 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9074640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8e41067f0 0x7fd8e419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 -- 172.21.15.111:0/2375542096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8e41067f0 msgr2=0x7fd8e419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8e41067f0 0x7fd8e419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 -- 172.21.15.111:0/2375542096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e4197820 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8e9875640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 0x7fd8e419d6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0031460 tx=0x7fd8e00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8e003f070 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8e00035f0 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.420+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e4197ab0 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.421+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8e0035030 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.421+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e4197fe0 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.421+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e4101f30 con 0x7fd8e41007f0 2024-09-16T09:57:40.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.423+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fd8e0042070 con 0x7fd8e41007f0 2024-09-16T09:57:40.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.423+0000 7fd8daffd640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd8d007abf0 0x7fd8d007d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:40.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.423+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fd8e00be840 con 0x7fd8e41007f0 2024-09-16T09:57:40.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.423+0000 7fd8e9074640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd8d007abf0 0x7fd8d007d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:40.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.424+0000 7fd8e9074640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd8d007abf0 0x7fd8d007d0b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005fd0 tx=0x7fd8d4005850 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:40.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.432+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fd8e0089dc0 con 0x7fd8e41007f0 2024-09-16T09:57:40.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.662+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7fd8e4198290 con 0x7fd8e41007f0 2024-09-16T09:57:40.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.663+0000 7fd8daffd640 1 -- 172.21.15.111:0/2375542096 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v37) ==== 107+0+4468 (secure 0 0 0) 0x7fd8e008ec70 con 0x7fd8e41007f0 2024-09-16T09:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:40.665 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":28,"btime":"2024-09-16T09:54:48:746819+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:47.751041+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":174,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:40.666 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 28 2024-09-16T09:57:40.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd8d007abf0 msgr2=0x7fd8d007d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:40.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd8d007abf0 0x7fd8d007d0b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005fd0 tx=0x7fd8d4005850 comp rx=0 tx=0).stop 2024-09-16T09:57:40.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 msgr2=0x7fd8e419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 0x7fd8e419d6a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0031460 tx=0x7fd8e00045e0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 shutdown_connections 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fd8d007abf0 0x7fd8d007d0b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fd8e41067f0 0x7fd8e419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 --2- 172.21.15.111:0/2375542096 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd8e41007f0 0x7fd8e419d6a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 >> 172.21.15.111:0/2375542096 conn(0x7fd8e40fc4f0 msgr2=0x7fd8e40fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 shutdown_connections 2024-09-16T09:57:40.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:40.666+0000 7fd8ebad9640 1 -- 172.21.15.111:0/2375542096 wait complete. 2024-09-16T09:57:40.989 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: pgmap v353: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:40.989 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:57:40.989 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:57:40.989 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:57:40.989 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2375542096' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-16T09:57:40.990 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:57:40.990 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:57:40.990 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:40 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: pgmap v353: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2375542096' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-16T09:57:41.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-16T09:57:41.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:40 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' 2024-09-16T09:57:41.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-16T09:57:41.550 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:42.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 -- 172.21.15.111:0/3037374547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 msgr2=0x7f4768101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:42.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 --2- 172.21.15.111:0/3037374547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f4768101d90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f475c009880 tx=0x7f475c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 -- 172.21.15.111:0/3037374547 shutdown_connections 2024-09-16T09:57:42.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 --2- 172.21.15.111:0/3037374547 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f4768101d90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 --2- 172.21.15.111:0/3037374547 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4768107930 0x7f4768107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 -- 172.21.15.111:0/3037374547 >> 172.21.15.111:0/3037374547 conn(0x7f47680fd630 msgr2=0x7f47680ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 -- 172.21.15.111:0/3037374547 shutdown_connections 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.014+0000 7f47706ca640 1 -- 172.21.15.111:0/3037374547 wait complete. 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f47706ca640 1 Processor -- start 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f47706ca640 1 -- start start 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f47706ca640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f476819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f47706ca640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4768107930 0x7f476819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f47706ca640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f476810ee00 con 0x7f4768101930 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f47706ca640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f476810ec80 con 0x7f4768107930 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f476e466640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f476819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f476e466640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f476819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42944/0 (socket says 172.21.15.111:42944) 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f476e466640 1 -- 172.21.15.111:0/2412145858 learned_addr learned my addr 172.21.15.111:0/2412145858 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f476e466640 1 -- 172.21.15.111:0/2412145858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4768107930 msgr2=0x7f476819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f476e466640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4768107930 0x7f476819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.015+0000 7f476e466640 1 -- 172.21.15.111:0/2412145858 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4768197810 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.016+0000 7f476e466640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f476819d690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f476000c8f0 tx=0x7f476000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.016+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f47600079b0 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.016+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4768197b00 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.016+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f47600054e0 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.016+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4760004dd0 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.016+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4768198090 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.017+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4768103070 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.017+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f4760005020 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.018+0000 7f47677fe640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f475007ab90 0x7f475007d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.018+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f476009de10 con 0x7f4768101930 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.018+0000 7f476dc65640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f475007ab90 0x7f475007d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.018+0000 7f476dc65640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f475007ab90 0x7f475007d050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f475c0096c0 tx=0x7f475c000bc0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:42.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.022+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f4760014030 con 0x7f4768101930 2024-09-16T09:57:42.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.233+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f4768109ea0 con 0x7f4768101930 2024-09-16T09:57:42.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.233+0000 7f47677fe640 1 -- 172.21.15.111:0/2412145858 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v37) ==== 107+0+5327 (secure 0 0 0) 0x7f4760007de0 con 0x7f4768101930 2024-09-16T09:57:42.235 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:42.235 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":29,"btime":"2024-09-16T09:54:49:752004+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:54:49.751999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi114.sreoiu","rank":0,"incarnation":26,"state":"up:active","state_seq":175,"addr":"172.21.15.114:6827/2254901057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2254901057},{"type":"v1","addr":"172.21.15.114:6827","nonce":2254901057}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24319,"qdb_cluster":[24319]},"id":1}]} 2024-09-16T09:57:42.235 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 29 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f475007ab90 msgr2=0x7f475007d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f475007ab90 0x7f475007d050 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f475c0096c0 tx=0x7f475c000bc0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 msgr2=0x7f476819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f476819d690 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f476000c8f0 tx=0x7f476000cdb0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 shutdown_connections 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f475007ab90 0x7f475007d050 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f4768107930 0x7f476819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 --2- 172.21.15.111:0/2412145858 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4768101930 0x7f476819d690 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.235+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 >> 172.21.15.111:0/2412145858 conn(0x7f47680fd630 msgr2=0x7f47680fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.236+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 shutdown_connections 2024-09-16T09:57:42.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:42.236+0000 7f47706ca640 1 -- 172.21.15.111:0/2412145858 wait complete. 2024-09-16T09:57:42.833 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-16T09:57:43.083 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:42 smithi111 ceph-mon[109885]: pgmap v354: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:43.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:42 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2412145858' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-16T09:57:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:42 smithi114 ceph-mon[79732]: pgmap v354: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:43.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:42 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2412145858' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 -- 172.21.15.111:0/2986182698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448106820 msgr2=0x7f6448106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 --2- 172.21.15.111:0/2986182698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448106820 0x7f6448106c00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f643c009880 tx=0x7f643c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 -- 172.21.15.111:0/2986182698 shutdown_connections 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 --2- 172.21.15.111:0/2986182698 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448100820 0x7f6448100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 --2- 172.21.15.111:0/2986182698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448106820 0x7f6448106c00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 -- 172.21.15.111:0/2986182698 >> 172.21.15.111:0/2986182698 conn(0x7f64480fc520 msgr2=0x7f64480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 -- 172.21.15.111:0/2986182698 shutdown_connections 2024-09-16T09:57:43.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.554+0000 7f644eb2e640 1 -- 172.21.15.111:0/2986182698 wait complete. 2024-09-16T09:57:43.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644eb2e640 1 Processor -- start 2024-09-16T09:57:43.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644eb2e640 1 -- start start 2024-09-16T09:57:43.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644eb2e640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 0x7f644819c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644eb2e640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448106820 0x7f644819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644eb2e640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f644810dcf0 con 0x7f6448100820 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644eb2e640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f644810db70 con 0x7f6448106820 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644c8ca640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 0x7f644819c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644c8ca640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 0x7f644819c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42222/0 (socket says 172.21.15.111:42222) 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.555+0000 7f644c8ca640 1 -- 172.21.15.111:0/3458911177 learned_addr learned my addr 172.21.15.111:0/3458911177 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f6447fff640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448106820 0x7f644819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f644c8ca640 1 -- 172.21.15.111:0/3458911177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448106820 msgr2=0x7f644819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f644c8ca640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448106820 0x7f644819cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f644c8ca640 1 -- 172.21.15.111:0/3458911177 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64481966e0 con 0x7f6448100820 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f6447fff640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448106820 0x7f644819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:57:43.559 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f644c8ca640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 0x7f644819c610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f643c031460 tx=0x7f643c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:43.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f643c03f070 con 0x7f6448100820 2024-09-16T09:57:43.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f643c0044d0 con 0x7f6448100820 2024-09-16T09:57:43.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6448196970 con 0x7f6448100820 2024-09-16T09:57:43.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f643c035030 con 0x7f6448100820 2024-09-16T09:57:43.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.556+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6448196e70 con 0x7f6448100820 2024-09-16T09:57:43.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.557+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6448101f60 con 0x7f6448100820 2024-09-16T09:57:43.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.558+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f643c042070 con 0x7f6448100820 2024-09-16T09:57:43.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.558+0000 7f6445ffb640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f643807ac50 0x7f643807d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:43.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.559+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f643c0be870 con 0x7f6448100820 2024-09-16T09:57:43.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.559+0000 7f6447fff640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f643807ac50 0x7f643807d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:43.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.559+0000 7f6447fff640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f643807ac50 0x7f643807d110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6448197f30 tx=0x7f6434005d30 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:43.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.563+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f643c004cf0 con 0x7f6448100820 2024-09-16T09:57:43.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.770+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7f6448108d90 con 0x7f6448100820 2024-09-16T09:57:43.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.771+0000 7f6445ffb640 1 -- 172.21.15.111:0/3458911177 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v37) ==== 107+0+4455 (secure 0 0 0) 0x7f643c089e70 con 0x7f6448100820 2024-09-16T09:57:43.773 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:43.773 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":30,"btime":"2024-09-16T09:55:00:141758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:00.141754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:43.773 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 30 2024-09-16T09:57:43.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f643807ac50 msgr2=0x7f643807d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:43.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f643807ac50 0x7f643807d110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6448197f30 tx=0x7f6434005d30 comp rx=0 tx=0).stop 2024-09-16T09:57:43.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 msgr2=0x7f644819c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:43.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 0x7f644819c610 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f643c031460 tx=0x7f643c0048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 shutdown_connections 2024-09-16T09:57:43.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f643807ac50 0x7f643807d110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6448106820 0x7f644819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 --2- 172.21.15.111:0/3458911177 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6448100820 0x7f644819c610 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:43.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 >> 172.21.15.111:0/3458911177 conn(0x7f64480fc520 msgr2=0x7f64480fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:43.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.773+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 shutdown_connections 2024-09-16T09:57:43.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:43.774+0000 7f644eb2e640 1 -- 172.21.15.111:0/3458911177 wait complete. 2024-09-16T09:57:44.075 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:43 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3458911177' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-16T09:57:44.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:43 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3458911177' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-16T09:57:44.745 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-16T09:57:44.998 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:45.119 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:44 smithi111 ceph-mon[109885]: pgmap v355: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:45.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:44 smithi114 ceph-mon[79732]: pgmap v355: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:45.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 -- 172.21.15.111:0/4052978380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 msgr2=0x7f8010106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 --2- 172.21.15.111:0/4052978380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010106c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8008009c20 tx=0x7f800802a970 comp rx=0 tx=0).stop 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 -- 172.21.15.111:0/4052978380 shutdown_connections 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 --2- 172.21.15.111:0/4052978380 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8010100820 0x7f8010100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 --2- 172.21.15.111:0/4052978380 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010106c00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 -- 172.21.15.111:0/4052978380 >> 172.21.15.111:0/4052978380 conn(0x7f80100fc520 msgr2=0x7f80100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 -- 172.21.15.111:0/4052978380 shutdown_connections 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.429+0000 7f8017134640 1 -- 172.21.15.111:0/4052978380 wait complete. 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f8017134640 1 Processor -- start 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f8017134640 1 -- start start 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f8017134640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8010100820 0x7f8010196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:45.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f8017134640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f8017134640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f801010dcf0 con 0x7f8010106820 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f8017134640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f801010db70 con 0x7f8010100820 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42228/0 (socket says 172.21.15.111:42228) 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 -- 172.21.15.111:0/1389384402 learned_addr learned my addr 172.21.15.111:0/1389384402 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 -- 172.21.15.111:0/1389384402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8010100820 msgr2=0x7f8010196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8010100820 0x7f8010196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 -- 172.21.15.111:0/1389384402 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8010197090 con 0x7f8010106820 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.430+0000 7f800ffff640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010196b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f800000d6f0 tx=0x7f800000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:45.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.431+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8000017070 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.431+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8010197380 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.431+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f800000de00 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.431+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8000004bb0 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.431+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80101a3e50 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.432+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8010101f60 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.432+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f8000004e60 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.433+0000 7f800dffb640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ffc07ac00 0x7f7ffc07d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.433+0000 7f8014ed0640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ffc07ac00 0x7f7ffc07d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.433+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f800009da30 con 0x7f8010106820 2024-09-16T09:57:45.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.433+0000 7f8014ed0640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ffc07ac00 0x7f7ffc07d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8008006010 tx=0x7f800802f9d0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:45.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.437+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f8000068fb0 con 0x7f8010106820 2024-09-16T09:57:45.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.649+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7f8010108800 con 0x7f8010106820 2024-09-16T09:57:45.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.649+0000 7f800dffb640 1 -- 172.21.15.111:0/1389384402 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v37) ==== 107+0+4466 (secure 0 0 0) 0x7f800006de60 con 0x7f8010106820 2024-09-16T09:57:45.651 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:45.651 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":31,"btime":"2024-09-16T09:55:00:146878+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:00.146861+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:replay","state_seq":1,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:45.652 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 31 2024-09-16T09:57:45.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.651+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ffc07ac00 msgr2=0x7f7ffc07d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:45.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.651+0000 7f8017134640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ffc07ac00 0x7f7ffc07d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8008006010 tx=0x7f800802f9d0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.651+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 msgr2=0x7f8010196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:45.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.651+0000 7f8017134640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010196b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f800000d6f0 tx=0x7f800000dbb0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 shutdown_connections 2024-09-16T09:57:45.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f7ffc07ac00 0x7f7ffc07d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8010106820 0x7f8010196b50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 --2- 172.21.15.111:0/1389384402 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f8010100820 0x7f8010196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:45.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 >> 172.21.15.111:0/1389384402 conn(0x7f80100fc520 msgr2=0x7f80100fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:45.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 shutdown_connections 2024-09-16T09:57:45.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:45.652+0000 7f8017134640 1 -- 172.21.15.111:0/1389384402 wait complete. 2024-09-16T09:57:46.030 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:45 smithi111 ceph-mon[109885]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:46.030 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:45 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1389384402' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-16T09:57:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:45 smithi114 ceph-mon[79732]: from='mgr.14724 172.21.15.111:0/2437233260' entity='mgr.smithi111.erxodt' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-16T09:57:46.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:45 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1389384402' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-16T09:57:46.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-16T09:57:46.590 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:47.026 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:46 smithi111 ceph-mon[109885]: pgmap v356: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- 172.21.15.111:0/503460616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 msgr2=0x7ff47c102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 --2- 172.21.15.111:0/503460616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c102ec0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff46c009880 tx=0x7ff46c02a530 comp rx=0 tx=0).stop 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- 172.21.15.111:0/503460616 shutdown_connections 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 --2- 172.21.15.111:0/503460616 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47c103400 0x7ff47c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 --2- 172.21.15.111:0/503460616 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c102ec0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- 172.21.15.111:0/503460616 >> 172.21.15.111:0/503460616 conn(0x7ff47c0fc520 msgr2=0x7ff47c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- 172.21.15.111:0/503460616 shutdown_connections 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- 172.21.15.111:0/503460616 wait complete. 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 Processor -- start 2024-09-16T09:57:47.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- start start 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c100740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47c103400 0x7ff47c100c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c10edf0 con 0x7ff47c102ae0 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.030+0000 7ff4822ab640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff47c10ec70 con 0x7ff47c103400 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c100740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c100740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42254/0 (socket says 172.21.15.111:42254) 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 -- 172.21.15.111:0/2501264403 learned_addr learned my addr 172.21.15.111:0/2501264403 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff473fff640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47c103400 0x7ff47c100c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 -- 172.21.15.111:0/2501264403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47c103400 msgr2=0x7ff47c100c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47c103400 0x7ff47c100c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 -- 172.21.15.111:0/2501264403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47c1011c0 con 0x7ff47c102ae0 2024-09-16T09:57:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff47bfff640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c100740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff46c031460 tx=0x7ff46c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff46c03f070 con 0x7ff47c102ae0 2024-09-16T09:57:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff46c0035f0 con 0x7ff47c102ae0 2024-09-16T09:57:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47c101450 con 0x7ff47c102ae0 2024-09-16T09:57:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff46c035030 con 0x7ff47c102ae0 2024-09-16T09:57:47.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.031+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47c1a3da0 con 0x7ff47c102ae0 2024-09-16T09:57:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.032+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47c06abe0 con 0x7ff47c102ae0 2024-09-16T09:57:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.033+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ff46c042070 con 0x7ff47c102ae0 2024-09-16T09:57:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.033+0000 7ff479ffb640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff46807abf0 0x7ff46807d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.033+0000 7ff473fff640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff46807abf0 0x7ff46807d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.033+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7ff46c0be790 con 0x7ff47c102ae0 2024-09-16T09:57:47.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.034+0000 7ff473fff640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff46807abf0 0x7ff46807d0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff47c1021d0 tx=0x7ff46400b2e0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:47.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.038+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ff46c089d10 con 0x7ff47c102ae0 2024-09-16T09:57:47.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:46 smithi114 ceph-mon[79732]: pgmap v356: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:47.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.249+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7ff47c105fb0 con 0x7ff47c102ae0 2024-09-16T09:57:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.250+0000 7ff479ffb640 1 -- 172.21.15.111:0/2501264403 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v37) ==== 107+0+4470 (secure 0 0 0) 0x7ff46c08ebc0 con 0x7ff47c102ae0 2024-09-16T09:57:47.252 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:47.252 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":32,"btime":"2024-09-16T09:55:08:815206+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:07.965620+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:reconnect","state_seq":18,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 32 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff46807abf0 msgr2=0x7ff46807d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff46807abf0 0x7ff46807d0b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff47c1021d0 tx=0x7ff46400b2e0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 msgr2=0x7ff47c100740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c100740 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff46c031460 tx=0x7ff46c0045e0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 shutdown_connections 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff46807abf0 0x7ff46807d0b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff47c103400 0x7ff47c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.252+0000 7ff4822ab640 1 --2- 172.21.15.111:0/2501264403 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff47c102ae0 0x7ff47c100740 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:47.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.253+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 >> 172.21.15.111:0/2501264403 conn(0x7ff47c0fc520 msgr2=0x7ff47c108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.253+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 shutdown_connections 2024-09-16T09:57:47.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:47.253+0000 7ff4822ab640 1 -- 172.21.15.111:0/2501264403 wait complete. 2024-09-16T09:57:47.898 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-16T09:57:48.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:47 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2501264403' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-16T09:57:48.149 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:48.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:47 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2501264403' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 -- 172.21.15.111:0/1565230360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074f40 msgr2=0x7f200c10dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 --2- 172.21.15.111:0/1565230360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074f40 0x7f200c10dc30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2008009880 tx=0x7f200802a530 comp rx=0 tx=0).stop 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 -- 172.21.15.111:0/1565230360 shutdown_connections 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 --2- 172.21.15.111:0/1565230360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074f40 0x7f200c10dc30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 --2- 172.21.15.111:0/1565230360 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c074620 0x7f200c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 -- 172.21.15.111:0/1565230360 >> 172.21.15.111:0/1565230360 conn(0x7f200c0fd630 msgr2=0x7f200c0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:48.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 -- 172.21.15.111:0/1565230360 shutdown_connections 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.619+0000 7f2013a55640 1 -- 172.21.15.111:0/1565230360 wait complete. 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f2013a55640 1 Processor -- start 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f2013a55640 1 -- start start 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f2013a55640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 0x7f200c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f2013a55640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c074f40 0x7f200c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f2013a55640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f200c111080 con 0x7f200c074620 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f2013a55640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f200c110f00 con 0x7f200c074f40 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f20117f1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 0x7f200c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f20117f1640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 0x7f200c19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42282/0 (socket says 172.21.15.111:42282) 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.620+0000 7f20117f1640 1 -- 172.21.15.111:0/2551233324 learned_addr learned my addr 172.21.15.111:0/2551233324 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f2010ff0640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c074f40 0x7f200c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:48.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20117f1640 1 -- 172.21.15.111:0/2551233324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c074f40 msgr2=0x7f200c19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20117f1640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c074f40 0x7f200c19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20117f1640 1 -- 172.21.15.111:0/2551233324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c199a70 con 0x7f200c074620 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20117f1640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 0x7f200c19f8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00b420 tx=0x7f1ffc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ffc011630 con 0x7f200c074620 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ffc016070 con 0x7f200c074620 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c199d60 con 0x7f200c074620 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ffc010d40 con 0x7f200c074620 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.621+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c19a2c0 con 0x7f200c074620 2024-09-16T09:57:48.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.622+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c075cd0 con 0x7f200c074620 2024-09-16T09:57:48.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.623+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f1ffc01b460 con 0x7f200c074620 2024-09-16T09:57:48.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.623+0000 7f20027fc640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ff807ac40 0x7f1ff807d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:48.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.624+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f1ffc09d4c0 con 0x7f200c074620 2024-09-16T09:57:48.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.624+0000 7f2010ff0640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ff807ac40 0x7f1ff807d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:48.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.624+0000 7f2010ff0640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ff807ac40 0x7f1ff807d100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f200c19b260 tx=0x7f2008031400 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:48.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.628+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f1ffc021250 con 0x7f200c074620 2024-09-16T09:57:48.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.838+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f200c19afa0 con 0x7f200c074620 2024-09-16T09:57:48.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.838+0000 7f20027fc640 1 -- 172.21.15.111:0/2551233324 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v37) ==== 107+0+4467 (secure 0 0 0) 0x7f1ffc068ac0 con 0x7f200c074620 2024-09-16T09:57:48.841 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:48.841 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":33,"btime":"2024-09-16T09:55:09:824538+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:08.826090+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:rejoin","state_seq":19,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-16T09:57:48.842 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 33 2024-09-16T09:57:48.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ff807ac40 msgr2=0x7f1ff807d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ff807ac40 0x7f1ff807d100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f200c19b260 tx=0x7f2008031400 comp rx=0 tx=0).stop 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 msgr2=0x7f200c19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 0x7f200c19f8b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc00b420 tx=0x7f1ffc00b8e0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 shutdown_connections 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f1ff807ac40 0x7f1ff807d100 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f200c074f40 0x7f200c19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 --2- 172.21.15.111:0/2551233324 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f200c074620 0x7f200c19f8b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 >> 172.21.15.111:0/2551233324 conn(0x7f200c0fd630 msgr2=0x7f200c10b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 shutdown_connections 2024-09-16T09:57:48.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:48.841+0000 7f2013a55640 1 -- 172.21.15.111:0/2551233324 wait complete. 2024-09-16T09:57:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:48 smithi111 ceph-mon[109885]: pgmap v357: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:49.132 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:48 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2551233324' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-16T09:57:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:48 smithi114 ceph-mon[79732]: pgmap v357: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:49.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:48 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2551233324' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-16T09:57:49.433 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-16T09:57:49.681 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 -- 172.21.15.111:0/784016720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 msgr2=0x7ff5ec101560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/784016720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec101560 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0009880 tx=0x7ff5e002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 -- 172.21.15.111:0/784016720 shutdown_connections 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/784016720 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ec101b30 0x7ff5ec105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/784016720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec101560 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 -- 172.21.15.111:0/784016720 >> 172.21.15.111:0/784016720 conn(0x7ff5ec0fbc40 msgr2=0x7ff5ec0fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 -- 172.21.15.111:0/784016720 shutdown_connections 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.109+0000 7ff5f2f95640 1 -- 172.21.15.111:0/784016720 wait complete. 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f2f95640 1 Processor -- start 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f2f95640 1 -- start start 2024-09-16T09:57:50.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f2f95640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec102420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f2f95640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ec101b30 0x7ff5ec102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f2f95640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec10dcd0 con 0x7ff5ec101180 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f2f95640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7ff5ec10db50 con 0x7ff5ec101b30 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f0d31640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec102420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f0d31640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec102420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42296/0 (socket says 172.21.15.111:42296) 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.110+0000 7ff5f0d31640 1 -- 172.21.15.111:0/2636452939 learned_addr learned my addr 172.21.15.111:0/2636452939 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5ebfff640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ec101b30 0x7ff5ec102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5f0d31640 1 -- 172.21.15.111:0/2636452939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ec101b30 msgr2=0x7ff5ec102960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5f0d31640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ec101b30 0x7ff5ec102960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5f0d31640 1 -- 172.21.15.111:0/2636452939 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5ec102ea0 con 0x7ff5ec101180 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5f0d31640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec102420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0031460 tx=0x7ff5e00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5e003f070 con 0x7ff5ec101180 2024-09-16T09:57:50.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5e00035f0 con 0x7ff5ec101180 2024-09-16T09:57:50.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5ec103130 con 0x7ff5ec101180 2024-09-16T09:57:50.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5e0035030 con 0x7ff5ec101180 2024-09-16T09:57:50.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.111+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5ec1a3ce0 con 0x7ff5ec101180 2024-09-16T09:57:50.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.112+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5ec102140 con 0x7ff5ec101180 2024-09-16T09:57:50.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.113+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7ff5e0042070 con 0x7ff5ec101180 2024-09-16T09:57:50.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.113+0000 7ff5e9ffb640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff5dc07ac40 0x7ff5dc07d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:50.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.113+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7ff5e00be700 con 0x7ff5ec101180 2024-09-16T09:57:50.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.113+0000 7ff5ebfff640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff5dc07ac40 0x7ff5dc07d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:50.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.114+0000 7ff5ebfff640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff5dc07ac40 0x7ff5dc07d100 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8005fd0 tx=0x7ff5d8005850 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:50.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.118+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7ff5e0089d00 con 0x7ff5ec101180 2024-09-16T09:57:50.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.326+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7ff5ec1a40c0 con 0x7ff5ec101180 2024-09-16T09:57:50.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.327+0000 7ff5e9ffb640 1 -- 172.21.15.111:0/2636452939 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v37) ==== 107+0+4476 (secure 0 0 0) 0x7ff5e008ebb0 con 0x7ff5ec101180 2024-09-16T09:57:50.330 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:50.330 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":34,"btime":"2024-09-16T09:55:10:831699+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:10.831692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:active","state_seq":20,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-16T09:57:50.330 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 34 2024-09-16T09:57:50.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff5dc07ac40 msgr2=0x7ff5dc07d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:50.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff5dc07ac40 0x7ff5dc07d100 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8005fd0 tx=0x7ff5d8005850 comp rx=0 tx=0).stop 2024-09-16T09:57:50.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 msgr2=0x7ff5ec102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:50.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec102420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5e0031460 tx=0x7ff5e00045e0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 shutdown_connections 2024-09-16T09:57:50.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7ff5dc07ac40 0x7ff5dc07d100 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7ff5ec101b30 0x7ff5ec102960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 --2- 172.21.15.111:0/2636452939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5ec101180 0x7ff5ec102420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:50.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 >> 172.21.15.111:0/2636452939 conn(0x7ff5ec0fbc40 msgr2=0x7ff5ec0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:50.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 shutdown_connections 2024-09-16T09:57:50.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:50.329+0000 7ff5f2f95640 1 -- 172.21.15.111:0/2636452939 wait complete. 2024-09-16T09:57:50.932 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-16T09:57:51.180 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:51.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:50 smithi114 ceph-mon[79732]: pgmap v358: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:51.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:50 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/2636452939' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-16T09:57:51.297 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:50 smithi111 ceph-mon[109885]: pgmap v358: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:51.297 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:50 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/2636452939' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-16T09:57:51.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 -- 172.21.15.111:0/70788943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100200 msgr2=0x7f5e6c1005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 --2- 172.21.15.111:0/70788943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100200 0x7f5e6c1005e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009880 tx=0x7f5e5c02a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 -- 172.21.15.111:0/70788943 shutdown_connections 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 --2- 172.21.15.111:0/70788943 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c104c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 --2- 172.21.15.111:0/70788943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100200 0x7f5e6c1005e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 -- 172.21.15.111:0/70788943 >> 172.21.15.111:0/70788943 conn(0x7f5e6c0fbc60 msgr2=0x7f5e6c0fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 -- 172.21.15.111:0/70788943 shutdown_connections 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.601+0000 7f5e7252a640 1 -- 172.21.15.111:0/70788943 wait complete. 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e7252a640 1 Processor -- start 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e7252a640 1 -- start start 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e7252a640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e6c100200 0x7f5e6c19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e7252a640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c19dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:51.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e7252a640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10d480 con 0x7f5e6c100bb0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e7252a640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10d300 con 0x7f5e6c100200 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e6b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c19dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e6b7fe640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c19dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42312/0 (socket says 172.21.15.111:42312) 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.602+0000 7f5e6b7fe640 1 -- 172.21.15.111:0/1132384505 learned_addr learned my addr 172.21.15.111:0/1132384505 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e6bfff640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e6c100200 0x7f5e6c19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e6b7fe640 1 -- 172.21.15.111:0/1132384505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e6c100200 msgr2=0x7f5e6c19d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e6b7fe640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e6c100200 0x7f5e6c19d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e6b7fe640 1 -- 172.21.15.111:0/1132384505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c195d80 con 0x7f5e6c100bb0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e6b7fe640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c19dc90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400d6f0 tx=0x7f5e5400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e54017070 con 0x7f5e6c100bb0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6c196010 con 0x7f5e6c100bb0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e5400de00 con 0x7f5e6c100bb0 2024-09-16T09:57:51.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e54004bb0 con 0x7f5e6c100bb0 2024-09-16T09:57:51.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.603+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6c1965a0 con 0x7f5e6c100bb0 2024-09-16T09:57:51.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.604+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6c1016e0 con 0x7f5e6c100bb0 2024-09-16T09:57:51.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.605+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f5e54004e60 con 0x7f5e6c100bb0 2024-09-16T09:57:51.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.605+0000 7f5e697fa640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5e5807ac00 0x7f5e5807d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:51.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.606+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f5e5409da90 con 0x7f5e6c100bb0 2024-09-16T09:57:51.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.606+0000 7f5e6bfff640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5e5807ac00 0x7f5e5807d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:51.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.606+0000 7f5e6bfff640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5e5807ac00 0x7f5e5807d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c031460 tx=0x7f5e5c0095c0 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:51.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.610+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f5e54068fd0 con 0x7f5e6c100bb0 2024-09-16T09:57:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.822+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7f5e6c108510 con 0x7f5e6c100bb0 2024-09-16T09:57:51.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.823+0000 7f5e697fa640 1 -- 172.21.15.111:0/1132384505 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v37) ==== 107+0+5326 (secure 0 0 0) 0x7f5e5406de80 con 0x7f5e6c100bb0 2024-09-16T09:57:51.825 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:51.826 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":35,"btime":"2024-09-16T09:55:11:840151+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6827/2165184879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2165184879},{"type":"v1","addr":"172.21.15.114:6827","nonce":2165184879}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:10.831692+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:active","state_seq":20,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-16T09:57:51.826 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 35 2024-09-16T09:57:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5e5807ac00 msgr2=0x7f5e5807d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5e5807ac00 0x7f5e5807d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c031460 tx=0x7f5e5c0095c0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 msgr2=0x7f5e6c19dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:51.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c19dc90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400d6f0 tx=0x7f5e5400dbb0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 shutdown_connections 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f5e5807ac00 0x7f5e5807d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e6c100bb0 0x7f5e6c19dc90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 --2- 172.21.15.111:0/1132384505 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f5e6c100200 0x7f5e6c19d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 >> 172.21.15.111:0/1132384505 conn(0x7f5e6c0fbc60 msgr2=0x7f5e6c0fd0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 shutdown_connections 2024-09-16T09:57:51.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:51.825+0000 7f5e7252a640 1 -- 172.21.15.111:0/1132384505 wait complete. 2024-09-16T09:57:52.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:51 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1132384505' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-16T09:57:52.204 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:51 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1132384505' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-16T09:57:52.502 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-16T09:57:52.757 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:53.131 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:52 smithi111 ceph-mon[109885]: pgmap v359: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:53.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:52 smithi114 ceph-mon[79732]: pgmap v359: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 -- 172.21.15.111:0/1657304900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901007e0 msgr2=0x7f7690100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 --2- 172.21.15.111:0/1657304900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901007e0 0x7f7690100c40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7680009c20 tx=0x7f768002a970 comp rx=0 tx=0).stop 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 -- 172.21.15.111:0/1657304900 shutdown_connections 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 --2- 172.21.15.111:0/1657304900 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901007e0 0x7f7690100c40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 --2- 172.21.15.111:0/1657304900 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76901067e0 0x7f7690106bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 -- 172.21.15.111:0/1657304900 >> 172.21.15.111:0/1657304900 conn(0x7f76900fc4c0 msgr2=0x7f76900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:53.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 -- 172.21.15.111:0/1657304900 shutdown_connections 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 -- 172.21.15.111:0/1657304900 wait complete. 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 Processor -- start 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.219+0000 7f76970ab640 1 -- start start 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f76970ab640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76901007e0 0x7f76901988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f76970ab640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 0x7f7690198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f76970ab640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f769010dd10 con 0x7f76901067e0 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f76970ab640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f769010db90 con 0x7f76901007e0 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 0x7f7690198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 0x7f7690198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:42330/0 (socket says 172.21.15.111:42330) 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 -- 172.21.15.111:0/1349153984 learned_addr learned my addr 172.21.15.111:0/1349153984 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f7694e47640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76901007e0 0x7f76901988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 -- 172.21.15.111:0/1349153984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76901007e0 msgr2=0x7f76901988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:53.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76901007e0 0x7f76901988a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 -- 172.21.15.111:0/1349153984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7690199430 con 0x7f76901067e0 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768ffff640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 0x7f7690198de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7680005cc0 tx=0x7f768002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7680047070 con 0x7f76901067e0 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f768002f7e0 con 0x7f76901067e0 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7680034070 con 0x7f76901067e0 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.220+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76901996c0 con 0x7f76901067e0 2024-09-16T09:57:53.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.221+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76901a1c70 con 0x7f76901067e0 2024-09-16T09:57:53.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.222+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7690101f20 con 0x7f76901067e0 2024-09-16T09:57:53.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.222+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f768004a070 con 0x7f76901067e0 2024-09-16T09:57:53.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.223+0000 7f768dffb640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f767c07abf0 0x7f767c07d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:53.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.223+0000 7f7694e47640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f767c07abf0 0x7f767c07d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:53.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.223+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f76800bedf0 con 0x7f76901067e0 2024-09-16T09:57:53.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.223+0000 7f7694e47640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f767c07abf0 0x7f767c07d0b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7678009890 tx=0x7f7678008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:53.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.227+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f768003f070 con 0x7f76901067e0 2024-09-16T09:57:53.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.436+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7f7690108d70 con 0x7f76901067e0 2024-09-16T09:57:53.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.437+0000 7f768dffb640 1 -- 172.21.15.111:0/1349153984 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v37) ==== 107+0+5326 (secure 0 0 0) 0x7f768008a2f0 con 0x7f76901067e0 2024-09-16T09:57:53.440 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-09-16T09:57:53.440 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":36,"btime":"2024-09-16T09:55:18:941345+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi111.yvusja","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6829/2183853210","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6828","nonce":2183853210},{"type":"v1","addr":"172.21.15.111:6829","nonce":2183853210}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44297,"name":"cephfs.smithi114.bdhdtm","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6825/2412191913","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6824","nonce":2412191913},{"type":"v1","addr":"172.21.15.114:6825","nonce":2412191913}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44319,"name":"cephfs.smithi114.sreoiu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.114:6827/2165184879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.114:6826","nonce":2165184879},{"type":"v1","addr":"172.21.15.114:6827","nonce":2165184879}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-16T09:43:11.978216+0000","modified":"2024-09-16T09:55:17.944327+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi111.jnzoej","rank":0,"incarnation":31,"state":"up:active","state_seq":20,"addr":"172.21.15.111:6827/125675573","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.111:6826","nonce":125675573},{"type":"v1","addr":"172.21.15.111:6827","nonce":125675573}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-16T09:57:53.440 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 36 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f767c07abf0 msgr2=0x7f767c07d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f767c07abf0 0x7f767c07d0b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7678009890 tx=0x7f7678008040 comp rx=0 tx=0).stop 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 msgr2=0x7f7690198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 0x7f7690198de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7680005cc0 tx=0x7f768002f5f0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 shutdown_connections 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f767c07abf0 0x7f767c07d0b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f76901067e0 0x7f7690198de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 --2- 172.21.15.111:0/1349153984 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f76901007e0 0x7f76901988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:53.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.439+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 >> 172.21.15.111:0/1349153984 conn(0x7f76900fc4c0 msgr2=0x7f76900fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:53.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.440+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 shutdown_connections 2024-09-16T09:57:53.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:53.440+0000 7f76970ab640 1 -- 172.21.15.111:0/1349153984 wait complete. 2024-09-16T09:57:54.083 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-16T09:57:54.096 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-16T09:57:54.096 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:57:54.097 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T09:57:54.114 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-09-16T09:57:54.115 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T09:57:54.172 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T09:57:54.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:53 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/1349153984' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-16T09:57:54.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:53 smithi114 ceph-mon[79732]: pgmap v360: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:54.234 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:53 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/1349153984' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-16T09:57:54.234 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:53 smithi111 ceph-mon[109885]: pgmap v360: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:54.458 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:54.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 -- 172.21.15.111:0/2275674710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28101930 msgr2=0x7f6f28101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:54.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/2275674710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28101930 0x7f6f28101d90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009880 tx=0x7f6f1002a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:54.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 -- 172.21.15.111:0/2275674710 shutdown_connections 2024-09-16T09:57:54.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/2275674710 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28101930 0x7f6f28101d90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/2275674710 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f28107930 0x7f6f28107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 -- 172.21.15.111:0/2275674710 >> 172.21.15.111:0/2275674710 conn(0x7f6f280fd630 msgr2=0x7f6f280ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 -- 172.21.15.111:0/2275674710 shutdown_connections 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.918+0000 7f6f2dc56640 1 -- 172.21.15.111:0/2275674710 wait complete. 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f2dc56640 1 Processor -- start 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f2dc56640 1 -- start start 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f2dc56640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f28101930 0x7f6f2819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f2dc56640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 0x7f6f2819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f2dc56640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2810ee60 con 0x7f6f28107930 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f2dc56640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2810ece0 con 0x7f6f28101930 2024-09-16T09:57:54.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f26ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 0x7f6f2819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f26ffd640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 0x7f6f2819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50730/0 (socket says 172.21.15.111:50730) 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f26ffd640 1 -- 172.21.15.111:0/472077393 learned_addr learned my addr 172.21.15.111:0/472077393 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f277fe640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f28101930 0x7f6f2819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f26ffd640 1 -- 172.21.15.111:0/472077393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f28101930 msgr2=0x7f6f2819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f26ffd640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f28101930 0x7f6f2819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.919+0000 7f6f26ffd640 1 -- 172.21.15.111:0/472077393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f28197870 con 0x7f6f28107930 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.920+0000 7f6f26ffd640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 0x7f6f2819dbf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6f10031460 tx=0x7f6f100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.920+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f1003f070 con 0x7f6f28107930 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.920+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f10004cf0 con 0x7f6f28107930 2024-09-16T09:57:54.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.920+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f28197b00 con 0x7f6f28107930 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.920+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f10035030 con 0x7f6f28107930 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.920+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f28198030 con 0x7f6f28107930 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.921+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f28103070 con 0x7f6f28107930 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.921+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7f6f10042070 con 0x7f6f28107930 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.922+0000 7f6f24ff9640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6f1407abf0 0x7f6f1407d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.922+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7f6f100be970 con 0x7f6f28107930 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.922+0000 7f6f277fe640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6f1407abf0 0x7f6f1407d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.922+0000 7f6f277fe640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6f1407abf0 0x7f6f1407d0b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6f281989b0 tx=0x7f6f18008040 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:54.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:54.926+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7f6f10089ef0 con 0x7f6f28107930 2024-09-16T09:57:55.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.113+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6f28198da0 con 0x7f6f28107930 2024-09-16T09:57:55.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.113+0000 7f6f24ff9640 1 -- 172.21.15.111:0/472077393 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v90) ==== 81+0+2231 (secure 0 0 0) 0x7f6f1008eda0 con 0x7f6f28107930 2024-09-16T09:57:55.116 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6827/2254901057 2024-09-17T09:55:00.141445+0000 2024-09-16T09:57:55.116 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6826/2254901057 2024-09-17T09:55:00.141445+0000 2024-09-16T09:57:55.116 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6827/4028227545 2024-09-17T09:53:55.127486+0000 2024-09-16T09:57:55.116 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/1312194133 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:55.116 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/1312194133 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1021150125 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/402500126 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1023452280 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2154493900 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1755678140 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/3108753484 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/4213406747 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6828/3778250509 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6829/3778250509 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1453802272 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/3983951060 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6824/3743279326 2024-09-17T09:54:39.206251+0000 2024-09-16T09:57:55.117 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/4213406747 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3045241611 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/4032555979 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1417608659 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/467641550 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/3922856832 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6828/4079898764 2024-09-17T09:54:19.669263+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/531255202 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3905288646 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1365706184 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/3108753484 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/4032555979 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6825/3743279326 2024-09-17T09:54:39.206251+0000 2024-09-16T09:57:55.118 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6826/4028227545 2024-09-17T09:53:55.127486+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/515452109 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6829/4079898764 2024-09-17T09:54:19.669263+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/2094518241 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/323192077 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/516969193 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/3231272440 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:55.119 INFO:teuthology.orchestra.run.smithi111.stderr:listed 37 entries 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6f1407abf0 msgr2=0x7f6f1407d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6f1407abf0 0x7f6f1407d0b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6f281989b0 tx=0x7f6f18008040 comp rx=0 tx=0).stop 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 msgr2=0x7f6f2819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 0x7f6f2819dbf0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6f10031460 tx=0x7f6f100048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 shutdown_connections 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7f6f1407abf0 0x7f6f1407d0b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f28107930 0x7f6f2819dbf0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 --2- 172.21.15.111:0/472077393 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7f6f28101930 0x7f6f2819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 >> 172.21.15.111:0/472077393 conn(0x7f6f280fd630 msgr2=0x7f6f280fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 shutdown_connections 2024-09-16T09:57:55.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:55.116+0000 7f6f2dc56640 1 -- 172.21.15.111:0/472077393 wait complete. 2024-09-16T09:57:55.381 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:55 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/472077393' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-16T09:57:55.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:55 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/472077393' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-16T09:57:55.918 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-16T09:57:55.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:55.918 DEBUG:teuthology.orchestra.run.smithi111:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-16T09:57:55.989 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T09:57:55.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:55.990 DEBUG:teuthology.orchestra.run.smithi111:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-16T09:57:56.065 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:57:56.065 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T09:57:56.086 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-09-16T09:57:56.086 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-16T09:57:56.145 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-16T09:57:56.397 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/mon.smithi111/config 2024-09-16T09:57:56.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:56 smithi114 ceph-mon[79732]: pgmap v361: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:56.518 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:56 smithi111 ceph-mon[109885]: pgmap v361: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.826+0000 7fee1c592640 1 -- 172.21.15.111:0/271210396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14101930 msgr2=0x7fee14101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.826+0000 7fee1c592640 1 --2- 172.21.15.111:0/271210396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14101930 0x7fee14101d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee04009880 tx=0x7fee0402a4a0 comp rx=0 tx=0).stop 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- 172.21.15.111:0/271210396 shutdown_connections 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 --2- 172.21.15.111:0/271210396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14101930 0x7fee14101d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 --2- 172.21.15.111:0/271210396 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14107930 0x7fee14107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- 172.21.15.111:0/271210396 >> 172.21.15.111:0/271210396 conn(0x7fee140fd630 msgr2=0x7fee140ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:56.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- 172.21.15.111:0/271210396 shutdown_connections 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- 172.21.15.111:0/271210396 wait complete. 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 Processor -- start 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- start start 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 --2- >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14101930 0x7fee1419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 0x7fee1419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 -- 0x7fee1410ee00 con 0x7fee14107930 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.827+0000 7fee1c592640 1 -- --> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] -- mon_getmap magic: 0 -- 0x7fee1410ec80 con 0x7fee14101930 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 0x7fee1419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 0x7fee1419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50750/0 (socket says 172.21.15.111:50750) 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 -- 172.21.15.111:0/3976655797 learned_addr learned my addr 172.21.15.111:0/3976655797 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee1a32e640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14101930 0x7fee1419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:56.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 -- 172.21.15.111:0/3976655797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14101930 msgr2=0x7fee1419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14101930 0x7fee1419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 -- 172.21.15.111:0/3976655797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee14197810 con 0x7fee14107930 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee1a32e640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14101930 0x7fee1419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee19b2d640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 0x7fee1419dbd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee04031460 tx=0x7fee040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee0403f070 con 0x7fee14107930 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee04004cf0 con 0x7fee14107930 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee14197aa0 con 0x7fee14107930 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee04035030 con 0x7fee14107930 2024-09-16T09:57:56.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.828+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee14197fd0 con 0x7fee14107930 2024-09-16T09:57:56.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.829+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee14103070 con 0x7fee14107930 2024-09-16T09:57:56.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.830+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 31) ==== 103168+0+0 (secure 0 0 0) 0x7fee04042070 con 0x7fee14107930 2024-09-16T09:57:56.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.830+0000 7fee0b7fe640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee0007ac40 0x7fee0007d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-16T09:57:56.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.831+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 6704+0+0 (secure 0 0 0) 0x7fee040be840 con 0x7fee14107930 2024-09-16T09:57:56.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.831+0000 7fee1a32e640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee0007ac40 0x7fee0007d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-16T09:57:56.834 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.831+0000 7fee1a32e640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee0007ac40 0x7fee0007d100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee100058c0 tx=0x7fee10005d30 comp rx=0 tx=0).ready entity=mgr.14724 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-16T09:57:56.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:56.835+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197043 (secure 0 0 0) 0x7fee04089e40 con 0x7fee14107930 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.022+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee14198d40 con 0x7fee14107930 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.022+0000 7fee0b7fe640 1 -- 172.21.15.111:0/3976655797 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v90) ==== 81+0+2231 (secure 0 0 0) 0x7fee0408ecf0 con 0x7fee14107930 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6827/2254901057 2024-09-17T09:55:00.141445+0000 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6826/2254901057 2024-09-17T09:55:00.141445+0000 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6827/4028227545 2024-09-17T09:53:55.127486+0000 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/1312194133 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/1312194133 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:57.025 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1021150125 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/402500126 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1023452280 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2154493900 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1755678140 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/3108753484 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/4213406747 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6828/3778250509 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6829/3778250509 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1453802272 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/3983951060 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6824/3743279326 2024-09-17T09:54:39.206251+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/4213406747 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:57.026 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3045241611 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6801/4032555979 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1417608659 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/467641550 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/3922856832 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6828/4079898764 2024-09-17T09:54:19.669263+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/531255202 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3905288646 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1365706184 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/3108753484 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6800/4032555979 2024-09-17T09:38:34.840593+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:6825/3743279326 2024-09-17T09:54:39.206251+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6826/4028227545 2024-09-17T09:53:55.127486+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/515452109 2024-09-17T09:37:39.495256+0000 2024-09-16T09:57:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6829/4079898764 2024-09-17T09:54:19.669263+0000 2024-09-16T09:57:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/2094518241 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/323192077 2024-09-17T09:37:08.491284+0000 2024-09-16T09:57:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/516969193 2024-09-17T09:46:19.767850+0000 2024-09-16T09:57:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.114:0/3231272440 2024-09-17T09:47:29.639731+0000 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:listed 37 entries 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.024+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee0007ac40 msgr2=0x7fee0007d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.024+0000 7fee1c592640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee0007ac40 0x7fee0007d100 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee100058c0 tx=0x7fee10005d30 comp rx=0 tx=0).stop 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.024+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 msgr2=0x7fee1419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.024+0000 7fee1c592640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 0x7fee1419dbd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fee04031460 tx=0x7fee040048f0 comp rx=0 tx=0).stop 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 shutdown_connections 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:6800/1537958175,v1:172.21.15.111:6801/1537958175] conn(0x7fee0007ac40 0x7fee0007d100 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fee14107930 0x7fee1419dbd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 --2- 172.21.15.111:0/3976655797 >> [v2:172.21.15.114:3300/0,v1:172.21.15.114:6789/0] conn(0x7fee14101930 0x7fee1419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 >> 172.21.15.111:0/3976655797 conn(0x7fee140fd630 msgr2=0x7fee140fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 shutdown_connections 2024-09-16T09:57:57.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-09-16T09:57:57.025+0000 7fee1c592640 1 -- 172.21.15.111:0/3976655797 wait complete. 2024-09-16T09:57:57.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:57 smithi114 ceph-mon[79732]: from='client.? 172.21.15.111:0/3976655797' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-16T09:57:57.523 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:57 smithi111 ceph-mon[109885]: from='client.? 172.21.15.111:0/3976655797' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-16T09:57:57.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-16T09:57:57.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:57.692 DEBUG:teuthology.orchestra.run.smithi114:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-16T09:57:57.724 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T09:57:57.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:57.724 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-16T09:57:57.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:57.794 DEBUG:teuthology.orchestra.run.smithi111:> ip netns list 2024-09-16T09:57:57.811 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-16T09:57:57.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:57.812 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-16T09:57:57.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:57.879 DEBUG:teuthology.orchestra.run.smithi111:> sudo ip link delete ceph-brx 2024-09-16T09:57:57.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:57.987 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-09-16T09:57:58.005 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-16T09:57:58.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:58.005 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-16T09:57:58.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-16T09:57:58.076 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-09-16T09:57:58.172 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-16T09:57:58.183 INFO:tasks.cephadm:Teardown begin 2024-09-16T09:57:58.184 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:57:58.210 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:57:58.238 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-16T09:57:58.238 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T09:57:58.265 DEBUG:teuthology.orchestra.run.smithi114:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-16T09:57:58.293 INFO:tasks.cephadm:Stopping all daemons... 2024-09-16T09:57:58.293 INFO:tasks.cephadm.mon.smithi111:Stopping mon.smithi111... 2024-09-16T09:57:58.293 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111 2024-09-16T09:57:58.437 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:58 smithi114 ceph-mon[79732]: pgmap v362: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:58.617 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:58 smithi111 ceph-mon[109885]: pgmap v362: 65 pgs: 65 active+clean; 219 MiB data, 894 MiB used, 536 GiB / 536 GiB avail 2024-09-16T09:57:58.618 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:58 smithi111 systemd[1]: Stopping Ceph mon.smithi111 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:57:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:58 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[109881]: 2024-09-16T09:57:58.615+0000 7fdf8ff47640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi111 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:57:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:58 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111[109881]: 2024-09-16T09:57:58.615+0000 7fdf8ff47640 -1 mon.smithi111@0(leader) e2 *** Got Signal Terminated *** 2024-09-16T09:57:58.882 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:58 smithi111 podman[150952]: 2024-09-16 09:57:58.636686592 +0000 UTC m=+0.138813691 container died b551614a9fe4e00361b439e2aa4fd75d1189721002b7d460458164ddd7105cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-16T09:57:59.276 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:59 smithi111 podman[150952]: 2024-09-16 09:57:59.015839189 +0000 UTC m=+0.517966287 container cleanup b551614a9fe4e00361b439e2aa4fd75d1189721002b7d460458164ddd7105cb9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:57:59.277 INFO:journalctl@ceph.mon.smithi111.smithi111.stdout:Sep 16 09:57:59 smithi111 bash[150952]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi111 2024-09-16T09:57:59.458 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi111.service' 2024-09-16T09:57:59.508 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:57:59.508 INFO:tasks.cephadm.mon.smithi111:Stopped mon.smithi111 2024-09-16T09:57:59.508 INFO:tasks.cephadm.mon.smithi114:Stopping mon.smithi114... 2024-09-16T09:57:59.509 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi114 2024-09-16T09:57:59.832 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:59 smithi114 systemd[1]: Stopping Ceph mon.smithi114 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:59 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114[79728]: 2024-09-16T09:57:59.830+0000 7fc1f1e34640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi114 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:00.187 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:57:59 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114[79728]: 2024-09-16T09:57:59.830+0000 7fc1f1e34640 -1 mon.smithi114@1(peon) e2 *** Got Signal Terminated *** 2024-09-16T09:58:00.188 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:58:00 smithi114 podman[112222]: 2024-09-16 09:58:00.014133696 +0000 UTC m=+0.305180358 container died 1890a098e70d09465ae0e7ec108127683d02a7e22e7ba4b9842e7ef739d246ff (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-16T09:58:00.657 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:58:00 smithi114 podman[112222]: 2024-09-16 09:58:00.438363341 +0000 UTC m=+0.729410042 container cleanup 1890a098e70d09465ae0e7ec108127683d02a7e22e7ba4b9842e7ef739d246ff (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:58:00.657 INFO:journalctl@ceph.mon.smithi114.smithi114.stdout:Sep 16 09:58:00 smithi114 bash[112222]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-mon-smithi114 2024-09-16T09:58:00.870 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@mon.smithi114.service' 2024-09-16T09:58:00.918 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:00.918 INFO:tasks.cephadm.mon.smithi114:Stopped mon.smithi114 2024-09-16T09:58:00.918 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-16T09:58:00.918 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.0 2024-09-16T09:58:01.131 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:00 smithi111 systemd[1]: Stopping Ceph osd.0 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:01.631 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:01 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[118039]: 2024-09-16T09:58:01.252+0000 7f5a92c60640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:01.632 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:01 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[118039]: 2024-09-16T09:58:01.253+0000 7f5a92c60640 -1 osd.0 90 *** Got signal Terminated *** 2024-09-16T09:58:01.632 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:01 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0[118039]: 2024-09-16T09:58:01.253+0000 7f5a92c60640 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:58:06.964 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:06 smithi111 podman[151083]: 2024-09-16 09:58:06.693404681 +0000 UTC m=+5.577235721 container died 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-16T09:58:07.348 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 podman[151083]: 2024-09-16 09:58:07.062322569 +0000 UTC m=+5.946153601 container cleanup 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-16T09:58:07.348 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 bash[151083]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0 2024-09-16T09:58:07.631 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 podman[151100]: 2024-09-16 09:58:07.347280367 +0000 UTC m=+0.646035852 container remove 77d6529d894e0158480e7470e1fa7f275dd7af00e5deb87a93e29b65093e488e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux ) 2024-09-16T09:58:07.943 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 podman[151187]: 2024-09-16 09:58:07.594232992 +0000 UTC m=+0.016352535 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:58:07.943 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 podman[151187]: 2024-09-16 09:58:07.723359719 +0000 UTC m=+0.145479251 container create efdefc34c1493e88d510940a5b0efeb3465273fb633e67b781f36489c607b922 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-16T09:58:07.943 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 podman[151187]: 2024-09-16 09:58:07.942715777 +0000 UTC m=+0.364835331 container init efdefc34c1493e88d510940a5b0efeb3465273fb633e67b781f36489c607b922 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-16T09:58:08.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:07 smithi111 podman[151187]: 2024-09-16 09:58:07.946864394 +0000 UTC m=+0.368983928 container start efdefc34c1493e88d510940a5b0efeb3465273fb633e67b781f36489c607b922 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:58:08.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:08 smithi111 podman[151187]: 2024-09-16 09:58:08.042691146 +0000 UTC m=+0.464810680 container attach efdefc34c1493e88d510940a5b0efeb3465273fb633e67b781f36489c607b922 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:58:08.382 INFO:journalctl@ceph.osd.0.smithi111.stdout:Sep 16 09:58:08 smithi111 podman[151187]: 2024-09-16 09:58:08.153440739 +0000 UTC m=+0.575560281 container died efdefc34c1493e88d510940a5b0efeb3465273fb633e67b781f36489c607b922 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-16T09:58:08.801 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.0.service' 2024-09-16T09:58:08.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:08.841 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-16T09:58:08.841 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-16T09:58:08.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1 2024-09-16T09:58:09.131 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:08 smithi111 systemd[1]: Stopping Ceph osd.1 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:09.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:09 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[123173]: 2024-09-16T09:58:09.200+0000 7f85087b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:09.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:09 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[123173]: 2024-09-16T09:58:09.200+0000 7f85087b5640 -1 osd.1 90 *** Got signal Terminated *** 2024-09-16T09:58:09.632 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:09 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1[123173]: 2024-09-16T09:58:09.200+0000 7f85087b5640 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:58:15.036 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:14 smithi111 podman[151296]: 2024-09-16 09:58:14.745944807 +0000 UTC m=+5.670341221 container died 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-16T09:58:15.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 podman[151296]: 2024-09-16 09:58:15.125691628 +0000 UTC m=+6.050088043 container cleanup 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-16T09:58:15.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 bash[151296]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1 2024-09-16T09:58:15.382 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 podman[151311]: 2024-09-16 09:58:15.285329999 +0000 UTC m=+0.535994920 container remove 14a192b194c006208fd6ddd7ecd92893bdb7c1b8ef5c66a28216d94b0c2c65ec (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:58:15.931 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 podman[151402]: 2024-09-16 09:58:15.670007841 +0000 UTC m=+0.093327126 container create 8e93d5a9c95fb9634ff4335725c88d1a012ae6abfccd6f082e11a7c47cf344e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T09:58:15.931 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 podman[151402]: 2024-09-16 09:58:15.592753846 +0000 UTC m=+0.016073089 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:58:15.932 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 podman[151402]: 2024-09-16 09:58:15.930748484 +0000 UTC m=+0.354067726 container init 8e93d5a9c95fb9634ff4335725c88d1a012ae6abfccd6f082e11a7c47cf344e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2) 2024-09-16T09:58:16.383 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:15 smithi111 podman[151402]: 2024-09-16 09:58:15.934300705 +0000 UTC m=+0.357619949 container start 8e93d5a9c95fb9634ff4335725c88d1a012ae6abfccd6f082e11a7c47cf344e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-16T09:58:16.384 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:16 smithi111 podman[151402]: 2024-09-16 09:58:16.014203437 +0000 UTC m=+0.437522691 container attach 8e93d5a9c95fb9634ff4335725c88d1a012ae6abfccd6f082e11a7c47cf344e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-16T09:58:16.384 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:16 smithi111 podman[151402]: 2024-09-16 09:58:16.120213049 +0000 UTC m=+0.543532302 container died 8e93d5a9c95fb9634ff4335725c88d1a012ae6abfccd6f082e11a7c47cf344e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-09-16T09:58:16.758 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1.service' 2024-09-16T09:58:16.782 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:16 smithi111 podman[151424]: 2024-09-16 09:58:16.726367474 +0000 UTC m=+0.599442494 container remove 8e93d5a9c95fb9634ff4335725c88d1a012ae6abfccd6f082e11a7c47cf344e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-16T09:58:16.782 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:16 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-16T09:58:16.782 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:16 smithi111 systemd[1]: Stopped Ceph osd.1 for 0ada01d2-740f-11ef-bceb-c7b262605968. 2024-09-16T09:58:16.782 INFO:journalctl@ceph.osd.1.smithi111.stdout:Sep 16 09:58:16 smithi111 systemd[1]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.1.service: Consumed 10.629s CPU time. 2024-09-16T09:58:16.804 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:16.804 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-16T09:58:16.804 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-16T09:58:16.805 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.2 2024-09-16T09:58:17.131 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:16 smithi111 systemd[1]: Stopping Ceph osd.2 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:17.631 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:17 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[128349]: 2024-09-16T09:58:17.155+0000 7f20f867c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:17.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:17 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[128349]: 2024-09-16T09:58:17.155+0000 7f20f867c640 -1 osd.2 90 *** Got signal Terminated *** 2024-09-16T09:58:17.632 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:17 smithi111 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2[128349]: 2024-09-16T09:58:17.155+0000 7f20f867c640 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:58:22.965 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:22 smithi111 podman[151504]: 2024-09-16 09:58:22.676266807 +0000 UTC m=+5.648266725 container died 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:58:23.271 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151504]: 2024-09-16 09:58:23.062866297 +0000 UTC m=+6.034866216 container cleanup 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:58:23.271 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 bash[151504]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2 2024-09-16T09:58:23.627 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151521]: 2024-09-16 09:58:23.297522187 +0000 UTC m=+0.617565661 container remove 93f32c9e8a952d1f90a06f28da3b796336767becabeafff7f9d5449e7abe3ee2 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-16T09:58:23.880 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151608]: 2024-09-16 09:58:23.528900844 +0000 UTC m=+0.016213335 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:58:23.880 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151608]: 2024-09-16 09:58:23.64844899 +0000 UTC m=+0.135761479 container create f24742bc53074db6085e7ee712ae2bfc5239e12f956c3fa54a1b8a7ef4600d83 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:58:23.880 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151608]: 2024-09-16 09:58:23.876065642 +0000 UTC m=+0.363378133 container init f24742bc53074db6085e7ee712ae2bfc5239e12f956c3fa54a1b8a7ef4600d83 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:58:23.880 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151608]: 2024-09-16 09:58:23.879477521 +0000 UTC m=+0.366790014 container start f24742bc53074db6085e7ee712ae2bfc5239e12f956c3fa54a1b8a7ef4600d83 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-16T09:58:24.132 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:23 smithi111 podman[151608]: 2024-09-16 09:58:23.967905057 +0000 UTC m=+0.455217560 container attach f24742bc53074db6085e7ee712ae2bfc5239e12f956c3fa54a1b8a7ef4600d83 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-16T09:58:24.132 INFO:journalctl@ceph.osd.2.smithi111.stdout:Sep 16 09:58:24 smithi111 podman[151608]: 2024-09-16 09:58:24.069373261 +0000 UTC m=+0.556685759 container died f24742bc53074db6085e7ee712ae2bfc5239e12f956c3fa54a1b8a7ef4600d83 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6) 2024-09-16T09:58:24.646 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.2.service' 2024-09-16T09:58:24.684 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:24.684 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-16T09:58:24.684 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-16T09:58:24.684 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.3 2024-09-16T09:58:25.187 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:24 smithi114 systemd[1]: Stopping Ceph osd.3 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:25.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:25 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:58:25.300+0000 7f8c8b956640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:25.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:25 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:58:25.300+0000 7f8c8b956640 -1 osd.3 90 *** Got signal Terminated *** 2024-09-16T09:58:25.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:25 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:58:25.300+0000 7f8c8b956640 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:58:28.937 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:28 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:58:28.682+0000 7f8c83f63640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:06.001078+0000 front 2024-09-16T09:58:06.001175+0000 (oldest deadline 2024-09-16T09:58:28.301017+0000) 2024-09-16T09:58:29.647 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:29 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:29.307+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:29.937 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:29 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3[87685]: 2024-09-16T09:58:29.645+0000 7f8c83f63640 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:06.001078+0000 front 2024-09-16T09:58:06.001175+0000 (oldest deadline 2024-09-16T09:58:28.301017+0000) 2024-09-16T09:58:29.937 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:29 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:29.858+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:30.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:30 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:30.282+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:31.020 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:30 smithi114 podman[112355]: 2024-09-16 09:58:30.7586537 +0000 UTC m=+5.880477119 container died e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-16T09:58:31.021 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:30 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:30.834+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:31.289 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:31 smithi114 podman[112355]: 2024-09-16 09:58:31.183590048 +0000 UTC m=+6.305413463 container cleanup e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-16T09:58:31.290 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:31 smithi114 bash[112355]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3 2024-09-16T09:58:31.687 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:31 smithi114 podman[112370]: 2024-09-16 09:58:31.401762791 +0000 UTC m=+0.635575049 container remove e7f600344e6b045473091d47fb596990d8eff3a13087f87792e3f5bd49712475 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-16T09:58:31.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:31 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:31.288+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:32.081 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:31 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:31.800+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:32.081 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:31 smithi114 podman[112459]: 2024-09-16 09:58:31.802491353 +0000 UTC m=+0.112282464 container create 8657d734f53d68392723ae2b339f400023bc3ffc1ebd8f1b95ad76f6ccef7839 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-16T09:58:32.081 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:31 smithi114 podman[112459]: 2024-09-16 09:58:31.705650143 +0000 UTC m=+0.015441264 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:58:32.081 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:32 smithi114 podman[112459]: 2024-09-16 09:58:32.004921974 +0000 UTC m=+0.314713085 container init 8657d734f53d68392723ae2b339f400023bc3ffc1ebd8f1b95ad76f6ccef7839 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-09-16T09:58:32.081 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:32 smithi114 podman[112459]: 2024-09-16 09:58:32.008490541 +0000 UTC m=+0.318281652 container start 8657d734f53d68392723ae2b339f400023bc3ffc1ebd8f1b95ad76f6ccef7839 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-16T09:58:32.081 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:32 smithi114 podman[112459]: 2024-09-16 09:58:32.079886922 +0000 UTC m=+0.389678045 container attach 8657d734f53d68392723ae2b339f400023bc3ffc1ebd8f1b95ad76f6ccef7839 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T09:58:32.437 INFO:journalctl@ceph.osd.3.smithi114.stdout:Sep 16 09:58:32 smithi114 podman[112459]: 2024-09-16 09:58:32.198307122 +0000 UTC m=+0.508098244 container died 8657d734f53d68392723ae2b339f400023bc3ffc1ebd8f1b95ad76f6ccef7839 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2) 2024-09-16T09:58:32.438 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:32 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:32.253+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:32.799 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.3.service' 2024-09-16T09:58:32.837 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:32.838 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-16T09:58:32.838 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-16T09:58:32.838 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.4 2024-09-16T09:58:33.180 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:32 smithi114 systemd[1]: Stopping Ceph osd.4 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:33.180 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:32 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:32.806+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:33.437 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:33.178+0000 7f0bc71fb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:33.437 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:33.178+0000 7f0bc71fb640 -1 osd.4 90 *** Got signal Terminated *** 2024-09-16T09:58:33.437 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:33.178+0000 7f0bc71fb640 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:58:33.437 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:33.301+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:34.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:33 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:33.823+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:34.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:34 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:34.303+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:35.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:34 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:34.872+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:35.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:35 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:35.316+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:35.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:35 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:35.316+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:10.876708+0000 front 2024-09-16T09:58:10.876730+0000 (oldest deadline 2024-09-16T09:58:34.976576+0000) 2024-09-16T09:58:36.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:35 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:35.879+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:36.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:36 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:36.315+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:36.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:36 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:36.315+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:10.876708+0000 front 2024-09-16T09:58:10.876730+0000 (oldest deadline 2024-09-16T09:58:34.976576+0000) 2024-09-16T09:58:37.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:36 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:36.856+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:37.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:36 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:36.856+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:37.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:37 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:37.361+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.875520+0000 front 2024-09-16T09:58:05.875478+0000 (oldest deadline 2024-09-16T09:58:28.675663+0000) 2024-09-16T09:58:37.687 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:37 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4[92345]: 2024-09-16T09:58:37.361+0000 7f0bc3810640 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:10.876708+0000 front 2024-09-16T09:58:10.876730+0000 (oldest deadline 2024-09-16T09:58:34.976576+0000) 2024-09-16T09:58:38.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:37 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:37.808+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:38.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:37 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:37.808+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:38.880 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:38 smithi114 podman[112562]: 2024-09-16 09:58:38.610224816 +0000 UTC m=+5.548171006 container died 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-16T09:58:38.880 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:38 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:38.789+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:38.880 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:38 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:38.789+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:39.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112562]: 2024-09-16 09:58:39.053259692 +0000 UTC m=+5.991205869 container cleanup 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-16T09:58:39.187 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 bash[112562]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4 2024-09-16T09:58:39.666 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112578]: 2024-09-16 09:58:39.263005269 +0000 UTC m=+0.648761710 container remove 52420a54759bed3e57607016be0f947ccc7ca5a236d7223466a2e2d9830de04f (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-16T09:58:39.937 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:39.775+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:39.937 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:39 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:39.775+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:39.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112668]: 2024-09-16 09:58:39.568184013 +0000 UTC m=+0.015937102 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:58:39.937 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112668]: 2024-09-16 09:58:39.672183303 +0000 UTC m=+0.119936433 container create 6bc419006bb364732b88e3418e0fea9da12a760751ee3afe38e41bf438841d7e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-16T09:58:39.938 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112668]: 2024-09-16 09:58:39.891718786 +0000 UTC m=+0.339471874 container init 6bc419006bb364732b88e3418e0fea9da12a760751ee3afe38e41bf438841d7e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-16T09:58:39.938 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112668]: 2024-09-16 09:58:39.894999011 +0000 UTC m=+0.342752100 container start 6bc419006bb364732b88e3418e0fea9da12a760751ee3afe38e41bf438841d7e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-16T09:58:40.373 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:39 smithi114 podman[112668]: 2024-09-16 09:58:39.982582578 +0000 UTC m=+0.430335667 container attach 6bc419006bb364732b88e3418e0fea9da12a760751ee3afe38e41bf438841d7e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:58:40.374 INFO:journalctl@ceph.osd.4.smithi114.stdout:Sep 16 09:58:40 smithi114 podman[112668]: 2024-09-16 09:58:40.083935279 +0000 UTC m=+0.531688375 container died 6bc419006bb364732b88e3418e0fea9da12a760751ee3afe38e41bf438841d7e (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-16T09:58:40.736 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.4.service' 2024-09-16T09:58:40.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:40.776 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-16T09:58:40.776 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-16T09:58:40.776 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.5 2024-09-16T09:58:41.091 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:40 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:40.813+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:41.091 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:40 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:40.813+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:41.091 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:40 smithi114 systemd[1]: Stopping Ceph osd.5 for 0ada01d2-740f-11ef-bceb-c7b262605968... 2024-09-16T09:58:41.091 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:41 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:41.089+0000 7f820625d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-16T09:58:41.091 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:41 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:41.089+0000 7f820625d640 -1 osd.5 90 *** Got signal Terminated *** 2024-09-16T09:58:41.437 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:41 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:41.089+0000 7f820625d640 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-16T09:58:42.133 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:41 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:41.808+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:42.133 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:41 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:41.808+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:43.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:42 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:42.833+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:43.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:42 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:42.833+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:44.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:43 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:43.812+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:44.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:43 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:43.812+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:45.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:44.798+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:45.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:44.798+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:45.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:44 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:44.798+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6822 osd.2 since back 2024-09-16T09:58:19.358346+0000 front 2024-09-16T09:58:19.358378+0000 (oldest deadline 2024-09-16T09:58:44.558632+0000) 2024-09-16T09:58:46.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:45 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:45.833+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6806 osd.0 since back 2024-09-16T09:58:05.456405+0000 front 2024-09-16T09:58:05.456376+0000 (oldest deadline 2024-09-16T09:58:29.556333+0000) 2024-09-16T09:58:46.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:45 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:45.833+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6814 osd.1 since back 2024-09-16T09:58:12.457078+0000 front 2024-09-16T09:58:12.457071+0000 (oldest deadline 2024-09-16T09:58:35.957055+0000) 2024-09-16T09:58:46.188 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:45 smithi114 ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5[97462]: 2024-09-16T09:58:45.833+0000 7f8202872640 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.111:6822 osd.2 since back 2024-09-16T09:58:19.358346+0000 front 2024-09-16T09:58:19.358378+0000 (oldest deadline 2024-09-16T09:58:44.558632+0000) 2024-09-16T09:58:46.851 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:46 smithi114 podman[112769]: 2024-09-16 09:58:46.589118803 +0000 UTC m=+5.590114323 container died 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-16T09:58:47.188 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112769]: 2024-09-16 09:58:47.025022596 +0000 UTC m=+6.026018119 container cleanup 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2) 2024-09-16T09:58:47.188 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 bash[112769]: ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5 2024-09-16T09:58:47.640 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112785]: 2024-09-16 09:58:47.209522623 +0000 UTC m=+0.616521795 container remove 94a0d154c08f6851e49c415f75d22623f1c33c7b3d4c997a3c53ac0e785c84a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:58:47.905 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112875]: 2024-09-16 09:58:47.539168582 +0000 UTC m=+0.015727108 image pull 261f2dc7b20f078cba20226e1a82a867f88de1a71ca34322497f8520cc32e62e quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f 2024-09-16T09:58:47.905 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112875]: 2024-09-16 09:58:47.653744554 +0000 UTC m=+0.130303063 container create 8854ed5421417f117451cc8402b88787b0d10a0626954bd3295491f08a4327a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-16T09:58:47.905 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112875]: 2024-09-16 09:58:47.85467235 +0000 UTC m=+0.331230863 container init 8854ed5421417f117451cc8402b88787b0d10a0626954bd3295491f08a4327a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True) 2024-09-16T09:58:47.905 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112875]: 2024-09-16 09:58:47.857894957 +0000 UTC m=+0.334453478 container start 8854ed5421417f117451cc8402b88787b0d10a0626954bd3295491f08a4327a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-16T09:58:48.187 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:47 smithi114 podman[112875]: 2024-09-16 09:58:47.929443793 +0000 UTC m=+0.406002306 container attach 8854ed5421417f117451cc8402b88787b0d10a0626954bd3295491f08a4327a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-16T09:58:48.188 INFO:journalctl@ceph.osd.5.smithi114.stdout:Sep 16 09:58:48 smithi114 podman[112875]: 2024-09-16 09:58:48.044435732 +0000 UTC m=+0.520994259 container died 8854ed5421417f117451cc8402b88787b0d10a0626954bd3295491f08a4327a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:2dbeb26ef01ea72be3b27ac61f923de34ec1a7d8b2fcd428841fc646734c133f, name=ceph-0ada01d2-740f-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-athakkar-testing-2024-09-12-1857-66e33d6, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-16T09:58:48.596 DEBUG:teuthology.orchestra.run.smithi114:> sudo pkill -f 'journalctl -f -n 0 -u ceph-0ada01d2-740f-11ef-bceb-c7b262605968@osd.5.service' 2024-09-16T09:58:48.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-16T09:58:48.636 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-16T09:58:48.637 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T09:58:48.842 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:59:12.852 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-16T09:59:13.059 INFO:teuthology.orchestra.run.smithi114.stdout:Deleting cluster with fsid: 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T09:59:28.169 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:59:28.203 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-16T09:59:28.230 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-16T09:59:28.232 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053/remote/smithi111/crash 2024-09-16T09:59:28.233 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/crash -- . 2024-09-16T09:59:28.271 INFO:teuthology.orchestra.run.smithi111.stderr:tar: /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T09:59:28.272 INFO:teuthology.orchestra.run.smithi111.stderr:tar: Error is not recoverable: exiting now 2024-09-16T09:59:28.273 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053/remote/smithi114/crash 2024-09-16T09:59:28.274 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/crash -- . 2024-09-16T09:59:28.298 INFO:teuthology.orchestra.run.smithi114.stderr:tar: /var/lib/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-16T09:59:28.298 INFO:teuthology.orchestra.run.smithi114.stderr:tar: Error is not recoverable: exiting now 2024-09-16T09:59:28.299 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-16T09:59:28.299 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-16T09:59:28.360 INFO:tasks.cephadm:Compressing logs... 2024-09-16T09:59:28.360 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T09:59:28.363 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-16T09:59:28.386 INFO:teuthology.orchestra.run.smithi111.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-16T09:59:28.386 INFO:teuthology.orchestra.run.smithi111.stderr:: No such file or directory 2024-09-16T09:59:28.386 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi111.yvusja.log 2024-09-16T09:59:28.389 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-16T09:59:28.390 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi111.yvusja.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi111.jnzoej.log 2024-09-16T09:59:28.390 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T09:59:28.390 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi111.jnzoej.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T09:59:28.390 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mgr.smithi111.erxodt.log 2024-09-16T09:59:28.390 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi111.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi114.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:: No such file or directory 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi114.bdhdtm.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi114.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi114.bdhdtm.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi114.sreoiu.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi114.sreoiu.log: 93.7% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi114.log.gz 2024-09-16T09:59:28.391 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mon.smithi114.log 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.audit.log: /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mon.smithi114.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi114.stderr: 85.3% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mgr.smithi111.erxodt.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi111.log: 93.9% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-client.ceph-exporter.smithi111.log.gz 2024-09-16T09:59:28.392 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mon.smithi111.log 2024-09-16T09:59:28.393 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.5.log: 91.7% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T09:59:28.394 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.6% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-16T09:59:28.394 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-16T09:59:28.394 INFO:teuthology.orchestra.run.smithi111.stderr: 91.6% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-16T09:59:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mgr.smithi114.xvotey.log 2024-09-16T09:59:28.399 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-16T09:59:28.401 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mgr.smithi114.xvotey.log: 88.2% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T09:59:28.403 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T09:59:28.407 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.3.log: 91.0% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T09:59:28.414 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mon.smithi111.log: gzip -5 --verbose -- /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log 2024-09-16T09:59:28.414 INFO:teuthology.orchestra.run.smithi111.stderr: 91.1%/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.2.log: -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-16T09:59:28.414 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-16T09:59:28.417 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log: 88.2% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-16T09:59:28.418 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T09:59:28.436 INFO:teuthology.orchestra.run.smithi114.stderr: 89.1% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mgr.smithi114.xvotey.log.gz 2024-09-16T09:59:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-16T09:59:28.759 INFO:teuthology.orchestra.run.smithi111.stderr: 89.4% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mgr.smithi111.erxodt.log.gz 2024-09-16T09:59:28.774 INFO:teuthology.orchestra.run.smithi114.stderr: 92.5% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mon.smithi114.log.gz 2024-09-16T09:59:29.457 INFO:teuthology.orchestra.run.smithi111.stderr: 90.5% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mon.smithi111.log.gz 2024-09-16T09:59:33.969 INFO:teuthology.orchestra.run.smithi114.stderr: 95.0% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi114.sreoiu.log.gz 2024-09-16T09:59:34.030 INFO:teuthology.orchestra.run.smithi114.stderr: 95.0% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi114.bdhdtm.log.gz 2024-09-16T09:59:34.302 INFO:teuthology.orchestra.run.smithi111.stderr: 93.7% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-16T09:59:34.683 INFO:teuthology.orchestra.run.smithi111.stderr: 95.0% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi111.yvusja.log.gz 2024-09-16T09:59:34.849 INFO:teuthology.orchestra.run.smithi114.stderr: 93.5% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-16T09:59:35.093 INFO:teuthology.orchestra.run.smithi114.stderr: 93.6% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-16T09:59:35.637 INFO:teuthology.orchestra.run.smithi111.stderr: 93.5% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-16T09:59:35.757 INFO:teuthology.orchestra.run.smithi111.stderr: 93.2% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-16T09:59:37.116 INFO:teuthology.orchestra.run.smithi114.stderr: 93.2% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-16T09:59:37.118 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-09-16T09:59:37.118 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m8.741s 2024-09-16T09:59:37.118 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m32.362s 2024-09-16T09:59:37.118 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m1.154s 2024-09-16T10:01:05.961 INFO:teuthology.orchestra.run.smithi111.stderr: 93.0% -- replaced with /var/log/ceph/0ada01d2-740f-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi111.jnzoej.log.gz 2024-09-16T10:01:05.961 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-09-16T10:01:05.962 INFO:teuthology.orchestra.run.smithi111.stderr:real 1m37.584s 2024-09-16T10:01:05.962 INFO:teuthology.orchestra.run.smithi111.stderr:user 2m1.758s 2024-09-16T10:01:05.962 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m3.904s 2024-09-16T10:01:05.962 INFO:tasks.cephadm:Archiving logs... 2024-09-16T10:01:05.963 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053/remote/smithi111/log 2024-09-16T10:01:05.965 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T10:01:24.258 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053/remote/smithi114/log 2024-09-16T10:01:24.259 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-16T10:01:28.335 INFO:tasks.cephadm:Removing cluster... 2024-09-16T10:01:28.336 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 --force 2024-09-16T10:01:28.539 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T10:01:28.935 DEBUG:teuthology.orchestra.run.smithi114:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 0ada01d2-740f-11ef-bceb-c7b262605968 --force 2024-09-16T10:01:29.136 INFO:teuthology.orchestra.run.smithi114.stdout:Deleting cluster with fsid: 0ada01d2-740f-11ef-bceb-c7b262605968 2024-09-16T10:01:29.456 INFO:tasks.cephadm:Removing cephadm ... 2024-09-16T10:01:29.456 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T10:01:29.472 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-16T10:01:29.488 INFO:tasks.cephadm:Teardown complete 2024-09-16T10:01:29.488 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-16T10:01:29.499 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-16T10:01:29.500 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T10:01:29.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-16T10:01:29.602 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-16T10:01:29.613 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-16T10:01:29.613 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T10:01:29.616 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-16T10:01:29.628 INFO:teuthology.orchestra.run.smithi111.stderr:bash: line 1: ntpq: command not found 2024-09-16T10:01:29.630 INFO:teuthology.orchestra.run.smithi114.stderr:bash: line 1: ntpq: command not found 2024-09-16T10:01:29.633 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T10:01:29.634 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-09-16T10:01:29.634 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 -527us[ -523us] +/- 54ms 2024-09-16T10:01:29.634 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +1034us[+1037us] +/- 57ms 2024-09-16T10:01:29.634 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 56 -644us[ -644us] +/- 79ms 2024-09-16T10:01:29.634 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T10:01:29.635 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-16T10:01:29.635 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-09-16T10:01:29.635 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 -555us[ -543us] +/- 54ms 2024-09-16T10:01:29.635 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +1032us[+1044us] +/- 57ms 2024-09-16T10:01:29.635 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -642us[ -630us] +/- 79ms 2024-09-16T10:01:29.635 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-16T10:01:29.636 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-16T10:01:29.652 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-16T10:01:29.652 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-16T10:01:29.743 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T10:01:29.822 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-16T10:01:29.894 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-16T10:01:29.922 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T10:01:29.923 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-16T10:01:29.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T10:01:29.951 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-16T10:01:29.961 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-16T10:01:30.018 INFO:teuthology.task.internal:Duration was 1907.089292 seconds 2024-09-16T10:01:30.018 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-16T10:01:30.033 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-16T10:01:30.033 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T10:01:30.036 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-16T10:01:30.072 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T10:01:30.074 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-16T10:01:30.420 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-16T10:01:30.421 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-09-16T10:01:30.421 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T10:01:30.482 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-09-16T10:01:30.483 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-16T10:01:30.508 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-16T10:01:30.508 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T10:01:30.526 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-16T10:01:30.575 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-16T10:01:30.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T10:01:30.594 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-16T10:01:31.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-16T10:01:31.246 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-16T10:01:31.246 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T10:01:31.272 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-16T10:01:31.298 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-16T10:01:31.323 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T10:01:31.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-16T10:01:31.346 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-09-16T10:01:31.362 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-09-16T10:01:31.377 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T10:01:31.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T10:01:31.415 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-16T10:01:31.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-16T10:01:31.432 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-16T10:01:31.445 INFO:teuthology.task.internal:Transferring archived files... 2024-09-16T10:01:31.447 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053/remote/smithi111 2024-09-16T10:01:31.447 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T10:01:31.504 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-16_08:23:53-orch:cephadm-wip-athakkar-testing-2024-09-12-1857-distro-default-smithi/7907053/remote/smithi114 2024-09-16T10:01:31.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-16T10:01:31.542 INFO:teuthology.task.internal:Removing archive directory... 2024-09-16T10:01:31.542 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T10:01:31.544 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-16T10:01:31.591 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-16T10:01:31.603 INFO:teuthology.task.internal:Not uploading archives. 2024-09-16T10:01:31.604 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-16T10:01:31.634 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-16T10:01:31.635 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T10:01:31.638 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-16T10:01:31.650 INFO:teuthology.orchestra.run.smithi111.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 10:01 /home/ubuntu/cephtest 2024-09-16T10:01:31.653 INFO:teuthology.orchestra.run.smithi114.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 16 10:01 /home/ubuntu/cephtest 2024-09-16T10:01:31.655 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-16T10:01:31.678 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-16T10:01:31.723 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1907.0892922878265 flavor: default owner: scheduled_avan@teuthology success: true 2024-09-16T10:01:31.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-16T10:01:31.795 INFO:teuthology.run:pass